Skip to main content
PLOS One logoLink to PLOS One
. 2023 Mar 13;18(3):e0276419. doi: 10.1371/journal.pone.0276419

Topological data analysis of human brain networks through order statistics

Soumya Das 1, D Vijay Anand 1, Moo K Chung 1,*
Editor: Chad M Topaz2
PMCID: PMC10010566  PMID: 36913351

Abstract

Understanding the common topological characteristics of the human brain network across a population is central to understanding brain functions. The abstraction of human connectome as a graph has been pivotal in gaining insights on the topological properties of the brain network. The development of group-level statistical inference procedures in brain graphs while accounting for the heterogeneity and randomness still remains a difficult task. In this study, we develop a robust statistical framework based on persistent homology using the order statistics for analyzing brain networks. The use of order statistics greatly simplifies the computation of the persistent barcodes. We validate the proposed methods using comprehensive simulation studies and subsequently apply to the resting-state functional magnetic resonance images. We found a statistically significant topological difference between the male and female brain networks.

Introduction

Modeling the human brain connectome as graphs has become the cornerstone of neuroscience, enabling an efficient abstraction of the brain regions and their interactions [1, 2]. Graphs offer the simplistic construct with only a set of nodes and edges to describe the connectivity of the brain network [3]. The generalizability of graph representation allows one to obtain quantitative measures across multiple spatio-temporal scales ranging from the node level up to the whole network level [4, 5]. To build the graph representation of brain networks, the whole brain is usually parcellated into hundreds of disjoint regions, which serves as nodes and the edges are associated with weights that indicate the strength of connection between the brain regions [6]. The graph theory based models provide reliable measures such as small-worldness, modularity, centrality and hubs [7–9]. However, these measures are often affected by the choice of arbitrary thresholds on the edge weights and thus make comparisons across networks difficult [10, 11]. To overcome this issue, the topological data analysis (TDA) has emerged to be a powerful method to systematically extract information from hierarchical layers of abstraction [12–15].

Persistent homology (PH), one of the TDA techniques, provides a coherent framework for obtaining topological invariants or features such as connected components and cycles at different spatial resolutions [16–19]. These topological invariants are often used to provide robust quantification measures to assess the topological similarity between networks [6]. Mostly the persistent barcodes are represented as persistent landscapes or diagrams and their distributions are used to compute a topological distance measure [20]. The PH based topological distances are found to consistently outperform traditional graph based metrics [21]. The main idea of using PH to brain networks is to generate a sequence of nested networks over every possible threshold through a graph filtration, which builds the hierarchical structure of the brain networks at multiple scales [10, 22–24].

In the graph filtration, a series of nested graphs containing topological information at different scales are produced. During the graph filtration, some topological features may live longer, whereas others die quickly. The filtration process tracks the birth, death and persistence of the topological features. The lifespans or persistence of these features are directly related to the topological properties of networks. The collection of intervals from births to deaths that defines persistences are called the barcodes which characterizes the topology of an underlying dataset [14]. The persistent diagram displays the paired births and deaths as scatter points [16, 20, 25–29]. The Betti curves, which counts the number of such features over filtrations, provide comprehensive visualizations of these intervals [6]. Thus, it is instructive to develop a statistical inference procedure using the persistent barcodes in order to compare across different groups and achieve meaningful inferences. This requires the statistical version of TDA [27, 30]. [30] worked on computing confidence bands through bootstraps. [27] introduced persistent landscapes which lies in a vector space, where the sample mean and variance can be computed and thus enable a proper statistical inference. [31] worked on the hypothesis testing on the Gaussian kernel smoothing on persistent diagrams Analogous to the persistent barcodes, we also have their stochastic versions referred as the expected persistent barcodes. However, computing them requires complex theoretical constructs and they are generally approximated [32–34].

Since the real brain networks are often affected by heterogeneity and intrinsic randomness [35, 36], it is challenging to build a coherent statistical framework to transform these topological features as quantitative measures to compare across different brain networks by averaging or matching [37]. The brain networks are inherently noisy which makes it even harder to establish similarity across networks. Thus, there is a need to develop a statistical model that accounts for the randomness and provides consistent results across networks. The statistical models based on the distributions are expected to be more robust and less affected by the presence of outliers. To this end, we use the concept of random graph to analyze brain networks across a population.

The random graphs have been investigated by many authors [38–42]. A graph whose features related to nodes and edges are determined in a random fashion is called a random graph. The theory of random graphs lies at the intersection between graph theory and probability theory. They are usually described using a probability distribution or a stochastic process that generates them [43, 44]. The homology of random graphs have been studied studied by Kahle in particular. [45] investigated the connectivity of neighborhood complex of a random graph. [46] studied the expected topological properties of Rips complexes built on randomly distributed points in Rd. [47] worked on the central limit theorem for Betti numbers of random simplical complexes. Random graphs are often encountered in graphical models, which build probabilistic models on the conditional dependency structures between nodes [48, 49]. However, topology is rarely investigated in graphical models.

In this paper, we propose a more adaptable random graph model for brain networks. We consider a random complete graph, where all the nodes are connected with its edge weights randomly drawn from a continuous distribution. The consideration of a complete graph model simplifies building graph filtration straightforward [22, 37]. We then compute the expected 0D and 1D barcodes through the order statistics [50–55]. The use of order statistics in computing persistent homology features such as persistent barcodes and Betti numbers can drastically speed up the computation. Further, we propose the expected topological loss (ETL), which quantifies the 0D and 1D barcodes obtained through order statistics. We use the ETL as a test statistic to determine the topological similarity and dissimilarity between networks. The proposed random graph model and corresponding ETL methods are validated using extensive simulation studies with the ground truths. Subsequently, the method is applied to the resting-state functional magnetic resonance images (rs-fMRI) of the human brain.

Materials and methods

Data

We considered a resting-state fMRI dataset collected as part of the Human Connectome Project (HCP) [56, 57]. The dataset consisted of fMRI scans of 400 subjects (168 males and 232 females) over approximately 14.5 minutes using a gradient-echoplanar imaging sequence with 1200 time points [24, 37]. Informed consent was obtained from all participants by the Washington University in St. Louis institutional review board [58]. The ethics approval for using the HCP data was obtained from the local ethics committee of University of Wisconsin-Madison.

The human brain can be viewed as a weighted network with its neurons as nodes. However, considering a high number of neurons (∼ 1012) in a human brain, the traditional brain imaging studies parcellate the brain into a manageable number of mutually exclusive regions [59–61]. These regions are then considered as nodes while the strength of connectivity between these regions are edges. For the considered dataset, the Automated Anatomical Labeling (AAL) template was employed to parcellate the brain volume into 116 non-overlapping anatomical regions [62] and the fMRI across voxels within each brain parcellation were averaged. This resulted 116 average fMRI time series with 1200 time points for each subject. Further, we removed fMRI volumes with significant head movements [63] because such movements are shown to produce spatial artifacts in functional connectivity [64–66].

Simplicial complex

A simplex is a generalization of the notion of a triangle or tetrahedron to arbitrary dimensions. A 0-simplex is a point, a 1-simplex is a line segment, and a 2-simplex is a triangle. In general, a k-simplex Sk is a convex hull of k + 1 affinely independent points u0,u1,…,uk∈Rk:

Sk={θ0u0+⋯+θkuk|∑i=0kθi=1,θi≥0fori=0,⋯,k}.

Whereas, a simplicial complex K is a set of simplices that satisfies the following two conditions. (1) Every face of a simplex from K is also in K. (2) The non-empty intersection of any two simplices S1,S2∈K is a shared face [67]. We call a simplicial complex consisting of up to k-simplices a k-skeleton. Since graphs are a collection of nodes (0-simplices) and edges (1-simplices), they are 1-skeleton simplicial complexes. In a 1-skeleton, 0-dimensional (0D) holes are connected components while the 1-dimensional (1D) holes are cycles. A cycle or loop in a graph is a path that starts and ends at the same node but no other nodes in the path are overlapping. There is no higher dimensional homology beyond dimensions 0 and 1 in 1-skeleton [37].

Graph filtration

The brain networks are traditionally represented and analyzed as a graph, a 1-skeleton consisting of only nodes and edges [59–62, 68]. The main focus of functional brain network analysis is quantifying and modeling the pairwise interaction between brain regions, which is usually called the effective connectivity [69–72]. Thus, we limited our algebraic representation of brain networks to graphs. Compared to the vast body of studies analyzing brain networks as graphs, modeling them as higher order simplicial complexes are only few [17, 73–75]. We used the graph filtration, which iteratively builds nested subgraphs of the original graph in a hierarchical manner [22]. Currently, this is the most often used filtration in analyzing brain networks due to its simplicity.

Consider a weighted graph G(p, w), where p is the number of nodes and w = (w1, …, wq)⊤ is a q-dimensional vector of edge weights with q = (p2 − p)/2. The binary graph Gϵ(p, wϵ) of G(p, w) has binary edge weight wϵ,i:

wϵ,i={1,ifwi>ϵ,0,otherwise.

The binary network Gϵ(p, wϵ) is a 1-skeleton. In 1-skeleton, 0-dimensional (0D) holes are connected components while the 1-dimensional (1D) holes are cycles. There is no higher dimensional homology beyond dimensions 0 and 1. The number of connected components and the number of independent cycles in a graph are referred to as the 0th Betti number (β0) and 1st Betti number (β1) respectively. For 1-skeletons, there is an efficient 1D filtration method called the graph filtration, which filters at the edge weights from −∞ to ∞ in a sequentially increasing manner [6, 37]. The graph filtration of G is defined as a collection of nested binary networks

Gϵ0⊃Gϵ1⊃⋯⊃Gϵk

over increasing filtration values ϵ0 < ϵ1 < ⋯ < ϵk. We used the edge weights as the filtration values to make the graph filtration unique [6].

During the graph filtration, edges are deleted one at a time from the lowest edge weight to the highest. The deletion of an edge disconnect the graph into at most two. Thus, the number of connected components (β0) stays the same or increases at most by one. Euler characteristic χ of the graph is given by [76]

χ=β0-β1=#ofnodes-#ofedges.

Thus the change of Euler characteristic Δχ over the filtration is given by

Δχ=Δβ0-Δβ1=1,

where the change of β0 is Δβ0 = 0 or 1. Subsequently the change of β0 is Δβ1 = −1 or 0. The number of cycles decrease at most by 1 [6, 77].

Birth-death decomposition

When we increase the filtration value ϵ, either one new connected component appears or one cycle disappears [6]. Once a connected component is born, it never dies implying an infinite death value. On the other hand, all the cycles are considered to be born at −∞. Therefore, we simply ignore the infinite death values of the connected components and the negative infinite birth values of the cycles and build the computation framework based on only the birth (death) values of the connected components (cycles) [37]. Also, the number of connected components (or cycles) is non-decreasing (or non-increasing) as ϵ increases. Subsequently, the 0D barcode is given by a set of increasing birth values:

B(G):ϵb1<⋯<ϵbm0,

and the 1D barcode is given by a set of increasing death values:

D(G):ϵd1<⋯<ϵdm1.

By tracing the birth values of connected components and the death values of cycles together, we can characterize the topology of the graph.

The above 0D and 1D barcodes summarize the persistences of connected components and cycles and are often visualized using persistent diagrams [16, 25–27] and Betti curves. The Betti curves plot the Betti numbers with respect to the filtration values. Since the Betti numbers are monotonic, the Betti curve is a step function with a one-unit jump (or drop) at every birth (or death) values. The total number of finite birth values of connected components and the total number of death values of cycles are

m0=p-1andm1=(p-1)(p-2)2,

respectively [37]. The number of connected components (β0) and cycles (β1) in the complete graph G−∞ are 1 and m1 respectively. We note that every edge weight must be in either 0D barcode or 1D barcode as summarized in the following theorem [37].

Theorem 1 (Birth-death decomposition). The set of 0D birth values B(G) and 1D death values D(G) partition the edge weight vector w such that B(G) ∪ D(G) = w and B(G) ∩ D(G) = ϕ. The cardinalities of B(G) and D(G) are p − 1 and (p − 1)(p − 2)/2, respectively.

The schematic of graph filtration and birth-death decomposition for a random graph is presented in Fig 1. The cycles we identify using the birth-death decomposition algebraically independent of each other and hence form a basis for cycles [24, 37]. In binary graph GW3 in Fig 1, there is one cycle consisting of edge weights W(4), W(5) and W(6). The cycle can be algebraically represented as [W(4)] + [W(5)] + [W(6)] with the convention of putting clockwise orientation along the edges. In the complete graph G−∞, there are three independent cycles

C1=[W(4)]+[W(5)]+[W(6)]C2=-[W(5)]+[W(3)]+[W(2)]C3=[W1]+[W6]+[W3].

Fig 1. Schematic of graph filtration and persistent barcodes computation.

Fig 1

We consider a random weighted graph with p = 4 nodes, where the number of edges is q = p(p − 1)/2 = 6. The random edge weights are {W1, W2, …, W6}. We order them using the order statistic as W(1) < W(2) < ⋯ < W(6). We remove each edge of the random graph one at a time in the graph filtration and construct the random birth and death sets of the connected components and cycles, respectively. The Betti-0 (lower right) and Betti-1 (lower left) curves are drawn using the birth and death sets. The blue and green shaded areas represent the areas under Betti-0 and Betti-1 curves. Later, we will consider the area under Betti-0 curve to quantify the curve and construct a test statistic to discriminate between two groups of networks.

All other cycles can be represented as a linear combination of C1, C2 and C2. For instance,

[W(4)]+[W(3)]+[W(2)]+[W(6)]=C1+C2-[W(1)]+[W(2)]+[W(4)]=-C3+C1+C2.

The total number of algebraically independent cycles is the 1st Betti number β1, which is equivalent to the number of death values of cycles. For a complete graph with p nodes, the total number of edges is p(p − 1)/2. In a graph filtration, the total number of birth values of connected components equals to the number of edges p − 1 in the maximum spanning tree. From the birth-death decomposition, the remaining edges contribute to the death values of cycles. The remaining number of edges are [37]

m1=p(p-1)2-(p-1)=(p-1)(p-2)2.

The connected components characterize the modular structure or shape of a network whereas the cycles are loops in a network [24, 78]. In [24], the authors focused specifically on cycles in a brain network as they embed higher order signal transmission paths to provide insights of the functioning of the brain. The presence of more cycles in a network indicates a dense connection with stronger connectivity. The cycles in the brain network not only determines the propagation of information but also controls the feedback [79]. The connected components and cycles provide dependent but complementary information about the network.

Wasserstein distance on barcodes

Since there is no higher dimensional homology beyond dimensions 0 and 1 in 1-skeleton, the 0D and 1D barcodes together can characterize the topology of a network [14]. Therefore, the topological similarity between two such networks can be quantified using a distance metric between the corresponding 0D or 1D barcodes [80]. Often used metric is the Wasserstein distance [23, 81–83]. Let G1(p, u) and G2(p, v) be two networks and the corresponding barcodes (or persistent diagrams) be P1 and P2. Then, the 2-Wasserstein distance on barcodes is given by

D(P1,P2)=infτ:P1→P2(∑x∈P1‖x-τ(x)‖2)1/2

over every possible bijection τ between P1 and P2 [23, 84, 85]. For graph filtrations, barcodes are 1D scatter points. Therefore, the bijection τ can be simplified to the L2 norm between the sorted birth values of connected components or the sorted death values of cycles [23].

Theorem 2 Let G1 and G2 be two networks with p nodes and

{ϵb1(k)<⋯<ϵbm0(k)}and{ϵd1(k)<⋯<ϵdm1(k)}

be the birth and death sets of the network Gk, k = 1, 2. Then, the 2-Wasserstein distance between the 0D barcodes for graph filtration is given by

D02(P1,P2)=[∑i=1m0(ϵbi(1)-ϵbi(2))2]1/2,

and the 2-Wasserstein distance between the 1D barcodes is

D12(P1,P2)=[∑i=1m1(ϵdi(1)-ϵdi(2))2]1/2.

Expected persistent barcodes of random graph

Consider random graph G(p,W), where its edge weights are drawn independent and identically from a distribution function FW. p is the number of nodes and W = (W1, …, Wq)⊤ is a q dimensional vector of random weights with q = (p2 − p)/2. The considered graph is complete and its edge weights are drawn randomly from a continuous distribution. To be mathematically precise, the considered random graph is almost surely complete. Since we the edge weights are drawn from a continuous distribution, the probability of having zero edge weight is nil. Fig 2 displays weighted brain networks randomly drawn from Beta distributions.

Fig 2. Visualization of simulated brain networks with 116 nodes.

Fig 2

Left: The empirical density functions of simulated edge weights from Beta(2, 5) (top) and Beta(5, 2) (bottom) distributions. Middle: The 116 × 116 correlation matrices constructed using the simulated edge weights. Right: Human brain networks with the simulated edge weights. Since correlation networks are too dense for visualization, we only displayed edges with values below 0.1 and above 0.9.

If we apply a graph filtration on the random weighted graph G(p,W), we have a set of random birth values of connected components (or random 0D barcode) and a set of random death values of cycles (or random 1D barcode). Since the notions of random birth and death values are abstract, it is important to turn them into deterministic topological descriptors. As often, one of the simplest way to turn a random object into a deterministic summary is to consider its average behavior. To that end, we study the expected birth and death values (or expected persistent barcodes) as follows.

Let G(p,W) be a random graph and its sorted random edge weights be

W(1)<W(2)<⋯<W(q),

where the subscript (i) indicates the ith smallest edge weight. For instance, W(1) = min1≤i≤qWi is the smallest edge weight while W(q) = max1≤i≤qWi. is the largest edge weight. Order statistics can be formulated by modeling indices (i) using random permutations while the actual edge weights are fixed nonrandom quantity. However, in order statistics, the indices (i) themselves are not considered as random but fixed [86, 87]. They simply indicates the order the random variables are indexed. Only what is in the ith variable is considered as random. In this study, we will follow the traditional convention in order statistics.

Let the random birth and death values of the connected components and cycles be

B(G):W(i1)<W(i2)<⋯<W(im0)andD(G):W(j1)<W(j2)<⋯<W(jm1),

where m0 = p − 1 and m1 = (p − 1)(p − 2)/2. Then, the expected birth and death values are given by

B(G):E(W(i1))<E(W(i2))<⋯<E(W(im0))

and

D(G):E(W(j1))<E(W(j2))<⋯<E(W(jm1)),

where E indicates the standard expectation operator on a random weight.

In order to compute the expected birth and death values, we provide an explicit expression for E(W(k)), for k = 1, …, q, through Theorem 3 below.

Theorem 3 Let the edge weights W = {W1, W2, …, Wq} of a random graph G(p,W) be drawn from a distribution with cumulative distribution function (cdf) FW and probability density function (pdf) fW. Then, the expectation of the kth edge wight W(k) can be approximated by

E(W(k))≈FW-1(kq+1),k=1,…,q.

Proof Since the edge weights W1, W2, …, Wq are drawn from a distribution with a cdf FW and a pdf fW, the pdf of the kth order statistic W(k) is given by

W(k)∼q!(k-1)!(q-k)!fW(x){FW(x)}k-1{1-FW(x)}q-k. (1)

W(k) does not follow a well-known distribution and, therefore, the computation of its mean and variance is difficult. However, [88] showed that the rth sample quantile of {W1, W2, …, Wq} is asymptotically normally distributed:

W([(q+1)r])∼AN(FW-1(r),r(1-r)(q+1)[fW{FW-1(r)}]2) (2)

for large q, where AN stands for asymptotic normal distribution. Thus, the approximate mean and variance of W(k) can be found from (2) by letting r = k/(q + 1):

E(W(k))≈FW-1(kq+1)andvar(W(k))≈kq+1(1-kq+1)(q+1)[fW{FW-1(kq+1)}]2.

The variance will be later used in computing confidence intervals.

Now, we use Theorem 3 and provide expressions for the expected birth and death values in Theorem 4 below.

Theorem 4 Let G(p,W) be a random graph, where its edge weights are drawn from a cdf FW. Then, the expected birth values of the connected components of G(p,W) are given by

FW-1(i1q+1)<⋯<FW-1(im0q+1)

and the expected death values of the cycles of G(p,W) are given by

FW-1(j1q+1)<⋯<FW-1(jm1q+1).

The proof follows Theorem 3. As a special case of Theorem 4, we show that if the edge weights follow uniform distribution in [0, 1], the expected birth and death values have a more simplified and an exact form. The expected birth values of the connected components are given by

i1q+1<⋯<im0q+1

and the expected death values of the cycles are given by

j1q+1<⋯<jm1q+1.

Then the distribution of the kth order statistic simplifies to

W(k)∼q!(k-1)!(q-k)!wk-1(1-w)q-k,

which is the distribution of the Beta distribution with parameters k and q + 1 − k. Since the mean of a Beta(k, q + 1 − k) distribution has an exact form of k/(q + 1), we have

E(W(k))=kq+1.

Once the expected birth and death values are computed, we can use them to plot Betti curves. In Fig 3 example, we generated two random graphs with p = 150 nodes and their edge weights drawn from Beta(2, 2) and Beta(2, 3) distributions. We observe that a slight change in distribution significantly affects the topology of a network.

Fig 3. Plots of Betti-0 (left) and Betti-1 (right) curves of random networks with edges drawn from Beta(2, 2) (in dotted red line) and Beta(2, 3) (in solid black line) distributions.

Fig 3

The change in distribution affects the topology of a network.

Confidence bands on birth and death values

Given a set of n samples from a random graph G(p,W), we show how to compute the confidence bands on the expected birth and death values. The method is later validated using a simulation study.

Let the random weights of the n sampled graphs be w1, w2, …, wn, where wi = (wi1, wi2, …, wiq)⊤ and wij ∼ FW. From the previous section, we know that W(k) follows a asymptotic Gaussian distribution with its mean and variance being

E(W(k))≈FW-1(kq+1)=μk

and

var(W(k))≈kq+1(1-kq+1)(q+1)[fW{FW-1(kq+1)}]2=σk2.

The density fW is estimated by averaging the n graphs with respect to their weights using Gaussian kernel density estimates (KDE). Let the average weight vector be w¯=1n∑i=1nwi=(w¯1,w¯2,…,w¯q)⊤. Then, the KDE of the pdf fW is given by [89]

f^W(x)=1qh∑i=1qK(x-w¯ih),

where K is the Gaussian kernel with bandwidth h. To estimate FW-1, we first find the empirical cdf of FW based on the averaged weight vector w¯ as

F^W(x)=1q∑i=1qIw¯i≤x.

Here, IA is an indicator function takeing value 1 if the event A is true and 0 otherwise. The inverse cumulative distribution of F^W(x) is then given by

F^W-1(x)=inf{t∈R:F^W(t)≥x}.

Once fW and FW-1 are estimated, we plug-in the corresponding estimates in μk and σk2 and obtain the estimates μ^k and σ^k2. Finally, we calculate the α% confidence intervals as

(μ^k-zασ^k,μ^k+zασ^k),

where zα is such that

P(Z≥zα)=α/2

for standard normal Z∼N(0,1). For α = 95, we have zα = 1.96.

Inference on expected birth and death values

Since a graph can be topologically characterized by 0D and 1D barcodes, the topological similarity and dissimilarity between two graphs can be measured using the differences of such barcodes. To quantify these differences, we propose the expected topological loss (ETL) as follows.

Let G1(p,U) and G2(p,V) be two random graphs, where the random weights U = {U1, …, Uq} and V = {V1, …, Vq} are drawn from distribution functions FU and FV, respectively. Further, let the expected birth and death values of G1(p,U) be

FU-1(i1q+1)<⋯<FU-1(im0q+1)andFU-1(j1q+1)<⋯<FU-1(jm1q+1).

Similarly, let the expected birth and death values of G2(p,V) be

FV-1(i1′q+1)<⋯<FV-1(im0′q+1)andFV-1(j1′q+1)<⋯<FV-1(jm1′q+1).

Then, the ETL is given by

ETL(G1,G2)=∑k=1m0[FU-1(ikq+1)-FV-1(ik′q+1)]2+∑k=1m1[FU-1(jkq+1)-FV-1(jk′q+1)]2. (3)

In most applications, the distribution functions FU and FV are unknown. In such scenarios, we plug-in the corresponding empirical distribution function estimates F^U-1 and F^V-1 in (3). The ETL is a function of expected 0D and 1D barcodes. The expected 0D barcode can also be viewed as the expected heights of branching in a random merge tree [90–95].

Application of ETL in discriminating networks

The ETL can be used to topologically discriminate between two groups of brain networks. Let Ω = {Ω1, …, Ωm} and Ψ = {Ψ1, …, Ψn} be two sets consisting of m and n complete networks each comprising p number of nodes. Let the empirical distribution functions of the edge weights of the graphs in group Ω be {F^Ω1,…,F^Ωm} and the expected birth and death values for Ωi be

F^Ωi-1(i1q+1)<⋯<F^Ωi-1(im0q+1)andF^Ωi-1(j1q+1)<⋯<F^Ωi-1(jm1q+1),

which will be simply denoted as

u1iΩ<⋯<um0iΩandv1iΩ<⋯<vm1iΩ.

The average of expected birth and death values within the group Ω are given by

u¯1Ω<⋯<u¯m0Ωandv¯1Ω<⋯<v¯m1Ω.

Similarly, for the second group Ψ, let the average of expected birth and death values be

u¯1Ψ<⋯<u¯m0Ψandv¯1Ψ<⋯<v¯m1Ψ.

The test statistic based on ETL to discriminate between groups is then given by

L(Ω,Ψ)=∑j=1m0(u¯jΩ-u¯jΨ)2+∑j=1m1(v¯jΩ-v¯jΨ)2. (4)

Large L(Ω,Ψ) indicates a significant topological difference between the two groups whereas a small value suggests that there is no significant topological group difference. Considering the probability distribution of the test statistic L(Ω,Ψ) is unknown, we use the permutation test [96–99]. In this study, we use 100000 permutations for small scale simulation studies and half million permutations for large-scale real data.

A similar widely-used statistic is the maximum gap statistics. On a similar line to L(Ω,Ψ), the statistic is given by:

L1(Ω,Ψ)=max1≤j≤m0|u¯jΩ-u¯jΨ|+max1≤j≤m1|v¯jΩ-v¯jΨ|. (5)

We will use L1(Ω,Ψ) to compare with the ETL statistic L(Ω,Ψ) in the simulation study section.

Area under Betti curves in discriminating networks

The difference of β0 curves can be also quantified using the area under the curve (AUC) [100, 101]. The AUC for Ωi of the group Ω and for Ψj of the group Ψ are given by

AUCΩi=∑k=2m0k(ukiΩ-u(k-1)iΩ)andAUCΨj=∑k=2m0k(ukjΨ-u(k-1)jΨ).

We compute the AUC by summing up the areas of rectangular blocks formed by the expected persistent barcodes. For example, in Fig 1, the area under the Betti-0 curve is 2(W(5) − W(3)) + 3(W(6) − W(5)).

To determine if AUC is significantly different between groups Ω and Ψ, we use the Wilcoxon rank sum test [102]. The Wilcoxon rank sum test is a nonparametric test of the null hypothesis, For randomly selected values X and Y from two populations, the probability of X being greater than Y is equal to the probability of Y being greater than X. This is unlike the previous situation, where we considered a ETL or a max-gap statistic. In those cases, since we are considering the distance between increasing births or deaths of two networks, the consideration of L1 or L2 norm in the statistic is meaningful. In contrast to distance-based methods, AUC offers an alternate area based topological inference procedure. The method can be equally applicable for area under Betti-1 curves as well.

Simulation study

Since there is no ground truth in real brain network data, we performed extensive simulation studies with known ground truth. The Matlab codes for simulation study is provided in https://github.com/laplcebeltrami/orderstat.

Validation of birth and death value estimates

We validate the method to estimate expected birth and death values. We generate the ground truth graph G(p, w) with given edge weights and calculate its birth and death values using the birth-death decomposition on p = 10 number of nodes [37]. The weight vector w is of dimension q = p(p − 1)/2 = 45. We drew the q variate random weights w from the Uniform(0, 1) distribution.

We then simulate n = 15 vectors of q-variate Gaussian noises and add them to the edge weights w of G(p, w) to have a set of n graphs

G(p,wi)=G(p,w+ϵi),i=1,…,n, (33)

where ϵi∼Nq(0,σ2I) with σ = 0.02. The produced set of graphs {G(p, w1), …, G(p, wn)} is considered as a realizations from a random graph G(p,W) and apply the proposed method to calculate the expected birth and death values along with their corresponding confidence bands. Then, we compare them with the initially calculated birth and death values of G(p, w). Fig 4 displays the schematic of the validation procedure. The original and expected birth (left panel) and death (right panel) values are plotted in Fig 5. The black line represents the original birth or death values, the dashed red line indicates the estimated birth or death values, and the dashed blue lines indicate the corresponding 95% upper and lower confidence bands. We observe that the dashed red lines almost overlap the black lines of the original birth and death values. In addition, the original birth or death values almost always lie within the confidence bands supporting the reliability of the proposed methodology.

Fig 4. Schematic of validate the proposed method to compute expected birth and death values.

Fig 4

The ground truth graph G is we used to calculate the Betti curves (solid black line) using the birth-death decomposition. We added Gaussian noise to edge weights to generate samples in each group. Then, we apply the proposed method on this set of sampled graphs and estimate the expected birth and death values and the Betti curves (dotted red line).

Fig 5. Plots of the original and expected birth (left) and death (right) values.

Fig 5

The black line represents the original birth (or death) values, the dashed red line indicates the expected birth (or death) values, and the dashed blue lines indicate the corresponding 95% confidence intervals.

Analyzing topological similarity between networks

We provide a toy example to illustrate whether the topological similarity or dissimilarity of two groups of networks, drawn from two different distributions or the same distribution, can be identified using the ETL statistic (4). We used the Beta(a, b) distribution, which are all defined in interval (0, 1). The shape parameters a and b allow for the variety of shapes including the shape of a uniform distribution Uniform(0, 1) when a = b = 1. We considered three different distributions (Fig 6).

Fig 6.

Fig 6

Top panel: Probability density functions of Beta(1, 1) or Uniform(0, 1) (in solid line), Beta(5, 2) (in dash-dotted line), and Beta(1, 5) (in dotted line). We sample the edge weights of random graphs from these three different distributions for validation purpose. Middle and bottom panel: Histogram plots of the ETL (middle) and maximum gap (bottom) test statistics and the corresponding observed test statistics (in dotted red lines) for the scenarios: Beta(1, 1) vs. Beta(5, 2) (left) and Beta(1, 1) vs. Beta(1, 1) (right) with 6 networks in each group.

We generated two groups of networks. For the both groups, we simulated n = 6, 8, 10, and 12 networks. We investigated the performance of both small (p = 10) and large (p = 100) network settings. Small networks may not yield complex cyclic structures often present in large networks. However, the overall conclusions are the same regardless of the size of networks. For the permutation test, we considered 100000 permutations and repeated that 10 times to compute the average p-values. Table 1 tabulates the p-values for small and large network settings. In all the scenarios, networks drawn from the same distribution produced large p-values and networks drawn from different distributions had p-values smaller than 0.01. Therefore, we conclude that the proposed ETL statistic, based on expected birth and death values, can discriminate networks drawn from different distributions at 99% confidence level. The middle panel of Fig 6 plots the histograms of the ETL test statistic and the corresponding observed test statistics (in dotted red) for two specific scenarios: (i) Beta(1, 1) vs. Beta(5, 2) (left) and (ii) Beta(1, 1) vs. Beta(1, 1) (right) with 12 networks in each group.

Table 1. The average p-values obtained using the ETL statistic for various pairs of distributions for small (p = 10) and large (p = 100) network settings.

Here, the columns 6 networks, 8 networks, 10 networks, and 12 networks indicate the number of networks that we considered for both the groups. The p-values smaller than 0.01 indicate that our method can identify network differences at a 99% confidence level.

Distribution (p = 10) 6 networks 8 networks 10 networks 12 networks
Beta(1, 1) vs. Beta(5, 2) 0.0017 1.00 × 10−5 0.0000 0.0000
Beta(1, 1) vs. Beta(1, 5) 0.0022 1.00 × 10−4 1.00 × 10−5 0.0000
Beta(5, 2) vs. Beta(1, 5) 0.0011 1.30 × 10−4 0.0000 0.0000
Beta(1, 1) vs. Beta(1, 1) 0.2478 0.6784 0.6859 0.8264
Beta(5, 2) vs. Beta(5, 2) 0.2393 0.4497 0.7836 0.8772
Beta(1, 5) vs. Beta(1, 5) 0.2721 0.6847 0.7585 0.7573
Distribution (p = 100) 6 networks 8 networks 10 networks 12 networks
Beta(1, 1) vs. Beta(5, 2) 0.0021 9.0000 × 10−5 2.0000 × 10−5 0.0000
Beta(1, 1) vs. Beta(1, 5) 0.0018 8.0000 × 10−5 2.0000 × 10−5 1.0000 × 10−5
Beta(5, 2) vs. Beta(1, 5) 0.0022 1.2000 × 10−4 0.0000 0.0000
Beta(1, 1) vs. Beta(1, 1) 0.6430 0.2844 0.3308 0.2665
Beta(5, 2) vs. Beta(5, 2) 0.7882 0.8828 0.5559 0.9319
Beta(1, 5) vs. Beta(1, 5) 0.1526 0.3831 0.2241 0.5021

Comparison of ETL against baselines

We compared the proposed ETL with several other widely-used baseline topological distances such as bottleneck, Gromov-Hausdorff (GH), and Kolmogorov-Smirnov (KS) distances [21, 103, 104]. We also compared the results with the maximum gap statistic defined earlier in (5). In all the scenarios, we considered two groups of networks each of size n = 6. The remaining simulation setting is similar to the above. The corresponding p-values are presented in Table 2 for small (p = 10) and large network (p = 100) settings. From the table, we observe that the ETL performs well in most scenarios. In particular, we note that the KS based methods do not perform well whereas the maximum gap based method is quite competitive. Further, for testing no network differences, all the distances perform well.

Table 2. The average p-values obtained using bottleneck, GH, KS, maximum gap, and ETL based statistics for small (p = 10) and large (p = 100) network settings.

There were 6 networks in each group. The p-values smaller than 0.01 indicate that the corresponding method can identify network differences at a 99% confidence level.

Distribution (p = 10) Bottleneck GH KS(β0) KS(β1) Maximum gap ETL
Beta(1, 1) vs. Beta(5, 2) 0.0035 0.0028 0.4667 0.3438 0.0022 0.0014
Beta(1, 1) vs. Beta(1, 5) 0.0190 0.0692 0.3804 0.6406 0.0016 0.0022
Beta(5, 2) vs. Beta(1, 5) 0.0026 0.3345 0.2885 0.5177 0.0021 0.0011
Beta(1, 1) vs. Beta(1, 1) 0.2255 0.4385 0.2591 0.6893 0.1013 0.3136
Beta(5, 2) vs. Beta(5, 2) 0.3046 0.2346 0.1991 0.6035 0.1446 0.2393
Beta(1, 5) vs. Beta(1, 5) 0.3351 0.5392 0.1217 0.4172 0.1058 0.2721
Distribution (p = 100) Bottleneck GH KS(β0) KS(β1) Maximum gap ETL
Beta(1, 1) vs. Beta(5, 2) 0.0029 0.0032 0.0879 0.2984 0.0020 0.0021
Beta(1, 1) vs. Beta(1, 5) 0.0039 0.1391 0.3412 0.1333 0.0032 0.0028
Beta(5, 2) vs. Beta(1, 5) 0.0001 0.8790 0.5854 0.4600 0.0015 0.0022
Beta(1, 1) vs. Beta(1, 1) 0.8204 0.3911 0.9848 0.7357 0.0863 0.6430
Beta(5, 2) vs. Beta(5, 2) 0.5272 0.0919 0.7677 0.6115 0.3785 0.7882
Beta(1, 5) vs. Beta(1, 5) 0.4840 0.1640 0.4224 0.6654 0.1315 0.1526

Since the maximum gap based method exhibits a competitive performance with the ETL based method, we plot the histograms of the maximum gap statistics obtained over different permutations and the corresponding observed test statistics (in dotted red) for two specific scenarios: (i) Beta(1, 1) vs. Beta(5, 2) (left) and (ii) Beta(1, 1) vs. Beta(1, 1) (right) with 6 networks in each group; see the bottom panel of Fig 6. Although both the methods (ETL and maximum-gap) perform well, the ETL generally produces better results (i.e., its p-value is closer to 0 when there is a network difference and closer to 1 when there is no network difference).

Area under Betti curves

We also conducted a simulation study for the method based on the area under β0 curve. The considered simulation layout was the same as before. The obtained p-values are tabulated in Table 3 for small networks (p = 10) and large networks (p = 100). As shown in Fig 3, a slight change in distribution significantly changes the topology of the network and, therefore, the area under β0 curve varies significantly. This change is more visible especially for large networks, which incases AUC. However, the Wilcoxon rank sum test places ranks to the aggregated sample that combined the first and second sample, then considers the sum of ranks for the both samples. This makes the test statistic fairly robust even if the distributions are varied. This makes the p-value computation extremely stable for large networks. For example Table 3 shows the exactly same p-value of 0.0022 for p = 100. Similar to the ETL, this approach can also discriminate networks drawn from different distributions at a 99% confidence level.

Table 3. The average p-values obtained using Wilcoxon rank sum test on the areas under β0 curves for small (p = 10) and large (p = 100) network settings.

Here, the columns 6 networks, 8 networks, 10 networks, and 12 networks indicate the number of networks that we considered for both the groups. The p-values smaller than 0.01 indicate that our method can identify network differences at a 99% confidence level.

Distribution (p = 10) 6 networks 8 networks 10 networks 12 networks
Beta(1, 1) vs. Beta(5, 2) 0.0087 3.10 × 10−4 7.68 × 10−4 0.0014
Beta(1, 1) vs. Beta(1, 5) 0.0022 6.21 × 10−4 0.0017 0.0061
Beta(5, 2) vs. Beta(1, 5) 0.0043 0.0030 1.82 × 10−4 3.65 × 10−5
Beta(1, 1) vs. Beta(1, 1) 0.6991 0.7209 0.4727 0.8852
Beta(5, 2) vs. Beta(5, 2) 0.4848 0.2786 0.2413 0.9770
Beta(1, 5) vs. Beta(1, 5) 0.8182 0.2786 0.7337 0.5444
Distribution (p = 100) 6 networks 8 networks 10 networks 12 networks
Beta(1, 1) vs. Beta(5, 2) 0.0022 1.5540 × 10−4 1.8365 × 10−4 3.6585 × 10−5
Beta(1, 1) vs. Beta(1, 5) 0.0022 1.5540 × 10−4 1.8267 × 10−4 3.6585 × 10−5
Beta(5, 2) vs. Beta(1, 5) 0.0022 1.5540 × 10−4 1.8267 × 10−4 3.6585 × 10−5
Beta(1, 1) vs. Beta(1, 1) 0.9372 0.2345 0.2413 0.4025
Beta(5, 2) vs. Beta(5, 2) 0.8182 0.1605 0.6776 0.7075
Beta(1, 5) vs. Beta(1, 5) 0.2403 0.6454 0.7913 0.1572

Results

For each of the 400 subjects, we computed the whole-brain functional connectivity by calculating the Pearson correlation matrix over 1200 time points across 116 anatomical regions resulting in 400 correlation matrices of dimension 116 × 116. Therefore, using our notations, we have p = 116 nodes, q = p(p − 1)/2 = 6670 edges, m0 = p − 1 = 115, and m1 = (p − 1)(p−2)/2 = 6555. Fig 7 summarizes the average female (left) and male (right) brain networks (top) and the corresponding correlation matrices (bottom).

Fig 7. Visualization of the fMRI brain data.

Fig 7

Left panel: The average female brain network (top) and the corresponding correlation matrix (bottom). Middle panel: The average male brain network (top) and the corresponding correlation matrix (bottom). Right panel: The β0 (top) and β1 (bottom) curves for female (in solid black) and male (in dashed red) brain networks. For a better visualization, we consider a threshold value of 0:5 while plotting the brain networks so that they contain fewer number of edges.

Two-sample test using ETL statistic

Given the 400 correlation matrices of 168 males and 232 females, we aim to check whether the proposed ETL statistic can determine the difference between the groups of males and females. We assume that the male and female edge weights are coming from distributions with cdfs FU and FV, respectively. However, these distribution functions are unknown. Therefore, we need to estimate them because the ETL statistic is constructed using these cdfs. To estimate the cdf, we average the male (female) correlation matrices across 168 subjects (232 subjects) and find the empirical cdf based on the averaged 6670 edge weights. The empirical cdfs of the average edge weights of females (in solid black line) and males (in dashed red line) are presented in the left panel of Fig 8. We observe that the empirical cdf corresponding to female is slightly higher than that of male. This suggests a relatively more number of edge weights with smaller values for the female, and a relatively more number of edge weights with bigger values for the male. In other words, the distribution of the female edge weights is slightly positively skewed than the male edge weights. Fig 9 plots the β0 and β1 curves of the average female and male networks (calculated in the standard way) and their corresponding estimated counterparts (computed using the expected birth and death values). We observe that the estimated Betti curves well approximate the original Betti curves.

Fig 8.

Fig 8

Left: Plot of the empirical cdfs of the average edge weights of females (in solid black line) and males (in dashed red line). Right: Histogram plot of the ETL statistic based on the resting-state fMRI dataset. The dotted red line represents the observed value of the ETL statistic.

Fig 9. Plots of the original (solid black line) and estimated (dashed red line) β0 (top) and β1 (bottom) curves using expected birth and death values for the female (left) and male (right) brain networks.

Fig 9

To conduct the test, we used the permutation test with 500000 random permutations. The observed test statistic is 4.9372 and the p-value is 0.0134. The histogram of test statistic is plotted in the right panel of Fig 8. We conclude that, although the weight distributions of the males and females are very close, the proposed ETL statistic can still discriminate them at a 95% confidence level.

Two-sample test using AUC statistic

We conducted a two-sample test using the method based on the area under β0 curve. The observed value of the Wilcoxon rank-sum statistic is 48374. The statistic corresponds to the p-value of 0.1036. That is, the test fails to discriminate male and female subjects if we use the traditional values of α, the level of significance, to be 0.05 or 0.1. However, if we relax this assumption a bit, the test can discriminate males and females at a confidence level of 89.5%.

The sex differences of resting state functional networks were previously investigated. There is known sex difference in the parietal region involved in spatial ability [105]. [106] reported sex differences in the left parietal, precentral and postcentral regions. The sex difference is also reported in the left rolandic operculum [107]. The previous rs-fMRI studies mainly focused on brain region specific analysis and not topological. Our topological methods are different. The use of the order statistic in quantifying topological difference between males and females is novel. This method identifies the impact of distribution differences in topological features. These specific results have not been observed before to best of our knowledge.

Discussion

The concept of random graphs was first proposed in mid-twentieth century [39] and has been of many researchers’ interest ever since [108–112]. The concepts of TDA tools such as persistent barcodes were extended to handle stochastic cases, which triggered the computation of expected persistent barcodes. However, such computation may require complex theoretical constructs. In this article, we considered a random graph model for which the computation of expected persistent barcodes became simplified by using the order statistic.

[37] formulated a topological loss based on the birth and death values of connected components and cycles of a network that provided an optimal matching and alignment at the edge level. In this article, we extended this formulation to a random graph scenario and proposed the expected topological loss (ETL) based on the expected birth and death values. We use the ETL as a test statistic to discriminate between two groups of networks. We validated this method using a simulation study. We showed that the ETL can identify group differences at a 99% confidence level whereas it produces large p-values when there is no network differences. We compared the proposed approach with baseline approaches and established an overall superior performance of the proposed method. Further, we considered the area under the Betti curves [101]. This resulted a scalar quantification of the curves which was used to discriminate between the groups. A respective simulation study showed its successful discriminative ability whenever there are network differences. We also applied the developed tools in a resting-state brain fMRI dataset and showed that they can differentiate male and female brain networks.

To calculate the expected persistent barcodes, we computed the unknown distribution using the nonparametric empirical distribution function. However, one may also consider hierarchical or Bayesian parametric models for the edge weights instead. For example, one may consider the edge weights to be drawn from a N(μ,σ2) distribution, where the location parameter μ and the dispersion parameter σ2 have a Gaussian and an inverse gamma conjugate prior, respectively. The parameters of the prior distributions will allow flexibility while we can still enjoy the advantages of a parametric model. This direction can be pursued in the future.

We can also use different filtration schemes such as relative filtration [113] or normalized filtration that scales filtration values between 0 and 1 [114]. As long as the order of sorted edge weights are not changed, they will not affect the statistical results. The Wasserstein distance we used is defined on the sorted edge weights. As long as we do not change the value of edge weights, the statistical results will not change.

Our methodology is based on the graph filtration, which gives both 0D and 1D persistence as monotonic 1D functions of birth and death values only. On the other hand, the clique filtration [115], does not produce monotone persistence or barcodes and the proposed method is not directly applicable [116–121]. Our method is applicable to any filtration that provides monotone persistence or Betti curves. The proposed graph filtration computes the barcodes in O(plogp), which is significantly faster than Rips filtrations. In traditional Rips filtrations, the computational complexity grows rapidly with the number of simplices [122]. With p nodes, the size of the k-skeleton grows as pk+ 1 and the computational run time is O(p3k+3) [123, 124]. Compared to the graph filtration, the Rips filtration constructed using Ripser package [125] is about 8 times slower in a computer. On top of that, we also need to compute the Wasserstein distance between persistent diagrams [126]. The Wasserstein distance computation requires expensive optimization process involving O(p6) run-time [127, 128].

Our algorithm exploits the geometric structure of the graph filtration, resulting in the persistence diagram representation in the form of 1-dimensional sorted scalar values. Thus, the proposed method computes he Wasserstein distance in O(plogp) bypassing multitude of computational bottlenecks. For resampling based statistical inference such as the permutation test, the computational bottleneck is caused by repreatedlby computing the test statistic over the random permutations of group labels at least half million times [129]. This is impractical if the Wasserstein distance for the Rips filtrations has to be used for 400 networks and then the whole computation has to be done repeatedly half million times. The development of scalable computation will have a significant impact in resampling based statistical inference.

Graph filtrations produce the monotone birth and death values over filtrations. Since our birth and death values are exactly edge weights, the slight changes in edge weight distribution will correspondingly change the birth and death values slightly. Since the expected topological loss (ETL) is sum of differences of birth and death values, it will also change correspondingly. This is the very reason which assures that our method can successfully discriminate topological group differences whenever there is a difference in edge distributions between two groups.

The monotone Betti curves usually follow S-shaped curves similar to the pattern of cumulative distribution functions. The pattern of S-shaped Betti curves do not change drastically even if different dataset is used as long as they are weighted graphs. To demonstrate this, we plotted Betti curves for task-fMRI. Fig 10 shows the Betti curves for task-fMRI, where cognitive inhibition was measured using go/no-go paradigm in 144 subjects on 100 brain regions [130, 131]. The correlation matrices were computed separately for the inhibition (go) and initiation (no-go) blocks of fMRI time series. The monotonic Betti curves show almost identical pattern of Betti curves in rs-fMRI networks in our study.

Fig 10. The average Betti curves of obtained from the graph filtration on correlation matrices computed separately for the inhibition (go) and initiation (no-go) blocks of fMRI time series in cognitive aging study [130, 131].

Fig 10

Acknowledgments

We like to thank Shih-Gu Huang of the National University of Singapore for providing support for fMRI processing. We also thank Gary Shiu of University of Wisconsin-Madison for discussion on the computational runtime on Rips filtrations.

Data Availability

The data is available from the public domain HCP database: http://www.humanconnectomeproject.org The code is available at https://github.com/laplcebeltrami/orderstat.

Funding Statement

For this study, we received funding from National Institute of Health (NIH) R01 EB02875 and National Science Foundation (NSF) MDS-2010778. All the authors (Das, Anand, Chung) received salaries from these two grants. However, the design of the study, the analysis of data and writing of papers are all done by the authors independent of the funders.

References

  • 1. Bassett DS, Sporns O. Network neuroscience. Nature neuroscience. 2017;20(3):353–364. doi: 10.1038/nn.4502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Sporns O. Graph theory methods: applications in brain networks. Dialogues in Clinical Neuroscience. 2018;20(2):111. doi: 10.31887/DCNS.2018.20.2/osporns [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Bullmore E, Sporns O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nature reviews neuroscience. 2009;10(3):186–198. doi: 10.1038/nrn2575 [DOI] [PubMed] [Google Scholar]
  • 4. Stam CJ, Reijneveld JC. Graph theoretical analysis of complex networks in the brain. Nonlinear biomedical physics. 2007;1(1):1–19. doi: 10.1186/1753-4631-1-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Rubinov M, Sporns O. Complex network measures of brain connectivity: uses and interpretations. Neuroimage. 2010;52(3):1059–1069. doi: 10.1016/j.neuroimage.2009.10.003 [DOI] [PubMed] [Google Scholar]
  • 6. Chung MK, Lee H, DiChristofano A, Ombao H, Solo V. Exact topological inference of the resting-state brain networks in twins. Network Neuroscience. 2019;3:674–694. doi: 10.1162/netn_a_00091 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Bassett DS. Small-World Brain Networks. The Neuroscientist. 2006;12:512–523. doi: 10.1177/1073858406293182 [DOI] [PubMed] [Google Scholar]
  • 8. Bassett DS, Porter MA, Wymbs NF, Grafton ST, Carlson JM, Mucha PJ. Robust detection of dynamic community structure in networks. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2013;23(1):013142. doi: 10.1063/1.4790830 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Van Den Heuvel MP, Sporns O. Rich-club organization of the human connectome. Journal of Neuroscience. 2011;31(44):15775–15786. doi: 10.1523/JNEUROSCI.3539-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Chung MK, Hanson JL, Lee H, Adluru N, Alexander AL, Davidson RJ, et al. Persistent Homological Sparse Network Approach to Detecting White Matter Abnormality in Maltreated Children: MRI and DTI Multimodal Study. MICCAI, Lecture Notes in Computer Science (LNCS). 2013;8149:300–307. doi: 10.1007/978-3-642-40811-3_38 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Lee H, Kang H, Chung MK, Kim BN, Lee DS. Persistent brain network homology from the perspective of dendrogram. IEEE Transactions on Medical Imaging. 2012;31:2267–2277. doi: 10.1109/TMI.2012.2219590 [DOI] [PubMed] [Google Scholar]
  • 12. Zomorodian AJ, Carlsson G. Computing Persistent Homology. Discrete and Computational Geometry. 2005;33:249–274. doi: 10.1007/s00454-004-1146-y [DOI] [Google Scholar]
  • 13. Singh G, Memoli F, Ishkhanov T, Sapiro G, Carlsson G, Ringach DL. Topological analysis of population activity in visual cortex. Journal of Vision. 2008;8:1–18. doi: 10.1167/8.8.11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Ghrist R. Barcodes: The persistent topology of data. Bulletin of the American Mathematical Society. 2008;45:61–75. [Google Scholar]
  • 15.Carlsson G, Memoli F. Persistent clustering and a theorem of J. Kleinberg. arXiv preprint arXiv:08082241. 2008.
  • 16. Edelsbrunner H, Harer J. Persistent Homology—a Survey. Contemporary Mathematics. 2008;453:257–282. [Google Scholar]
  • 17. Petri G, Expert P, Turkheimer F, Carhart-Harris R, Nutt D, Hellyer PJ, et al. Homological scaffolds of brain functional networks. Journal of The Royal Society Interface. 2014;11:20140873. doi: 10.1098/rsif.2014.0873 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Sizemore AE, Giusti C, Kahn A, Vettel JM, Betzel RF, Bassett DS. Cliques and cavities in the human connectome. Journal of computational neuroscience. 2018;44:115–145. doi: 10.1007/s10827-017-0672-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Lee H, Chung MK, Kang H, Choi H, Kim YK, Lee DS. Abnormal hole detection in brain connectivity by kernel density of persistence diagram and Hodge Laplacian. In: IEEE International Symposium on Biomedical Imaging (ISBI); 2018. p. 20–23. [DOI] [PMC free article] [PubMed]
  • 20. Bubenik P. The persistence landscape and some of its properties. In: Topological Data Analysis. Springer; 2020. p. 97–117. [Google Scholar]
  • 21.Chung MK, Lee H, Solo V, Davidson RJ, Pollak SD. Topological distances between brain networks. International Workshop on Connectomics in Neuroimaging. 2017; p. 161–170. [DOI] [PMC free article] [PubMed]
  • 22. Lee H, Chung MK, Kang H, Kim BN, Lee DS. Computing the shape of brain networks using graph filtration and Gromov-Hausdorff metric. MICCAI, Lecture Notes in Computer Science. 2011;6892:302–309. doi: 10.1007/978-3-642-23629-7_37 [DOI] [PubMed] [Google Scholar]
  • 23.Songdechakraiwut T, Shen L, Chung MK. Topological learning and its application to multimodal brain network integration. Medical Image Computing and Computer Assisted Intervention (MICCAI). 2021; p. in press, http://pages.stat.wisc.edu/~mchung/papers/song.2021.MICCAI.pdf. [DOI] [PMC free article] [PubMed]
  • 24.Anand DV, Chung MK. Hodge-Laplacian of Brain Networks and Its Application to Modeling Cycles. arXiv preprint arXiv:211014599. 2021.
  • 25. Berry E, Chen YC, Cisewski-Kehe J, Fasy BT. Functional summaries of persistence diagrams. Journal of Applied and Computational Topology. 2020;4(2):211–262. doi: 10.1007/s41468-020-00048-w [DOI] [Google Scholar]
  • 26.Chazal F, Fasy BT, Lecci F, Rinaldo A, Wasserman L. Stochastic convergence of persistence landscapes and silhouettes. In: Proceedings of the thirtieth annual symposium on Computational geometry; 2014. p. 474–483.
  • 27. Bubenik P. Statistical topological data analysis using persistence landscapes. Journal of Machine Learning Research. 2015;16:77–102. [Google Scholar]
  • 28. Biscio CA, Møller J. The accumulated persistence function, a new useful functional summary statistic for topological data analysis, with a view to brain artery trees and spatial point process applications. Journal of Computational and Graphical Statistics. 2019;28:671–681. doi: 10.1080/10618600.2019.1573686 [DOI] [Google Scholar]
  • 29.Chen YC, Wang D, Rinaldo A, Wasserman L. Statistical analysis of persistence intensity functions. arXiv preprint arXiv:151002502. 2015.
  • 30.Fasy BT, Kim J, Lecci F, Maria C. Introduction to the R package TDA. arXiv preprint arXiv:14111830. 2014.
  • 31. Kwitt R, Huber S, Niethammer M, Lin W, Bauer U. Statistical topological data analysis-a kernel perspective. Advances in neural information processing systems. 2015;28. [Google Scholar]
  • 32. Gayet D, Welschinger JY. Lower estimates for the expected Betti numbers of random real hypersurfaces. Journal of the London Mathematical Society. 2014;90(1):105–120. doi: 10.1112/jlms/jdu018 [DOI] [Google Scholar]
  • 33.Salepci N, Welschinger JY. Tilings, packings and expected Betti numbers in simplicial complexes. arXiv preprint arXiv:180605084. 2018.
  • 34. Wigman I. On the expected Betti numbers of the nodal set of random fields. Analysis & PDE. 2021;14(6):1797–1816. doi: 10.2140/apde.2021.14.1797 [DOI] [Google Scholar]
  • 35. King JB, Prigge MB, King CK, Morgan J, Weathersby F, Fox JC, et al. Generalizability and reproducibility of functional connectivity in autism. Molecular Autism. 2019;10(1):1–23. doi: 10.1186/s13229-019-0273-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Blinowska KJ, Kaminski M. Functional brain networks: random,“small world” or deterministic? PloS one. 2013;8(10):e78763. doi: 10.1371/journal.pone.0078763 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Songdechakraiwut T, Chung MK. Topological learning for brain networks. 2020; p. arXiv:2012.00675. [DOI] [PMC free article] [PubMed]
  • 38. Gilbert EN. Random graphs. The Annals of Mathematical Statistics. 1959;30(4):1141–1144. doi: 10.1214/aoms/1177706098 [DOI] [Google Scholar]
  • 39. Erdös P, Rényi A. On the evolution of random graphs. Bull Inst Internat Statist. 1961;38:343–347. [Google Scholar]
  • 40. Newman MEJ, Strogatz SH, Watts DJ. Random graphs with arbitrary degree distributions and their applications. Physical Review E. 2001;64:26118. doi: 10.1103/PhysRevE.64.026118 [DOI] [PubMed] [Google Scholar]
  • 41. Janson S, Rucinski A, Luczak T. Random graphs. John Wiley & Sons; 2011. [Google Scholar]
  • 42. Bobrowski O, Kahle M. Topology of random geometric complexes: a survey. Journal of applied and Computational Topology. 2018;1(3):331–364. doi: 10.1007/s41468-017-0010-0 [DOI] [Google Scholar]
  • 43. Bollobás B, Béla B. Random graphs. 73. Cambridge university press; 2001. [Google Scholar]
  • 44. Frieze A, Karoński M. Introduction to random graphs. Cambridge University Press; 2016. [Google Scholar]
  • 45. Kahle M. The neighborhood complex of a random graph. Journal of Combinatorial Theory, Series A. 2007;114:380–387. doi: 10.1016/j.jcta.2006.05.004 [DOI] [Google Scholar]
  • 46. Kahle M. Random geometric complexes. Discrete & Computational Geometry. 2011;45:553–573. doi: 10.1007/s00454-010-9319-3 [DOI] [Google Scholar]
  • 47. Kahle M, Meckes E. Limit theorems for Betti numbers of random simplicial complexes. Homology, Homotopy and Applications. 2013;15:343–374. doi: 10.4310/HHA.2013.v15.n1.a17 [DOI] [Google Scholar]
  • 48. Jordan MI. Learning in graphical models. MIT press; 1999. [Google Scholar]
  • 49. Bishop CM. Pattern recognition and machine learning. springer; 2006. [Google Scholar]
  • 50. Wilks SS. Order statistics. Bulletin of the American Mathematical Society. 1948;54(1):6–50. doi: 10.1090/S0002-9904-1948-08936-4 [DOI] [Google Scholar]
  • 51. Rényi A. On the theory of order statistics. Acta Mathematica Academiae Scientiarum Hungarica. 1953;4(3-4):191–231. doi: 10.1007/BF02127580 [DOI] [Google Scholar]
  • 52. David HA, Nagaraja HN. Order statistics. John Wiley & Sons; 2004. [Google Scholar]
  • 53.Arnold BC, Balakrishnan N, Nagaraja HN. A first course in order statistics. SIAM; 2008.
  • 54. Ahsanullah M, Nevzorov VB, Shakil M. An introduction to order statistics. vol. 8. Springer; 2013. [Google Scholar]
  • 55. Balakrishnan N, Cohen AC. Order statistics & inference: estimation methods. Elsevier; 2014. [Google Scholar]
  • 56. Van Essen DC, Ugurbil K, Auerbach E, Barch D, Behrens TEJ, Bucholz R, et al. The Human Connectome Project: a data acquisition perspective. NeuroImage. 2012;62:2222–2231. doi: 10.1016/j.neuroimage.2012.02.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Glasser MF, Sotiropoulos SN, Wilson JA, Coalson TS, Fischl B, Andersson JL, et al. The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage. 2013;80:105–124. doi: 10.1016/j.neuroimage.2013.04.127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Bzdok D, Varoquaux G, Grisel O, Eickenberg M, Poupon C, Thirion B. Formal models of the network co-occurrence underlying mental operations. PLoS computational biology. 2016;12:e1004994. doi: 10.1371/journal.pcbi.1004994 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. NeuroImage. 2006;31:968–980. doi: 10.1016/j.neuroimage.2006.01.021 [DOI] [PubMed] [Google Scholar]
  • 60. Hagmann P, Kurant M, Gigandet X, Thiran P, Wedeen VJ, Meuli R, et al. Mapping human whole-brain structural networks with diffusion MRI. PLoS One. 2007;2(7):e597. doi: 10.1371/journal.pone.0000597 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Arslan S, Ktena SI, Makropoulos A, Robinson EC, Rueckert D, Parisot S. Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex. NeuroImage. 2018;170:5–30. doi: 10.1016/j.neuroimage.2017.04.014 [DOI] [PubMed] [Google Scholar]
  • 62. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage. 2002;15:273–289. doi: 10.1006/nimg.2001.0978 [DOI] [PubMed] [Google Scholar]
  • 63. Power JD, Barnes KA, Snyder AZ, Schlaggar BL, Petersen SE. Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. NeuroImage. 2012;59:2142–2154. doi: 10.1016/j.neuroimage.2011.10.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Van Dijk KRA, Sabuncu MR, Buckner RL. The influence of head motion on intrinsic functional connectivity MRI. NeuroImage. 2012;59:431–438. doi: 10.1016/j.neuroimage.2011.07.044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65. Satterthwaite TD, Wolf DH, Loughead J, Ruparel K, Elliott MA, Hakonarson H, et al. Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youth. NeuroImage. 2012;60:623–632. doi: 10.1016/j.neuroimage.2011.12.063 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66. Caballero-Gaudes C, Reynolds RC. Methods for cleaning the BOLD fMRI signal. NeuroImage. 2017;154:128–149. doi: 10.1016/j.neuroimage.2016.12.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Edelsbrunner H, Harer J. Computational topology: An introduction. American Mathematical Society; 2010.
  • 68. Fornito A, Zalesky A, Bullmore E. Fundamentals of Brain Network Analysis. New York: Academic Press; 2016. [Google Scholar]
  • 69. Park HJ, Friston KJ, Pae C, Park B, Razi A. Dynamic effective connectivity in resting state fMRI. NeuroImage. 2018;180:594–608. doi: 10.1016/j.neuroimage.2017.11.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Horwitz B, Warner B, Fitzer J, Tagamets MA, Husain FT, Long TW. Investigating the neural basis for functional and effective connectivity. Application to fMRI. Philosophical Transactions of the Royal Society B: Biological Sciences. 2005;360(1457):1093–1108. doi: 10.1098/rstb.2005.1647 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Schlösser R, Gesierich T, Kaufmann B, Vucurevic G, Hunsche S, Gawehn J, et al. Altered effective connectivity during working memory performance in schizophrenia: a study with fMRI and structural equation modeling. Neuroimage. 2003;19(3):751–763. doi: 10.1016/S1053-8119(03)00106-X [DOI] [PubMed] [Google Scholar]
  • 72. Dirkx MF, den Ouden H, Aarts E, Timmer M, Bloem BR, Toni I, et al. The cerebral network of Parkinson’s tremor: an effective connectivity fMRI study. Journal of Neuroscience. 2016;36(19):5362–5372. doi: 10.1523/JNEUROSCI.3634-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73. Giusti C, Ghrist R, Bassett DS. Two’s company, three (or more) is a simplex. Journal of computational neuroscience. 2016;41(1):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74. Reimann MW, Nolte M, Scolamiero M, Turner K, Perin R, Chindemi G, et al. Cliques of neurons bound into cavities provide a missing link between structure and function. Frontiers in computational neuroscience. 2017; p. 48. doi: 10.3389/fncom.2017.00048 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75. Tadić B, Andjelković M, Melnik R. Functional geometry of human connectomes. Scientific reports. 2019;9(1):1–12. doi: 10.1038/s41598-019-48568-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Adler RJ, Bobrowski O, Borman MS, Subag E, Weinberger S. Persistent homology for random fields and complexes. In: Borrowing strength: theory powering applications–a Festschrift for Lawrence D. Brown. Institute of Mathematical Statistics; 2010. p. 124–143.
  • 77.Chung MK, Huang SG, Gritsenko A, Shen L, Lee H. Statistical inference on the number of cycles in brain networks. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE; 2019. p. 113–116. [DOI] [PMC free article] [PubMed]
  • 78. Carlsson G. Topology and data. Bulletin of the American Mathematical Society. 2009;46:255–308. doi: 10.1090/S0273-0979-09-01249-X [DOI] [Google Scholar]
  • 79. Lind PG, Gonzalez MC, Herrmann HJ. Cycles and clustering in bipartite networks. Physical review E. 2005;72:056127. doi: 10.1103/PhysRevE.72.056127 [DOI] [PubMed] [Google Scholar]
  • 80. Mileyko Y, Mukherjee S, Harer J. Probability measures on the space of persistence diagrams. Inverse Problems. 2011;27(12):124007. doi: 10.1088/0266-5611/27/12/124007 [DOI] [Google Scholar]
  • 81. Vallender S. Calculation of the Wasserstein distance between probability distributions on the line. Theory of Probability & Its Applications. 1974;18(4):784–786. doi: 10.1137/1118101 [DOI] [Google Scholar]
  • 82.Mi L, Zhang W, Gu X, Wang Y. Variational Wasserstein clustering. In: Proceedings of the European Conference on Computer Vision (ECCV); 2018. p. 322–337. [DOI] [PMC free article] [PubMed]
  • 83.Mi L, Zhang W, Wang Y. Regularized Wasserstein means for aligning distributional data. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 34; 2020. p. 5166–5173. [DOI] [PMC free article] [PubMed]
  • 84. Panaretos VM, Zemel Y. Statistical aspects of Wasserstein distances. Annual review of statistics and its application. 2019;6:405–431. doi: 10.1146/annurev-statistics-030718-104938 [DOI] [Google Scholar]
  • 85.Kolouri S, Zou Y, Rohde GK. Sliced Wasserstein kernels for probability distributions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016. p. 5258–5267.
  • 86. Conover WJ. Practical Nonparametric Statistics. New York: Wiley; 1980. [Google Scholar]
  • 87. Gibbons JD, Chakraborti S. Nonparametric Statistical Inference. Chapman & Hall/CRC Press; 2011. [Google Scholar]
  • 88. Mosteller F. On some useful “inefficient” statistics. In: Selected Papers of Frederick Mosteller. Springer; 2006. p. 69–100. [Google Scholar]
  • 89. Duong T, Hazelton ML. Cross-validation bandwidth matrices for multivariate kernel density estimation. Scandinavian Journal of Statistics. 2005;32(3):485–506. doi: 10.1111/j.1467-9469.2005.00445.x [DOI] [Google Scholar]
  • 90. O’Neil P, Cheng E, Gawlick D, O’Neil E. The log-structured merge-tree (LSM-tree). Acta Informatica. 1996;33(4):351–385. doi: 10.1007/s002360050048 [DOI] [Google Scholar]
  • 91.Sears R, Ramakrishnan R. bLSM: a general purpose log structured merge tree. In: Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data; 2012. p. 217–228.
  • 92.Morozov D, Weber G. Distributed merge trees. In: Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming; 2013. p. 93–102.
  • 93. Liu T, Seyedhosseini M, Tasdizen T. Image segmentation using hierarchical merge tree. IEEE transactions on image processing. 2016;25(10):4596–4607. doi: 10.1109/TIP.2016.2592704 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Nigmetov A, Morozov D. Local-global merge tree computation with local exchanges. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis; 2019. p. 1–13.
  • 95.Samardzic N, Qiao W, Aggarwal V, Chang MCF, Cong J. Bonsai: High-performance adaptive merge tree sorting. In: 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA). IEEE; 2020. p. 282–294.
  • 96. Thompson PM, Cannon TD, Narr KL, van Erp T, Poutanen VP, Huttunen M, et al. Genetic influences on brain structure. Nature Neuroscience. 2001;4:1253–1258. doi: 10.1038/nn758 [DOI] [PubMed] [Google Scholar]
  • 97. Zalesky A, Fornito A, Harding IH, Cocchi L, Yücel M, Pantelis C, et al. Whole-brain anatomical networks: Does the choice of nodes matter? NeuroImage. 2010;50:970–983. doi: 10.1016/j.neuroimage.2009.12.027 [DOI] [PubMed] [Google Scholar]
  • 98. Nichols TE, Holmes AP. Nonparametric permutation tests for functional neuroimaging: A primer with examples. Human Brain Mapping. 2002;15:1–25. doi: 10.1002/hbm.1058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99. Winkler AM, Ridgway GR, Douaud G, Nichols TE, Smith SM. Faster permutation inference in brain imaging. NeuroImage. 2016;141:502–516. doi: 10.1016/j.neuroimage.2016.05.068 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100. Chung MK, Hanson JL, Ye J, Davidson RJ, Pollak SD. Persistent Homology in Sparse Regression and Its Application to Brain Morphometry. IEEE Transactions on Medical Imaging. 2015;34:1928–1939. doi: 10.1109/TMI.2015.2416271 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Xu F, Garai S, Chung M, Caciagli L, Saykin AJ, Bassett DS, et al. Identifying topological changes of structural connectome in MCI and AD through persistent homology. In preperation. 2021.
  • 102. Haynes W. In: Dubitzky W, Wolkenhauer O, Cho KH, Yokota H, editors. Wilcoxon Rank Sum Test. New York, NY: Springer New York; 2013. p. 2354–2355. Available from: 10.1007/978-1-4419-9863-7_1185. [DOI] [Google Scholar]
  • 103. Cohen-Steiner D, Edelsbrunner H, Harer J. Stability of Persistence Diagrams. Discrete and Computational Geometry. 2007;37:103–120. doi: 10.1007/s00454-006-1276-5 [DOI] [Google Scholar]
  • 104.Chazal F, Cohen-Steiner D, Guibas LJ, Mémoli F, Oudot SY. Gromov-Hausdorff Stable Signatures for Shapes using Persistence. In: Computer Graphics Forum. vol. 28; 2009. p. 1393–1403.
  • 105. Koscik T, O’Leary D, Moser DJ, Andreasen NC, Nopoulos P. Sex differences in parietal lobe morphology: relationship to mental rotation performance. Brain and cognition. 2009;69:451–459. doi: 10.1016/j.bandc.2008.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106. Xu Y, Lindquist MA. Dynamic connectivity detection: an algorithm for determining functional connectivity change points in fMRI data. Frontiers in Neuroscience. 2015;9:285. doi: 10.3389/fnins.2015.00285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107. Rubin LH, Yao L, Keedy SK, Reilly JL, Bishop JR, Carter CS, et al. Sex differences in associations of arginine vasopressin and oxytocin with resting-state functional brain connectivity. Journal of neuroscience research. 2017;95:576–586. doi: 10.1002/jnr.23820 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108. Kovalenko I. Theory of random graphs. Cybernetics. 1971;7(4):575–579. doi: 10.1007/BF01071028 [DOI] [Google Scholar]
  • 109. Barabási AL, Albert R. Emergence of scaling in random networks. science. 1999;286(5439):509–512. doi: 10.1126/science.286.5439.509 [DOI] [PubMed] [Google Scholar]
  • 110. Karoński M, Scheinerman ER, Singer-Cohen KB. On random intersection graphs: The subgraph problem. Combinatorics, Probability and Computing. 1999;8(1-2):131–159. doi: 10.1017/S0963548398003459 [DOI] [Google Scholar]
  • 111. Chung F, Lu L. Connected components in random graphs with given expected degree sequences. Annals of combinatorics. 2002;6(2):125–145. doi: 10.1007/PL00012580 [DOI] [Google Scholar]
  • 112.Leskovec J, Chakrabarti D, Kleinberg J, Faloutsos C. Realistic, mathematically tractable graph generation and evolution, using kronecker multiplication. In: European conference on principles of data mining and knowledge discovery. Springer; 2005. p. 133–145.
  • 113.Murai T, Nakata M, Sato Y. A note on filtration and granular reasoning. In: Annual Conference of the Japanese Society for Artificial Intelligence. Springer; 2001. p. 385–389.
  • 114. Kannan H, Saucan E, Roy I, Samal A. Persistent homology of unweighted complex networks via discrete Morse theory. Scientific reports. 2019;9:1–18. doi: 10.1038/s41598-019-50202-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115. Petri G, Scolamiero M, Donato I, Vaccarino F. Topological strata of weighted complex networks. PloS one. 2013;8(6):e66506. doi: 10.1371/journal.pone.0066506 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116.Stolz BJ, Harrington HA, Porter MA. The topological “shape” of Brexit. arXiv preprint arXiv:161000752. 2016.
  • 117. Stolz BJ, Harrington HA, Porter MA. Persistent homology of time-dependent functional networks constructed from coupled time series. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2017;27(4):047410. doi: 10.1063/1.4978997 [DOI] [PubMed] [Google Scholar]
  • 118. Ignacio PSP, Darcy IK. Tracing patterns and shapes in remittance and migration networks via persistent homology. EPJ Data science. 2019;8(1):1. doi: 10.1140/epjds/s13688-018-0179-z [DOI] [Google Scholar]
  • 119. Nguyen M, Aktas M, Akbas E. Bot detection on social networks using persistent homology. Mathematical and Computational Applications. 2020;25(3):58. doi: 10.3390/mca25030058 [DOI] [Google Scholar]
  • 120. Piangerelli M, Maestri S, Merelli E. Visualising 2-simplex formation in metabolic reactions. Journal of Molecular Graphics and Modelling. 2020;97:107576. doi: 10.1016/j.jmgm.2020.107576 [DOI] [PubMed] [Google Scholar]
  • 121.Giunti B, Houry G, Kerber M. Average complexity of matrix reduction for clique filtrations. arXiv preprint arXiv:211102125. 2021.
  • 122. Topaz CM, Ziegelmeier L, Halverson T. Topological data analysis of biological aggregation models. PLoS One. 2015; p. e0126383. doi: 10.1371/journal.pone.0126383 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123. Solo V, Poline JB, Lindquist M, Simpson SL, Bowman CMK D, Cassidy B. Connectivity in fMRI: a review and preview. IEEE Transactions on Medical Imaging. 2018; p. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124.Chung MK, Smith A, Shiu G. Reviews: Topological Distances and Losses for Brain Networks. arXiv e-prints. 2020; p. arXiv–2102.08623.
  • 125. Bauer U. Ripser: efficient computation of Vietoris–Rips persistence barcodes. Journal of Applied and Computational Topology. 2021;5(3):391–423. doi: 10.1007/s41468-021-00071-5 [DOI] [Google Scholar]
  • 126.Sharathkumar R, Agarwal PK. Algorithms for the transportation problem in geometric settings. In: Proceedings of the twenty-third annual ACM-SIAM symposium on Discrete Algorithms. SIAM; 2012. p. 306–317.
  • 127. Edmonds J, Karp RM. Theoretical improvements in algorithmic efficiency for network flow problems. Journal of the ACM (JACM). 1972;19:248–264. doi: 10.1145/321694.321699 [DOI] [Google Scholar]
  • 128. Kerber M, Morozov D, Nigmetov A. Geometry helps to compare persistence diagrams. Journal of Experimental Algorithmics. 2017;22. doi: 10.1145/3064175 [DOI] [Google Scholar]
  • 129.Chung MK, Xie L, Huang SG, Wang Y, Yan J, Shen L. Rapid Acceleration of the Permutation Test via Transpositions. In: International Workshop on Connectomics in Neuroimaging. vol. 11848. Springer; 2019. p. 42–53. [DOI] [PMC free article] [PubMed]
  • 130. Rieck JR, Baracchini G, Nichol D, Abdi H, Grady CL. Dataset of functional connectivity during cognitive control for an adult lifespan sample. Data in Brief. 2021;39:107573. doi: 10.1016/j.dib.2021.107573 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 131. Rieck JR, Baracchini G, Nichol D, Abdi H, Grady CL. Reconfiguration and dedifferentiation of functional networks during cognitive control across the adult lifespan. Neurobiology of Aging. 2021;106:80–94. doi: 10.1016/j.neurobiolaging.2021.03.019 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Chad M Topaz

20 Jun 2022

PONE-D-22-10228Topological Data Analysis of Brain Networks Through Order StatisticsPLOS ONE

Dear Dr. Chung,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 The first reviewer has serious concerns about the manuscript, and in particular, has stated that the approach is essentially a renamed version of an existing approach (hierarchical clustering). In order to move your manuscript forward, I'd ask you to please address this point directly (both in the paper itself and in a revision letter) either by pointing out how your approach is not identical, thereby refuting the critique, or by modifying your approach accordingly. The second reviewer is more satisfied with the manuscript, but has suggested a number of improvements that you should address.

Please submit your revised manuscript by Jul 19 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Chad M. Topaz

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating the following financial disclosure:

“NO”

At this time, please address the following queries:

a)        Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution.

b)        State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

c)        If any authors received a salary from any of your funders, please state which authors and which funders.

d)        If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. Please expand the acronym “NIH, NSF and NIH” (as indicated in your financial disclosure) so that it states the name of your funders in full.

This information should be included in your cover letter; we will change the online submission form on your behalf.

6. Thank you for stating the following in your Competing Interests section: 

“NO”

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now

 This information should be included in your cover letter; we will change the online submission form on your behalf.

7. Thank you for stating the following in the Acknowledgments Section of your manuscript:

“We like to thank Shih-Gu Huang of National University of Singapore for providing support for fMRI processing. This study is funded by NIH R01 EB02875 and NSF MDS-2010778.”

We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“NO”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

8. Please amend either the title on the online submission form (via Edit Submission) or the title in the manuscript so that they are identical.

9. Please ensure that you refer to Figure 7 in your text as, if accepted, production will need this reference to link the reader to the figure.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this article, the authors describe an order-statistic based approach to classification of brain networks.

1. Is the manuscript technically sound, and do the data support the conclusions?

I cannot recommend this article for publication based on the technical methods used. The analysis is described as an application of topological data analysis (TDA), but the actual tools used are more correctly described in terms of classical hierarchical clustering. Specifically, the authors develop their methods only in the context of the 1D graph, not any enrichment into a simplicial complex. Since they can study only 0D and 1D homology in this setting, and they discard the barcode in favor of lists of birth/death times, it turns out that they are using an impoverished version of hierarchical single linkage clustering, as I will make clear below.

Explicitly, they rely on the classical graph theory fact that, if one removes the (n choose 2) edges of a complete graph in some order, at exactly (n-1) steps, the number of components will increase. Thus, the rest will decrease the number of circuits. As the authors track only the locations of these changes -- the "birth" and "death" times of bars in the 0D and 1D barcode in this very simple case -- as they note, the steps which increase the number of components are the complement of those that decrease the number of circuits. However, this tells us that the data contained in the list of 1D death times is entirely determined by the list of 0D birth times; we simply take the complement in the ordered list (1..(n choose 2)). Thus, the 1D Betti curve they describe contains no information not available using the 0D Betti curve and the size N of the network. The information they retain is the data of the heights of splitting of components in the merge tree, but not the data of which branches are attached to which. As such, the statistic being used in the paper is effectively the expected heights of branching in a random merge tree. I am not sure if this is well-studied in the literature, but it seems like a careful review of the relevant work -- some of it stretching back decades -- should be performed before the authors can claim novelty, and in any case that prior work by the community that studies such objects should be cited. Further, the authors should be careful to cite primary sources for TDA methods; many of the ideas they discuss here first appear in early work of e.g. Kahle on homology of random graphs, and various groups' early work on statistical TDA for data analysis.

In addition, the authors claim that their statistic is useful for reducing the computational burden of topological data analysis. However, on networks of the size the authors are studying, modern software will easily compute persistence diagrams up through degrees three or four on a standard laptop, and much larger networks can be studied on even moderately powerful servers. Thus, the examples in the paper do not serve to demonstrate utility of the method.

Finally, the authors repeatedly claim that this information completely characterizes the "topology" of a graph. If by this they mean that the branching heights of a merge tree are a complete invariant of weighted complete graphs, we can see that this is untrue simply by noting that there are multiple non-isomorphic merge trees with the same list of branch heights: consider a tree with two branches where both attach to the trunk versus one where the shorter branch attaches to the longer.

2. Has the statistical analysis been performed appropriately and rigorously?

The controls and statistical tests appear correctly done to me, but given that the authors do not survey or discuss the literature about statistics on merge trees, it is not clear to me that more appropriate analyses should not have been performed.

4. Is the manuscript presented in an intelligible fashion and written in standard English?

There are several places in the manuscript where careful editing would improve clarity. In particular, the subscripted indices i_a and j_a used in the definition of the order statistic are used for pages without addressing how one would go about finding them, or even acknowledging that the authors have a method for doing so. In addition, the above-mentioned claim about characterizing topology is unclear without further explanation, as are a range of claims made about TDA.

Reviewer #2: Review: Topological Data Analysis of Brain Networks Through Order Statistics

The authors develop order statistics to compute expected Betti curves for the graph filtration of weighted networks. Specifically, they propose the expected topological loss (ETL) as a test statistic. They showcase the ETL on random graphs with 10 nodes and compare it to the maximum gap statistics, the area under the Betti-0 curve, the bottleneck distance, the Gromov-Hausdorff distance, and the Kolmogorov-Smirnov distance. They then apply the ETL to weighted networks with 116 nodes created from resting state fMRI data. Using the approach on the data, they find a statistically significant topological difference between male and female brain networks.

The manuscript is well written and addresses an interesting question. We recommend that the manuscript be accepted with minor revisions (see comments below):

p4: It would be helpful to give the reader an intuition about what you mean by independent cycles. Similarly, a brief explanation how to compute the total number of cycles would be helpful.

p4: Since you mention that you consider the edge weights as the filtration values rather than, for example, relative filtration steps or a normalised filtration - how would such a change in filtration affect your developed statistics?

p4: You only consider edges and nodes in your filtration giving only barcodes in H0 and H1. Could your approach be generalised to a clique filtration, which has in the past also been applied in neuroscience contexts?

p8: Since slight changes in weight distribution significantly change the topology of the network, is the distribution of edge weights in the data comparable enough between different subjects to motivate group level summaries? Does this aspect change when moving from resting state to task-based fMRI data?

p7: Figure 2 is referred to very late in the text. An earlier reference would be helpful for the reader.

p14: What rationale is behind choosing networks that are very small compared to the data? I.e. 10 nodes versus 116?

p17: Has this difference in male and female brain networks been observed in this type of data before?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: ReviewTDABrainStats.pdf

Decision Letter 1

Chad M Topaz

7 Oct 2022

Topological Data Analysis of Brain Networks Through Order Statistics

PONE-D-22-10228R1

Dear Dr. Chung,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Additionally, please note this one small, remaining comment from one of the reviewers. I would ask you to please address this in your finalized manuscript:

Regarding the clarification of independent cycles on p.5 I think there is an error: the complete graph on four vertices should have three independent cycles rather than two (how would you obtain the cycle [W_1]+[W_3]+[W_6] from the two independent cycles given in the example?). Also, it wasn’t entirely clear to me why both G_0 and G_{-\\inf} were used to refer to the complete graph (neither notation was used in Fig. 1). The example would further be much clearer if the complete graph with labelled edges were included in the figure.

Within one week, you’ll receive an e-mail detailing the other required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Chad M. Topaz

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thank you for addressing my comments. Overall, I am happy with the improvements to the manuscript. Regarding the clarification of independent cycles on p.5 I think there is an error: the complete graph on four vertices should have three independent cycles rather than two (how would you obtain the cycle [W_1]+[W_3]+[W_6] from the two independent cycles given in the example?). Also, it wasn’t entirely clear to me why both G_0 and G_{-\\inf} were used to refer to the complete graph (neither notation was used in Fig. 1). The example would further be much clearer if the complete graph with labelled edges were included in the figure.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Acceptance letter

Chad M Topaz

25 Oct 2022

PONE-D-22-10228R1

Topological Data Analysis of Human Brain Networks Through Order Statistics

Dear Dr. Chung:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Chad M. Topaz

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: ReviewTDABrainStats.pdf

    Attachment

    Submitted filename: Response.2022.08.06.pdf

    Data Availability Statement

    The data is available from the public domain HCP database: http://www.humanconnectomeproject.org The code is available at https://github.com/laplcebeltrami/orderstat.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES