Summary
Brain functional connectivity (FC), the temporal synchrony between brain networks, is essential to understand the functional organization of the brain and to identify changes due to neurological disorders, development, treatment, and other phenomena. Independent component analysis (ICA) is a matrix decomposition method used extensively for simultaneous estimation of functional brain topography and connectivity. However, estimation of FC via ICA is often sub-optimal due to the use of ad hoc estimation methods or temporal dimension reduction prior to ICA. Bayesian ICA can avoid dimension reduction, estimate latent variables and model parameters more accurately, and facilitate posterior inference. In this article, we develop a novel, computationally feasible Bayesian ICA method with population-derived priors on both the spatial ICs and their temporal correlation (that is, their FC). For the latter, we consider two priors: the inverse-Wishart, which is conjugate but is not ideally suited for modeling correlation matrices; and a novel informative prior for correlation matrices. For each prior, we derive a variational Bayes algorithm to estimate the model variables and facilitate posterior inference. Through extensive simulation studies, we evaluate the performance of the proposed methods and benchmark against existing approaches. We also analyze fMRI data from over 400 healthy adults in the Human Connectome Project. We find that our Bayesian ICA model and algorithms result in more accurate measures of functional connectivity and spatial brain features. Our novel prior for correlation matrices is more computationally intensive than the inverse-Wishart but provides improved accuracy and inference. The proposed framework is applicable to single-subject analysis, making it potentially clinically viable.
Keywords: functional MRI, independent component analysis, neuroimaging, variational Bayes
1. INTRODUCTION
The widespread availability of functional magnetic resonance imaging (fMRI) technology for obtaining high-resolution images of brain function noninvasively has made it possible to study the function and organization of the human brain in ever-increasing detail. One of the techniques that has proven most useful in this context is independent component analysis (ICA; Hyvarinen et al. 2002). First introduced for blind source separation (McKeown et al. 1998), ICA is a matrix factorization method used for estimating latent spatial signals based on the blood oxygen level dependent (BOLD) signals from fMRI data (Beckmann et al. 2005). The spatial independent components (ICs) from fMRI are believed to represent brain “networks,” or collections of locations that tend to activate in a coordinated manner. By estimating these networks we can identify, for instance, differences in brain network localization between populations of interest.
While early ICA studies in fMRI focused primarily on the spatial ICs, ICA can also be used to study brain functional connectivity (FC), that is the temporal synchrony between networks. FC is based on the correlation between columns of the “mixing matrix” containing the time courses corresponding to each independent component (van de Ven et al. 2004). Compared with anatomical or functional brain atlases traditionally used in FC analyses, ICA deconstructs connectivity into between- and within-network components, providing a richer and more nuanced picture of brain organization (Joel et al. 2011). In addition, ICA has greater flexibility to capture the overlapping, continuous nature of brain functional topography, unlike deterministic atlases with hard boundaries (Bijsterbosch et al. 2018). ICA has been used in a range of scientific investigations to study FC, advancing understanding of autism (Nebel et al. 2014), Alzheimer’s disease (Li et al. 2012), major depression (Greicius et al. 2007), and others. More methodological research in this area is needed, however, since existing ICA methods do not focus on estimating dependence among the columns of the mixing matrix.
One of the historical limitations of nonparametric (eg Hyvarinen et al. 2002) and likelihood-based (Eloyan et al. 2013; Guo and Tang 2013) ICA methods is the assumption of a square and invertible mixing matrix. With few exceptions (eg Risk et al. 2019), most ICA methods require dimension reduction via principal component analysis (PCA) prior to model fitting. The full temporal activation profile associated with each IC is obtained by projecting back to the full temporal dimension, which may not provide optimal estimation.
Bayesian ICA techniques can address this limitation by avoiding the need to invert the unmixing matrix, thereby allowing for rectangular mixing matrices and avoiding dimension reduction (Lawrence and Bishop 2000). Bayesian approaches for ICA additionally facilitate inference on the spatial and/or temporal brain measures based on the posterior distributions of the model parameters. However, fitting hierarchical Bayesian ICA models to high-dimensional fMRI data may be computationally demanding or even impossible. Computationally efficient Bayesian ICA techniques are needed to provide more accurate FC estimation versus standard ICA methods that require a square mixing matrix, while being feasible and practical for fMRI analysis.
We previously proposed a computationally efficient Bayesian ICA approach for fMRI data using known population brain networks and subject-specific topographic deviations modeled as latent variables (Mejia et al. 2020). Here, we extend that model by incorporating multivariate priors on the temporal activity, whose correlation represents the FC between brain networks. Building on our earlier work, wherein we used population-derived priors to inform the spatial configuration of brain networks, here we use population data to build an informative prior on the correlation to encode expected patterns of FC. Thus, in this work we use multiple sources of prior population information (spatial and temporal) to inform the ICA model.
A key scientific advantage of the proposed methods is the ability to estimate unique subject-level functional brain features with high accuracy. The conventional use of population-level atlases can produce biased FC estimates, due to spatial misalignment with the functional topography of a subject’s brain (Bijsterbosch et al. 2018). Such biases may compromise the validity of observed associations between FC and behavior, given that topographic differences are themselves biologically relevant (Kong et al. 2019). Our proposed Bayesian ICA approach can disentangle functional topography and FC to accurately depict functional brain organization and its relationship to disease, development, and treatment. Importantly, the techniques developed here perform well when applied to typical 10 to 15 min fMRI experiments, avoiding the need to collect hours of data (Laumann et al. 2015) to overcome high noise levels.
In the remainder of this article, in Section 2, we present the proposed Bayesian ICA model, describe our novel informative prior for correlation matrices, and derive 2 variational Bayes algorithms for posterior estimation and inference. In Section 3, we present extensive realistic simulation studies to evaluate the performance of the proposed methods versus existing approaches. In Section 4, we analyze test-retest fMRI data to further evaluate our algorithms’ performance and feasibility in real fMRI studies. We conclude with a discussion in Section 5.
2. METHODS
For a single subject, let
be the observed fMRI data, where
is the number of brain locations (voxels or vertices) and
is the number of time points. We assume
is centered across
. A probabilistic ICA model is given by
, where
contains the spatially independent components, the unmixing matrix
contains the temporal activity of each IC, and
is Gaussian white noise. As it is necessary to constrain the scale of
or
for identifiability (Hyvarinen et al. 2002; Eloyan et al. 2013), we constrain the columns of
to have unit variance. Let
represent the
th row of
, and let
represent the
th column of
. Of interest are the spatial ICs
and their functional connectivity (FC)
, defined as the correlation among the columns of
. We refer to the proposed Bayesian ICA model as FC template ICA, and to the model of Mejia et al. (2020) wherein
is treated as a parameter, as template ICA. The first level of the proposed model is
![]() |
(2.1) |
At the second level, we model the unmixing matrix
and the ICs
using population-derived priors. Following our previous work (Mejia et al. 2020), we model
as
![]() |
(2.2) |
where
and
are estimated a priori (Appendix SA), and the
are mutually independent. Here, we further treat
as random via a multivariate prior with covariance
. The full model is
![]() |
where the inverse Gamma (IG) parameters
and
are set to be uninformative. The FC prior
is described below. Note that
is a correlation matrix due to the unit variance constraint.
2.1. Population-derived prior on
No conjugate prior exists for correlation matrices. Existing priors for correlation matrices include the LKJ prior (Lewandowski et al. 2009) and restricted inverse-Wishart (Wang et al. 2018). These are designed for uniform sampling from the space of positive-definite correlation matrices, resulting in an uninformative prior. They therefore do not fulfill our goal of incorporating population information through an informative prior. There is a lack of informative priors for correlation matrices in the literature (Merkle et al. 2023).
Here, we consider 2 choices of informative prior for
, a correlation matrix: (i) a conjugate prior for covariance matrices, the inverse Wishart (IW), centered at a correlation matrix, and (ii) a novel informative prior for correlation matrices based on permuted Cholesky factorizations. During model estimation, we constrain the posterior mean of
to have unit variance to satisfy the identifiability constraint. Note that
is treated as a hyperparameter in the prior on
and
as a hyperprior; we therefore do not update the distribution of
based on
. This is an important distinction, since updating
based on the prior on
, rather than its posterior based on data from a single subject, is in accord with the goal of incorporating population information into estimation of
by shrinking
toward the population mean FC.
To estimate the prior parameters, we require test-retest FC estimates from a set of
training subjects (see Appendix SA). In some cases, we may have access to an appropriate training set from a large, publicly available fMRI database (eg Van Essen et al. 2013; Casey et al. 2018). The training sample should represent a similar population as the focal subject. Alternatively, a holdout portion of the focal study can also be used for training, which has been done successfully in previous work (Gaddis et al. 2022; Derman et al. 2025). As a last resort, one can take an empirical Bayes approach and use the same subjects for parameter estimation and model estimation, recognizing the associated risks of over-fitting and under-estimation of posterior variances.
2.1.1. Inverse Wishart (IW) prior
A convenient choice of prior on
is the IW, since it is conjugate for the multivariate Gaussian prior on
. Let
, where
and
. Using the FC estimates
,
from the training set, we first estimate the element-wise population mean and variance of
,
and
. While for the spatial IC priors we use between-subject variance, here
refers to total variance, since FC is known to vary both between and within subjects. We then estimate the IW parameters
and
via a constrained method of moments (MoM) approach, motivated by a well-known limitation of the IW prior:
controls the variance in an omnibus fashion for all elements of
. The standard MoM estimator of
would likely give rise to an element-wise prior variance smaller than the empirical population variance for some elements. We therefore require that the element-wise prior variance not be less than the empirical variance to avoid an overly informative prior for any element of
.
2.1.2. Permuted Cholesky (pChol) prior
A limitation of assuming an IW prior for a correlation matrix is that the diagonal elements have nonzero variance, so samples from
are unlikely to be correlation matrices. Furthermore, the IW distribution assumes a monotonic relationship between the element-wise mean and variance, which may be unrealistic.
Here, we develop a novel informative prior for correlation matrices that can be used to sample correlation matrices that mimic the element-wise mean and variance in the training sample. This approach utilizes Cholesky decompositions, which have played an important role in modeling correlation and covariance matrices, since ensuring positive definiteness only requires positive diagonal elements (Pourahmadi et al. 2007; Ghosh et al. 2021; Merkle et al. 2023). Our proposed permuted Cholesky (pChol) prior is presented in detail in Appendix SB but is briefly described here. First, consider the naive approach of constructing univariate priors based on the element-wise training set mean and variance. Univariate sampling from these priors would fail to satisfy positive definiteness. However, the Cholesky factorization of correlation matrices,
, only requires (i)
and (ii) row sum of squares
. Consequently, the diagonal and off-diagonal elements are respectively constrained to
and
.
This suggests a simple approach: for each FC estimate
in the training sample, compute the Cholesky factor
, transform each element to
, and sample from univariate priors designed to match the empirical mean and variance of each lower triangular element. After applying the reverse transformations to the sampled values, we only need to rescale to satisfy the sum-of-squares constraint. However, this univariate Cholesky approach has 2 flaws, which we now address. The first flaw is that strong dependencies between the elements of
are not accounted for through univariate priors. To address this, we first perform PCA on the elements of
from the training set. We then assume univariate priors on the PC scores (see Appendix SB). Sampling from those priors produces a sample Cholesky factor
and correlation matrix
.
However, examining the element-wise mean and variance of the resulting correlation matrix samples reveals a second flaw. While the mean of the
is very close to
, their variance exhibits systematic bias, with some elements’ variances being overestimated and others underestimated. The correlation elements that are a function of fewer elements of
(ie the upper-left part of
) have higher variance, while those that are a function of more elements of
(ie the lower-right part of
) have lower variance. This reflects an undesirable ordering effect. To address this, we randomly permute the rows and columns of the training samples
prior to Cholesky factorization, then reverse-permute the samples to obtain sample correlation matrices with the original ordering. In our setting, we find 100 permutations sufficient to mitigate this bias.
Samples from this pChol prior are generated based on this procedure to obtain a set of
samples from
. In our experiments, we sample 500 matrices for each of 100 random permutations, resulting in
. As we describe in the following section, these prior samples will be used to (i) obtain the approximate posterior mean and covariance of
and (ii) to produce posterior samples of
to facilitate inference on the FC matrix
.
2.2. Model estimation
Our previous work relied on expectation-maximization (EM) to estimate the model parameters and conditional posterior moments of the latent variables (Mejia et al. 2020, 2023). Previously
was considered as a parameter, whereas here both
and
are random. As a result, the E-step in EM is not straightforward, involving unknown joint posterior moments of
and
. One option is to use Gibbs sampling at the E-step, but this would be computationally intensive since the sampler must be run at each iteration. Further, many samples may be required to accurately estimate the required high-dimensional moments. Therefore, we consider an alternative approach using variational Bayes (VB) to relax the posterior dependence between
and
.
Using VB, we assume that the joint posterior factorizes over
,
, and
. That is, if
represents all the latent variables, we assume that
. This factorization assumption is fundamental to VB and results in approximate inference. The convergence of the estimators has been studied in various settings, for example see Wang and Titterington (2006) for convergence properties of the estimators for a Gaussian mixture model.
We derive 2 VB algorithms based on the 2 different priors for
described above. Derivation details are given in Appendix SC. The first algorithm, VB1, is based on the IW prior for
. VB1 is very computationally efficient, since it benefits from conjugacy for every approximate posterior. The second, VB2, is associated with our novel pChol prior. It uses a pre-determined set of sample correlation matrices from
to update
. For both VB1 and VB2, the approximate posteriors for
and
have analytical solutions, given as follows.
-
•
factorizes across
, and
is Normal with mean and covariance given by
and 
-
•
with mean
, where
and 
Turning now to
, using the approximate posterior requires integrating over
. However, the 2 choices of prior for
necessitate different integration strategies, which we now describe.
-
•For VB1,
, so the marginal prior
follows a multivariate
distribution with
degrees of freedom. This can be represented as a scale-mixture of Normals: conditional on
,
is Normal with mean zero and covariance
a-priori. Hence, the approximate posterior
is Normal and factorizes over
, with mean
and covariance
, where
,
, and
are approximate posterior moments. Applying laws of total expectation and covariance, we obtain:

which are estimated via Monte Carlo using samples from
. To facilitate inference, we generate samples from the approximate posterior of
using the same samples
: for each
, we draw a sample from
, which collectively form a set of samples from
.
-
•For VB2, we have sample correlation matrices
from the pChol prior
. Conditional on
, the approximate posterior
is Normal and factorizes over
, with mean
and covariance
. Let
. Applying the laws of total expectation and covariance, we obtain

where
refers to the covariance over the
samples. Optionally, we can use an approximation for
(described in Appendix SC) until the final iteration. We obtain samples from the approximate posterior of
similarly to VB1: for each sample
from
, we draw a sample of
,
, which collectively form a set of samples from
.
To facilitate posterior inference on the FC, we first draw samples from
as described above. For VB2, we obtain one sample of
for each
; for VB1, we obtain one sample of
for each Gamma-distributed
. In our analyses, we draw
samples of
in VB1 or
samples of
in VB2. Using these samples, we can estimate and perform posterior inference on the FC matrix
. For instance, we can construct element-wise credible intervals to identify statistically significant FC pairs. While our focus is the FC matrix, these posterior samples of
have other potential uses, such as analyzing FC dynamics and performing inference on dwell time and other metrics.
We initialize the parameter values as follows: we use standard template ICA to produce initial estimates of
and
and the element-wise variance of
. We initialize the residual variance
based on the template ICA residuals. We then iteratively estimate the approximate posteriors until convergence of the posterior estimates of
,
and
.
3. SIMULATION STUDY
We simulate realistic functional MRI data to test the accuracy of the proposed algorithms for FC template ICA (FC-tICA) and compare them with existing approaches. These include our previous template ICA (tICA) model, wherein the temporal mixing matrix is treated as a model parameter rather than a latent variable, and dual regression (DR), a popular ad hoc method. For each method, we quantify the accuracy of the resulting spatial IC maps and temporal FC matrices, with respect to the unique true subject-level spatial maps and FC matrices. We also assess the sensitivity of each method to the duration of the fMRI time series.
3.1. Data generation
Our simulated data was generated using realistic features derived from the Human Connectome Project (HCP) dataset, which is introduced in Section 4 (Van Essen et al. 2013). The generation of subject-specific spatial IC maps is described in Appendix SD.1. Among the 25 HCP group ICA maps, we choose 3 visual components (ICs 1 to 3), one default mode network (DMN) (IC 4), and one motor (IC 5). For each IC, we randomly generate unique subject-level versions containing subtle individual features, a reasonable representation of the differences known to exist between individuals. An example subject’s deviations and ICs are shown in Fig. SD.1.
To generate realistic IC time courses, we use the HCP minimally preprocessed, surface-projected fMRI timeseries from the left-to-right (LR) run of the first visit, which contains 1200 time points (volumes) over 14.4 min. Details of the HCP data processing pipelines can be found in Glasser et al. (2013). We utilize observations from 1,068 subjects with valid data. To obtain IC timeseries for the simulation, we regress the high-pass filtered fMRI data against the 25 HCP group ICs, then select the time courses corresponding to our 5 ICs.
Sample IC time courses are shown in Fig. SD.2, along with their FC matrices. They show the expected patterns of high connectivity within the 3 visual ICs, moderate connectivity between the visual and motor regions, and lower connectivity between the DMN and visuomotor regions. Yet individual differences in FC patterns can also be clearly seen. The population mean and standard deviation of each FC pair across all subjects are shown in Fig. SD.4. The mean FC is similar to the patterns seen in the example subjects. The variance patterns show that all FC pairs exhibit variation across subjects, with more variance for weaker connections.
Finally, we generate synthetic fMRI data for each subject as follows. Let
contain Gaussian white noise with standard deviation
such that the signal-to-noise ratio (SNR)
is equal to 0.5, where
is the average variance of IC time courses scaled by the IC spatial intensity at the peak (top 1% of) vertices. This SNR level is chosen to be similar to real fMRI data. The synthetic fMRI data are then given by
, where
contains the
IC maps and
contains the corresponding IC time courses. We use 500 subjects for template estimation and 50 held-out test subjects to fit the models and evaluate model performance. For the test subjects, the first half (
, 7.2 min) of volumes is used for model estimation, while the second half is reserved to evaluate the predictive accuracy of our FC estimates. We also consider the effect of shorter scan duration, varying
from 200 to 600 volumes.
3.2. Prior and model estimation
We estimate the population priors on the ICs and the FC, as described in Section 2.1. Figure SD.3 shows the estimated prior mean and variance maps for each spatial IC, along with the true (oracle) population mean and variance maps. The prior means closely mimic the true population means. The prior variance mimics the true variance in high-variance areas but is larger in low-variance areas. This is an expected result of our biased non-negative variance estimation approach, which avoids under-estimation of the true variance in favor of a less informative prior.
Figure SD.4 shows the true population mean and variance of each FC pair, along with the prior mean and variance associated with the IW and pChol priors. The prior mean is close to the true population mean for both priors. For the IW prior, the variance is monotonically related to the magnitude of the mean, in contrast to the population. Our conservative estimation of the IW prior variance therefore leads to a relatively uninformative prior, particularly for stronger connections. The variance of the pChol prior, conversely, closely mimics the population variance.
For each of the 50 test subjects, we fit our FC-tICA model using the two proposed VB algorithms, along with the existing methods tICA and DR. For tICA and FC-tICA, we run each algorithm to a tolerance of 0.001 for a maximum of 100 iterations.
3.3. Simulation results
Here, we summarize the performance of FC-tICA versus existing methods. Our primary metric of accuracy is median absolute error (MAE) relative to the subject-specific ground truth values across all 50 test subjects. To assess the predictive accuracy of FC estimates, we use ground truth FC values for each subject based on the held-out half of the simulated session.
Considering first the spatial maps, Fig. SD.5 shows example true and estimated deviation maps for 3 test subjects. Recall that the spatial ICs for each subject are generated as the prior mean plus a subject-level deviation, as described in Section 3.1. Both tICA and FC-tICA identify the unique subject-level spatial features. While these features can also be seen with DR, the estimates exhibit much higher noise levels. Figure SD.6 shows the accuracy of spatial IC maps. FC-tICA and tICA have similar accuracy, with higher error in areas of engagement and lower error in background areas, while the accuracy of DR is much worse.
Turning to the FC matrices, the main focus in this work, Fig. SD.7 displays true and estimated FC matrices for 3 randomly selected subjects. All methods produce visually similar estimates, and idiosyncrasies across subjects can be clearly seen. Figure 1 quantifies the accuracy of FC estimates for each method. The stronger within-network connections, generally of greater interest, are outlined in green on each image. The fourth row/column contains connections with the DMN IC, and the fifth row/column contains connections with the motor IC. Overall, FC-tICA tends to outperform existing methods in terms of predictive accuracy of FC. The advantage of FC-tICA is predominantly in the stronger within-network connections, but is also apparent for some moderate and weak connections. Comparing VB1 and VB2, there is not a clear advantage of one over the other, though VB2 shows somewhat better performance for the stronger within-network connections, suggesting a possible advantage of the pChol prior.
Fig. 1.
Accuracy of FC estimates across 50 simulated test subjects. The first 3x3 submatrix (green box) indicates the stronger connections within the visual network; the fourth row/column of each matrix corresponds to weak connections between the default mode and visual/motor regions; the fifth row/column of each matrix corresponds to connections with the motor network. Accuracy is summarized in terms of median absolute error (MAE). Columns 2 to 4 show the percent change in MAE compared with existing methods. Negative values (blue) indicate improved accuracy. Compared with DR and tICA, both FC-tICA VB algorithms tend to result in higher accuracy, particularly for the stronger within-network correlations (green box). VB1 and VB2 have similar performance, even though they assume different priors on the FC.
Figure 2 and Fig. SD.8 summarize the accuracy of FC estimates by scan duration. Both VB algorithms consistently outperform tICA and DR across scan durations, with VB2 having a slight advantage over VB1 overall. As a preliminary investigation of asymptotic properties as
, and on the influence of the prior for small
, we perform an additional simulation study described in Appendix SD.3. We observe that as
, estimation of FC improves to a point, and that the data dominate the prior even for small
. Therein, we also discuss the complex effects of
.
Fig. 2.
Accuracy of FC estimates by scan duration in simulation study. Accuracy is summarized in terms of median absolute error (MAE), averaged over FC pairs. Appendix Fig. SD.8 shows the pair-specific MAE values by scan duration. As scan duration varies from
volumes (2.4 min) to
volumes (7.2 min), both VB algorithms for FC-tICA outperform the existing methods tICA and DR. VB2 slightly outperforms VB1 for longer scan durations, possibly reflecting a benefit of the permuted Cholesky prior over the inverse-Wishart for modeling correlation matrices.
Finally, we perform Bayesian inference by constructing 95% credible intervals (CIs) for the FC. We obtain posterior samples of
as described in Section 2.2, then compute
for each sample. For each FC pair, we construct a middle 95% CI and evaluate their coverage. Figure SD.9 shows the CI and true FC for the first 10 subjects. We observe that the VB2 intervals include the true in-sample FC value 73% of the time, while the VB1 intervals only do so 12% of the time. This reflects the narrow width of the VB1 CIs (0.015 on average) compared with VB2 (0.12 on average). The risk of posterior variance underestimation, a common problem in VB (Bishop and Nasrabadi 2006), is apparently greater in VB1. Therefore, while VB1 and VB2 produce visually similar estimates, VB2 appears to produce more valid inferences. This suggests an additional benefit of the pChol prior for correlation matrices.
The mean computation time of our 2 VB algorithms for FC-tICA was 2.99 s for VB1 and 100.77 s for VB2, indicating considerably higher computational burden associated with the pChol prior. For comparison, tICA converged in 2.14 s on average. Since tICA is used within FC-tICA to initialize parameter values, the VB1 computations only required an additional 0.85 s. FC-tICA with VB1 therefore represents a highly pragmatic model extension to tICA.
4. EXPERIMENTAL DATA ANALYSIS
In this section, we use fMRI data from the Human Connectome Project (HCP) to evaluate the performance of our proposed FC template ICA model over standard template ICA and to assess the computational feasibility and practicality of the proposed VB algorithms.
4.1. Data processing and analysis
We analyze resting-state fMRI from the HCP 1200-subject release (http:// humanconnectome.org). The HCP fMRI data were collected using a custom multiband acquisition for high spatial and temporal resolution (Van Essen et al. 2013) and were processed according to the HCP minimal preprocessing pipelines, including projection to the cortical surface (Glasser et al. 2013). We avoid spatial smoothing to preserve the functional spatial features of each individual. To reduce the computational burden during model estimation, we resample to approximately
vertices per hemisphere and exclude subcortical regions.
Each HCP participant underwent 4 resting-state fMRI runs across 2 visits. Each run contains 1200 volumes 0.72 s apart over approximately 15 min. At each visit, the 2 runs were acquired using opposite phase encoding directions (LR and RL). To avoid acquisition-related spatial distortions, here we limit analysis to the 2 LR runs per subject. We utilize a version of the released data that has been high-pass filtered and denoised via ICA-FIX (Salimi-Khorshidi et al. 2014). We randomly select 362 subjects for template estimation and 100 subjects for analysis, analyzing in total 924 fMRI runs from 462 subjects.
Group ICA is a prerequisite for estimating the hyperparameters of the population-derived priors in our Bayesian ICA models, as described in Section 2.1. The HCP 500-subject release includes group ICA maps based on nearly 500 subjects. We utilize the HCP 25-component group ICA (see Appendix SE for IC maps and their network memberships). We estimate the prior hyperparameters for the IC maps and FC based on full-resolution test-retest data from the 362 training subjects. Figure SF.12 in Appendix SF illustrates the population-derived priors for the spatial ICs, and Fig. 3 illustrates the 2 population-derived priors for the FC. Note that the variance of the IW prior is generally larger than the population variance. This is by design to an overly informative prior for any FC pair, as described in Section 2.1.1. By contrast, the pChol prior closely mimics the population variance.
Fig. 3.
Population and prior means and standard deviations of functional connectivity (FC) in the HCP analysis. ICs are grouped by network, with abbreviations given in Table SE.1. The prior means closely mimic the population mean FC patterns. For the inverse-Wishart (IW) prior, the prior variance is generally inflated compared with the empirical population variance. This is by design, given that the IW distribution has a single parameter to control the variance across the matrix, and we wish to avoid an overly informative prior for any FC pair (see Section 2.1.1). By contrast, the element-wise variance of our novel pChol prior closely mimics the population variance.
We analyze both visits for each of the 100 test subjects using FC template ICA (FC-tICA) via each of our proposed VB algorithms (VB1 and VB2). We also apply standard template ICA (tICA) to assess the additional benefit of the population-derived priors for the FC in the model. We run all algorithms to a tolerance of 0.001. For better computational efficiency, we set the number of nuisance ICs to estimate and remove prior to model fitting, as described in Mejia et al. (2020), to 200 for all methods. Our open-source templateICAr R package (version 10.0) and R version 4.4.1 are used for all analyses.
4.2. Results
FC-tICA requires approximately 23 min per session using VB1 and 278 min using VB2. By comparison, tICA requires approximately 17 min. These computation times include all preprocessing steps, parameter initialization and model estimation. This shows that FC-tICA with VB1, which uses the IW prior, represents a highly practical model extension to standard tICA. While our pChol prior requires a much greater computational investment, it is computationally feasible in practical settings.
Figure 4 shows estimated FC matrices for 3 example subjects. Unique connectivity features can be seen across subjects and appear quite similar across methods. The last row shows the standard deviation of subject-level estimates around the population mean, an indication of the degree of shrinkage of FC estimates in FC-tICA. The population variance is smaller with FC-tICA compared with tICA, and is smaller for VB2 compared with VB1. This illustrates that the pChol prior for the FC results in more shrinkage toward the population mean, compared with no prior (tICA) or with the less informative IW prior (VB2).
Fig. 4.
Example FC estimates and population variability. For 3 randomly chosen subjects, FC matrices estimated via FC template ICA (FC-tICA) and standard template ICA (tICA) are shown using visit 1 data. The last row shows the standard deviation (SD) of subject-level estimates with respect to the training set population mean, the basis of the FC priors. The SD is lower with VB2, indicating greater shrinkage toward the population mean with our novel pChol prior.
Figure 5 summarizes the reliability of FC in terms of intra-class correlation coefficient (ICC). Without access to the ground truth, test-retest error measures like MSE or MAE can be spuriously improved due to Bayesian shrinkage toward a group mean. By contrast, ICC represents the proportion of variance attributable to unique individual features. Thus, higher ICC indicates improved estimation of unique subject-level FC features. The difference images in the second row show that FC-tICA produces more individually reliable FC estimates compared with standard tICA. Comparing the two FC-tICA VB algorithms, VB2 produces more dramatic improvements for some FC pairs, suggesting an advantage of our pChol prior compared to the IW.
Fig. 5.
Reliability of FC matrices. Values shown are the intra-class correlation coefficient (ICC), that is the proportion of variability in the estimates that represents unique subject-level information. The difference between FC template ICA (FC-tICA) and standard template ICA (tICA) is shown on the second row. Nearly all FC pairs exhibit improved reliability using FC-tICA. The improvement is greater with VB2 versus VB1, suggesting an advantage of our novel pChol prior over the IW at reducing noise levels relative to signal variance.
Turning finally to the spatial IC maps representing functional brain topography, Fig. SF.13 shows example spatial IC estimates and posterior standard deviations for two subjects. Visually, FC-tICA and tICA produce very similar estimates—unsurprising, given that they utilize the same population-derived priors on the spatial IC maps. The individuals’ spatial patterns show some clear differences in the precise locations of engagement, including in the temporal lobe and lateral frontal lobe. To quantify the individuality and reliability of these spatial maps, Fig. SF.14 displays the their vertex-wise intra-class correlation coefficient (ICC). As expected, ICC is higher within areas of engagement for each IC, since “background” regions exhibit little true between-subject variability. Figure SF.15 compares the ICC of FC-tICA and tICA and reveals a subtle improvement with FC-tICA. This suggests that the inclusion of informative priors on the ICA mixing matrix in FC-tICA may have downstream benefits for estimation of the spatial ICs.
5. DISCUSSION
In this article, we develop a computationally efficient Bayesian ICA framework for subject-level analysis of functional MRI data leveraging population information on spatial topography and functional connectivity (FC), an important measure of brain function. We employ population-derived priors on both the latent spatial source signals and their associated temporal activity, which can improve single-subject analysis and reduce the effects of high noise levels in fMRI data. We propose a new informative prior for correlation matrices, which can be used to draw samples that exhibit a desired mean and variance structure. To our knowledge, no similarly informative prior for correlation matrices has been proposed previously in the literature. This novel pChol prior has many potential applications within and beyond neuroimaging in settings where the within-subject correlation between variables is of interest and prior information is available.
Through extensive simulation studies and analysis of a large fMRI dataset, we show that the proposed techniques outperform 2 existing methods: our earlier Bayesian ICA model with priors on spatial topography alone, and dual regression, an ad hoc method popular in practice. We chose these 2 benchmark methods because they can also be used to analyze single-subject data to generate subject-level versions of IC maps matched to an established group ICA atlas and the FC between them. Other methods, such as hierarchical ICA and single-subject ICA, are not considered here because they either cannot be applied to single-subject data or do not produce ICs matched to established ICA atlases. Both of these requirements are essential for a method with clinical applicability, which is our motivation here. The proposed methods are computationally efficient, presenting a realistic alternative to ad hoc methods.
Compared with existing ICA methods, our Bayesian ICA model has several advantages. First, it allows for a rectangular mixing matrix, avoiding dimension reduction and reducing the risk of eliminating relevant signals (Risk et al. 2019). Retaining the full richness of the temporal signals is necessary for precise estimation of the FC. Second, inference is possible through the posteriors, unlike in ad hoc approaches or machine learning algorithms. Identifying significantly engaged brain locations, or significant functional connectivity pairs, provides a convenient way to summarize ICA results or to identify promising features for biomarker development.
Bayesian ICA also has a scientific advantage over the popular ad hoc method dual regression. Dual regression obtains subject-level IC time courses, and hence FC, based on group-average IC maps. Misalignment between the individual and group averages may induce systematic bias into FC estimates. Recent work has suggested that functional topography is highly individualized (see Fig. SF.14) and that observed differences in FC may be driven by unaccounted-for differences in spatial topography (Bijsterbosch et al. 2018). Along with FC, topography is biologically relevant (Kong et al. 2019). It is therefore important to disentangle subject-level functional topography from true FC differences, which is possible using Bayesian ICA.
A limitation of our variational Bayes algorithms is the poor coverage of the FC credible intervals observed in our simulation studies. While this is not surprising given the known issue of posterior variance underestimation with VB, we do not recommend the use of these credible intervals for inference, particularly if using the IW prior as in VB1. The use of our novel pChol prior results in much better coverage, although there is still room for improvement. One possible reason for the poor coverage of the credible intervals is failure to account for spatial dependencies in the IC maps
. Previously we developed a Bayesian ICA model with spatial priors on
(Mejia et al. 2023). Future work should focus on incorporating spatial priors into this model, a computationally burdensome extension, but one which may be worthwhile to facilitate valid inference at the individual level. For now, we recommend combining ICA results from multiple subjects to perform inference on group averages, group differences, and covariate effects of FC.
While here we consider FC to be fixed throughout the session, there is growing interest in “dynamic” or time-varying FC (Lindquist et al. 2014). Our Bayesian ICA framework produces IC time courses that can be used for downstream dynamic FC analyses. Furthermore, we can obtain posterior samples of
, which can be used to perform Bayesian inference on dynamic FC metrics like dwell times, particularly if future work produces algorithms that better quantify posterior uncertainty. Alternatively, it may be possible to explicitly model dynamic FC within the Bayesian ICA model by introducing a time-varying latent FC state.
One potential application of the proposed framework is for the analysis of small studies. If the focal study population is similar to that of a large repository like the HCP, it may be reasonable to apply an externally-derived prior even if the acquisition and processing protocols differ, since the population-derived priors are designed to encode the population distribution of latent brain features, not noise properties. A thorough investigation of the performance of externally-derived priors is warranted in future work. In other contexts, it may be more appropriate estimate study-specific priors, as we have done previously (Gaddis et al. 2022; Derman et al. 2025). An interesting alternative is a hierarchical ICA framework, wherein externally-derived priors would be updated based on the data to better represent the specific population or groups being analyzed. This would also facilitate comparing groups and accounting for covariates.
This study has several limitations that should be addressed in future work. First, we have not investigated the biological relevance of the functional brain features we obtain, an important next step. Second, our model assumes temporal residual independence. In our experience, this assumption is fairly reasonable in ICA due to the high number of neural and artifactual signals being accounted for, but this assumption should be checked. Prewhitening, common in task fMRI models, could be a simple solution. Third, our framework does not account for covariates such as age and sex. Doing so at the stage of prior estimation could improve model performance by accounting for some of the between-subject variability, thus reducing prior variance. We are working to account for covariates in future extensions of the model. Finally, here we have analyzed a single-site study of healthy young adults. More complex datasets, including multi-site datasets and those representing heteogeneous populations, may require additional nuance and care.
As a final point, here we have not performed a thorough investigation of the asymptotic properties of our estimators. Prior theoretical work in ICA mostly considers the effects of
on convergence of the square unmixing matrix (Eloyan and Ghosh 2013; Risk et al. 2019). The effects of
are rarely considered, since temporal dimension reduction via PCA is almost always performed as a pre-processing step, in contrast to our context where the temporal dimension is retained. If
or
, this increases not only the sample size, but the number of temporal (or spatial) features that need to be estimated, complicating the asymptotics. If we instead focus on estimation of the FC, the dimensionality is fixed, which may provide a more promising avenue for asymptotic investigation. While this is out of the scope of the current manuscript, it is an important future direction.
Supplementary Material
Contributor Information
Amanda F Mejia, Department of Statistics, Indiana University, 729 E 3rd Street, Bloomington, IN, 47405, United States.
David Bolin, Statistics Program, Computer, Electrical and Mathematical Sciences and Engineering Division, King Abdullah University of Science and Technology, Thuwal, Makkah, 23955, Saudi Arabia.
Daniel A Spencer, Department of Statistics, Indiana University, 729 E 3rd Street, Bloomington, IN, 47405, United States.
Ani Eloyan, Department of Biostatistics, Brown University, 121 S Main Street, Providence, RI, 02903, United States.
SUPPLEMENTARY MATERIAL
Supplementary material is available at Biostatistics Journal online.
FUNDING
This work was supported by the National Institutes of Health through the National Institute on Aging (R01AG083919 to AFM and R01AG075511 to AE) and the National Institute of Biomedical Imaging and Bioengineering (R01EB027119) to AFM and AE.
CONFLICT OF INTEREST
None declared.
DATA AVAILABILITY
Code reproducing the simulation and experimental data analysis is available at the following Github repository: https://github.com/mandymejia/FC-TemplateICA-paper/. The R package templateICAr is available on Github (https://github.com/mandymejia/templateICAr) and CRAN (https://cran.r-project.org/web/packages/templateICAr/index.html).
References
- Beckmann CF, DeLuca M, Devlin JT, Smith SM. 2005. Investigations into resting-state connectivity using ICA. Philos Trans R Soc Lond B Biol Sci. 360:1001–1013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bijsterbosch JD et al. 2018. The relationship between spatial configuration and functional connectivity of brain regions. eLife. 7:e32992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bishop CM, Nasrabadi NM. 2006. Pattern recognition and machine learning. Vol. 4. Springer. [Google Scholar]
- Casey BJ et al. 2018. The adolescent brain cognitive development (ABCD) study: imaging acquisition across 21 sites. Dev Cogn Neurosci. 32:43–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Derman D, Pham DD, Mejia AF, Ferradal SL. 2025. Individual patterns of functional connectivity in neonates as revealed by surface-based Bayesian modeling. Imaging Neurosci. 3:imag_a_00504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eloyan A, Crainiceanu CM, Caffo BS. 2013. Likelihood-based population independent component analysis. Biostatistics. 14:514–527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eloyan A, Ghosh SK. 2013. A semiparametric approach to source separation using independent component analysis. Comput Stat Data Anal. 58:383–396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gaddis A et al. 2022. Psilocybin induces spatially constrained alterations in thalamic functional organizaton and connectivity. Neuroimage. 260:119434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ghosh RP, Mallick B, Pourahmadi M. 2021. Bayesian estimation of correlation matrices of longitudinal data. Bayesian Anal. 16:1039–1058. [Google Scholar]
- Glasser MF et al. 2013. The minimal preprocessing pipelines for the human connectome project. Neuroimage. 80:105–124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greicius MD et al. 2007. Resting-state functional connectivity in major depression: abnormally increased contributions from subgenual cingulate cortex and thalamus. Biol Psychiatry. 62:429–437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guo Y, Tang L. 2013. A hierarchical model for probabilistic independent component analysis of multi-subject fMRI studies. Biometrics. 69:970–981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hyvarinen A, Karhunen J, Oja E. 2002. Independent component analysis. Stud Inf Control. 11:205–207. [Google Scholar]
- Joel SE, Caffo BS, Van Zijl PC, Pekar JJ. 2011. On the relationship between seed-based and ICA-based measures of functional connectivity. Magn Reson Med. 66:644–657. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kong R et al. 2019. Spatial topography of individual-specific cortical networks predicts human cognition, personality, and emotion. Cereb Cortex. 29:2533–2551. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Laumann TO et al. 2015. Functional system and areal organization of a highly sampled individual human brain. Neuron. 87:657–670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lawrence ND, Bishop CM. 2000. Variational Bayesian independent component analysis. Univ of Cambridge Tech Report.
- Lewandowski D, Kurowicka D, Joe H. 2009. Generating random correlation matrices based on vines and extended onion method. J Multivar Anal. 100:1989–2001. [Google Scholar]
- Li S et al. 2012. Analysis of group ICA-based connectivity measures from fMRI: application to Alzheimer’s disease. PLoS One. 7:e49340. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lindquist MA, Xu Y, Nebel MB, Caffo BS. 2014. Evaluating dynamic bivariate correlations in resting-state fMRI: a comparison study and a new approach. Neuroimage. 101:531–546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McKeown MJ et al. 1998. Analysis of fMRI data by blind separation into independent spatial components. Human Brain Mapping. 6:160–188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mejia AF et al. 2023. Template independent component analysis with spatial priors for accurate subject-level brain network estimation and inference. J Comput Graph Stat. 32:413–433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mejia AF, Nebel MB, Wang Y, Caffo BS, Guo Y. 2020. Template independent component analysis: targeted and reliable estimation of subject-level brain networks using big data population priors. J Am Stat Assoc. 115:1151–1177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merkle EC, Ariyo O, Winter SD, Garnier-Villarreal M. 2023. Opaque prior distributions in Bayesian latent variable models. Methodol Eur J Res Methods Behavioral Soc Sci. 19:228–255. [Google Scholar]
- Nebel MB, Eloyan A, Barber AD, Mostofsky SH. 2014. Precentral gyrus functional connectivity signatures of autism. Front Syst Neurosci. 8:80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pourahmadi M, Daniels MJ, Park T. 2007. Simultaneous modelling of the Cholesky decomposition of several covariance matrices. J Multivar Anal. 98:568–587. [Google Scholar]
- Risk BB, Matteson DS, Ruppert D. 2019. Linear non-Gaussian component analysis via maximum likelihood. J Am Stat Assoc. 114:332–343. [Google Scholar]
- Salimi-Khorshidi G et al. 2014. Automatic denoising of functional MRI data: combining independent component analysis and hierarchical fusion of classifiers. Neuroimage. 90:449–468. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van de Ven VG, Formisano E, Prvulovic D, Roeder CH, Linden DE. 2004. Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest. Hum Brain Mapp. 22:165–178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Essen DC et al. ; WU-Minn HCP Consortium. 2013. The WU-Minn human connectome project: an overview. Neuroimage. 80:62–79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang B, Titterington DM. 2006. Convergence properties of a general algorithm for calculating variational Bayesian estimates for a normal mixture model. Bayesian Anal. 1:625–650. [Google Scholar]
- Wang Z, Wu Y, Chu H. 2018. On equivalence of the LKJ distribution and the restricted Wishart distribution [preprint]. arXiv, arXiv:1809.04746.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Code reproducing the simulation and experimental data analysis is available at the following Github repository: https://github.com/mandymejia/FC-TemplateICA-paper/. The R package templateICAr is available on Github (https://github.com/mandymejia/templateICAr) and CRAN (https://cran.r-project.org/web/packages/templateICAr/index.html).








