Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Oct 15.
Published in final edited form as: Neuroimage. 2013 Apr 28;80:505–514. doi: 10.1016/j.neuroimage.2013.04.073

Networks of Task Co-Activations

Angela R Laird 1, Simon B Eickhoff 2,3, Claudia Rottschy 2,4, Danilo Bzdok 2, Kimberly L Ray 5, Peter T Fox 5,6
PMCID: PMC3720689  NIHMSID: NIHMS473903  PMID: 23631994

Abstract

Recent progress in neuroimaging informatics and meta-analytic techniques has enabled a novel domain of human brain connectomics research that focuses on task-dependent co-activation patterns across behavioral tasks and cognitive domains. Here, we review studies utilizing the BrainMap database to investigate data trends in the activation literature using methods such as meta-analytic connectivity modeling (MACM), connectivity-based parcellation (CPB), and independent component analysis (ICA). We give examples of how these methods are being applied to learn more about the functional connectivity of areas such as the amygdala, the default mode network, and visual area V5. Methods for analyzing the behavioral metadata corresponding to regions of interest and to their intrinsically connected networks are described as a tool for local functional decoding. We finally discuss the relation of observed co-activation connectivity results to resting state connectivity patterns, and provide implications for future work in this domain.

Keywords: meta-analysis, co-activations, task co-occurrence, BrainMap, intrinsic connectivity networks, functional brain networks, functional connectivity, resting state networks, neuroinformatics

Introduction

The study of connectomics predominantly involves investigation of the functional and structural connectivity of the human brain through the use of functional magnetic resonance imaging (FMRI), diffusion tensor imaging (DTI), and structural MRI. To this end, a massive amount of data is being acquired, analyzed, and published to provide a more complete understanding of the organization and interactions between cortical and subcortical brain regions that enable human cognition. Prominent and valued databasing projects include BrainMap (http://brainmap.org; Fox and Lancaster, 2002; Laird et al., 2005a), Neurosynth (http://neurosynth.org; Yarkoni et al., 2011), OpenfMRI.org, 1000 Functional Connectomes/INDI (Mennes et al., 2013a), the Human Connectome Project (Van Essen et al., 2013), BIRN (Keator et al., 2008; Fennema-Notestine, 2009), OASIS (Marcus et al., 2007a), and XNAT Central (Marcus et al., 2007b). Two decades of progress in neuroinformatics research is now coming to fruition, as these databases are being used to aggregate, synthesize, and mine the collective work of the neuroimaging community. Many of these projects archive resting state FMRI (rs-FMRI), DTI, or structural MRI data, but others focus on neuroimaging results acquired during activation studies. While these data are less recognized in connectomics discussions, the repositories of the task-based FMRI and PET literature offer significant opportunity to expand our knowledge of task-dependent functional connectivity.

Here, we review studies describing task co-activation networks, which identify and examine networks of brain regions that are consistently observed to activate in coordination with each other across a range of experimental neuroimaging tasks and paradigms. These networks are derived from meta-analytic methods, in which sets of activation patterns are extracted across multiple published studies in the form of three-dimensional stereotactic coordinates and assessed for convergent spatial locations. We review a range of meta-analytic techniques for investigation of task co-activation networks, from meta-analytic connectivity modeling (MACM) that examines seed-based co-activations for a user-defined region of interest, to connectivity-based parcellation (CBP) that computes these MACM patterns at the level of voxels and investigates their similarity using clustering techniques, to independent component analysis (ICA) of large scale brain networks archived in a task activation database. We also address how activation databases may allow functional interpretation of regions or networks of interest via forward or reverse inference methods. While the methodology differs, each of these methods have been developed to provide a more complete understanding of functional connectivity, but in the context of while active during a range of goal-directed tasks.

Many of these approaches have been implemented in conjunction with the BrainMap database, which has been a key resource for developing and applying meta-analytic methods in both healthy and clinical populations across a range of behavioral conditions examining action, cognition, emotion, perception, and interoception (Laird et al., 2009a). The BrainMap database was created in 1988 and has been in steady development since. In addition to published three-dimensional stereotactic coordinates in Talairach (Talairach and Tournoux, 1988) or MNI (Evans et al., 1993; Collins et al., 1994) space that both standardize and summarize the spatial locations of brain activations, BrainMap also archives extensive metadata that furnish formalized descriptions of a study’s experimental design, including subject population and behavioral task conditions, as well as relevant details of imaging and analysis parameters (Fox et al., 2005). Given the prior success of BrainMap to provide a schema of annotations for functional neuroimaging studies, this metadata taxonomy was eventually extended into a cognitive paradigm ontology (CogPO; Turner and Laird, 2012) for use by other databasing projects.

The introduction of a coordinate-based meta-analysis method by Turkeltaub et al. in 2002 led to dramatic increases in the utility and application of BrainMap. This algorithm allowed neuroimagers interested in pooling brain activation patterns to assess groups of studies for consistency and spatial convergence. Since then, the activation likelihood estimation (ALE) method has gone through several iterations of improvements and extensions (Laird et al., 2005b; Eickhoff et al., 2009; 2011; 2012; Turkeltaub et al., 2012), and has been applied in currently over 200 published meta-analyses across a wide range of cognitive neuroscience topics. ALE meta-analyses can be performed using the BrainMap GingerALE application (http://brainmap.org/ale).

Meta-Analytic Connectivity Modeling

The majority of published ALE meta-analyses are carried out by domain experts who limit their literature searches to an often-narrow set of inclusion criteria, which are focused on specific paradigms of interest. Instead of limiting such synthesis of studies to a particular domain, other meta-analytic approaches have sought to examine functional co-activations of a given region of interest across a domain-arching pool of studies examining different mental tasks and functions (Koski and Paus, 2000; Postuma and Dagher, 2006). This general concept was extended across the whole brain and applied to a larger corpus of the literature when Toro et al. (2008) mined 3,402 experiments (published in a total of 825 scientific papers) in the BrainMap database and seeded regions to identify the corresponding whole-brain co-activation profile of these seeds. Thus for every voxel in stereotactic space, they produced a meta-analytic co-activation image that contained a complete three-dimensional volume of that voxel’s individual co-activations with the whole brain, yielding nearly 45,000 individual brain volumes (one for every 4mm3 voxel in the brain). The result was a query tool that allowed a user to graphically specific a region of interest and be shown an image of which regions co-activate with that seed location. Toro et al. noted that the individual meta-co-activation maps were strongly similar to seed-based correlation maps derived from rs-FMRI data, and many of the volumes presented complex patterns of cortical and subcortical regions of co-activation. Given that a group of regions consistently reported to concurrently change activity across various experiments associated with coordinated execution of mental goals, the authors followed that they therefore were functionally connected. Using this method, Toro et al. were able to recover canonical functional brain networks of many cognitive domains, such as the cortico-diencephalo-cerebellar motor network, the default mode network, and the fronto-parietal attention network. Notably, these co-activation maps demonstrated some of the brain’s fundamental connectivity principles, such as a higher degree of connectivity in the near-neighborhood of the seed region, as well as symmetric interhemispheric connections (Figure 1). This study was the first to propose that meta-analytic co-activations provide a novel measure of functional connectivity, which reflects task-based activations, and is therefore complementary to resting state correlations. Source code for a co-activation map graphic user interface has been made available for this work, available at http://coactivationmap.sourceforge.net.

Figure 1. Meta-Analytic Maps Demonstrating Symmetric Interhemispheric Co-Activations.

Figure 1

In one of the first applications that examined task-based functional connectivity patterns using a database approach, a graphical user interface was created that allowed users to specify a seed location, which produced a corresponding whole-brain meta-analytic co-activation profiles. Co-activation networks corresponding to seed locations voxels are shown. Seed regions in a given hemisphere generally showed strong co-activation with symmetric regions in the opposite hemisphere, as shown for volume reconstructions (A, B) as well as specific slices in the axial (C) and coronal planes (D). Seed locations are indicated by the white squares seen in the slice images. For more details, see http://coactivationmap.sourceforge.net and Toro et al. (2008).

Once it was established that meta-analytic task co-occurrences provide an alternate means to examining functional connectivity, a new method was introduced for interrogation of whole brain co-activation patterns of user-defined seed regions, which was termed meta-analytic connectivity modeling (MACM). The first step of performing MACM on a region of interest is to filter a task activation database, such as BrainMap or NeuroSynth, for those experiments that feature at least one focus of activation within the seed region. Only studies reporting group analyses of functional mapping experiments of healthy subjects should be considered in the search, while those dealing with disease or drug effects or any other between-subject comparison should be excluded. For the analysis of significant co-activations and task-dependent functional connectivity, a meta-analysis, such as activation likelihood estimation, is performed over all foci of the retrieved experiments to quantify their convergence. As all of the experiments are identified in the database by virtue of featuring at least one activation within the seed region, the highest degree of convergence will inevitably be found in that region. Significant convergence outside the seed indicates the above-chance recruitment of additional areas whenever the seed was active, i.e., significant co-activation. MACM was first applied to provide new insight into the task-based functional connectivity of regions of the default mode network (Laird et al., 2009b), the amygdala (Robinson et al., 2010) and the parietal operculum (Eickhoff et al., 2010). This approach is part of the growing field of investigations into the functional connectivity of specific pre-defined seed regions. Such studies usually start with an anatomically (by external knowledge of histological or macroscopical brain architecture) or functionally (by activation information from prior neuroimaging experiments or meta-analyses) defined region of interest, often derived from a previous study (Jakobs et al., 2012). The aim of seed-based connectivity mapping is to identify brain regions that are significantly related to and presumably interact with the seed.

In Laird et al. (2009b), regions of the default mode network (DMN) were isolated from in the BrainMap database by performing an ALE meta-analysis of all coordinates reported as task-related decreases during cognitive subtraction experiments using rest or fixation as a control condition. Once identified, these regions of convergence deactivation were then individually seeded and analyzed using MACM to identify their whole-brain co-activation patterns in the context of task-related increases, which included both within-DMN and non-DMN connections. Figure 2 illustrates how the network of task-related decreases showed substantial overlap with a seed region’s co-activation network for some regions (e.g., posterior cingulate cortex and right middle temporal gyrus), while other seeds demonstrated minimal overlap (e.g., right inferior parietal cortex and ventral anterior cingulate cortex). This suggested increased or reduced coherence, respectively, between a region’s role in DMN functioning and their role in task-based activity across a range of behavioral conditions (Laird et al., 2009b).

Figure 2. Meta-Analytic Connectivity Modeling.

Figure 2

Composite images are shown of the meta-analytic default mode network of task-related decreases (blue) and MACM maps of task-related increases for each seed region of the DMN (red). Substantial overlap was observed for some regions (e.g., PCC and RMTG), while other regions showed minimal overlap (e.g., RIPL and vACC). For more details, see Laird et al. (2010).

The MACM approach can also be applied as a means to investigate the functional interactions of histologically defined areas to provide a link between (micro-) structure, function, and connectivity (Eickhoff et al., 2010; Bzdok et al., 2013). Alternatively, a key application is the characterization of morphometric findings, i.e., brain regions showing atrophy in a particular group of patients or a significant association with a particular behavioral trait (Reetz et al., 2012). Such findings are as commonplace in the literature as they are difficult to interpret. The main challenge lies in the fact that the investigation used to provide the respective effect (usually some form of voxel-based morphometry or cortical thickness mapping) does inherently not contain any information about the function or connectivity associated with the respective findings, opening the door for subjective and hence potentially biased reverse inference (Poldrack, 2006). MACM analyses can be performed using the BrainMap Sleuth (http://brainmap.org/sleuth) and GingerALE applications (http://brainmap.org/ale); alternatively, co-activation maps can be generated within the web interface of the NeuroSynth Project (http://neurosynth.org).

Connectivity-Based Parcellation

A new and still developing extension of MACM analyses is its application to connectivity-based parcellation (CBP) as an approach to identify functionally homogenous sub-clusters of voxels within a seed region. The key idea behind CBP is to perform whole-brain connectivity analysis individually for each and every voxel within the seed region of interest. The connection strength of all other voxels in the brain are then recorded and aggregated into an Ns × Nt connectivity matrix, with Ns being the number of voxels in the seed region and Nt the number of voxels in the rest of the brain serving as the target. The difference in these whole-brain connectivity profiles is then computed between any pair of voxels with the seed region, yielding a distance matrix reflecting the dissimilarity between all different seed voxels (cf. Johansen-Berg et al., 2004 for an early implementation of this idea). The next step in a CBP analysis is to cluster the seed voxels into distinct groups in such a manner that the voxels within a cluster feature a similar whole brain connectivity pattern, whereas the patterns of the different clusters are maximally different. The actual clustering method has, however, varied greatly over studies. Early applications have used a semi-automated approach based on spectral reordering of the distance matrix (Johansen-Berg et al., 2004; Kelly et al., 2010), while later applications have used k-means (Nanetti et al., 2009; Kim et al., 2010; Cauda et al., 2011; Kahnt et al., 2012) or hierarchical clustering analysis (Cordes et al., 2002; Bellec et al., 2006; Bzdok et al., 2013).

It is important to note that the CBP approach described above is completely independent of the modality on which the whole-brain connectivity profiles are based. While originally described for anatomical connectivity measures based on diffusion-weighted images (Johansen-Berg et al., 2004) and resting state functional connectivity (Cordes et al., 2002; van den Heuvel et al., 2008; Kelly et al., 2010; Kim et al., 2010), the very same concept may also be applied to task-based functional connectivity measures, i.e., MACM. Similar to procedures employed in the other modalities mentioned above, the whole-brain co-activation pattern is first computed for each voxel within the seed region. Subsequently, a distance matrix is computed, indicating the degree of dissimilarity between the co-activation profiles of each voxel. Finally, the voxels are clustered into distinct sub-regions of the original seed based on this information. In order to characterize the differences in whole-brain co-activation patterns between the ensuing clusters and hence the variations in connectivity that drove the parcellation of the seed region, follow-up MACM analyses are usually performed using the derived clusters as seeds. MACM-CBP is a relatively new technique for identifying connectivity-based sub-regions of a seed volume, but has already provided new insight into the functional segregation of the pre-SMA and SMA (Eickhoff et al., 2011), dorsolateral prefrontal cortex (Cieslik et al, 2013), and the amygdala (Bzdok et al., 2013). Using this technique, Figure 3 illustrates the remarkable correspondence observed between cytoarchitectonic-(left) and connectivity- (right) based parcellations of the amygdala into the laterobasal, centromedial, and superficial nuclei groups. The study by Bzdok et al. 2013) is an excellent example of how newly developed neuroimaging analysis methods are providing the means to investigate concurrence across structural, connectional, and functional sub-specialization, which is critical for progress in connectomics research.

Figure 3. Connectivity-Based Parcellation.

Figure 3

Both cytoarchitectonic (left) and connectivity-based (right) parcellation analyses were performed, yielding a strong agreement in spatial continuity and localization for sub-regions corresponding to the laterobasal (blue), centromedial (red), and superficial (green) nuclei groups. For more details, see Bdzok et al. (2013).

Discovery of ICA-Derived Co-Activation Networks

The early correlational work of Biswal et al. (1995) provided a tantalizing hint that functionally connected networks could be studied in resting state FMRI data. During the mid to late 2000’s an increasingly large group of neuroimagers became intrigued by the investigation of resting state networks (RSNs) derived from independent component analysis (ICA) of rs-FMRI data. With the advent of ICA to the neuroimaging community, the trend of studying individual seed-based networks was broadened to utilize resting state data to simultaneously investigate many of the brain’s functionally connected RSNs at once (Beckmann et al., 2005; Damoiseaux et al., 2006). Using ICA, FMRI data are decomposed into sets of d networks, which typically range from a low model order (e.g., d = 20) to a high model order (e.g., d = 100). Generally speaking, low model ICA decompositions provide a broad assessment of large-scale resting state networks, while high model decompositions offer more finely-grained examination of these networks, yet also provide a more complete understanding of the complexities associated with how the low model order networks fractionate into higher model order sub-networks as d is increased (Abou-Elseoud et al., 2010).

Given evidence that the brain’s functional networks could be extracted from correlations of co-activation data (Toro et al., 2008), and the first set of results provided by MACM (Laird et al., 2009b; Robinson et al., 2010; Eickhoff et al., 2010), it was hypothesized that meaningful inferences could be made across a broad range of functional brain networks by direct comparison of co-activation networks with resting state networks. Thus, in a seminal publication, Smith et al. (2009) independently applied ICA to two types of data: first, from data acquired during rs-FMRI in 36 individual subjects, and second, to group results of task activation patterns from 7,342 neuroimaging experiments (1,687 publications) archived in the BrainMap database. For the BrainMap data, co-occurrence of different activation locations was investigated across the range of tasks in the database by using ICA to estimate the low model order (i.e., d = 20) set of spatial maps and associated time series of the major networks of covariance in the brain. When ICA is applied to BrainMap data, which are 3D sets of Gaussian modeled activation images, the fourth dimension of the data matrix analyzed refers “experiment ID” (rather than “time” in rs-FMRI data), such that each time point in one component’s “time course” describes how strongly the observed spatial map relates to that particular experiment’s activation image in BrainMap. When the results of these independent analyses were compared using spatial Pearson cross correlation, Smith et al. demonstrated that over two-thirds of the non-artifactual networks at d = 20 matched across resting state and task-based conditions (e.g., 10 of 20 components), and that functional characterization of these networks was possible using BrainMap metadata. These networks have also been extracted from the NeuroSynth database (Yarkoni et al., 2011) using a topic mapping approach (Poldrack et al., 2012), adding to the evidence that these networks represent fundamental components of the brain’s functional architecture. Moreover, when the BrainMap task networks were closely examined by Laird et al. (2011) in comparison to the ICA-derived resting state networks observed by Biswal et al. (2010), it was shown that the degree of correspondence across the sets of resting state and task co-activation networks increased from the initial estimate provided by Smith et al. (2009). Indeed, 12 of the non-artifactual components were an excellent match to those published by Biswal et al., whereas four components were a close partial match. This improved rate of agreement was attributed to the greater sample size studied, which was increased from 36 subjects in Smith et al. (2009) to 306 subjects in Biswal et al. (2010). Ongoing work is being carried out to assess the degree of agreement for higher model orders (e.g., d = 70, 100, etc.). Regardless, the Smith et al. (2009) study demonstrated that the major task-based functional networks in the active brain show similar organization to those of the majority of the networks of spontaneous covariation in the resting brain. The important implication here is that the resting state can be shown to be inclusive of the brain’s functional dynamics from a range of mental tasks. Moreover, there is an intrinsic organization to the brain’s functional networks, whose topography is invariable during rest and task.

Functional Interpretation of Co-Activation Networks

Across different imaging modalities, mapping the whole-brain connectivity of large-scale brain networks or specific regions of interest generates quantitative and statistically testable information concerning connectivity and interactions across neural regions. In rs-FMRI, relating functional brain networks to specific mental functions is difficult, since by definition the resting state lacks behavioral specificity. Although recent work demonstrates that intrinsic connectivity networks can be related to specific behavioral measures (Mennes et al., 2011; Meier et al., 2012), more progress is needed to address this gap in our knowledge. The combination of meta-analytic investigations and databases such as BrainMap offer an opportunity for this in that they also allow inference on the characteristics and properties of experiments that underlie the co-activations. A wealth of information concerning the experimental design and methodological details of each archived experiment is coded in BrainMap according to a well-defined taxonomy, which has been refined by experts in the field for nearly two decades. Neuroinformatics tools have subsequently been developed to exploit this valuable source of information to provide associations with psychological constructs and thus potential functional interpretations for a specific region or regions of interest.

As a follow-up to the Smith et al. (2009) publication, Laird et al. (2011) sought to provide a more complete functional characterization of the 20 low model order networks. In this study, a slightly larger volume of the literature was available in BrainMap, and hence included 8,637 experiments from 1,840 publications. The BrainMap metadata taxonomy includes the fields of “Behavioral Domain” and “Paradigm Class” that characterize experiments resulting in activation of the specified region of interest. The behavioral domain (BD) of a particular experiment identifies the mental process isolated by the statistical contrast of images, and includes the main categories of cognition, action, perception, emotion, and interoception, as well as their related sub-categories (Fox et al., 2005). Paradigm class (PC) categorizes the specific task employed in the published study (Turner and Laird, 2011). A metadata matrix that quantified the relationships between the ICA component images and BrainMap experimental metadata for BDs and PCs was generated and analyzed with hierarchical clustering to determine groupings of similar metadata classes as well as similar sets of networks. Figure 4 provides a summary of the spatial topography of the 20 low order BrainMap co-activation networks shown by Laird et al. (2011), which match those originally presented by Smith et al. (2009) and demonstrate strong correspondence to resting state networks. Clustering results revealed that the BrainMap co-activation networks could be classified into 4 groups relevant to their associated mental processes: [1] emotional and interoceptive processes that included networks for limbic and medial temporal areas, subgenual ACC and OFC, bilateral basal ganglia and thalamus, bilateral anterior insula and anterior cingulate cortex; [2] motor and visuospatial integration, coordination, and execution that included premotor and supplementary motor cortices, DLPFC and posterior parietal cortices, hand areas of the primary snsorimotor cortices, and superior parietal lobule; [3] visual perception, including visual association cortices, as well as lateral and medial posterior occipital cortices; and [4] higher cognitive processes that included the default mode network, cerebellar network, right-lateralized fronto-parietal cortices, auditory cortices, mouth areas of the primary sensorimotor cortices, and left-lateralized fronto-parietal cortices. Complete functional explication of the BrainMap behavioral metadata associated with these networks was provided by Laird et al. (2011), and the results of these analyses have been shared with the community with the aim that they will be useful for functional interpretations of observed resting state networks in both healthy and clinical investigations (www.brainmap.org/icns).

Figure 4. ICA-Derived Co-Activation Networks.

Figure 4

ICA was used to decompose BrainMap experiment images into 20 spatially co-occurring maps of task co-activation networks. The spatial topography of these maps are seen after the ICA maps were converted to z statistic images and thresholded at z > 4. Hierarchical clustering was performed on the corresponding BrainMap metadata for each network, yielding groups of similar network functions. Group 1 was associated with emotional and interoceptive processes, Group 2 with motor and visuospatial integration and execution, Group 3 with visual perception, and Group 4 with higher cognition. Two of the observed components were artifactual (not shown). For more details, see Laird et al. (2011).

While this prior work focuses on developing methods to examine the functional or behavioral interpretation of large-scale brain networks using BrainMap metadata, similar methods may be applied to individual regions of interest. Subsequent to applying MACM, functional decoding may be performed on a given region of interest, again using the BD and PC metadata fields. The behavioral functions consistently associated with the particular part of the brain identified as a region of interest are quantitatively inferred by testing which of the different BDs and PCs are significantly over-represented among the experiments that featured activation in the seed. In other words, a BrainMap metadata analysis identifies which types of experiments are more likely than one would expect by chance to result in activation of the seed region. Similarly, functional interpretation techniques are also provided by the NeuroSynth Project (Yarkoni et al., 2011; http://neurosynth.org). In contrast to BrainMap, which relies on manual annotation of neuroimaging experiments by its user community, NeuroSynth has implemented automated harvesting of three-dimensional stereotactic and annotations that are tagged for each publication representing terms that occur at high frequency (i.e., 20 or more studies). A list of several thousand text-mined terms has been generated that allows quantitative associations to be made between a specific term and a given region of interest. NeuroSynth’s web interface provides access to tools capable of quickly generating dynamic meta-analysis maps representing term-based maps or co-activation maps.

Using their different frameworks for manual and automated annotations, BrainMap and NeuroSynth provide tools for examining both forward inference (i.e., how likely is the region activated given a particular taxonomic label?) and reverse inference (i.e., how likely is a particular taxonomic label given activation in this region?) (Yarkoni et al., 2011). In other words, forward inference on the functional characterization tests the probability of observing activity in a brain region given knowledge of the psychological process, whereas reverse inference tests the probability of a psychological process being present given knowledge of activation of a particular brain region. While both are usually considered in the functional interpretation of an effect, reverse inference is somewhat closer to the colloquial meaning of the question “what is this region doing?”. However, the results of this reverse inference analyses are also more dependent on the a priori structure of the database queried or the kind of experiments that are routinely carried in functional neuroimaging studies. That is, if a database contained a dramatically larger percentage of studies focusing on emotion as compared to cognition or action, then there may be an increased probability of observing emotion in association with a given region of interest, simply due to the over-representation of studies.

The BrainMap behavioral metadata procedure was initially presented by Laird et al. (2009b) in a functional characterization of regions of the default mode network. Other studies have utilized this functional characterization method for regions of interest, such as the amygdala (Bzdok et al., 2013), caudate (Robinson et al., 2012), and the orbitofrontal cortex (Zald et al., 2013). A new method of providing automated functional labels to a region or regions of interest has been released as part of the Mango software package (http://ric.uthscsa.edu/mango; Lancaster et al., 2012).

Comparisons to Resting State Connectivity

What has been learned thus far is that task-based co-activation networks demonstrate remarkable correspondence to other measures of functional connectivity, such as resting state connectivity. However, this is not to say that these sets of networks from dramatically disparate data sources are identical. While MACM may reveal brain regions showing significant task-based functional connectivity with a seed region, this describes only one particular aspect of brain connectivity among many others (cf. Eickhoff & Grefkes 2011). Consequently, the obtained results may potentially reflect biases in experimental design, analysis, or reporting of neuroimaging results that have not yet been characterized. Regardless, they do reflect a very specific and important aspect of functional brain networks. As a result, the multi-modal assessment of functional connectivity using multiple independent measures aimed at delineating different characteristics of brain networks has become an important line of research. Generally, the most commonly employed method for studying multi-modal functional connectivity is to compare task-based connectivity to correlations in low-frequency BOLD activation in the absence of a particular task, i.e., resting state analyses.

To exemplify this type of comparison, we focus on a region in the vicinity of right visual area V5 (Malikovic et al., 2007) that was previously found to show convergent evidence for structural aberrations in an ALE meta-analysis of voxel-based morphometry studies in patients diagnosed with autism-spectrum disorder (ASD; Nickl-Jockschat et al., 2012). This ROI (Figure 5, inset) was seeded in the BrainMap database, yielding 198 experiments (performed on 2,811 subjects and reporting a total of 3,320 foci). As seen in Figure 5A, MACM results across these 198 experiments indicated significant co-activation between the V5 region affected in ASD and the bilateral lateral occipital cortex, inferior parietal cortex, inferior frontal cortex including the ventral premotor cortex and BA 44 (Broca’s area), and anterior insula and frontal operculum (P < 0.05, cluster-level corrected for multiple comparisons). A separate analysis was then performed in which the same right visual area V5 region was seeded in resting state FMRI data from a group of 132 healthy subjects derived from the NKI/Rockland sample (Nooner et al., 2012), using standard preprocessing and analysis methods. Figure 5B reveals that the resting state approach yielded much more extensive functional connectivity in comparison to the MACM approach with almost all posterior parts of the brain, including the ventral and dorsal occipital cortex, as well as the inferior and superior parietal lobe. Significant resting state connectivity with the premotor cortex was also found, but with a stronger emphasis on its dorsal aspect than observed in the task-dependent data. When computing the conjunction between both approaches, the occipital and parietal regions that featured significant MACM and resting state connectivity with the V5 seed closely resembled those found in the MACM analysis (Figure 5C). In turn, significant frontal connectivity that was robust over both analyses was only observed in a small cluster of the left precentral gyrus and a larger one in the right inferior frontal gyrus located within BA 44 and the adjacent ventral premotor cortex.

Figure 5. MACM and Resting State Functional Connectivity of Right Visual Area V5.

Figure 5

Previous ALE meta-analysis of VBM studies identified convergent structural aberrations in a region of visual area V5 in ASD patients (Nickl-Jockschat et al., 2012; shown in inset). Results of independent MACM-based functional connectivity (A) and resting state functional connectivity (B) analyses are shown for this V5 seed region. Both sets of connectivity results are visualized at P < 0.05, cluster-level corrected for multiple comparisons. Conjunction analysis (C) revealed significant overlap between occipital and parietal regions.

In light of the as-yet limited number of studies combining MACM and resting state functional connectivity analyses (Reetz et al., 2012; Rottschy et al., 2013; Jakobs et al., 2012; Eickhoff et al., 2011, Cieslik et al., 2013), the above results obtained for the V5 region that was shown to be structurally affected in ASD features several typical aspects. First, all of these previous studies demonstrated the presence of robust networks of functional interaction with a seed region that are likewise present in both approaches for mapping whole-brain functional interactions. Given the independent nature of the data as well as the conceptual and methodological differences between MACM and resting state analyses, this convergence holds important implications. In particular, the ensuing regions may be considered a “core” network that is robustly interacting with the seed independent of whether the subjects are in a self-referentially, endogenously controlled mind-wandering state (cf. Schilbach et al., 2012 for a psychological interpretation of this mental state) or in an exogenously driven state imposed by a structured experimental paradigm. That is, these regions showing significant association across methods and mental states may be deemed the most robust and consistent interactions of the seed. Another rather frequent observation is the fact that in addition to this core network there are usually also appreciable differences in the revealed interactions. These differences demonstrate that in spite of the same underlying concept of “functional connectivity”, MACM and resting state analyses actually do reflect different information about brain connectivity. In this respect, resting state correlations often tend to show a more extensive network when thresholded at the same level of significance. In contrast, regions exhibiting significant MACM co-activation but not resting state functional connectivity are much more sparse. Nevertheless, as shown by the example focusing on right visual area V5, those regions nevertheless commonly exist (e.g., the anterior insula / frontal operculum). There are multiple different factors that may contribute to this kind of pattern. The potentially most interesting one pertains to the difference in mental states, i.e., endogenously vs. exogenously orientation of attention. Following this line of reasoning, the differences observed between MACM and resting state analyses could reflect differences in functional interaction that are conditioned upon the current mental state of the subjects. However, technical and conceptual differences between both approaches, as alluded to above, may not be discounted either. Consequently, it must remain open at present, whether the observed differences reflect primarily differential biases (or even artifacts) of the two methods or true differences in interaction patterns of the seed region dependent on the mental state of the subjects.

Limitations or Considerations for the Co-Activation Approach

The meta-analytic approach for identifying functionally co-activated brain networks is an appealing area of connectomics research since it allows for insight into the brain’s connectivity during the engagement of goal-directed behavior. However, this behavior is not limited to a single, specific task, but encompasses a diverse range of tasks. This is both an advantage and a disadvantage, depending on one’s research perspective. Although we place much emphasis on the results of Smith et al. (2009), which revealed strong similarity between resting state and co-activation networks, it is important to consider that these networks are not explicitly identical. Recent work by Mennes et al. (2013b) has shown that the relationship between intrinsic and extrinsic connectivity is quite complex, and that evoked interaction patterns show weaker correspondence to intrinsic connectivity networks, particularly for subcortical and limbic regions, as well as primary sensorimotor areas. There is no substitute for the precision, temporal resolution, and power of a carefully controlled task-based neuroimaging experiment, and we do not advocate abandonment of this domain of research. Rather, we promote simultaneous and symbiotic exploration of what knowledge may be gleaned from a meta-analytic co-activation perspective.

Forward progress in developing meta-analytic methods can be challenging as this data is sometimes construed as being too highly variable and noisy. Clusters of functional brain activations have highly complex and rich shape in three-dimensional space. Extracting the centers of masses of these clusters and analysis of the reported foci of these locations represents a dramatic loss in spatial sensitivity and specificity. Moreover, pooling foci across studies results in a loss of precision with respect to various experimental parameters, such as scanner strength, imaging acquisition and analysis, subject sample size and individual variability, and variations in behavioral conditions. However, it can be reasoned that observation of consistent results across studies despite this variability represents an undeniably powerful response of the brain to task and should therefore be examined to the fullest. Furthermore, the fact that the brain’s co-activation patterns can be disentangled to extract functional brain networks not only validates that meta-analysis is indeed an experimentally valid source of data, but it is also telling us something extraordinary about brain organization and how we conceptualize the associations between behavioral tasks and the mental operations they elicit.

Conclusion

While one of the more novel aspects of human connectomics research, task co-activation networks are providing biologically meaningful insight into functional brain dynamics and interactions. Meta-analytic connectivity modeling, connectivity-based parcellation, and behavioral metadata analyses have been successfully applied to regions of the default mode network, visual area V5, and the amygdala, among others. Resting state analyses are undeniably powerful, yet co-activation connectivity via the task activation literature offers a quantitative means to address the behavioral and experimental specificity of a region of interest. Moreover, although there is much work yet to be done, preliminary studies have shown that the level of convergence and divergence in co-activation connectivity and resting state connectivity is quite complex, and may offer increased insight into the relationship between external and internal orienting of attention. Future examination of task co-occurrence networks will focus on elucidating these patterns, and on applying the methods described here to an even larger array cortical and subcortical brain regions.

Highlights.

  • Task co-activation networks are providing insight into functional brain dynamics.

  • Methods include meta-analytic connectivity modeling and metadata analyses.

  • Co-activation and resting state comparisons yield complex but important results.

Acknowledgments

This work was funded by the National Institutes of Mental Health (MH74457 and MH084812).

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  1. Abou-Elseoud A, Starck T, Remes J, Nikkienen J, Tervonene O, Kiviniemi V. The effect of model order selection in group PICA. Hum Brain Mapp. 2010;31:1207–1216. doi: 10.1002/hbm.20929. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Beckmann CF, De Luca M, Devlin JT, Smith SM. Investigations into resting-state connectivity using independent component analysis. Philos Trans R Soc London. 2005;36:1001–1013. doi: 10.1098/rstb.2005.1634. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bellec P, Perlbarg V, Jbabdi S, Pelegrini-Issac M, Anton JL, Doyon J, Benali H. Identification of large-scale networks in the brain using fMRI. Neuroimage. 2006;29:1231–1243. doi: 10.1016/j.neuroimage.2005.08.044. [DOI] [PubMed] [Google Scholar]
  4. Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, Smith SM, Beckmann CF, Adelstein JS, Buckner RL, Colcombe S, Dogonowski AM, Ernst M, Fair D, Hampson M, Hoptman MJ, Hyde JS, Kiviniemi VJ, Kötter R, Li SJ, Lin CP, Lowe MJ, Mackay C, Madden DJ, Madsen KH, Margulies DS, Mayberg HS, McMahon K, Monk CS, Mostofsky SH, Nagel BJ, Pekar JJ, Peltier SJ, Petersen SE, Riedl V, Rombouts SA, Rypma B, Schlaggar BL, Schmidt S, Seidler RD, Siegle GJ, Sorg C, Teng GJ, Veijola J, Villringer A, Walter M, Wang L, Weng XC, Whitfield-Gabrieli S, Williamson P, Windischberger C, Zang YF, Zhang HY, Castellanos FX, Milham MP. Toward discovery science of human brain function. Proc Natl Acad Sci. 2010;107:4734–4739. doi: 10.1073/pnas.0911855107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bzdok D, Laird AR, Zilles K, Fox PT, Eickhoff SB. An investigation of the structural, connectional, and functional subspecialization in the human amygdala. Hum Brain Mapp. 2013 doi: 10.1002/hbm.22138. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Biswal B, Zerrin Yetkin F, Haughton V, Hyde J. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson Med. 1995;34:537–541. doi: 10.1002/mrm.1910340409. [DOI] [PubMed] [Google Scholar]
  7. Caspers S, Zilles K, Laird AR, Eickhoff SB. ALE meta-analysis of action observation and imitation in the human brain. Neuroimage. 2010;50:1148–1167. doi: 10.1016/j.neuroimage.2009.12.112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Cauda F, D'Agata F, Sacco K, Duca S, Geminiani G, Vercelli A. Functional connectivity of the insula in the resting brain. Neuroimage. 2011;55:8–23. doi: 10.1016/j.neuroimage.2010.11.049. [DOI] [PubMed] [Google Scholar]
  9. Cieslik EC, Zilles K, Caspers S, Roski C, Kellermann TS, Jakobs O, Langner R, Laird AR, Fox PT, Eickhoff SB. Is There "One" DLPFC in Cognitive Action Control? Evidence for heterogeneity from co-activation-based parcellation. Cereb Cortex. 2013;23:223–229. doi: 10.1093/cercor/bhs256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Collins DL, Neelin P, Peters TM, Evans AC. Automatic 3D intersubject registration of MR columetric data in standardized Talairach space. J Comput Assist Tomogr. 1994;18:192–205. [PubMed] [Google Scholar]
  11. Cordes D, Haughton V, Carew JD, Arkanakis K, Maravilla K. Hierarchical clustering to measure connectivity in fMRI resting-state data. Magn Reson Imag. 2002;20:305–317. doi: 10.1016/s0730-725x(02)00503-9. [DOI] [PubMed] [Google Scholar]
  12. Damoiseaux JS, et al. Consistent resting-state networks across healthy subjects. Proc Natl Acad Sci USA. 2006;103:13848–13853. doi: 10.1073/pnas.0601417103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Eickhoff SB, Bzdok D, Laird AR, Kurth F, Fox PT. Activation likelihood estimation revisited. Neuroimage. 2012;59:2349–2361. doi: 10.1016/j.neuroimage.2011.09.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Eickhoff SB, Bzdok D, Laird AR, Roski C, Caspers S, Zilles K, Fox PT. Co-activation patterns distinguish cortical modules, their connectivity and functional differentiation. Neuroimage. 2011;57:938–949. doi: 10.1016/j.neuroimage.2011.05.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Eickhoff SB, Grefkes C. Approaches for the integrated analysis of structure, function and connectivity of the human brain. Clin EEG Neurosci. 2011;42:107–121. doi: 10.1177/155005941104200211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Eickhoff S, Jbabdi S, Caspers S, Laird AR, Fox PT, Zilles K, Behrens T. Anatomical and functional connectivity of cytoarchitectonic areas within the human parietal operculum. J Neurosci. 2010;30:6409–6421. doi: 10.1523/JNEUROSCI.5664-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Eickhoff SB, Laird AR, Grefkes C, Wang LE, Zilles K, Fox PT. Coordinate-based activation likelihood estimation meta-analysis of neuroimaging data: A random-effects approach based on empirical estimates of spatial uncertainty. Hum Brain Mapp. 2009;30:2907–2926. doi: 10.1002/hbm.20718. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Evans AC, Collins DL, Mills SR, Brown ED, Kelly RL, Peters TM. 3D statistical neuroanatomical models from 305 MRI volumes. Proceedings of IEEE-Nuclear Science Symposium and Medical Imaging Conference. 1993:1813–1817. [Google Scholar]
  19. Fennema-Notestine C. Enabling public data sharing: encouraging scientific discovery and education. Methods Mol Biol. 2009;569:25–32. doi: 10.1007/978-1-59745-524-4_2. [DOI] [PubMed] [Google Scholar]
  20. Fox PT, Laird AR, Fox SP, Fox M, Uecker AM, Crank M, Koenig SF, Lancaster JL. BrainMap taxonomy of experimental design: Description and evaluation. Hum Brain Mapp. 2005;25:185–198. doi: 10.1002/hbm.20141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Fox PT, Lancaster JL. Mapping context and content: The BrainMap model. Nature Rev Neurosci. 2002;3:319–321. doi: 10.1038/nrn789. [DOI] [PubMed] [Google Scholar]
  22. Jakobs O, Langner R, Caspers S, Roski C, Cieslik EC, Zilles K, Laird AR, Fox PT, Eickhoff SB. Across-study and within-subject functional connectivity of a right temporo-parietal junction subregion involved in stimulus-context integration. Neuroimage. 2012;60:2389–2398. doi: 10.1016/j.neuroimage.2012.02.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Johansen-Berg H, Behrens TE, Robson MD, Drobnjak I, Rushworth MF, Brady JM, Smith SM, Higham DJ, Matthews PM. Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. Proc Natl Acad Sci USA. 2004;101:13335–13340. doi: 10.1073/pnas.0403743101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Kahnt T, Chang LJ, Park SQ, Heinzle J, Haynes JD. Connectivity-based parcellation of the human orbitofrontal cortex. J Neurosci. 2012;32:6240–6250. doi: 10.1523/JNEUROSCI.0257-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Keator DB, Grethe JS, Marcus D, Ozyurt B, Gadde S, Murphy S, et al. A national human neuroimaging collaboratory enabled by the Biomedical Informatics Research Network (BIRN) IEEE Trans Inf Technol Biomed. 2008;12:162–172. doi: 10.1109/TITB.2008.917893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Kelly C, Uddin LQ, Shehzad Z, Margulies DS, Castellanos FX, Milham MP, Petrides M. Broca’s region: Linking human brain functional connectivity data, non-human primate tracing anatomy studies. Eur J Neurosci. 2010;32:383–398. doi: 10.1111/j.1460-9568.2010.07279.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kim JH, Lee JM, Jo HJ, Kim SH, Lee JH, Kim ST, Seo SW, Cox RW, Na DL, Kim SI, Saad ZS. Defining functional SMA and pre-SMA subregions in human MFC using resting state fMRI: Functional connectivity-based parcellation method. Neuroimage. 2010;49:2375–2386. doi: 10.1016/j.neuroimage.2009.10.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Koski L, Paus T. Functional connectivity of the anterior cingulate cortex within the human frontal lobe: A brain-mapping meta- analysis. Exp Brain Res. 2000;133:55–65. doi: 10.1007/s002210000400. [DOI] [PubMed] [Google Scholar]
  29. Laird AR, Fox PM, Eickhoff SB, Turner JA, Ray KL, McKay DR, Glahn DC, Beckmann CF, Smith SM, Fox PT. Behavioral interpretations of intrinsic connectivity networks. J Cogn Neurosci. 2011;23:4022–4037. doi: 10.1162/jocn_a_00077. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Laird AR, Eickhoff SB, Kurth F, Fox PM, Uecker AM, Turner JA, Robinson JL, Lancaster JL, Fox PT. ALE meta-analysis workflows via the BrainMap database: Progress towards a probabilistic functional brain atlas. Front Neuroinformatics. 2009a;3:23. doi: 10.3389/neuro.11.023.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Laird AR, Eickhoff SB, Li K, Robin DA, Glahn DC, Fox PT. Investigating the functional heterogeneity of the default mode network using coordinate-based meta-analytic modeling. J Neurosci. 2009b;29:14496–14505. doi: 10.1523/JNEUROSCI.4004-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Laird AR, Lancaster JL, Fox PT. BrainMap: The social evolution of a functional neuroimaging database. Neuroinformatics. 2005a;3:65–78. doi: 10.1385/ni:3:1:065. [DOI] [PubMed] [Google Scholar]
  33. Laird AR, Fox M, Price CJ, Glahn DC, Uecker AM, Lancaster JL, Turkeltaub PE, Kochunov P, Fox PT. ALE meta-analysis: Controlling the false discovery rate and performing statistical contrasts. Hum Brain Mapp. 2005b;25:155–164. doi: 10.1002/hbm.20136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Lancaster JL, Laird AR, Eickhoff SB, Martinez MJ, Fox PM, Fox PT. Automated regional behavioral analysis for human brain images. Front Neuroinform. 2012;6:23. doi: 10.3389/fninf.2012.00023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Malikovic A, Amunts K, Schleicher A, Mohlberg H, Eickhoff SB, Wilms M, Palomero-Gallagher N, Armstrong E, Zilles K. Cytoarchitectonic analysis of the human extrastriate cortex in the region of V5/MT+: A probabilistic, stereotaxic map of area hOc5. Cereb Cortex. 2007;17:562–574. doi: 10.1093/cercor/bhj181. [DOI] [PubMed] [Google Scholar]
  36. Marcus DS, Wang TH, Parker J, Csernansky JG, Morris JC, Buckner RL. Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. J Cogn Neurosci. 2007a;19:1498–1507. doi: 10.1162/jocn.2007.19.9.1498. [DOI] [PubMed] [Google Scholar]
  37. Marcus DS, Olsen TR, Ramaratnam M, Buckner RL. The Extensible Neuroimaging Archive Toolkit: An informatics platform for managing, exploring, and sharing neuroimaging data. Neuroinformatics. 2007b;5:11–34. doi: 10.1385/ni:5:1:11. [DOI] [PubMed] [Google Scholar]
  38. Meier TB, Wildenberg JC, Liu J, Chen J, Calhoun VD, Biswal BB, Meyerand ME, Birn RM, Prabhakaran V. Parallel ICA identifies sub-components of resting state networks that covary with behavioral indices. Front Hum Neurosci. 2012;6:281. doi: 10.3389/fnhum.2012.00281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Mennes M, Biswal BB, Castellanos FX, Milham MP. Making data sharing work: The FCP/INDI experience. Neuroimage. 2013a doi: 10.1016/j.neuroimage.2012.10.064. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Mennes M, Kelly C, Colcombe S, Castellanos FX, Milham MP. The extrinsic and intrinsic functional architectures of the human brain are not equivalent. Cereb Cortex. 2013b;23:223–229. doi: 10.1093/cercor/bhs010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Mennes M, Zuo XN, Kelly C, Di Martino A, Zang YF, Biswal B, Castellanos FX, Milham MP. Linking inter-individual differences in neural activation and behavior to intrinsic brain dynamics. Neuroimage. 2011;54:2950–2959. doi: 10.1016/j.neuroimage.2010.10.046. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Nanetti L, Cerliani L, Gazzola V, Renken R, Keysers C. Group analyses of connectivity-based cortical parcellation using repeated k-means clustering. Neuroimage. 2009;47:1666–1677. doi: 10.1016/j.neuroimage.2009.06.014. [DOI] [PubMed] [Google Scholar]
  43. Nickl-Jockschat T, Habel U, Michel TM, Manning J, Laird AR, Fox PT, Schneider F, Eickhoff SB. Brain structure anomalies in autism spectrum disorder--A meta-analysis of VBM studies using anatomic likelihood estimation. Hum Brain Mapp. 2012;33:1470–1489. doi: 10.1002/hbm.21299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Nooner KB, Colcombe SJ, Tobe RH, Mennes M, Benedict MM, Moreno AL, Panek LJ, Brown S, Zavitz ST, Li Q, Sikka S, Gutman D, Bangaru S, Schlachter RT, Kamiel SM, Anwar AR, Hinz CM, Kaplan MS, Rachlin AB, Adelsberg S, Cheung B, Khanuja R, Yan C, Craddock CC, Calhoun V, Courtney W, King M, Wood D, Cox CL, Kelly AM, Di Martino A, Petkova E, Reiss PT, Duan N, Thomsen D, Biswal B, Coffey B, Hoptman MJ, Javitt DC, Pomara N, Sidtis JJ, Koplewicz HS, Castellanos FX, Leventhal BL, Milham MP. The NKI-Rockland Sample: A Model for Accelerating the Pace of Discovery Science in Psychiatry. Front Neurosci. 2012;6:152. doi: 10.3389/fnins.2012.00152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Poldrack RA, Mumford JA, Schonberg T, Kalar D, Barman B, Yarkoni T. Discovering relations between mind, brain, and mental disorders using topic mapping. PLoS Comp Biol. 2012;8:e1002707. doi: 10.1371/journal.pcbi.1002707. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Poldrack RA. Can cognitive processes be inferred from neuroimaging data? Trends Cogn Sci. 2006;10:59–63. doi: 10.1016/j.tics.2005.12.004. [DOI] [PubMed] [Google Scholar]
  47. Postuma RB, Dagher A. Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. Cereb Cortex. 2006;16:1508–1521. doi: 10.1093/cercor/bhj088. [DOI] [PubMed] [Google Scholar]
  48. Reetz K, Dogan I, Rolfs A, Binkofski F, Schulz JB, Laird AR, Fox PT, Eickhoff SB. Investigating function and connectivity of morphometric findings - Exemplified on cerebellar atrophy in spinocerebellar ataxia 17 (SCA17) Neuroimage. 2012;62:1354–1366. doi: 10.1016/j.neuroimage.2012.05.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Robinson JL, Laird AR, Glahn DC, Blangero J, Sanghera MK, Pessoa L, Fox PM, Uecker A, Friehs G, Young KA, Griffin JL, Lovallo WR, Fox PT. The functional connectivity of the human caudate: an application of meta-analytic connectivity modeling with behavioral filtering. Neuroimage. 2012;60:117–129. doi: 10.1016/j.neuroimage.2011.12.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Robinson JL, Laird AR, Glahn DC, Lovallo WR, Fox PT. Meta-analytic connectivity modelling: Delineating the functional connectivity of the human amygdala. Hum Brain Mapp. 2010;31:173–184. doi: 10.1002/hbm.20854. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Rottschy C, Caspers S, Roski C, Reetz K, Dogan I, Schulz JB, Zilles K, Laird AR, Fox PT, Eickhoff SB. Differentiated parietal connectivity of frontal regions for "what" and "where" memory. Brain Struct Funct. 2013 doi: 10.1007/s00429-012-0476-4. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Schilbach L, Bzdok D, Timmermans B, Fox PT, Laird AR, Vogeley K, Eickhoff SB. Introspective minds: Using ALE meta-analyses to study commonalities in the neural correlates of emotional processing, social & unconstrained cognition. PLoS ONE. 2012;7:e30920. doi: 10.1371/journal.pone.0030920. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Smith SM, Fox PT, Miller KL, Glahn DC, Fox PM, Mackay CE, Filippini N, Watkins KE, Toro R, Laird AR, Beckmann CF. Correspondence of the brain's functional architecture during activation and rest. Proc Natl Acad Sci USA. 2009;106:13040–13045. doi: 10.1073/pnas.0905267106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Talairach J, Tournoux P. Co-planar Stereotaxic Atlas of the Human Brain. New York: Thieme; 1988. [Google Scholar]
  55. Toro R, Fox PT, Paus T. Functional coactivation map of the human brain. Cereb Cortex. 2008;18:2553–2559. doi: 10.1093/cercor/bhn014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Turkeltaub PE, Eickhoff SB, Laird AR, Fox M, Wiener M, Fox P. Minimizing within-experiment and within-group effects in activation likelihood estimation meta-analyses. Hum Brain Mapp. 2012;33:1–13. doi: 10.1002/hbm.21186. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Turkeltaub PE, Eden GF, Jones KM, Zeffiro TA. Meta-analysis of the functional neuroanatomy of single-word reading: Method and validation. NeuroImage. 2002;16:765–780. doi: 10.1006/nimg.2002.1131. [DOI] [PubMed] [Google Scholar]
  58. Turner JA, Laird AR. The Cognitive Paradigm Ontology: Design and application. Neuroinformatics. 2012;10:57–66. doi: 10.1007/s12021-011-9126-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. van den Heuvel M, Mandl R, Hulshoff Pol. Normalized cut group clustering of resting-state fMRI data. PLoS ONE. 2008;3:e2001. doi: 10.1371/journal.pone.0002001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Van Essen DC, Ugurbil K, Auerbach E, Barch D, Behrens TE, Bucholz R, Chang A, Chen L, Corbetta M, Curtiss SW, Della Penna S, Feinberg D, Glasser MF, Harel N, Heath AC, Larson-Prior L, Marcus D, Michalareas G, Moeller S, Oostenveld R, Petersen SE, Prior F, Schlaggar BL, Smith SM, Snyder AZ, Xu J, Yacoub E. WU-Minn HCP Consortium The Human Connectome Project: A data acquisition perspective. Neuroimage. 2013 doi: 10.1016/j.neuroimage.2012.02.018. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Yarkoni T, Poldrack RA, Nichols TE, Van Essen DC, Wager TD. Large-scale automated synthesis of human functional neuroimaging data. Nat Methods. 2011;8:665–670. doi: 10.1038/nmeth.1635. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Zald DH, McHugo M, Ray KL, Glahn DC, Eickhoff SB, Laird AR. Meta-analytic connectivity modeling reveals differential functional connectivity of the medial and lateral orbitofrontal cortex. Cereb Cortex. 2013 doi: 10.1093/cercor/bhs308. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES