Abstract
During rest, the cerebral cortex displays rich, coordinated patterns of spontaneous activity. The mechanism that shapes these patterns is largely unknown. Here we demonstrate that a Hebbian-like, sustained process plays a role in focusing these coherent patterns. Human subjects used an fMRI-based neurofeedback (NF) paradigm to intensely activate the dorsal anterior cingulate cortex for a single epoch (30 min). Resting-state correlations between all of the cortical voxels' BOLD time courses (functional connectivity) were mapped before, immediately after, and one day after the NF session. We found that the single epoch of cortical activation induced a lasting restructuring of the functional connections according to a Hebbian-like rule. Therefore, the change (increase and decrease) in functional connectivity strength of cortical voxels during rest reflected the level of their prior coactivation during the NF epoch. Interestingly, the effect was significantly enhanced 1 d after the NF activation epoch. The effect was evident in each subject individually, indicating its potential as a diagnostic window into the personal history of prior brain activations of both healthy and abnormal individuals.
Introduction
Even when subjects rest with eyes closed, the cerebral cortex displays a complex pattern of coordinated BOLD-fMRI “resting-state” activity. A remarkable feature of this activity is its organized nature (Greicius et al., 2003; Nir et al., 2006; Golland et al., 2008; Biswall, 2010; Mennes et al., 2010; Power et al., 2010; Shirer et al., 2011). Therefore, the correlation structures of spontaneous fluctuations follow the outlines of well known cortical networks (Greicius et al., 2003; Nir et al., 2006; Golland et al., 2008; Biswall, 2010; Power et al., 2010) and show a consistent interhemispheric connectivity (Nir et al., 2008). Despite a large body of research, the mechanism that underlies the spatial patterning of this spontaneously coordinated activity is still unknown. It has been demonstrated that cortical activation could restructure resting-state activity immediately after task performance (Albert et al., 2009; Lewis et al., 2009; Stevens et al., 2010; Tambini et al., 2010; Eryilmaz et al., 2011; Riedl et al., 2011; Zhang et al., 2012; Urner et al., 2013) or even at longer periods afterward (Taubert et al., 2011). However, the reported effects were mixed. For example, although Tambini et al. (2010) reported enhanced correlations after training in memory-related networks, Lewis et al. (2009) reported increased anticorrelations in visual to frontal cortex connectivity. We hypothesize that both increases and decreases in functional connectivity (FC) may be considered as two complementary aspects of a single cortical mechanism. We propose that the restructuring of resting-state connectivity follows a Hebbian-like learning rule. In Hebb's original formulation (Hebb, 1949), neuronal assemblies are generated through their successful coactivations. However, as both subsequent theoretical and experimental research has demonstrated in animal models, the complementary Hebbian modification is equally important and prevalent; that is, when activity between cortical neurons is decorrelated or even anticorrelated, the Hebbian-learning rule leads to a corresponding decrease in connectivity between the decorrelated neurons (Artola et al., 1990; Markram et al., 1997). Here we tested this hypothesis using an fMRI-based neurofeedback (NF) training method, which is known to produce strong activations resulting in significant brain-behavior changes even after a single session (Weiskopf et al., 2004; DeCharms et al., 2005; Johnston et al., 2010; Scharnowski et al., 2012). We trained subjects to enhance activity in the dorsal anterior cingulate cortex (dACC), an area implicated in volitional behavior (Rushworth et al., 2004; Holroyd and Coles, 2008). This protocol was chosen with the intent that a reorganization after such training may be potentially valuable if applied to patients suffering from volitional impairments (Levy and Dubois, 2006). Rest scans preceded and followed the NF training, enabling us to determine the nature of resting-state FC restructuring.
Materials and Methods
Subjects.
Twenty healthy subjects, all research students and research fellows (five females; mean age, 30.5 ± 4.5 years [range, 26–46]) participated in the experiment. All participants were right-handed, had normal hearing and normal or corrected-to-normal vision, and provided written informed consent for their participation. The Hertzog hospital ethics committee approved the experimental protocols.
Tasks and stimuli.
The experiment was conducted in three separate days, with the last two days being consecutive (Fig. 1). On the first day, subjects were scanned while resting (6 min) and subsequently underwent a real-time fMRI NF training session (30 min), after which they were again scanned during rest (6 min). On the following day, the subjects were scanned once more while at rest (6 min). Subjects' eyes were closed and covered during all scans.
Localizer.
To localize the dACC region to be enhanced during training (see below), subjects performed two localizer tasks involving self-initiation and volitional behavior, which were shown to activate this region (Rushworth et al., 2004; Holroyd and Coles, 2008; Mostofsky and Simmonds, 2008; Preminger et al., 2011).
A self-initiated action task (Preminger and Harmelech, 2008) consisted of intermittent blocks of voluntary action and blocks of determined action (60 s blocks of each condition) separated by rest periods (14 s). During the voluntary blocks, subjects viewed changing stimuli and, at the time of their choosing, could freely perform actions that have rewards and costs. The determined (control) game was similar to the voluntary game in actions, stimuli, and their timing, but the actions were determined by external stimuli. Voluntary and determined periods were presented in blocks of 60 s, interleaved with each other, with 14 s blocks of black screen in between.
A self-initiated thought task (Preminger et al., 2011) consisted of seven blocks of volitional prospection in which subjects were asked to think about initiating a new project in their research (Preminger et al., 2011) intermittently with rest periods (40 and 20 s, respectively) and blocks of reciting or recalling externally oriented content such as reciting the alphabet, the national anthem, or place imagery of a familiar place.
Neurofeedback training.
On a subsequent day (average 2.6 ± 0.54 d later), the subjects underwent an rtfMRI NF (Weiskopf et al., 2004; DeCharms et al., 2005; Johnston et al., 2010) session. The NF session consisted of 3 runs, with each run constituting a 7.5 min scan that included blocks of “dACC elevation” and rest (Fig. 1). For the dACC-elevating condition, subjects were given a general cognitive strategy (“volitional prospection,” i.e., “think about initiating a new project in your research”) that is known to activate this region (Preminger et al., 2011). Each block lasted 40 s and was followed by a 20 s rest period, both marked by brief (<1 s) auditory cues. During each run, subjects were provided with ongoing auditory feedback, a tone 2000 ms in length at every repetition time (TR) point, the pitch of which indicated the level of activity in the target region of interest (ROI) out of seven levels. For each TR, baseline was calculated by extracting the minimum and maximum values from a sliding window of the last 10 time points and subtracting them to calculate the dynamic activation range. The activation range was multiplied by 1.1 in case the activation level at a given time point exceeded that range. The relative level of activity was calculated as the ratio between the average ROI value for the given time point minus the minimum value, and the baseline as follows: given TR value − min/1.1(max − min). Both the auditory cues and the real-time feedback were provided via headphones. Auditory feedback was chosen after a few pilot experiments with different types of feedback (two types of visual, auditory, and bimodal) were done. The feedback that yielded the best results (at least for this ROI) was the auditory feedback. The subjects also reported such auditory feedback to be less interfering with their mental strategy while being salient enough as feedback/for monitoring.
Rest scans.
All the subjects were scanned during rest (6 min) at three time points of the experiment: before, immediately after, and 24 h after the NF session. The instruction to the subjects was as follows: “please rest. You can let your mind wander freely and think about whatever you'd like, except for the NF strategy.” After each rest scan, the subjects were asked to give a description of their thought content during that scan.
Reports.
After each resting and NF scan, the subjects were asked to freely describe their thought content/strategy during that scan. In addition, for the NF scans only, the subjects completed a questionnaire with four categories of questions regarding their experience during the dACC-elevating condition. The categories included experiences of: control (e.g., “to what extent did you feel you were controlling your thoughts?”), self (e.g., “to what extent were your thoughts self-oriented”), success (e.g., “to what extent did you find yourself successful”), and modality (e.g., “to what extent were your thoughts visual”). A 5-point scale was used for this rating, for which 1 = not at all and 5 = a lot. Category-specific questionnaires were limited to the NF scan to minimize external induction of thought processes during the resting scans.
The subjects' free reports after the resting state scans could be divided (Buckner and Carroll, 2007) into two main content categories (1) “self-projection,” which included episodic memory and planning (examples of subjects' descriptions in this category are as follows: “I remembered a dinner with friends from the past weekend”; “I thought about what I need to get from the market”; and (2) “here and now,” which included such things as “I was concentrating on the noise of the magnet” and “I was concentrating on sensory aspects of the blanket on my body and the headphones over my ears.” A prominent category of such “here and now” thoughts consisted of repetitive inner speech such as “I was counting my breaths” or “I was repeating a mantra.” These subjects will be referred to as the “repetitive speech” group in the following text. We used a blind scoring procedure, in which the reports from the three resting-state periods were intermixed. Ten naive raters who were unaware of which report belonged to which resting state independently rated the similarity between these reports and the reports of thoughts used during the NF period. The rating involved a 5-grade scale for which 1 = very similar and 5 = very different. The instruction to the raters was simply to “rate the similarity of rest reports with NF reports on a scale of 1 to 5, 1 being very similar and 5 being very different.” No strategy was given. Cronbach's α coefficient was calculated as a measure of internal consistency/interrater reliability of these content ratings.
Imaging setup.
The scans were performed on a 3T Trio Magnetom Siemens scanner, at the Weizmann Institute of Science, Rehovot, Israel. The 3D T1-weighted anatomical images were acquired with high-resolution 1 mm slice thickness (3D MP-RAGE sequence, TR = 2300 ms, TE = 2.98 ms, 1 × 1 × 1 mm voxels). BOLD contrast was obtained with gradient echo planar imaging sequence (TR = 2000 ms, TE = 30 ms, flip angle = 90°, FOV 240 mm, matrix size 80 × 80, scanned volume = 35 axial slices of 4 mm thickness, no gap, 3 × 3 × 4 mm voxels, anterior commissure–posterior commissure).
Data analysis and preprocessing.
RtfMRI data were analyzed with the “Turbo Brain-voyager” and “Brain-voyager” software packages (Brain Innovation) and with complementary in-house software. The first two images of each functional scan were discarded to allow for T1-equilibration effects. The functional images were superimposed on 2D anatomic images and incorporated into the 3D datasets through trilinear interpolation. The cortical surface in a Talairach coordinate system (Talairach and Tournoux, 1988) was reconstructed for each subject from the 3D-spoiled gradient echo scan. Data were corrected for slice-dependent time shifts for each volume and 3D head motion. Motion parameters generated in the latter process were used later as nuisance regressors in the general linear model (GLM) and correlation analyses. fMRI images from the localizer tasks and the NF session were spatially smoothed with a Gaussian kernel with a full width at half maximum (FWHM) of 4 mm. Temporal filtering of linear trends was performed to account for LF noise (e.g., scanner drift). All regressors were modeled as box-car functions convolved with the hemodynamic response function. A hemodynamic lag of 3–6 s was assumed and verified for each subject. The analysis was performed independently for the time course of each individual voxel. After computing the coefficients for all regressors, a Student's t test between coefficients of different conditions (e.g., dACC elevation vs rest) was performed. Multisubject analysis was based on a random-effect GLM (Friston et al., 1999). The multisubject functional maps were projected on an inflated or unfolded Talairach-normalized brain. Significance levels were calculated taking into account the minimum cluster size and the probability threshold of a false detection of any given cluster. This was accomplished by a Monte Carlo simulation (cluster-level statistical threshold estimator in “Brain-voyager”) using the combination of individual voxel probability thresholding. The probability of a false-positive detection per image was determined from the frequency count of cluster sizes within the entire cortical surface (NF session had a threshold of 184 voxels, the self-initiated thought localizer task had a threshold of 183 voxels, and the self-initiated action localizer task had a threshold of 118 voxels; α was set at 0.05 throughout). Spatial smoothing with a Gaussian kernel with an FWHM of 8 mm was used for all multisubject maps.
Definitions of ROIs.
NF session target ROI (left dACC) was defined individually for each subject as the region of overlap (r = 15 mm) between the self-initiated action and the self-initiated thought task activations. Neutral ROI (left middle frontal gyrus) was defined individually for each subject as a region (r = 15 mm) neighboring the NF target ROI that was not activated during the NF. The second most activated ROI (left inferior parietal lobule [IPL]) was defined individually for each subject as a region (r = 15 mm) that was the second most activated during the NF (the first being the target ROI in dACC). The group-level ROIs are shown for presentation purposes in the figures; however, for the actual calculations, measurements from individually defined subjects' ROIs were used for all the analyses.
Statistical analysis of behavioral measures.
Correlations of subjects' reports with fMRI data were performed using nonparametric Spearman's rank order tests. FDR correction for multiple comparisons was done according to the Benjamini-Hochberg method (Benjamini and Hochberg, 1995). α was set at 0.05.
FC maps.
After preprocessing, the fMRI data from the rest runs were subjected to additional processing steps, as described previously (Fox et al., 2005; Vincent et al., 2006; Van Dijk et al., 2010), before FC analysis of low-frequency BOLD fluctuations. First, a temporal bandpass filter was applied to the atlas aligned BOLD data, retaining signal within the frequency range of 0.009–0.08 Hz. Data were then spatially smoothed with a Gaussian kernel (FWHM = 4 mm). Sources of variance of noninterest were then removed from the data by regression of nuisance variables (in addition to first temporal derivatives of each), including: the six motion parameters obtained during the motion correction procedure, the mean signal from the lateral ventricles, and the mean signal from a region within the deep cerebral white matter.
To perform the FC analysis, seed time series were sampled, averaged, and z-transformed for all voxels in the NF peak activation ROI (see ROI definition for details). The resulting time series were then used as predictor after removal of the auto-regression factor model in a single-subject GLM. A second-level random effect analysis was then performed to determine brain areas that showed significant FC with the NF peak ROI across all subjects during the experiment. To perform a two-tailed paired t test to determine significant voxel-by-voxel correlation differences between the rest periods, the correlation coefficients were converted to z values using Fisher's r-to-z transformation to improve normality. The resulting t values were projected onto a representative individual's cortical surface, forming FC disparity maps. A correction for multiple comparisons was performed by calculating the probability of a false positive from the frequency count of cluster sizes within the entire cortical surface using a Monte Carlo simulation as noted above (the presession rest had a threshold of 181 voxels, the postsession rest had a threshold of 185 voxels, and the day-after-session rest had a threshold of 176 voxels; α was set at 0.05 throughout). Spatial smoothing with a Gaussian kernel with an FWHM of 8 mm was used for all multisubject maps.
Hebbian-like sharpening analysis.
To examine the quantitative relationship between the cortical activation during the NF and the changes in resting-state FC, a whole cortex analysis was conducted as follows. For each subject and each cortical voxel, the level of its coactivation with the target ROI (Fig. 5B) during the NF training was calculated. The relationship between this coactivation level and the increment in FC (Table 1) 1 d after the training was then plotted. The significance of each scatter plot was determined by a two-tailed Student's t test. To avoid overestimation of the p-value due to the spatial smoothing of the data, the analysis was also performed on unsmoothed data. Before comparing the effect immediately after the NF session to 1 d after the NF session, the correlation coefficients were converted to z values using Fisher's r-to-z transformation to improve normality and then a two-tailed paired t test was performed to determine significant differences between the immediate and latent effects. The same procedure was performed for the comparison between the effects of the target ROI (dACC) and the second most activated ROI (IPL).
Table 1.
Index name | Definition | Calculation | Where used |
---|---|---|---|
Increment in FC | Change/difference in dACC resting-state FC | dACC FC in second rest − dACC FC in first rest | Figure 4, Figure 5 |
CI | Global correlation per voxel | Average correlation per voxel of all its TC correlations with all other voxel TCs | Figure 7A |
Disparity index | Change/difference in CI | Two-tailed paired t test between CI values in second and first rest | Figure 7B |
Global FC: single-subject correlation index.
For each subject's functional scan, the time course of each cortical voxel was transformed to units of percentage signal change, correlated with the time courses of all other cortical voxels, and then the correlations were averaged for each voxel. Voxels with a mean signal intensity level lower than 100 were discarded as noise, because regions outside the brain show similar values. This procedure (Fig. 7A, modified from Salomon et al., 2011) yielded a single correlation index (CI) per voxel (Table 1), which represented the degree of correlation between the voxel and all other cortical voxels. The CIs of all cortical voxels were then presented in cortical map form.
Global FC: group-level analysis and disparity index.
For each voxel, the average CI was computed separately for each rest period by averaging the CIs of that voxel between all the subjects. Coregistration of the subjects' voxel space was done in the Talairach coordinate system (Talairach and Tournoux, 1988) on the 3D volume space. The resulting averaged voxel correlations were then projected onto a representative individual's cortical surface. Disparity indices (Table 1) were computed to measure the degree of difference between the rest periods in terms of the average CI of each voxel. The gray matter cortical voxels of all subjects were intersected and the correlation coefficients were converted to z values using Fisher's r-to-z transformation to improve normality. The CIs of all voxels were then extracted and a two-tailed paired t test was performed to determine significant voxel-by-voxel correlation differences between the rest periods. The resulting t values were projected onto a representative individual's cortical surface, forming FC disparity maps. These maps show voxels in which the presession rest period had significantly higher FC than the day-after-session rest period. A correction for multiple comparisons was performed by calculating the probability of a false positive from the frequency count of cluster sizes within the entire cortical surface using a Monte Carlo simulation as noted above (threshold of 180 mm2, α set at 0.05).
Results
Brain activity during rtfMRI-NF session
Brain activity during the tasks localizing the dACC is depicted in Figure 2. For each subject, the region that was chosen for the NF procedure was the overlapping activation in the two tasks in the dACC (arrow, overlap in red, for details, see Materials and Methods).
Figure 3 depicts the results of the NF experiment (see Materials and Methods). Figure 3B shows an example time course in one such session obtained from the target dACC ROI showing the successful BOLD activation during NF periods. The effect was robust and consistent across subjects, as depicted in the group map (Fig. 3A). High activation in the target ROI (arrow), as well as some additional regions in prefrontal, parietal, and temporal cortices (the IPL, superior frontal gyrus, middle frontal gyrus, and middle temporal gyrus) likely overlapping the default mode network, can be seen. Cross-scan analysis revealed a significant NF activation, with similar activation levels as the session progressed (Fig. 3C). Figure 3D depicts subjects' reports of experience during the NF (see questionnaire details in Materials and Methods), with experience of control over thought being significantly correlated with level of activation.
Resting-state FC changes after rtfMRI-NF
Our central focus was the possible changes in FC–resting-state correlations associated with the NF target ROI after the NF session. Figure 4A–C depicts the FC of the NF target ROI before, immediately after (∼2 min), and 1 d after (24 h later) the NF session. As is evident even by a qualitative inspection, the anatomical spread of FC was reduced after the NF session and this spread constricted further 1 d after the NF session. Figure 4D, E show statistical analysis of the difference (two-tailed paired t test) in FC before versus immediately after and before versus 1 d after the NF session, respectively. The contours on top of these disparity maps represent the activity during the NF session. The overlap displayed shows a decrease in FC in regions that were inactivated during the NF session as opposed to an increase in the activated regions. To examine the quantitative relationship between the cortical activation during the NF and the changes in resting-state FC, we conducted a whole cortex analysis (see Materials and Methods). For each subject and each cortical voxel, we calculated the level of its coactivation with the target ROI (Fig. 5B) during the NF training. We then plotted the relationship between this coactivation level and the increment in FC (Table 1) 1 d after the training. We found a highly significant correlation that was consistently evident in every subject who participated in the study. To represent this consistency across individuals, the scatter-plots are presented as a “gallery” of individual subjects (Fig. 5A). It is evident that in every subject who underwent training, there was a highly significant (p < 0.005) relationship between the level of coactivation during the NF training and connectivity increment (or decrement) in the resting-state connectivity. To avoid overestimation of the p-value due to the spatial smoothing of the data, the analysis was also performed on unsmoothed data. The p-values reported are the more conservative estimates. Furthermore, the results remained significant (p < 0.05) even after reducing the number of degrees of freedom by a conservative fivefold.
Comparing these correlations for the rest period immediately after the training (mean 0.49 ± 0.02, p < 0.01) and the one 1 d after the training showed that the effect was significantly stronger on the second day (p < 0.001, with only 1 subject of 20 showing the opposite trend).
Relationship of FC change to NF activation
We also examined whether the relationship between NF coactivation and resting-state FC modulation was dependent on individual subjects' success in activating the NF target ROI during the training. The results are depicted in Figure 5C, in which the level of FC “Hebbian sharpening” (reflected in the individual correlation coefficients of the panels in Fig. 5A) in each of the subjects is plotted against their NF success (measured as the GLM β values). Statistical analysis showed that the relationship between the two phenomena was highly significant (r = 0.68, p < 0.01).
Was the Hebbian sharpening localized to the NF target site or was it present also in neighboring cortical regions, depending on their level of activation by the NF task? To answer this, we conducted two control analyses with two different ROIs as the targets for the analyses. The first ROI we chose was a neighboring neutral (nonactivated, see Materials and Methods) ROI as the target for the analysis. Repeating the correlation analysis in identical fashion to that conducted for the dACC ROI (Fig. 5) failed to show any significant sharpening effect in the correlation to the “sham” cortical site. The results are depicted in Figure 6. Comparing Figure 5 and Figure 6 again illustrates the consistent, subject-by-subject difference between the target and control sites. To examine the possibility of a rapidly decaying focusing effect in the sham cortical site, we repeated the analysis for the rest immediately after the NF period. Again, no significant focusing effect was discerned (mean 0.08 ± 0.033, p = 0.1, and 0.09 ± 0.036, p = 0.09, for the postsession and day-after, respectively, and p = 0.45 for the difference).
In addition, we analyzed activity in another ROI, the region that was the second most activated region during the NF (see Materials and Methods). We found the same effect, albeit to a lesser extent (mean 0.42 ± 0.04, p < 0.01, and 0.51 ± 0.02, p < 0.005, for the postsession and day-after, respectively, and p < 0.01 for the difference).
Selectivity of the Hebbian-like sharpening effect
To further examine whether the Hebbian sharpening was selective to the NF activation site or reflected a more global cortical phenomena, we mapped changes in global FC for each cortical voxel. We analyzed the three rest periods for each subject individually as follows (Fig. 7A). For every cortical voxel in each subject, we assigned a CI by computing the correlation of that voxel with all other cortical voxels. This resulted in a CI map, in which voxels were assigned high or low values depending on how widespread their correlations with the rest of the cortex were. We then averaged these CI maps across individuals for each of the rest periods to generate a multisubject CI map for each period (see Materials and Methods). These CI maps were then compared across the rest periods to reveal changes in global connectivity. This comparison enabled us to identify, in a data-driven fashion, those cortical regions that underwent a significant FC change after the NF activation (Fig. 7A, see Materials and Methods). The results of this analysis are depicted in Figure 7B. As can be seen, the region that underwent the most prominent change in global connectivity after the training largely overlapped the NF activation site.
Assessment of subjects' cognitive state during rest
Was the subjects' cognitive state during the resting-state measurements affected by the prior NF training? To examine this issue, we used four complementary approaches. First, subjects were interviewed about their thought content after each rest period (see Materials and Methods for details). Ten naive raters who were unaware of which report belonged to which resting state rated the similarity between these reports and those obtained for the NF period. The rating involved a 5-grade scale for which 1 = very similar and 5 = very different. The reports for all three rest periods were rated as very different from the NF strategy (average presession, 4.81 ± 0.08; immediate postsession, 4.85 ± 0.06; day-after-session, 4.91 ± 0.04, respectively). The internal consistency of the content ratings was very high (Cronbach's α = 0.92). Furthermore, no correlation was found between the success in NF activation and the resting-state thought content (r = 0.07, p = 0.8).
Second, we divided the rest reports into two categories, which appeared to differ in their similarity to the NF strategy (see Materials and Methods). Comparing the sharpening effects for reports from the two categories failed to show any significant difference (mean similar, 0.64 ± 0.035; different, 0.69 ± 0.03, p = 0.79). Furthermore, no correlation was found between the rest and NF reports' similarity rating and the sharpening effects (r = 0.08, p = 0.74).
Third, we identified a specific group of subjects termed “repetitive speech,” whose thought content appeared clearly remote from the NF strategy (see Materials and Methods). The Hebbian focusing effect for this selected group is depicted in red frames in Figure 5A. As can be seen, no bias for lower sharpening level in this group of subjects can be discerned.
Fourth, comparing the amplitude of BOLD fluctuations during the NF session with those obtained during the rest periods revealed that the fluctuations were significantly higher than both the presession and day after rest periods (p = 0.001 and p = 0.02, paired t test, respectively, Bonferonni corrected). We took advantage of this observation to examine, in an objective manner, whether there was a “replay” of the NF task during the subsequent rest periods. Comparing the BOLD fluctuations during the rest periods before and 1 d after the NF training failed to reveal a significant difference (p = 0.55, paired t test). These results argue against the possibility that the observed FC changes were due to subjects' “replaying” the NF task during the rest period 1 d after the NF training.
Discussion
Our study demonstrates that the pattern of resting-state activity can be reorganized after a single intense epoch of cortical activation. The reorganization process followed a remarkably consistent, unitary, “Hebbian” rule. Therefore, voxels that were coactivated during training increased their resting-state connectivity 1 d after training, whereas those that were decorrelated during training, decreased it. Furthermore, the effect appeared to be linearly related to the magnitude of the co-modulation (Fig. 5). Therefore, the main characteristic of the FC restructuring can be described as Hebbian-like sharpening. The overall consequence of intense cortical activation was thus to “focus” the patterns of resting-state correlations (FCs) around the most activated sites. This conclusion was further supported by the fact that, in our purely data-driven analysis of connectivity, the main site showing reduced global connectivity overlapped the NF-activated region (Fig. 7B).
Our results provide a unifying framework to the substantial body of literature describing such restructurings, in which some FC changes were reported to be of deeper anticorrelation (Lewis et al., 2009), whereas others reported increased FC levels (Albert et al., 2009; Tambini et al., 2010; Taubert et al., 2011) or mixed FC levels (Stevens et al., 2010; Eryilmaz et al., 2011). Our study shows that both increases and decreases in FC after the cortical activation occurred and were quantitatively proportional to the level (and sign) of co-modulation. Therefore, cortical networks that showed antagonistic relationship during training (e.g., the right IPL and left dACC) showed a corresponding reduction in their resting-state FC after training. However, it is important to point out that our present study was focused on the dACC network, so generalization to other cortical networks necessitates additional verification.
Interestingly, our study shows that the cortical restructuring was significantly accentuated when long versus short delays were compared (Fig. 3B,C). This unexpected finding raises the intriguing possibility that the enhancement reflects overnight consolidation effects (Karni et al., 1994; Laureys et al., 2001; Lamprecht and LeDoux, 2004). However, it is also possible that exhaustion or fatigue processes immediately after the task reduced the full manifestation of the FC-restructuring effect.
Although we have used a NF procedure to achieve effective brain activation, there is no reason to assume that NF per se played a critical role in the effect. Furthermore, our study was not aimed to demonstrate an improved dACC control or learning effects after the NF. The significant link between the extent of coactivation and the focusing effect (Fig. 5A) suggests that the critical parameter in restructuring was the task-coactivation level rather than the NF procedure itself. However, it is possible that the intensity of the NF activations (Christopher deCharms, 2008) and the volition-related NF strategy (Preminger et al., 2011) allowed us to generate long-term changes even after 30 min of task activation.
As mentioned previously, the subjects were all research students and this might have contributed to their success in controlling the dACC by possibly having enhanced motivation to succeed in such a NF procedure. Future studies can include populations of subjects who are not research students to further generalize the effect.
It could be argued that our day-after effect might be the result of subjects' reenactment of the NF strategy during the rest period on the following day. Several types of analyses were conducted to rule out this interpretation. First, subjects were interviewed immediately after each of the NF and rest conditions and reported about their thought content. Detailed, blind analysis of these reports showed a significant difference between the NF and resting conditions, but no difference between any of the resting conditions themselves and no correlation between the amplitude of NF activation or the sharpening effect and the category of thought content during rest. Second, analyzing separately selected groups of subjects whose reported thought content during the resting scan appeared to greatly differ from the NF strategy (e.g., repetitive inner speech) failed to reveal a significantly lower focusing effect (see Results and Fig. 5A).
Finally, using BOLD fluctuation amplitude (power) as a “signature” of focused cognitive processes, we show that during the NF, fluctuation power was significantly different from both the pre- and day-after NF resting states. However, no significant difference was found between the pre and day-after resting-state fluctuations themselves. These results argue against the possibility that the focusing effect was due to subjects' reenactment of the NF thought processes during the resting-state periods.
Another trivial explanation for the focusing effect may be subjects' fatigue or other general time-related effects. Therefore, it could be argued that the focused FC was not a result of the NF procedure proper, but was merely due to the repetition of the fMRI scanning. Three findings argue against a “fatigue” effect. First, although we have not included a “passive” control group that did not perform the NF task, our results show that the amount of focusing effect was specifically linked to the amplitude of NF activation and not merely to the number of fMRI scans. Furthermore, the effect was selective to the NF target ROI, because repeating the same analysis on a sham ROI located near the NF ROI but not activated failed to reveal the sharpening effect (Fig. 6). Furthermore, the lack of sharpening effect in the sham ROI could not be attributed to faster habituation dynamics, because no significant focusing was found immediately after the NF period (see Results). Second, the effect was complex in nature, in fact showing both increases and decreases in resting-state FC depending on the level of coactivation during the NF session (Fig. 5A). Third, we found, in a largely data-driven manner (although it should be noted that our analysis is novel and additional research will be needed to fully establish its potential), that the focusing effect coincided with the specific NF-activated region (Fig. 7B). The anatomical specificity and activity dependence of this effect strongly argue against a generalized fatigue produced by the repeated fMRI scanning as the underlying cause of the focusing effect.
Our present results offer a unified and plausible explanation to the remarkably rich and consistent pattern of coordinated activity observed during rest. Therefore, our findings are compatible with the hypothesis that the patterning of resting-state activity is the result of a generalized Hebbian-like sharpening principle that is initiated by prior network activations. In other words, the resting-state patterns can be viewed as slowly changing traces that have been imposed, at least partially, upon the cortical architecture by the accumulated impact of prior cortical activity. How much of the resting-state connectivity pattern may be attributed to such prior Hebbian sharpening is still not clear. The actual role played by such restructuring, whether it simply reflects strengthening and weakening of FC (Amedi et al., 2005) or serve some other function (Esser et al., 2006; Schmidt et al., 2006; Tononi and Cirelli, 2006), remains to be investigated.
We demonstrate here that a focus of brain activation that occurred 24 h before the scan could be revealed in a data-driven and hypothesis-free analysis (Fig. 7B). Of particular relevance is the observation that this effect was extremely robust and thus could be detected in every subject tested individually. Given that the resting-state scan lasted merely 6 min, this result opens up the exciting possibility that the resting-state patterns may constitute a powerful brain-wide and personalized “window” into the personal history of brain activations in individual subjects. Such information could be important for an objective yet personalized diagnosis of cortical and cognitive pathologies and perhaps even the unique habits and traits in healthy individuals.
Footnotes
This work was funded by the Israel Science Foundation (Grant #160/07 and Minerva grants to R.M. and Bikura Grant #1538/09), the National Institute of Psychobiology in Israel (grant to S.P. and R.M.), the European Union (FP7 VERE grant), the Helen and Martin Kimmel Institute (award to R.M.), and the Weizmann Institute–Tel-Hashomer Medical Center (Sheba collaboration grant to S.P.). We thank Nahum Stern, Fanny Atar, and Dr. Edna Haran-Furman for their assistance in the imaging setup and rtfMRI data collection.
The authors declare no competing financial interests.
References
- Albert NB, Robertson EM, Miall RC. The resting human brain and motor learning. Curr Biol. 2009;19:1023–1027. doi: 10.1016/j.cub.2009.04.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Amedi A, Merabet LB, Bermpohl F, Pascual-Leone A. The occipital cortex in the blind–lessons about plasticity and vision. Curr Dir Psychol Sci. 2005;14:306–311. doi: 10.1111/j.0963-7214.2005.00387.x. [DOI] [Google Scholar]
- Artola A, Bröcher S, Singer W. Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature. 1990;347:69–72. doi: 10.1038/347069a0. [DOI] [PubMed] [Google Scholar]
- Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc Series B (Methodological) 1995:289–300. [Google Scholar]
- Biswall B. 12 Resting-state brain connectivity. Foundational Issues in Human Brain Mapping 135. 2010 [Google Scholar]
- Buckner RL, Carroll DC. Self-projection and the brain. Trends Cogn Sci. 2007;11:49–57. doi: 10.1016/j.tics.2006.11.004. [DOI] [PubMed] [Google Scholar]
- deCharms RC. Applications of real-time fMRI. Nat Rev Neurosci. 2008;9:720–729. doi: 10.1038/nrn2414. [DOI] [PubMed] [Google Scholar]
- deCharms RC, Maeda F, Glover GH, Ludlow D, Pauly JM, Soneji D, Gabrieli JD, Mackey SC. Control over brain activation and pain learned by using real-time functional MRI. Proc Natl Acad Sci U S A. 2005;102:18626–18631. doi: 10.1073/pnas.0505210102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eryilmaz H, Van De Ville D, Schwartz S, Vuilleumier P. Impact of transient emotions on functional connectivity during subsequent resting state: A wavelet correlation approach. Neuroimage. 2011;54:2481–2491. doi: 10.1016/j.neuroimage.2010.10.021. [DOI] [PubMed] [Google Scholar]
- Esser SK, Huber R, Massimini M, Peterson MJ, Ferrarelli F, Tononi G. A direct demonstration of cortical LTP in humans: a combined TMS/EEG study. Brain Res Bull. 2006;69:86–94. doi: 10.1016/j.brainresbull.2005.11.003. [DOI] [PubMed] [Google Scholar]
- Fox MD, Snyder AZ, Vincent JL, Corbetta M, Van Essen DC, Raichle ME. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc Natl Acad Sci U S A. 2005;102:9673–9678. doi: 10.1073/pnas.0504136102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friston KJ, Holmes AP, Price CJ, Büchel C, Worsley KJ. Multisubject fMRI studies and conjunction analyses. Neuroimage. 1999;10:385–396. doi: 10.1006/nimg.1999.0484. [DOI] [PubMed] [Google Scholar]
- Golland Y, Golland P, Bentin S, Malach R. Data-driven clustering reveals a fundamental subdivision of the human cortex into two global systems. Neuropsychologia. 2008;46:540–553. doi: 10.1016/j.neuropsychologia.2007.10.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greicius MD, Krasnow B, Reiss AL, Menon V. Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc Natl Acad Sci U S A. 2003;100:253–258. doi: 10.1073/pnas.0135058100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hebb DO. The organization of behavior: a neuropsychological theory. New York: Psychology Press; 1949. [Google Scholar]
- Holroyd CB, Coles MG. Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex. 2008;44:548–559. doi: 10.1016/j.cortex.2007.08.013. [DOI] [PubMed] [Google Scholar]
- Johnston SJ, Boehm SG, Healy D, Goebel R, Linden DE. Neurofeedback: a promising tool for the self-regulation of emotion networks. Neuroimage. 2010;49:1066–1072. doi: 10.1016/j.neuroimage.2009.07.056. [DOI] [PubMed] [Google Scholar]
- Karni A, Tanne D, Rubenstein BS, Askenasy JJ, Sagi D. Dependence on REM sleep of overnight improvement of a perceptual skill. Science. 1994;265:679–682. doi: 10.1126/science.8036518. [DOI] [PubMed] [Google Scholar]
- Lamprecht R, LeDoux J. Structural plasticity and memory. Nat Rev Neurosci. 2004;5:45–54. doi: 10.1038/nrn1301. [DOI] [PubMed] [Google Scholar]
- Laureys S, Peigneux P, Phillips C, Fuchs S, Degueldre C, Aerts J, Del Fiore G, Petiau C, Luxen A, van der Linden M, Cleeremans A, Smith C, Maquet P. Experience-dependent changes in cerebral functional connectivity during human rapid eye movement sleep. Neuroscience. 2001;105:521–525. doi: 10.1016/S0306-4522(01)00269-X. [DOI] [PubMed] [Google Scholar]
- Levy R, Dubois B. Apathy and the functional anatomy of the prefrontal cortex–basal ganglia circuits. Cereb Cortex. 2006;16:916–928. doi: 10.1093/cercor/bhj043. [DOI] [PubMed] [Google Scholar]
- Lewis CM, Baldassarre A, Committeri G, Romani GL, Corbetta M. Learning sculpts the spontaneous activity of the resting human brain. Proc Natl Acad Sci U S A. 2009;106:17558–17563. doi: 10.1073/pnas.0902455106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Markram H, Lübke J, Frotscher M, Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science. 1997;275:213–215. doi: 10.1126/science.275.5297.213. [DOI] [PubMed] [Google Scholar]
- Mennes M, Kelly C, Zuo XN, Di Martino A, Biswal BB, Castellanos FX, Milham MP. Inter-individual differences in resting-state functional connectivity predict task-induced BOLD activity. Neuroimage. 2010;50:1690–1701. doi: 10.1016/j.neuroimage.2010.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mostofsky SH, Simmonds DJ. Response inhibition and response selection: Two sides of the same coin. J Cogn Neurosci. 2008;20:751–761. doi: 10.1162/jocn.2008.20500. [DOI] [PubMed] [Google Scholar]
- Nir Y, Hasson U, Levy I, Yeshurun Y, Malach R. Widespread functional connectivity and fMRI fluctuations in human visual cortex in the absence of visual stimulation. Neuroimage. 2006;30:1313–1324. doi: 10.1016/j.neuroimage.2005.11.018. [DOI] [PubMed] [Google Scholar]
- Nir Y, Mukamel R, Dinstein I, Privman E, Harel M, Fisch L, Gelbard-Sagiv H, Kipervasser S, Andelman F, Neufeld MY, Kramer U, Arieli A, Fried I, Malach R. Interhemispheric correlations of slow spontaneous neuronal fluctuations revealed in human sensory cortex. Nat Neurosci. 2008;11:1100–1108. doi: 10.1038/nn.2177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Power JD, Fair DA, Schlaggar BL, Petersen SE. The development of human functional brain networks. Neuron. 2010;67:735–748. doi: 10.1016/j.neuron.2010.08.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preminger S, Harmelech T, Malach R. Stimulus-free thoughts induce differential activation in the human default network. Neuroimage. 2011;54:1692–1702. doi: 10.1016/j.neuroimage.2010.08.036. [DOI] [PubMed] [Google Scholar]
- Preminger S, Harmelech T, et al. Functional magnetic resonance imaging study of self-initiated motivated behavior in the human cerebral cortex. Soc Neurosci Abstr. 2008;34 682.2. [Google Scholar]
- Riedl V, Valet M, Wöller A, Sorg C, Vogel D, Sprenger T, Boecker H, Wohlschläger AM, Tölle TR. Repeated pain induces adaptations of intrinsic brain activity to reflect past and predict future pain. Neuroimage. 2011;57:206–213. doi: 10.1016/j.neuroimage.2011.04.011. [DOI] [PubMed] [Google Scholar]
- Rushworth MF, Walton ME, Kennerley SW, Bannerman DM. Action sets and decisions in the medial frontal cortex. Trends Cogn Sci. 2004;8:410–417. doi: 10.1016/j.tics.2004.07.009. [DOI] [PubMed] [Google Scholar]
- Salomon R, Bleich-Cohen M, Hahamy-Dubossarsky A, Dinstien I, Weizman R, Poyurovsky M, Kupchik M, Kotler M, Hendler T, Malach R. Global functional connectivity deficits in schizophrenia depend on behavioral state. J Neurosci. 2011;31:12972–12981. doi: 10.1523/JNEUROSCI.2987-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scharnowski F, Hutton C, Josephs O, Weiskopf N, Rees G. Improving visual perception through neurofeedback. J Neurosci. 2012;32:17830–17841. doi: 10.1523/JNEUROSCI.6334-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schmidt C, Peigneux P, Muto V, Schenkel M, Knoblauch V, Münch M, de Quervain DJ, Wirz-Justice A, Cajochen C. Encoding difficulty promotes postlearning changes in sleep spindle activity during napping. J Neurosci. 2006;26:8976–8982. doi: 10.1523/JNEUROSCI.2464-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shirer W, Ryali S, Rykhlevskaia E, Menon V, Greicius M. Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb Cortex. 2011 doi: 10.1093/cercor/bhr099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stevens WD, Buckner RL, Schacter DL. Correlated low-frequency BOLD fluctuations in the resting human brain are modulated by recent experience in category-preferential visual regions. Cereb Cortex. 2010;20:1997–2006. doi: 10.1093/cercor/bhp270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Talairach J, Tournoux P. Co-planar stereotaxic atlas of the human brain: 3-dimensional proportional system: an approach to cerebral imaging (Thieme) 1988 [Google Scholar]
- Tambini A, Ketz N, Davachi L. Enhanced brain correlations during rest are related to memory for recent experiences. Neuron. 2010;65:280–290. doi: 10.1016/j.neuron.2010.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taubert M, Lohmann G, Margulies DS, Villringer A, Ragert P. Long-term effects of motor training on resting-state networks and underlying brain structure. Neuroimage. 2011;57:1492–1498. doi: 10.1016/j.neuroimage.2011.05.078. [DOI] [PubMed] [Google Scholar]
- Tononi G, Cirelli C. Sleep function and synaptic homeostasis. Sleep Med Rev. 2006;10:49–62. doi: 10.1016/j.smrv.2005.05.002. [DOI] [PubMed] [Google Scholar]
- Urner M, Schwarzkopf DS, Friston K, Rees G. Early visual learning induces long-lasting connectivity changes during rest in the human brain. Neuroimage. 2013 doi: 10.1016/j.neuroimage.2013.03.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Dijk KR, Hedden T, Venkataraman A, Evans KC, Lazar SW, Buckner RL. Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. J Neurophysiol. 2010;103:297–321. doi: 10.1152/jn.00783.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vincent JL, Snyder AZ, Fox MD, Shannon BJ, Andrews JR, Raichle ME, Buckner RL. Coherent spontaneous activity identifies a hippocampal-parietal memory network. J Neurophysiol. 2006;96:3517–3531. doi: 10.1152/jn.00048.2006. [DOI] [PubMed] [Google Scholar]
- Weiskopf N, Scharnowski F, Veit R, Goebel R, Birbaumer N, Mathiak K. Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI) J Physiol Paris. 2004;98:357–373. doi: 10.1016/j.jphysparis.2005.09.019. [DOI] [PubMed] [Google Scholar]
- Zhang G, Zhang H, Li X, Zhao X, Yao L, Long Z. Functional alteration of the DMN by learned regulation of the PCC using real-time fMRI. IEEE Trans Neural Syst Rehabil Eng. 2012 doi: 10.1109/TNSRE.2012.2221480. Advance online publication. Retrieved October 9, 2012. [DOI] [PubMed] [Google Scholar]