Abstract
Our understanding of the cognitive functions of the human brain has tremendously benefited from the population functional Magnetic Resonance Imaging (fMRI) studies in the last three decades. The reliability and replicability of the fMRI results, however, have been recently questioned, which has been named the replication crisis. Sufficient statistical power is fundamental to alleviate the crisis, by either “going big,” leveraging big datasets, or by “going small,” densely scanning several participants. Here we reported a “going small” project implemented in our department, the Bergen breakfast scanning club (BBSC) project, in which three participants were intensively scanned across a year. It is expected this kind of new data collection method can provide novel insights into the variability of brain networks, facilitate research designs and inference, and ultimately lead to the improvement of the reliability of the fMRI results.
Keywords: deep neuroimaging, precision brain mapping, resting-state fMRI, MRS, reliability, variability, reproducibility
Introduction
The pursuit of understanding how the brain works has been driving researchers to develop innovative and novel utilities. Since the discovery of functional Magnetic Resonance Imaging (fMRI) in the early 90s (Kwong et al., 1992; Ogawa et al., 1992) it has been ubiquitously utilized in the cognitive neuroscience research field due to its relatively high spatial resolution compared to other non-invasive neuroimaging tools. Undoubtedly, by leveraging fMRI, our understanding of the brain has been substantially deepened and expanded. For example, it is now well known that there are several brain regions preferentially responding to specific stimuli, such as the fusiform area (FFA) for faces (Kanwisher et al., 1997), the visual word form area for words (Nobre et al., 1994), and the number form area (NFA) for numbers (Shum et al., 2013). Besides, several brain networks have been consistently recognized with the resting-state fMRI data (Damoiseaux et al., 2006), which can be corresponded to the brain networks at tasks (Smith et al., 2009). In addition, the association between the brain indices and phenotypes has also been widely explored (Genon et al., 2018; Masouleh et al., 2019).
Although new insights and perspectives have been proliferated with fMRI data, however, the reliability and reproducibility have been recently questioned (Bennett and Miller, 2010). It has shown that different parameter choices in the processing pipeline could affect the final conclusions (Botvinik-Nezer et al., 2020). What’s more, the puzzlingly high correlation in fMRI studies in emotion, personality, and social cognition (Vul et al., 2009) is somehow worrisome [but also see different opinion (Lieberman et al., 2009)]. Playing into this point, low statistical power, often produced by small sample sizes, can undermine the reliability of the neuroscience research (Button et al., 2013).
Having said that, how can we increase the reliability and reproducibility of fMRI studies, especially about the brain-behavior correlation? In one recently published article in Nature, the researchers have suggested that acquiring thousands of individuals’ data can be one way to reliably detect small effects from brain-wide associations (Marek et al., 2022). A corresponding opinion article (Gratton et al., 2022) has suggested that there are generally two ways to increase reliability by obtaining sufficient data: “going big” as in the mentioned article, or “going small” in which several individuals can be repeatedly scanned to form a deep neuroimaging dataset.
The concept of deep brain imaging is relatively new but not exotic. It can be traced down to the MyConnectome project (Laumann et al., 2015; Poldrack et al., 2015; Poldrack, 2021), where a single subject was densely scanned for around 2 years resulting in around 100 MRI sessions. It has been shown that the brain networks trend differently between group level and individual level, and different factors such as drinking coffee can introduce connectomic shifts (Poldrack et al., 2015). The Bergen breakfast scanning club (BBSC) project is inspired by the MyConnectome project, and we would like to replicate the findings from the MyConnectome project as well as explore other factors which could affect fMRI signals, for example, the effect of seasonal long-night and long-day phenomena which are unique to world regions close to the poles.
Based on this endeavor, here we report a “going small” project implemented in our department between February 2021 and 2022, where three individuals were densely scanned for a year. All three subjects are male, right-handed, and speak at least two languages (age: 31, 27, and 40). The name of the project is a combination of scanning place Bergen and the breakfast club, where initially we wanted to scan the participants in the morning. It was also an homage to the Midnight Scanning Club dataset (Gordon et al., 2017).
Project’s description
The overarching goal of the BBSC project is to understand the variability of the fMRI signal and explore precision brain mapping at the individual level. The purpose of the project is threefold. The first is to explore the effects of exogenous factors exerting on fMRI signals, such as time of day, and time of year since the long-night and long-day phenomena in Norway. The second is to explore how endogenous factors affect fMRI signals, such as emotional state, physiological indices, and daily routine. The third is to explore the relationship between functional and structural brain organization. Accordingly, there were three protocols in the project including a behavioral, a functional, and a structural protocol. Brain imaging data were acquired at the Haukeland University Hospital with an up-to-date high-performance 3T MRI (GE Discovery 750).
It was expected that the participants would be scanned twice a week (once in the morning, once in the afternoon) with the functional protocol and once a month with the structural protocol, which would result in 50 scanning sessions in total for each participant.
In the behavioral protocol, we have collected information about the participants’ daily life such as sleep duration, time spent on excise, and any significant daily events. The behavioral protocol was implemented twice a day (after getting up and before going to bed) on participants’ mobile phones.
In the functional protocol (Figure 1A), first, 7 min T1-weighted brain image data were collected, which will be used for brain registration and gray matter changes exploration. Second, to test the metabolism level, 5 min magnetic resonance spectroscopy (MRS) data were recorded. MRS can detect metabolism changes in the brain, where major metabolites concentration can be calculated (Harris et al., 2017). Last, 12 min resting-state fMRI data as recommended (Birn et al., 2013) have been collected as well as the pulse, respiratory, and blood oxygen saturation levels. The resting-state fMRI, simply put, records systematic, non-random variations in the activation of the brain in the absence of a specific task. These activations are indirectly reflected in regional fluctuations in the level of oxygenation of the blood (a.k.a. BOLD signal). It has been widely used to explore functional brain activation (Biswal et al., 1995), from which brain networks (also called “resting-state networks”) can be extracted (Damoiseaux et al., 2006) and network-related characteristics can be explored (Bullmore and Sporns, 2009; Van Den Heuvel and Pol, 2010). Questionnaires including the outside and inside weather indices and the participants’ emotional states were filled out before scanning, while the Amsterdam resting state questionnaire (Diaz et al., 2013) was filled out after scanning. This protocol was implemented twice a week for a year except for public holidays.
In the structural protocol (Figure 1A), 10 min T2-weighted brain images were first collected to examine the variability of the gray matter. Then, 10 min diffusion-weighted imaging (DWI) and 7 min Fluid-attenuated inversion recovery (FLAIR) brain imaging data were recorded to explore the variability of the white matter. This protocol was implemented once a month for a year except for public holidays.
Analysis plan
The overview of the analysis plan was depicted in Figure 1B. First and foremost, we will chart the fluctuation of the fMRI data and MRS data to depict the variability of those signals over a year. Second, in order to achieve the first purpose, indices extracted from the neuroimaging data will be compared between season-dependent long and short daylight periods, as well as morning and evening. Third, in order to get the second purpose, we will explore the relationship between physiological data (pulse, respiratory, and blood oxygen saturation levels) and resting-state fMRI data. Accordingly, we will propose how to clean the resting-state fMRI data with these physiological data. Finally, in order to reach the third purpose, a virtual brain model will be constructed based on the virtual brain (TVB) platform (Sanz Leon et al., 2013). The dataset will be made public after the main results have been published.
Discussion
In a conventional way, dozens or hundreds of participants should be recruited for an fMRI study or big open datasets can be leveraged to explore the questions that one is interested in. Contrary to the conventional way, here we report a deep brain imaging project, the BBSC project, where three participants have been densely scanned for a year. The relatively new data collection method can provide new insights into the architecture of the brain and the variability of how the brain signal fluctuates over a year.
Deep brain imaging data can extend our understanding of brain parcellation which are yet mainly based on the “going big” approach. Brain templates or parcellations are conventionally constructed from congregated data from different participants, which inevitably will wipe out the individual characters. For example, a recent study shows that a brain region belonging to the default mode network (DMN) network at the group level brain parcellation is actually affiliated with the attention network at the individual level (Laumann et al., 2015). By leveraging deep brain imaging data, detailed brain parcellation based on individual functional connections can be revealed (Gordon et al., 2017; Marek and Greene, 2021), which can further make a contribution to precision medicines (Gratton et al., 2020). The BBSC project will advance this endeavor, and further based on the individual brain parcellation explore the variability of individual brain networks.
Furthermore, deep brain imaging data can better illustrate the relationship between structural and functional brain organizations. By using the functional and structural data collected in the BBSC project, a virtual brain model can be constructed with the TVB platform (Sanz Leon et al., 2013). Thus, the dependence between functional and structural brain organizations can be illustrated by manipulating the parameters in the model (Sanz Leon et al., 2013). Overall, the deep brain imaging method holds much potential and can advance our understanding of how the brain works (Gratton and Braga, 2021).
Deriving from the project, we can provide practical information for fMRI data collection and analysis. For example, it could be ideal that participants should be scanned within a season or daytime window; always measure variable X in addition to fMRI because the signal can be convoluted by variable X. In summary, the rich data collected from the BBSC project entails the potential to chart the variability of the fMRI signal over a year, better comprehension of the relationship between functional and structural data, and the dependence between exogenous and endogenous factors and fMRI signals. Hereafter, the results can enhance the reliability of the fMRI studies.
Data availability statement
The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.
Ethics statement
The studies involving human participants were reviewed and approved by the Regional Committee for Medical and Health Research Ethics. The patients/participants provided their written informed consent to participate in this study.
Author contributions
M-YW, MK, RE, and KS contributed to the conception of the research project and final version of the manuscript. All authors contributed to the article and approved the submitted version.
Acknowledgments
We thank Alexandra Vik and Liucija Vaisvilaite for their suggestions on post resting-state fMRI data collection questionnaire. We also thank Alexander R. Craven for his expertise in MRS data analysis. Besides, we thank Ulvhild Faerøvik and Tania Martínez-Montero for providing useful resources. More importantly, we appreciate the tech support and data collection from our radiologists (Christel Jansen, Eva Øksnes, Roger Barndon, Trond Øvreaas, Tor Fjørtoft, and Turid Randa) at the Haukeland University Hospital.
Funding
This study was financed by the Research Council of Norway (Project number: 276044: When default is not default: Solutions to the replication crisis and beyond).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
- Bennett C. M., Miller M. B. (2010). How reliable are the results from functional magnetic resonance imaging? Ann. N. Y. Acad. Sci. 1191 133–155. [DOI] [PubMed] [Google Scholar]
- Birn R. M., Molloy E. K., Patriat R., Parker T., Meier T. B., Kirk G. R., et al. (2013). The effect of scan length on the reliability of resting-state fMRI connectivity estimates. Neuroimage 83 550–558. 10.1111/j.1749-6632.2010.05446.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Biswal B. B., Zerrin Yetkin F., Haughton V. M., Hyde J. S. (1995). Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn. Reson. Med. 34 537–541. 10.1016/j.neuroimage.2013.05.099 [DOI] [PubMed] [Google Scholar]
- Botvinik-Nezer R., Holzmeister F., Camerer C. F., Dreber A., Huber J., Johannesson M., et al. (2020). Variability in the analysis of a single neuroimaging dataset by many teams. Nature 582 84–88. 10.1002/mrm.1910340409 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bullmore E., Sporns O. (2009). Complex brain networks: Graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10 186–198. 10.1038/s41586-020-2314-9 [DOI] [PubMed] [Google Scholar]
- Button K. S., Ioannidis J., Mokrysz C., Nosek B. A., Flint J., Robinson E. S., et al. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14 365–376. 10.1038/nrn2575 [DOI] [PubMed] [Google Scholar]
- Damoiseaux J. S., Rombouts S., Barkhof F., Scheltens P., Stam C. J., Smith S. M., et al. (2006). Consistent resting-state networks across healthy subjects. Proc. Natl. Acad. Sci.U.S.A. 103 13848–13853. 10.1038/nrn3475 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Diaz B. A., Van Der Sluis S., Moens S., Benjamins J. S., Migliorati F., Stoffers D., et al. (2013). The amsterdam resting-state questionnaire reveals multiple phenotypes of resting-state cognition. Front. Hum. Neurosci. 7:446. 10.1073/pnas.0601417103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genon S., Reid A., Langner R., Amunts K., Eickhoff S. B. (2018). How to characterize the function of a brain region. Trends Cogn. Sci. 22 350–364. 10.3389/fnhum.2013.00446 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gordon E. M., Laumann T. O., Gilmore A. W., Newbold D. J., Greene D. J., Berg J. J., et al. (2017). Precision functional mapping of individual human brains. Neuron 95 791.–807. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gratton C., Braga R. M. (2021). Editorial overview: Deep imaging of the individual brain: Past, practice, and promise. Curr. Opin. Behav. Sci. 40 iii–vi. 10.1016/j.tics.2018.01.010 [DOI] [Google Scholar]
- Gratton C., Kraus B. T., Greene D. J., Gordon E. M., Laumann T. O., Nelson S. M., et al. (2020). Defining individual-specific functional neuroanatomy for precision psychiatry. Biol. Psychiatry 88 28–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gratton C., Nelson S. M., Gordon E. M. (2022). Brain-behavior correlations: Two paths toward reliability. Neuron 110 1446–1449. 10.1016/j.cobeha.2021.06.011 [DOI] [PubMed] [Google Scholar]
- Harris A. D., Saleh M. G., Edden R. A. (2017). Edited 1H magnetic resonance spectroscopy in vivo: Methods and metabolites. Magn. Reson. Med. 77 1377–1389. 10.1016/j.biopsych.2019.10.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanwisher N., McDermott J., Chun M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. J. Neurosci. 17 4302–4311. 10.1016/j.neuron.2022.04.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kwong K. K., Belliveau J. W., Chesler D. A., Goldberg I. E., Weisskoff R. M., Poncelet B. P., et al. (1992). Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proc. Natl. Acad. Sci. 89 5675–5679. 10.1002/mrm.26619 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Laumann T. O., Gordon E. M., Adeyemo B., Snyder A. Z., Joo S. J., Chen M.-Y., et al. (2015). Functional system and areal organization of a highly sampled individual human brain. Neuron 87 657–670. 10.1523/JNEUROSCI.17-11-04302.1997 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lieberman M. D., Berkman E. T., Wager T. D. (2009). Correlations in social neuroscience aren’t voodoo: Commentary on Vul etal. (2009). Perspect. Psychol. Sci. 4 299–307. 10.1073/pnas.89.12.5675 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marek S., Greene D. J. (2021). Precision functional mapping of the subcortex and cerebellum. Curr. Opin. Behav. Sci. 40 12–18. 10.1016/j.neuron.2015.06.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marek S., Tervo-Clemmens B., Calabro F. J., Montez D. F., Kay B. P., Hatoum A. S., et al. (2022). Reproducible brain-wide association studies require thousands of individuals. Nature 603 654–660. 10.1111/j.1745-6924.2009.01128.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Masouleh S. K., Eickhoff S. B., Hoffstaedter F., Genon S. Alzheimer’s Disease Neuroimaging Initiative. (2019). Empirical examination of the replicability of associations between brain structure and psychological variables. Elife 8:e43464. 10.1016/j.cobeha.2020.12.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nobre A. C., Allison T., McCarthy G. (1994). Word recognition in the human inferior temporal lobe. Nature 372 260–263. 10.1038/s41586-022-04492-9 [DOI] [PubMed] [Google Scholar]
- Ogawa S., Tank D. W., Menon R., Ellermann J. M., Kim S. G., Merkle H., et al. (1992). Intrinsic signal changes accompanying sensory stimulation: Functional brain mapping with magnetic resonance imaging. Proc. Natl. Acad. Sci. 89 5951–5955. 10.7554/eLife.43464 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poldrack R. A. (2021). Diving into the deep end: A personal reflection on the MyConnectome Study. Curr. Opin. Behav. Sci. 40 1–4. 10.1038/372260a0 [DOI] [Google Scholar]
- Poldrack R. A., Laumann T. O., Koyejo O., Gregory B., Hover A., Chen M.-Y., et al. (2015). Long-term neural and physiological phenotyping of a single human. Nat. Commun. 6 1–15. 10.1073/pnas.89.13.5951 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanz Leon P., Knock S. A., Woodman M. M., Domide L., Mersmann J., McIntosh A. R., et al. (2013). The virtual brain: A simulator of primate brain network dynamics. Front. Neuroinform. 7:10. 10.1016/j.cobeha.2020.10.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shum J., Hermes D., Foster B. L., Dastjerdi M., Rangarajan V., Winawer J., et al. (2013). A brain area for visual numerals. J. Neurosci. 33 6709–6715. 10.1038/ncomms9885 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith S. M., Fox P. T., Miller K. L., Glahn D. C., Fox P. M., Mackay C. E., et al. (2009). Correspondence of the brain’s functional architecture during activation and rest. Proc. Natl. Acad. Sci. U.S.A. 106 13040–13045. 10.3389/fninf.2013.00010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Den Heuvel M. P., Pol H. E. H. (2010). Exploring the brain network: A review on resting-state fMRI functional connectivity. Eur. Neuropsychopharmacol. 20 519–534. 10.1523/JNEUROSCI.4558-12.2013 [DOI] [PubMed] [Google Scholar]
- Vul E., Harris C., Winkielman P., Pashler H. (2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect. Psychol. Sci. 4 274–290. 10.1073/pnas.0905267106 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.