Abstract
Human neuroimaging has led to an overwhelming amount of research into brain function in healthy and clinical populations. However, a better appreciation of the limitations of small sample studies has led to an increased number of multi-site, multi-scanner protocols to understand human brain function. As part of a multi-site project examining social cognition in schizophrenia, a group of “travelling human phantoms” had structural T1, diffusion, and resting-state functional MRIs obtained annually at each of three sites. Scan protocols were carefully harmonized across sites prior to the study. Due to scanner upgrades at each site (all sites acquired PRISMA MRIs during the study) and one participant being replaced, the end result was 30 MRI scans across 4 people, 6 MRIs, and 4 years. This dataset includes multiple neuroimaging modalities and repeated scans across six MRIs. It can be used to evaluate differences across scanners, consistency of pipeline outputs, or test multi-scanner harmonization approaches.
Subject terms: Cognitive neuroscience, Computational neuroscience, Magnetic resonance imaging
Measurement(s) | Three-Dimensional Spoiled Gradient MRI • Functional Magnetic Resonance Imaging • Diffusion Weighted Imaging |
Technology Type(s) | T1 MRI • fMRI • Diffusion MRI |
Sample Characteristic - Organism | homo sapiens |
Sample Characteristic - Location | Canada and United States |
Background & Summary
Multi-site study designs are highly beneficial in combining resources across centers to maximize research participant recruitment. Such approaches have proven powerful for acquiring the large samples needed for transformative research. Multi-site collaboration is vital in the context of techniques such as neuroimaging, where data acquisition is both expensive and time-consuming, and in psychiatric research, where the available patient population at any given center is limited. However, multi-site neuroimaging research also suffers from some inherent challenges. Differences in signal characteristics across scanners, including scanners of the same manufacturer and model, can pose a challenge when combining data collected across multiple sites1,2. Furthermore, even within a single-site study, scanner upgrades and related changes can have impacts on data3; this problem is magnified when several sites are contributing data and potentially undergoing upgrades during the course of a study. Evaluating approaches to harmonize data across sites is essential as an increasing number of neuroimaging datasets include data collected across different scanners. One tool for validating harmonization approaches is to examine data from the same individuals collected across multiple scanners.
Another issue that has been rising to the forefront in neuroimaging research is low replicability4–6. Substantial efforts have been devoted to using neuroimaging approaches to develop ‘biomarkers’ of illness7–10. This has led to a proliferation of large scale, multi site neuroimaging studies, such as the Alzheimer’s Disease Neuroimaging Initiative (ADNI)11, the Canadian Dementia Imaging Protocol (CDIP)12, and the UK Biobank13. However, any such neuroimaging biomarkers are only clinically useful if they are stable/reliable measures. The stability of neuroimaging measures can be assessed via scan-rescan approaches. While some structural MRI measures such as cortical thickness seem to have high stability14–16, functional measures, such as task activity or functional connectivity, typically show low reliability when repeated in the same individual14,17. Measures such as functional connectivity between two specific brain regions are statistical values of inherently noisy signals; it may not be expected that such measures would show high stability. But despite poor scan-rescan reliability, functional connectivity patterns are individually identifying14,18. This demonstrates that useful signal is present amongst the noise, and within-subject scan-rescan variability may be lower than between-subject variability. Establishing useful neuroimaging biomarkers requires establishing the stability/reliability of such measures, as well as accounting for non-biological factors such as different signal characteristics across scanners. This is especially critical given the growth of large sample multi-site neuroimaging datasets.
We have been exploring biomarkers of social cognitive dysfunction in schizophrenia through the NIMH RDoC study ‘Social Processes Initiative in the Neurobiology of the Schizophrenias’ (SPINS)19–21. The SPINS study sample included neuroimaging data collected across three sites to maximize the available number of participants. To examine signal differences across MRIs, three “human phantoms” travelled to each of the three sites and underwent the imaging protocol. This process was repeated on an annual basis, during which one new “human phantom” was added and three new (PRISMA) scanners were introduced. We previously used a subset of this data to assess neuroimaging metrics across individuals and scanners14. Using a clustering approach, we noted that, with minimal correction for different scanners, an individual’s repeated scans are reliably clustered together. However, essential sources of MRI scanner variability were also present; particularly, the PRISMA scanners had substantial differences in diffusion metrics compared to the non-PRISMA scanners.
In total, this dataset consists of 30 scanning sessions across four individuals on six MRIs across four years. It provides a valuable resource for considering the MRI scanner’s effects on functional and structural neuroimaging metrics. While other datasets are available with larger numbers of participants or a greater number of scans17,22, this dataset has a relatively unique combination of the inclusion of functional, structural, and diffusion data collected across several MRI models over time. This provides an opportunity to examine site effects in a more naturalistic way, in a dataset that emerged from a multi-site study rather than being systematically designed and controlled for site effects. In this way, this dataset represents a ‘real world’ example of the challenges of integrating data across sites.
Methods
Data collection
MRI scans were collected annually across three participating sites starting in 2014 and ending in 2018. Participants traveled to each site and performed an MRI scan. At all three sites, Siemens Prisma MRIs were made available part way through the study. As a result, data from six MRIs is included in the dataset; each site changed MRI scanners mid-study. Each MRI is identified via a three-letter identifier in the file names (see below and Table 1). The three study sites were the Center for Addiction and Mental Health, affiliated with the University of Toronto, the Maryland Psychiatric Research Center (MPRC) affiliated with the University of Maryland School of Medicine, and Zucker Hillside Hospital, affiliated with the Zucker School of Medicine at Hofstra/Northwell. The original MRI at the Center for Addiction and Mental Health was a General Electric 750w Discovery 3 T, referred to as CMH; a Siemens Prisma (referred to as CMP) was made available in year four at the Toronto Neuroimaging Facility (ToNI) of the University of Toronto, Department of Psychology. The original MRI model at the Maryland Psychiatric Research Center was a Siemens Tim Trio 3 T (referred to as MRC); they later upgraded to a Siemens Prisma (referred to as MRP) for year three. Zucker Hillside had a General Electric 750 Signa 3 T (refer to a ZHH) at study start and upgraded to a Siemens Prisma (referred to as ZHP) for year three. Scans were performed annually, though in 2018 (year 4) scans were only performed on CMP (to collect data from the newly available Prisma scanner). Scan sites, scanner model and years at which scans were performed on each MRI are presented in Table 1.
Table 1.
Site | MRI Scanner | Years | Scanner ID |
---|---|---|---|
Toronto | General Electric 750w Discovery 3 T | 1,2,3 | CMH |
Toronto | Siemens Prisma 3 T | 4 | CMP |
Maryland | Siemens Tim Trio 3 T | 1,2 | MRC |
Maryland | Siemens Prisma 3 T | 3 | MRP |
New York | General Electric 750 Signa 3 T | 1,2 | ZHH |
New York | Siemens Prisma 3 T | 3 | ZHP |
Participants
Data are available from four healthy male participants, aged 34 to 59 during study start (aged 38 to 63 at study end). Participants had no history of psychiatric, neurological, or major chronic illness. Participants sub-01, sub-02, and sub-03 were collected at year one (study start) and during year two on scanners CMH, MRC, and ZHH. However, sub-03 was not available in year three and was thus replaced with sub-04. In year three, sub-01, sub-02, and sub-04 were scanned on CMH, MRP, and ZHP. In year four, participants sub-01, sub-02, and sub-04 were scanned at CMP only to provide data on an additional PRISMA scanner. A total of 30 MRI sessions were completed across the study. A schematic of the participant’s scanner schedule by year is presented in Fig. 1. All participants signed informed consent, including explicit consent to share data on a public repository, and the study had IRB approval at all sites.
Prospective data harmonization
Data were prospectively harmonized to the limits of available hardware at each site by matching scan parameters. When exact parameters were unable to be matched due to hardware capabilities or limitations, the closest appropriate value was selected. As the Siemens Prisma scanners were identical models, it was possible to perfectly match scan parameters across sites.
MRI scans
Each participant underwent MRI scans consisting of a T1-weighted (T1w) anatomical MRI, a diffusion-weighted MRI, and a 7-minute resting state functional MRI. The parameters for all sequences across all scanners were matched as closely as possible given the available hardware and specifics of each scanner. T1w anatomical scans used the manufacturer-specific fast gradient echo sequences (Siemens MRIs MRC, MRP, ZHP, and CMP: MPRAGE; GE MRIs CMH, ZHH: BRAVO). T1w scan parameters were TR = 2300 ms, 0.9 mm isotropic voxel size with no gap, interleaved ascending acquisition order, with TE from 2.78–3 ms, as determined by the scanner-specific hardware). As is standard practice to increase scan SNR at the MPRC site (Kochunov et al., 2006), three T1w scans were acquired and subsequently averaged into a single image prior to any preprocessing for the MRC and MRP scanners.
Diffusion weighted scans used an axial EPI dual spin echo sequence, with 60 gradient directions, b = 1000, five baseline scans with b = 0 (or six in the case of the PRISMA scanners), TR = 8800 ms, with the exception of ZHH where TR = 17700 ms; TE = 85 ms; FOV = 256 mm; in-plane matrix size was 128 × 128, 2.0 mm isotropic voxels with no gap). Resting fMRI scans lasted 7 minutes, with participants instructed to remain awake, eyes closed, and let their mind wander. The resting state fMRI was an EPI sequence of 212 volumes, TR = 2000 ms, TE = 30.0ms, FOV = 20 cm, 64 × 64 acquisition matrix, 40 slices of 4 mm thickness, interleaved ascending acquisition order. Relevant scan parameters are included in json files provided with each data record, and are presented in detail in Supplementary Table 1.
BIDS derivatives (BIDS details)
All data are organized according to the brain imaging data structure (BIDS) formatting23. BIDS provides a standardized naming specification and folder structure to allow for easy reference and standardized pipelines. In the BIDs specification, a folder for each participant exists at the top level of the folder hierarchy, with scans/sessions embedded within. Each session folder then has a sub-folder for each scan type acquired.
Following data acquisition, DICOM files were exported from each site to a common XNAT repository, and visual QC was performed. DICOM images were then converted to nifti format via dcm2niix v1.0.20190410, and renamed/organized according to the current BIDS standards. The integrity of the BIDS formatting was then checked via the BIDS validator (https://bids-standard.github.io/bids-validator/). To preserve participant anonymity, T1 scans were defaced using pydeface 2.0.0 (https://github.com/poldracklab/pydeface).
Data Records
Raw data has been uploaded to https://openneuro.org, in a repository entitled “Social Processes Initiative in Neurobiology of the Schizophrenia(s) Traveling Human Phantoms”24, accession number ds003011. The full link is https://openneuro.org/datasets/ds003011.
Following BIDS, data from each participant is stored within a separate folder, labeled by subject ID (sub-01, sub-02, sub-03, and sub-04). Within participant folders, separate folders exist for each session which that participant completed. Session folders are labeled in the form ses-[Year][Scanner], with year indicated by Y1, Y2, Y3, or Y4 (for years 1–4 respectively) and scanner as indicated on Table 2. Each session folder in turn includes folders for anat (T1), func (resting state fMRI), and dwi (diffusion MRI scan). Within each of these folders exists a nifti (.nii.gz) file for the image, and a.json file containing scan parameters (generated by dcm2niix). For the dwi folder, bvec and bval files are also included, containing the gradient directions and diffusion weighting respectively.
Table 2.
Record | Participant | Scanner | Date | Age | |||
---|---|---|---|---|---|---|---|
sub-01 | Y1 | CMH | sub-01_ses-Y1CMH | sub-01 | CMH | Fall 2014 | 52 |
sub-01 | Y1 | MRC | sub-01_ses-Y1MRC | sub-01 | MRC | Fall 2014 | 52 |
sub-01 | Y1 | ZHH | sub-01_ses-Y1ZHH | sub-01 | ZHH | Fall 2014 | 52 |
sub-01 | Y2 | CMH | sub-01_ses-Y2CMH | sub-01 | CMH | Fall 2015 | 53 |
sub-01 | Y2 | MRC | sub-01_ses-Y2MRC | sub-01 | MRC | Fall 2015 | 53 |
sub-01 | Y2 | ZHH | sub-01_ses-Y2ZHH | sub-01 | ZHH | Fall 2015 | 53 |
sub-02 | Y3 | CMH | sub-02_ses-Y3CMH | sub-02 | CMH | Fall 2016 | 39 |
sub-02 | Y3 | MRP | sub-02_ses-Y3MRP | sub-02 | MRP | Fall 2016 | 39 |
sub-02 | Y3 | ZHP | sub-02_ses-Y3ZHP | sub-02 | ZHP | Fall 2016 | 39 |
sub-02 | Y4 | CMP | sub-02_ses-Y4CMP | sub-02 | CMP | Fall 2017 | 40 |
sub-03 | Y1 | CMH | sub-03_ses-Y1CMH | sub-03 | CMH | Fall 2014 | 36 |
sub-03 | Y1 | MRC | sub-03_ses-Y1MRC | sub-03 | MRC | Fall 2014 | 36 |
sub-03 | Y1 | ZHH | sub-03_ses-Y1ZHH | sub-03 | ZHH | Fall 2014 | 36 |
sub-03 | Y2 | CMH | sub-03_ses-Y2CMH | sub-03 | CMH | Fall 2015 | 37 |
sub-03 | Y2 | MRC | sub-03_ses-Y2MRC | sub-03 | MRC | Fall 2015 | 37 |
sub-03 | Y2 | ZHH | sub-03_ses-Y2ZHH | sub-03 | ZHH | Fall 2015 | 37 |
sub-03 | Y3 | CMH | sub-03_ses-Y3CMH | sub-03 | CMH | Fall 2016 | 38 |
sub-03 | Y3 | MRP | sub-03_ses-Y3MRP | sub-03 | MRP | Fall 2016 | 38 |
sub-03 | Y3 | ZHP | sub-03_ses-Y3ZHP | sub-03 | ZHP | Fall 2016 | 38 |
sub-03 | Y4 | CMP | sub-03_ses-Y4CMP | sub-03 | CMP | Fall 2017 | 39 |
sub-04 | Y1 | CMH | sub-04_ses-Y1CMH | sub-04 | CMH | Fall 2014 | 59 |
sub-04 | Y1 | MRC | sub-04_ses-Y1MRC | sub-04 | MRC | Fall 2014 | 59 |
sub-04 | Y1 | ZHH | sub-04_ses-Y1ZHH | sub-04 | ZHH | Fall 2014 | 59 |
sub-04 | Y2 | CMH | sub-04_ses-Y2CMH | sub-04 | CMH | Fall 2015 | 60 |
sub-04 | Y2 | MRC | sub-04_ses-Y2MRC | sub-04 | MRC | Fall 2015 | 60 |
sub-04 | Y2 | ZHH | sub-04_ses-Y2ZHH | sub-04 | ZHH | Fall 2015 | 60 |
sub-04 | Y3 | CMH | sub-04_ses-Y3CMH | sub-04 | CMH | Fall 2016 | 61 |
sub-04 | Y3 | MRP | sub-04_ses-Y3MRP | sub-04 | MRP | Fall 2016 | 61 |
sub-04 | Y3 | ZHP | sub-04_ses-Y3ZHP | sub-04 | ZHP | Fall 2016 | 61 |
sub-04 | Y4 | CMP | sub-04_ses-Y4CMP | sub-04 | CMP | Fall 2017 | 62 |
sub-03 | Y4 | CMP |
Technical Validation
After MRI images were acquired, the scans were reviewed visually for artefacts and to ensure the diffusion scan directions were correct. To extract standardized image quality metrics (IQMs), the T1 and fMRI images were run through mriqc (version 0.14.2)25. IQMs were extracted from diffusion scans using FSL EDDY QUAD (Quality Assessment for DMRI)26. Data quality metrics are shown in Fig. 2. CNR (contrast-to-noise ratio) is an extension of signal to noise ratio (SNR), which evaluates the separation between gray and white matter tissue distributions. SNR was not used as a metric in this case as the bias field within the PRISMA scans distorts the SNR calculation. Mean framewise displacement (FD) is reported for DWI and fMRI. FD reflects head motion from frame-to-frame in an image that is acquired across time (i.e., fMRI or DWI). We report the mean of this framewise displacement for each scan. tSNR (time signal to noise ratio) is an extension of SNR over time. It is calculated as the bold signal across time divided by the temporal standard deviation.
Of the 30 scans included in this data set, 27 were part of a previously published paper examining differences between scanner and participants14. In that analysis, we performed hierarchical clustering on cortical thickness derived from the T1, basic diffusion metrics (white matter skeleton fractional anisotropy, FA), and resting state connectivity. In an initial clustering solution, diffusion data showed scanner specific clustering, with the PRISMA scan separating into a distinct cluster. However, when a simple correction for scanner was incorporated, all three modalities clustered by participant but not scanner, with the exception of two high motion resting state scans. This demonstrates that the data from all three scans was of sufficient quality to distinguish scans from different participants scanned repeatedly.
Usage Notes
Given ongoing concerns over reliability and sample size in neuroimaging, multi-site studies have become a critical tool for advancing research. This can be especially true in research on clinical populations, which has resulted in tremendous growth of multi-site neuroimaging samples11–13,20,27, as well as in the identification of treatment relevant biomarkers or biotypes28,29. While the protocol used in the current dataset uses older imaging sequences, which are not in alignment with state of the art public data sets, such as human connectome or adolescence brain cognitive development27,30, clinical datasets, such as ADNI, more commonly have scanning parameters closer to those in the current protocol11,12. Large scale projects such as the ENIGMA consortium have demonstrated the power of building large samples from combining previously collected data31,32, often featuring older sequences such as those in the current data.One challenge of working on neuroimaging data collected across multiple sites can be differences in signal across MRIs, even from the same vendor or the same model3,14,15,33–35. For example, within this data set our previous work noted a large difference in diffusion metrics in the Prisma as compared to non-Prisma scanners14. Repeated scanning data sets, such as the one presented here, can be useful to validate approaches intended to minimize MRI specific signal differences while retaining individually unique variance. While there has been a growing number of scan-rescan data sets at a single site36 or incorporating data from multiple sites but rescanning on the same MRI37, there remains a relative paucity of openly available multi-site travelling human datasets17,38,39. This data adds an additional openly available resource for evaluating the effects of different scanners within the same individuals, including the combination of structural, functional, and diffusion metrics which are not generally present in a single travelling human sample.
Repeated multi-site data sets also have the potential to address issues around stability and reliability of neuroimaging metrics1,5,16,17. Whether considering clinical populations of typically developing individuals, valid measurements are essential to understanding the human brain. These challenges can be exacerbated in clinical populations or when scanning older or younger populations, who often show greater motion40,41. Moreover, signal quality issues and higher motion related to behavior variability of interest, such as impulsivity or other clinical scales, can influence the assessment of brain-behavior relationships42,43. However, despite challenges in reliability of measurements, especially in fMRI44,45, important and replicable individual variability can be observed within these data18,22. Repeat scanning data sets can be used to help evaluate analytical approaches designed to minimize noise signals (e.g. motion) or pull important individual sources of variability from different MRI signals. For example, analytical frameworks which decrease within-subject variability (while accounting for potential within-subject noise sources) may represent more valid measures for individually meaningful brain signals.
This data set adds another resource to a growing list of publicly available rescan data sets. The novel features of this data set include the multi-modal data available and the fact that scans were collected across several years, MRIs, and across scanner upgrades (a common issue during longitudinal studies and long-term data collection).
Supplementary information
Acknowledgements
This work was supported by the National Institute of Mental Health (Grant Nos. 1/3R01MH102324 to ANV, 2/3R01MH102313 to AKM, and 3/3R01MH102318 to RWB). Aside from the listed authors, we acknowledge the contributions of the remaining members of the Social Processes Initiative in Neurobiology of the Schizophrenias (SPINS) group: Will Carpenter, Jen Zaranski, Eric Arbach, Sharon August, Peter Kingsley, Xiangzhi Zhou, Sofia Chavez, Gary Remington, Judy Kwan, Christina Plagiannakos, Mikko Mason, Marzena Boczulak, Dielle Miranda, James M. Gold, Pamela DeRosse, George Foussias, and Michael Green. We thank Joanna Collaton, Jessica D’Arcey, Shelley Grady, Adriana Halaby, Jef West, Rebecca Ruiz, John Fitzgerald, Kathryn Rhindress, Kristin Minara, Tracy A Giordonello, Lara Prizgint, Simran Kang, Taylor Marzouk, Sana Ali, Bernie Kompancaril, Christopher Morell, Danielle Beech, Darren Phane, George Nitzburg, Ivana De Lucia, and Natasha Bennett for performing behavioral and neuroimaging data collection; Nancy Lobaugh for managing and maintaining the consistency of the Centre for Addiction and Mental Health MRI equipment; and Steve Hawley, Navona Calarco, Michael Joseph, Jerrold Jeyachandra, Joseph Viviano, Jon Pipitone, Dawn Smith, John Cholewa, and Tom Wright for data management.
Author contributions
A.M., R.B., and A.V. designed the overall study and were PIs of the SPINS study. C.H., M.A., A.M., R.B., and A.V. contributed to data collection. C.H., E.D., and G.H. contributed to data organization, E.D. oversaw conversion to BIDS format and uploading. G.H. contributed to QC measures. All authors contributed to the final manuscript.
Code availability
All tools used are open source and available at their respective references. The code for generating plots of quality control data (and the respective source data) can be found at https://github.com/TIGRLab/human_phantoms_plots.
Competing interests
Dr. Buchanon is on data safety monitoring boards for Roche, Newron, Merck, as well as advisory boards for Acadia, Boehringer-Ingelheim, and GW Pharma Ltd.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
The online version contains supplementary material available at 10.1038/s41597-022-01386-3.
References
- 1.Han X, et al. Reliability of MRI-derived measurements of human cerebral cortical thickness: the effects of field strength, scanner upgrade and manufacturer. Neuroimage. 2006;32:180–194. doi: 10.1016/j.neuroimage.2006.02.051. [DOI] [PubMed] [Google Scholar]
- 2.Lee H, et al. Estimating and accounting for the effect of MRI scanner changes on longitudinal whole-brain volume change measurements. Neuroimage. 2019;184:555–565. doi: 10.1016/j.neuroimage.2018.09.062. [DOI] [PubMed] [Google Scholar]
- 3.Plitman, E. et al. The Impact of the Siemens Tim Trio to Prisma Upgrade and the Addition of Volumetric Navigators on Cortical Thickness, Structure Volume, and 1H-MRS Indices: An MRI Reliability Study with Implications for Longitudinal Study Designs. Neuroimage 118172 (2021). [DOI] [PubMed]
- 4.Kharabian Masouleh, S., Eickhoff, S. B., Hoffstaedter, F., Genon, S. & Alzheimer’s Disease Neuroimaging Initiative. Empirical examination of the replicability of associations between brain structure and psychological variables. Elife8, (2019). [DOI] [PMC free article] [PubMed]
- 5.Turner BO, Paul EJ, Miller MB, Barbey AK. Small sample sizes reduce the replicability of task-based fMRI studies. Commun Biol. 2018;1:62. doi: 10.1038/s42003-018-0073-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:e124. doi: 10.1371/journal.pmed.0020124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Uddin LQ, Dajani DR, Voorhies W, Bednarz H, Kana RK. Progress and roadblocks in the search for brain-based biomarkers of autism and attention-deficit/hyperactivity disorder. Transl. Psychiatry. 2017;7:e1218. doi: 10.1038/tp.2017.164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Dunlop BW, Mayberg HS. Neuroimaging-based biomarkers for treatment selection in major depressive disorder. Dialogues Clin. Neurosci. 2014;16:479–490. doi: 10.31887/DCNS.2014.16.4/bdunlop. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Linden DEJ. The challenges and promise of neuroimaging in psychiatry. Neuron. 2012;73:8–22. doi: 10.1016/j.neuron.2011.12.014. [DOI] [PubMed] [Google Scholar]
- 10.Woo C-W, Chang LJ, Lindquist MA, Wager TD. Building better biomarkers: brain models in translational neuroimaging. Nat. Neurosci. 2017;20:365–377. doi: 10.1038/nn.4478. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Jack CR, Jr, et al. The Alzheimer’s Disease Neuroimaging Initiative (ADNI): MRI methods. J. Magn. Reson. Imaging. 2008;27:685–691. doi: 10.1002/jmri.21049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Duchesne S, et al. The Canadian Dementia Imaging Protocol: Harmonizing National Cohorts. J. Magn. Reson. Imaging. 2019;49:456–465. doi: 10.1002/jmri.26197. [DOI] [PubMed] [Google Scholar]
- 13.Alfaro-Almagro F, et al. Image processing and Quality Control for the first 10,000 brain imaging datasets from UK Biobank. Neuroimage. 2018;166:400–424. doi: 10.1016/j.neuroimage.2017.10.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hawco C, et al. A longitudinal human phantom reliability study of multi-center T1-weighted, DTI, and resting state fMRI data. Psychiatry Res Neuroimaging. 2018;282:134–142. doi: 10.1016/j.pscychresns.2018.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Deprez S, et al. Multi-center reproducibility of structural, diffusion tensor, and resting state functional magnetic resonance imaging measures. Neuroradiology. 2018;60:617–634. doi: 10.1007/s00234-018-2017-1. [DOI] [PubMed] [Google Scholar]
- 16.Jovicich J, et al. Brain morphometry reproducibility in multi-center 3T MRI studies: a comparison of cross-sectional and longitudinal segmentations. Neuroimage. 2013;83:472–484. doi: 10.1016/j.neuroimage.2013.05.007. [DOI] [PubMed] [Google Scholar]
- 17.Noble S, et al. Influences on the Test–Retest Reliability of Functional Connectivity MRI and its Relationship with Behavioral Utility. Cereb. Cortex. 2017;27:5415–5429. doi: 10.1093/cercor/bhx230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Finn ES, et al. Functional connectome fingerprinting: identifying individuals using patterns of brain connectivity. Nat. Neurosci. 2015;18:1664–1671. doi: 10.1038/nn.4135. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Viviano JD, et al. Resting-State Connectivity Biomarkers of Cognitive Performance and Social Function in Individuals With Schizophrenia Spectrum Disorder and Healthy Control Subjects. Biol. Psychiatry. 2018;84:665–674. doi: 10.1016/j.biopsych.2018.03.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hawco, C. et al. Separable and Replicable Neural Strategies During Social Brain Function in People With and Without Severe Mental Illness. Am. J. Psychiatry appiajp201817091020 (2019). [DOI] [PubMed]
- 21.Oliver LD, et al. Lower- and Higher-Level Social Cognitive Factors Across Individuals With Schizophrenia Spectrum Disorders and Healthy Controls: Relationship With Neurocognition and Functional Outcome. Schizophr. Bull. 2019;45:629–638. doi: 10.1093/schbul/sby114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gordon EM, et al. Precision Functional Mapping of Individual Human Brains. Neuron. 2017;95:791–807.e7. doi: 10.1016/j.neuron.2017.07.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Gorgolewski KJ, et al. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Sci Data. 2016;3:160044. doi: 10.1038/sdata.2016.44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hawco, C. et al. Social Processes Initiative in Neurobiology of the Schizophrenia(s) Traveling Human Phantoms, OpenNeuro., 10.18112/openneuro.ds003011.v1.2.3 (2021).
- 25.Esteban O, et al. MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites. PLoS One. 2017;12:e0184661. doi: 10.1371/journal.pone.0184661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Andersson JLR, Sotiropoulos SN. An integrated approach to correction for off-resonance effects and subject movement in diffusion MR imaging. Neuroimage. 2016;125:1063–1078. doi: 10.1016/j.neuroimage.2015.10.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Volkow ND, et al. The conception of the ABCD study: From substance use to a broad NIH collaboration. Dev. Cogn. Neurosci. 2018;32:4–7. doi: 10.1016/j.dcn.2017.10.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Clementz BA, et al. Identification of Distinct Psychosis Biotypes Using Brain-Based Biomarkers. Am. J. Psychiatry. 2016;173:373–384. doi: 10.1176/appi.ajp.2015.14091200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Drysdale AT, et al. Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat. Med. 2017;23:28–38. doi: 10.1038/nm.4246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Van Essen DC, et al. The WU-Minn Human Connectome Project: an overview. Neuroimage. 2013;80:62–79. doi: 10.1016/j.neuroimage.2013.05.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.van den Heuvel, O. A. et al. An overview of the first 5 years of the ENIGMA obsessive-compulsive disorder working group: The power of worldwide collaboration. Hum. Brain Mapp.10.1002/hbm.24972 (2020). [DOI] [PMC free article] [PubMed]
- 32.Medland, S. E. et al. Ten years of enhancing neuro-imaging genetics through meta-analysis: An overview from the ENIGMA Genetics Working Group. Hum. Brain Mapp.10.1002/hbm.25311 (2020). [DOI] [PMC free article] [PubMed]
- 33.Fortin J-P, et al. Harmonization of cortical thickness measurements across scanners and sites. Neuroimage. 2018;167:104–120. doi: 10.1016/j.neuroimage.2017.11.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Fortin J-P, et al. Harmonization of multi-site diffusion tensor imaging data. Neuroimage. 2017;161:149–170. doi: 10.1016/j.neuroimage.2017.08.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Helmer, K. G. et al. Multi-site study of diffusion metric variability: effects of site, vendor, field strength, and echo time on regions-of-interest and histogram-bin analyses. Proc. SPIE Int. Soc. Opt. Eng. 9788 (2016). [DOI] [PMC free article] [PubMed]
- 36.Maclaren J, Han Z, Vos SB, Fischbein N, Bammer R. Reliability of brain volume measurements: a test-retest dataset. Sci Data. 2014;1:140037. doi: 10.1038/sdata.2014.37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Zuo X-N, et al. An open science resource for establishing reliability and reproducibility in functional connectomics. Sci Data. 2014;1:140049. doi: 10.1038/sdata.2014.49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Buonincontri G, et al. Multi-site repeatability and reproducibility of MR fingerprinting of the healthy brain at 1.5 and 3.0 T. Neuroimage. 2019;195:362–372. doi: 10.1016/j.neuroimage.2019.03.047. [DOI] [PubMed] [Google Scholar]
- 39.Duchesne S, et al. Structural and functional multi-platform MRI series of a single human volunteer over more than fifteen years. Sci Data. 2019;6:245. doi: 10.1038/s41597-019-0262-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Satterthwaite TD, et al. Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youth. Neuroimage. 2012;60:623–632. doi: 10.1016/j.neuroimage.2011.12.063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Pardoe HR, Kucharsky Hiess R, Kuzniecky R. Motion and morphometry in clinical and nonclinical populations. Neuroimage. 2016;135:177–185. doi: 10.1016/j.neuroimage.2016.05.005. [DOI] [PubMed] [Google Scholar]
- 42.Kong X-Z, et al. Individual differences in impulsivity predict head motion during magnetic resonance imaging. PLoS One. 2014;9:e104989. doi: 10.1371/journal.pone.0104989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Siegel JS, et al. Data Quality Influences Observed Links Between Functional Connectivity and Behavior. Cereb. Cortex. 2017;27:4492–4502. doi: 10.1093/cercor/bhw253. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Forsyth JK, et al. Reliability of functional magnetic resonance imaging activation during working memory in a multi-site study: analysis from the North American Prodrome Longitudinal Study. Neuroimage. 2014;97:41–52. doi: 10.1016/j.neuroimage.2014.04.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Elliott ML, et al. What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis. Psychol. Sci. 2020;31:792–806. doi: 10.1177/0956797620916786. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All tools used are open source and available at their respective references. The code for generating plots of quality control data (and the respective source data) can be found at https://github.com/TIGRLab/human_phantoms_plots.