Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Feb 22.
Published in final edited form as: Neuroimage. 2020 Nov 26;226:117585. doi: 10.1016/j.neuroimage.2020.117585

Is it time to switch your T1W sequence? Assessing the impact of prospective motion correction on the reliability and quality of structural imaging

Lei Ai a, R Cameron Craddock b, Nim Tottenham c, Jonathan P Dyke d, Ryan Lim e, Stanley Colcombe e,f, Michael Milham a,e, Alexandre R Franco a,e,f,*
PMCID: PMC7898192  NIHMSID: NIHMS1666841  PMID: 33248256

Abstract

New large neuroimaging studies, such as the Adolescent Brain Cognitive Development study (ABCD) and Human Connectome Project (HCP) Development studies are adopting a new T1-weighted imaging sequence with prospective motion correction (PMC) in favor of the more traditional 3-Dimensional Magnetization-Prepared Rapid Gradient-Echo Imaging (MPRAGE) sequence. Here, we used a developmental dataset (ages 5–21, N = 348) from the Healthy Brain Network (HBN) Initiative to directly compare two widely used MRI structural sequences: one based on the Human Connectome Project (MPRAGE) and another based on the ABCD study (MPRAGE+PMC). We aimed to determine if the morphometric measurements obtained from both protocols are equivalent or if one sequence has a clear advantage over the other. The sequences were also compared through quality control measurements. Inter- and intra-sequence reliability were assessed with another set of participants (N = 71) from HBN that performed two MPRAGE and two MPRAGE+PMC sequences within the same imaging session, with one MPRAGE (MPRAGE1) and MPRAGE+PMC (MPRAGE+PMC1) pair at the beginning of the session and another pair (MPRAGE2 and MPRAGE+PMC2) at the end of the session. Intraclass correlation coefficients (ICC) scores for morphometric measurements such as volume and cortical thickness showed that intra-sequence reliability is the highest with the two MPRAGE+PMC sequences and lowest with the two MPRAGE sequences. Regarding inter-sequence reliability, ICC scores were higher for the MPRAGE1 - MPRAGE+PMC1 pair at the beginning of the session than the MPRAGE1 - MPRAGE2 pair, possibly due to the higher motion artifacts in the MPRAGE2 run. Results also indicated that the MPRAGE+PMC sequence is robust, but not impervious, to high head motion. For quality control metrics, the traditional MPRAGE yielded better results than MPRAGE+PMC in 5 of the 8 measurements. In conclusion, morphometric measurements evaluated here showed high inter-sequence reliability between the MPRAGE and MPRAGE+PMC sequences, especially in images with low head motion. We suggest that studies targeting hyperkinetic populations use the MPRAGE+PMC sequence, given its robustness to head motion and higher reliability scores. However, neuroimaging researchers studying non-hyperkinetic participants can choose either MPRAGE or MPRAGE+PMC sequences, but should carefully consider the apparent tradeoff between relatively increased reliability, but reduced quality control metrics when using the MPRAGE+PMC sequence.

1. Introduction

New technologies are constantly being developed to improve the quality of Magnetic Resonance Imaging (MRI) sequences. While generally welcomed, such advances can present a significant challenge to longitudinal studies, as well as large-scale data acquisitions, both of which tend to be wary of changing methods mid-study in virtue of the potential introduction of confounds. In light of this, choosing optimal and robust MRI pulse sequences for a study is always a challenging task for a neuroimaging researcher. Since its development in the early 1990s, the T1 weighted 3-Dimensional Magnetization-Prepared Rapid Gradient-Echo Imaging (3D MPRAGE, MPRAGE, or MPR) (Mugler and Brookeman 1990; Brant-Zawadzki et al., 1992) has become one of the most widely used MRI sequence by neuroimaging researchers. This sequence, or similar sequences from other manufacturers,1 has been broadly adopted for studies with large or small sample sizes. However, as with all MRI sequences, it is susceptible to head motion which can significantly alter the quality of the morphometry measurements that are extracted (Reuter et al., 2015; Pardoe et al., 2016; Alexander-Bloch et al., 2016). In recent years, the MPRAGE sequence has been expanded to include volumetric navigators (vNav), allowing prospective motion correction (PMC) during the acquisition (Tisdall et al., 2012, 2016). These structural sequences with navigator-based PMC have the potential to be transformative for studies involving hyperkinetic populations, such as children, the elderly, or patients with movement disorders. In particular, new large multisite studies are adopting these structural scans with PMC (see Table 1). However, the impact of the change from the traditional MPRAGE sequence to the new MPRAGE sequence with PMC has not been fully quantified (Harms et al., 2018; Greene et al., 2018), in part, because few datasets contain a large enough sample size with and without PMC images in the same subjects.

Table 1.

T1-weighted structural imaging parameters across large imaging studies. Only reporting imaging sequences performed on 3T Siemens MRIs.

Study Pulse sequence Voxel size (mm) Matrix Size Num Slices TI (ms) TR (ms) Bandwidth (Hz/Pz) Parallel Imaging Partial Fourier Flip Angle (degrees) Scanner

Rockland Sample MPRAGE 1.0 × 1.0 × 1.0 256 × 256 176 900 1900 170 2 off 9 Tim-Trio
UK Biobank MPRAGE 1.0 × 1.0 × 1.0 256 × 256 208 880 2000 240 2 off 8 Siemens 3T Skyra
ADN13 MPRAGE 1.0 × 1.0 × 1.0 256 × 240 176 900 2300 240 2 off 9 Many
WU-Minn HCP [a.k.a HCP-YA] MPRAGE 0.7 × 0.7 × 0.7 320 × 320 256 1000 2400 210 2 off 8 Custom HCP Skyra
HCP Aging (HCP-A) MPRAGE 0.8 × 0.8 × 0.8 320 × 300 208 1000 2500 220 2 off 8 Prisma
And Development (HCP-D) MPRAGE+PMC 0.8 × 0.8 × 0.8 320 × 300 208 1000 2500 740 2 6/8 (slice partial Fourier) off for phase 8 Prisma
HCP Baby (BCP)* MPRAGE 0.8 × 0.8 × 0.8 320 × 320 208 1060 2400 8 Prisma
ABCD MPRAGE+PMC 1.0 × 1.0 × 1.0 256 × 256 176 1060 2500 240 2 off 8 Prisma
Healthy Brain Network (HBN) ** MPRAGE *** 0.8 × 0.8 × 0.8 320 × 320 224 1060 2500 130 2 7/8 (slice partial Fourier) off for phase 8 Prisma
MPRAGE+PMC **** 1.0 × 1.0 × 1.0 256 × 256 176 1060 2500 240 2 off 8 Prisma
*

We were unable to find all the sequence parameters for the BCP. However, the researchers of BCP state they attempt to match as much as possible the imaging parameters of the other HCP studies (Howell et al. 2019).

**

For the HBN study, currently only one of the imaging sites (Citigroup Biomedical Imaging Center - CBIC) is collecting two structural scans for all subjects.

***

Turbo factor for the HBN MPRAGE sequence is 196.

****

Turbo factor for the HBN MPRAGE+PMC sequence is 256.

This ultrafast gradient-echo 3D pulse sequence is used by a large fraction of neuroimaging researchers because of its excellent contrast properties and capacity to collect reliable structural images for cortical thickness and volumetric measures (Wonderlick et al., 2009). MPRAGE can be considered as a defacto standard imaging sequence for brain morphometry studies.2 As such, large neuroimaging studies such as the WU-Minn Human Connectome Project (HCP) (Van Essen et al., 2013) more recently referred to as the HCP Young-Adult (HCP-YA), the NKI-Rockland Sample (Nooner et al., 2012), the UK BioBank (Sudlow et al., 2015), and the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (Jack et al., 2008), all use the MPRAGE sequence to collect structural T1 weighted images of the brain. While some slight differences in sequence parameters exist across studies, such as voxel size and TR/TI values, differences are small across parameters (see Table 1).

For navigator-based prospective motion correction (PMC) approaches, the sequence periodically collects fast-acquisition lower resolution images (navigators) to estimate the amount and direction of head motion since the last navigator was collected. Based on the motion estimation, sequence parameters are adjusted at each repetition time (TR) to nullify this motion. For MPRAGE sequences, navigators can be collected and motion can be estimated during the long inversion recovery time (TI) and applied to update the readout orientation for the current line of k-space. An early example of this method is the PROMO sequences (for GE scanners) that employ spiral acquisitions to collect navigators along the three cardinal planes of the volume (coronal, axial, and sagittal) (White et al., 2010; Sarlls et al., 2018). This has been extended by Tisdall et al. to use echo volume imaging (EPI applied to all 3 dimensions) to collect 3D vNAV (Tisdall et al., 2012, 2016). In addition to prospectively correcting for motion that occurs between acquisitions, this sequence with PMC can also identify large motion that occurs during an acquisition. The TRs that have motion above a predefined threshold are reacquired at the end of the sequence. The number of TRs that can be reacquired and motion threshold is set by the operator. The MPRAGE sequence with PMC (MPRAGE+PMC) has been widely adopted by research groups and more specifically, by new large imaging studies (see Table 1). The equivalent of the vNav sequence for Philips MRIs is the iMOCO (Andersen et al., 2019).

Among those most attracted to the promises of sequences with PMC are pediatric imaging researchers (Bookheimer, 2000). In particular, head motion has been shown to significantly reduce gray matter volume and thickness estimates accuracy (Reuter et al., 2015) and also alter gray matter probability scores (Gilmore et al., 2019). Given this concern, the longitudinal Adolescent Brain Cognitive Development (ABCD) Study (Casey et al., 2018) adopted the MPRAGE+PMC sequence as its standard T1-weighted structural sequence. The Healthy Brain Network (HBN) study (Alexander et al., 2017) also adopted the new MPRAGE+PMC sequence, while also maintaining the HCP style MPRAGE sequence due to concerns regarding reproducibility across sequences. The original HCP study (HCP-YA) is a project that has already concluded its data acquisition, but the study is now being expanded through the HCP Lifespan Studies. The Lifespan Studies have all adopted the MPRAGE+PMC protocol, in addition to standard MPRAGE. This includes the HCP Aging (HCP-A) (Bookheimer et al., 2019) for ages 36–100+ years old, the HCP Development (HCP-D) (Somerville et al., 2018) for ages 5–21 years old, and the Lifespan Baby Connectome Project (BCP) for children aged 0–5 years old (Howell et al., 2019). See Table 1 for details regarding T1-weighted structural sequences used in large neuroimaging studies.

Given that new large imaging studies (i.e. HCP Lifespan and ABCD) are using the MPRAGE+PMC sequence to collect their structural data, we raise a key question: should other researchers switch from the well established MPRAGE sequence to the MPRAGE+PMC sequence? In this manuscript, we present quantifiable similarities and differences between the HCP style MPRAGE to the ABCD style MPRAGE+PMC sequence to address this question.

2. Methods

2.1. Neuroimaging data

All neuroimaging data used in this study were collected as part of the Healthy Brain Network (HBM) Project (Alexander et al. 2017) and were acquired on a Siemens Prisma Fit with a 32 channel head coil located at the Citigroup Biomedical Imaging Center (CBIC) at Weill Cornell Medicine. A total of 465 imaging sessions were analyzed. Of these 465 participants, 348 completed the full HBN MRI protocol and are included in this study, with an age range of 5 to 21 years old (mean=11.3 ± 3.6) which included 120 females and 228 males. The HBN protocol at CBIC includes two structural T1-weighted sequences, one based on the Human Connectome Project-YA (here referred to as the “MPRAGE” sequence), and another based on the ABCD study with the MPRAGE sequence with PMC (here referred to as the “MPRAGE+PMC” sequence). These sequences differ in other parameters as well, such as voxel and matrix size, bandwidth, and partial Fourier. Nonetheless, it is worth noting that the parameters for the MPRAGE and MPRAGE+PMC sequences were independently optimized by the designers of the HCP and ABCD studies (Glasser et al. 2013; Casey et al., 2018).

Another set of participants (N = 72) performed a test-retest protocol (Test-Retest Group). As part of the protocol specifically designed for this study, these participants performed two MPRAGE scans and two vNav scans within the same imaging session. Specifically, one MPRAGE+PMC (MPRAGE+PMC1) and then one MPRAGE (MPRAGE1) sequence were performed at the beginning of the imaging session and the other two sequences were repeated at the end of the imaging session (MPRAGE2 and then MPRAGE+PMC2). This strategy was chosen since a larger amount of head motion is expected on the runs at the end of the session. The test-retest group had an age range of 5 to 20 years old (mean=11.6 ± 3.7) with 23 females and 42 males. The HBN protocol and timing of the sequences for both groups are provided in Supplementary Tables 1 (ST1) and 2 (ST2).

2.2. Imaging parameters

The MR Protocol Guidance from the Human Connectome Project (Glasser et al., 2016) was followed to define the 3D MPRAGE HCP style imaging sequence. For the structural sequences with the navigators (MPRAGE+PMC), we used the protocol from the ABCD study (Casey et al., 2018). The imaging sequence protocol parameters used in this study are shown in Table 1. Additionally, for the MPRAGE+PMC sequence, we configured the sequence with a reacquisition threshold of 0.5 (see equation [3] in (Tisdall et al., 2012) for details) and up to 24 TRs could be remeasured. The MPRAGE sequence had a duration of 7 min and 19 s, while the MPRAGE+PMC can take up to 7 min and 12 s to be acquired. During the structural runs, the participants were shown the Inscapes Movie (Vanderwal et al., 2015), a video developed to improve compliance related to motion and wakefulness.

2.3. Visual quality control

An instance of the Braindr web application (Keshavan et al., 2019) was created for this project to perform visual quality control of the MPRAGE and MPRAGE+PMC scans. This instance contained only the images collected for this study. Within Braindr, a rater can choose to “PASS” or “FAIL” an image depending on the quality. We asked the raters to cast their vote based on the general quality of the image but to specifically examine if the border areas between white and gray matter are blurry or not. Example images used for training are shown in Supplementary Fig. SF1. Five research assistants of HBN participated as raters. They did not have any prior knowledge regarding the focus of this study (to compare MPRAGE and MPRAGE+PMC). For each structural image two axial and two sagittal slices were shown to the raters. Hence, every MRI image received a total of 20 votes. Slices were presented to the raters in random order.

2.4. Quality control

Six measures of quality control for the structural images were performed by using the Quality Assessment Protocol (QAP) toolbox (Zarrar et al., 2015). Specifically for each subject and structural image the following quality control scores measures were calculated:

  • Contrast to Noise Ratio (CNR): measures the mean of the gray matter intensity values minus the mean of the white matter intensity values divided by the standard deviation of the values outside the brain) (Magnotta et al., 2006);

  • Signal to Noise Ratio (SNR): measures the mean intensity within the gray matter divided by the standard deviation of the values outside the brain) (Magnotta et al., 2006);

  • Foreground to Background Energy Ratio (FBER): measures the variance of voxels inside the brain divided by the variance of voxels outside the brain;

  • Percent Artifact Voxels (PAV): measures the proportion of voxels outside the brain with artifacts to the total number of voxels outside the brain (Mortamet et al., 2009);

  • Smoothness of Voxels (FWHM) measures the full-width half maximum of the spatial distribution of the image intensity values in voxel units (Magnotta et al., 2006);

  • Entropy Focus Criterion (EFC), measures the Shannon entropy of voxel intensities proportional to the maximum possible entropy for a similarly sized image; Indicates ghosting and head motion-induced blurring) (Atkinson et al., 1997).

For the CNR, SNR, and FBER, a higher score means a better image, while for the FWHM, PAV, and EFC, a lower score is better.

Two additional quality control measurements were also performed that are not part of the QAP package. For the first additional measure, we compared the background noise in two regions around the brain. One 12 mm radius circle located in front of the forehead immediately above the eyeball (Anterior ROI), and another above the head (Superior ROI) (See Supplementary Fig. SF2 for the location of the circles). We then calculated the ratio of the average signal from the Anterior divided by the Superior region of interest, hence Anterior-to-Superior Ratio (ASR). The rationale of using ASR is that the prime source of image motion is manifested in the AP phase encode direction and results in increased noise and blurring in the spatial domain (Barish and Jara 1999), which we seek to quantify. Minimal motion is expected in the Inferior-Superior direction along the bore of the magnet. By comparing the background signal that is anterior to the head to a background signal superior to the head we are capturing the effects of head motion. A similar approach is performed by White et al. (2018). A lower ASR yields lower anterior noise and hence, better image quality. The second additional quality control measure is Freesurfer’s Euler number, which summarizes the topological complexity of the reconstructed cortical surface and has been shown to identify “unusable” images with very high accuracy (Rosen et al., 2018). Higher Euler numbers were shown to be consistently positively correlated with manual image ratings.

2.5. Structural quantitative measurements

We extracted morphometry measurements from the images using Mindboggle v1.2.2 (Klein et al., 2017). Within Mindboggle, Freesurfer v5.1 (Fischl, 2012) measures were also extracted. These data were processed using an AWS EC2 r4.large instance with Amazon Linux AMI 2017.9 operating system. For each Freesurfer label, measurements included volume, area, median travel depth, geodesic depth, and the median measurement of Freesurfer’s cortical thickness, curvature, and convexity of the sulcus (Fischl, 2012). Geodesic depth is the shortest distance along the surface of the brain from the point to where the brain surface makes contact with the outer reference surface (Klein et al. 2017), whereas travel depth is the shortest distance from a point to the outer reference surface without penetrating any surface (Giard et al., 2011; Klein et al. 2017). Total gray matter volume across different structural runs was also measured with FSL’s SIENAX (Smith et al. Stephen M. 2002) package, in addition to the results obtained through Mindboggle.

2.6. Reliability

Intraclass correlation coefficients (ICC(3,1)) was used to calculate the reliability for each of the morphometric measures (Shrout and Fleiss, 1979). Inter-sequence reliability was measured between the different imaging sequences, MPRAGE and MPRAGE+PMC. Intra-sequence reliability was measured across different imaging runs for the same pulse sequence.

2.7. Age-related changes

We estimated age-related changes to compare the two imaging sequences. Age-related curves were separated by sex and by the quantity of motion during the functional sequences.

2.8. Motion estimation

EPI volumetric navigators with an 8 mm isotropic resolution are collected with the MPRAGE+PMC pulse sequence. These volumes are used as navigators to estimate the head motion during the scan, and one three dimensional volume is acquired at each TR. For the HBN study, the total number of volumes that were acquired at each MPRAGE+PMC sequence ranged from 143 to 168, depending on the number of TRs that need to be reacquired based on subject motion (Tisdall et al., 2012). By using QAP, which internally uses AFNI’s (Cox, 2012) 3dvolreg to estimate motion parameters, the framewise displacement (FD) (Jenkinson et al., 2002) was calculated for each MPRAGE+PMC run on these low resolution EPI volumes.3 The FD was then normalized to FD per minute (FDpm) by Tisdall et al. (2012):

FDpm=i=2NFD(i1,i)NTR60

where N is the number of TRs, TR is the repetition time in seconds, i is the volume, and FD(i-1,i) is the FD between two subsequent volumes.

With the MPRAGE sequence, we cannot directly estimate motion, hence we investigated if the average motion across all functional scans can be used as a proxy for how much a participant moves during a structural scan (Pardoe et al., 2016; Savalia et al., 2017). Specifically, the average FDpm for all functional MRI scans of the protocol were also calculated and compared.

3. Results

3.1. How do the sequences compare by visual inspection?

By visual inspection, there were some key differences in image intensity and quality when comparing the MPRAGE and MPRAGE+PMC sequences (Fig. 1). For the purposes of demonstration, through visual inspection of the structural images, we identified two participants, one with a low amount of motion (Low-Mover) and one with a high amount of motion (Mover). For the participant data on the left (Low-Mover), visually, the images appear to be of excellent quality for both the MPRAGE and MPRAGE+PMC sequences. This subject had a low amount of motion during the data collection of the MPRAGE+PMC sequence (FDpm = 6.04 during MPRAGE+PMC sequence). For the functional scans of the protocol, the same participant has a low FDpm = 7.24 (see Motion Estimation section below on how head motion was estimated for the MPRAGE runs). The images on the right represent a participant with a large amount of motion for the MPRAGE and MPRAGE+PMC sequence. Even though there was a large amount of head motion during the acquisition in the MPRAGE+PMC sequence (FDpm = 62.23 during MPRAGE+PMC sequence; average FDpm=17.41 during functional scans), the quality of the T1’s is still sufficient for many applications. That is not the case for the MPRAGE images, where the ringing artifacts are strikingly pronounced and this data would have to be discarded for any neuroimaging study. However, it is important to note that for the MPRAGE+PMC image, the gray-white matter boundaries are not as sharp as the low motion subject. There are also some ringing artifacts present in the MPRAGE+PMC image. Hence, the MPRAGE+PMC image is not completely immune to head motion, as seen in Fig. 1 and also in Supplementary Fig. SF3.

Fig. 1.

Fig. 1.

T1 structural images for the two sequences, MPRAGE and MPRAGE+PMC. The top row shows the MPRAGE sequence, while the bottom row shows the images that were generated with the MPRAGE+PMC sequence. Columns represent two different participants, one with minimal head motion (left, Low-Mover) and another with a large quantity of motion (right, High-Mover). Pial and white matter (WM) surface reconstruction from Freesurfer are also shown.

3.2. Quantifying visual rating

By using Braindr, each of the 5 raters inspected a total of 3920 slices. These images include scans from the large group, with a total of 346 participants that completed both the MPRAGE and MPRAGE+PMC sequences (346×2 × 4 = 2768 slices). Images shown to the raters are also from the test-retest group, which includes 72 participants that completed the 4 structural runs, with the MPRAGE1 and MPRAGE+PMC1 sequences at the beginning of the session and MPRAGE2 and MPRAGE+PMC2 at the end. A total of 1152 slices (72×4 × 4) from the test-retest group were shown to the raters.

Wilcoxon signed-rank tests were calculated to test if the observed differences are statistically significant. With the data from the large group, there was a significant (p<0.001) higher score for the MPRAGE+PMC images compared to the MPRAGE images with a z-score equal to −6.8298. Within the test-retest group, the MPRAGE-PMC scans were also significantly (p<0.001) scored higher than the MPRAGE scans, with a z-score = −5.0029 when comparing the two scans at the beginning of the run (MPRAGE1 and MPRAGE+PMC1) and a z-score = −4.9517 for the scans at the end of the run (MPRAGE2 and MPRAGE+PMC2). Likewise, we calculated the proportion of images from each scan type that had an average score above 0.5. For the large group, 60.06% and 72.99% of the MPRAGE and MPRAGE+PMC scans, respectively, have an average score above 0.5. For the test-retest group, there are 56.94% of the MPRAGE1, 44.44% of the MPRAGE2, 81.94% of the MPRAGE-PMC1, and 66.67% of the MPRAGE-PMC2 scans with a score above 0.5. Density plots of the average score per image type are shown in Fig. 2 for the test-retest group.

Fig. 2.

Fig. 2.

Density plots of the average Braindr score of each scan type for the test-retest group.

3.3. Does the surface reconstruction complete?

Another simple, however very practical, comparison of these two sequences is to test whether Mindboggle was able to complete processing the surface reconstruction. With images of poor quality, such as the one seen for the “High-Mover” subject in the MPRAGE sequence (Fig. 1), the software does not complete and returns an error instead of the morphometry measurements. For all participants in which there was an error, incomplete surface reconstructions were caused by the topological defects. This was either due to the failure of the automatic topology fixer (mris_fix_topology) or as a result of the running time exceeding the time limit (60 h) that was set. Considering that the purpose of this study is to show the differences and similarities between the MPRAGE and MPRAGE+PMC sequences, we did not manually edit and correct the volume and attempt to reprocess the data as is suggested in FreeSurfer’s tutorials.

For the large group, a total of 346 participants completed both the MPRAGE and MPRAGE+PMC sequences. Of the 346 images, Mindboggle successfully completed surface reconstruction in 89.3% (N = 309) of the MPRAGE images and 91.6% (N = 317) of the MPRAGE+PMC images. Using McNemar’s test (McNEMAR, 1947), no statistically significant differences (p>0.1) were found between completing the processing of the images for the different sequences. We visually inspected the 31 images from the MPRAGE+PMC images that did not complete surface reconstruction and all looked blurry (see examples in Supplementary Fig. SF3). The average motion from the EPI navigators of the MPRAGE+PMC sequences was then calculated. For the images that completed the surface reconstruction, there was an FDpm = 13.70 +- 12.85, while for the images that were not completed the motion was much higher, with an FDpm = 47.56 +- 37.32. For the subsequent analysis shown in this manuscript that depends on the surface reconstruction results, only the data from participants that Mindboggle was able to complete processing both images are used. Hence, the following results that are presented only use data that has already passed through a first level of quality control, i.e. completing surface reconstruction. A total of 290 subjects (105 females, mean age = 11.20 +- 3.66, age range = [5.44, 20.47]) are included in the following analyses that depend on surface reconstruction estimates.

Of the 72 test-retest participants that completed all four runs, Mindboggle completed processing on 94.5% (N = 68) of the MPRAGE1, 98.6% (N = 71) of the MPRAGE+PMC1, 97.2.6% (N = 70) of the MPRAGE2, and 97.2% (N = 70) of the MPRAGE+PMC2. Again, using McNemar’s test we found no statistically significant differences (p>0.1) between the sequences regarding Mindboggle completing the processing of the images. Mindboggle was able to calculate morphometric measurements in all 4 structural runs for 65 participants. These participants are used in the reliability tests shown below.

Even though there was no significant difference in surface reconstruction completion between MPRAGE and MPRAGE+PMC scans, it does not indicate the two sequences have the same data quality or accuracy measurements. As the reliability results are shown below, there are significant differences in reliability between the scans in which the surface reconstruction completed.

3.4. Reliability

Intra- and inter-sequence reliability results for the Mindboggle measurements are shown in Fig. 3. ICC scores are shown for each of 62 cortical regions from the Desikan Atlas (Desikan et al., 2006), which are sorted by Yeo networks (Yeo et al., 2011; Alexander-Bloch et al., 2018) (list of regions can be seen in Supplementary Table ST3), and for the following measurements, (1) area, (2) Freesurfer median cortical thickness, (3) travel depth, (4) geodesic distance, (5) curvature, and (6) convexity. The first row shows results for all participants. They were then divided into two groups, through a median split of the mean FDpm of the functional scans. The Intra-sequence reliability of cortical measures extracted from the two MPRAGE+PMC sequences was significantly higher (paired t-test, all p < 0.0001) for all of the regions and measures compared to the MPRAGE pair without PMC. These significant results are observed when including all subjects in the analysis, and also when calculating the t-tests with only the low- or high-motion subjects. These results are possibly due to a higher motion during the MPRAGE2 scan, which was collected at the end of the session. Another noticeable result is that, even for the low motion subjects, the ICC was significantly higher (paired t-test, all p < 0.0001) for the MPRAGE1 x MPRAGE+PMC1 pair (inter-sequence) compared to the MPRAGE1 x MPRAGE2 pair (intra-sequence). Again, this is possibly a result of the higher motion in the MPRAGE2 runs, even though these were the subjects with lower motion estimation scores. From the same reproducibility results it is important to notice that even though the voxel sizes are of different sizes for the MPRAGE (0.512mm3) and MPRAGE+PMC (1mm3) sequences, the ICC scores between MPRAGE1 and MPRAGE+PMC1 are higher than repeating the MPRAGE sequence. This could be due to the higher bandwidth of the MPRAGE+PMC protocol, which makes it more resilient to field inhomogeneities that can interact with head motion to cause time-varying image distortions (van der Kouwe et al., 2008).

Fig. 3.

Fig. 3.

Test-retest reliabilityICC results for Mindboggle measurements within each of the 62 Desikan-Killiany Atlas cortical regions. Regions have been sorted by the Yeo 7 Network Atlas (Yeo et al. 2011). Measurements tested were (1) area, (2) Freesurfer median cortical thickness (FMCT), (3) travel depth, (4) geodesic distance, (5) curvature, and (6) convexity.

Density plots of ICC for the area, volume, and Freesurfer median cortical thickness across all brain regions are shown in Fig. 4. As can be seen in the density plots, the pair MPRAGE+PMC1 x MPRAGE+PMC2 (orange line) outperformed the ICC scores of all other pairs. It is clear that the reproducibility between MPRAGE+PMC1 and MPRAGE+PMC2 is high, with an average ICC score above 0.8 for Area and Volume and above 0.6 for cortical thickness. The pair MPRAGE1 x MPRAGE+PMC1 (green line) typically showed the second-best performance. The lower ICC scores in the low-motion and high-motion subjects for any pair that contains the MPRAGE2 run (blue, purple, and brown lines) are highly observable, especially for Area. The MPRAGE+PMC2 run is also performed at the end of the session, however contrary to the MPRAGE sequence, we can directly measure the amount of motion during that run. During the MPRAGE+PMC2 run, on average, there is at least twice the amount of head motion compared to MPRAGE+PMC1 (FDpm = 7.5 for MPRAGE+PMC1 and FDpm = 15.34 for MPRAGE+PMC2). Also when considering the pairs that contain the MPRAGE2 run, there is a large negative shift in ICC scores when comparing the “Low-Motion” and “High-Motion” subjects. With the other pairs, there is also a negative shift in ICC scores, but at a much smaller scale. These results corroborate with the notion that the MPRAGE+PMC is more robust to motion compared to the sequence without PMC.

Fig. 4.

Fig. 4.

Density plots of ICC for the test-retest group that performed two MPRAGE scans and two MPRAGE+PMC scans within the same session. ICC is calculated for Area, Volume, and Cortical Thickness.

ICC of Cortical Thickness was worse for all pairs compared to Area and Volume. This shows how sensitive the measurement of Cortical Thickness is, especially in regards to head motion. The improvement in ICC for the MPRAGE+PMC pair over the MPRAGE pair was unanticipated for the low motion group, given that the MPRAGE sequence has a better spatial resolution, which is expected to obtain better cortical thickness estimation results. Another key result from the “ideal” low motion group, is that the inter-sequence pairs MPRAGE1 - MPRAGE+PMC1 (green line) and MPRAGE1 - MPRAGE+PMC2 (red line) show higher reliability than the intra-sequence pair MPRAGE1–2 (blue line) for all the three measures being evaluated.

Besides the reliability of measures from all 62 individual brain regions, the impact of acquisition sequence on the overall gray matter volume estimation was evaluated using Mindboggle and SIENAX (Fig. 5) with the test-retest dataset. Pairwise comparisons were made for each combination by calculating the absolute difference in volume measures. MPRAGE+PMC1 and MPRAGE+PMC2 had the most similar gray matter volumes for both toolboxes. The largest differences were observed in the pairs that included the MPRAGE2 image. These results indicate that the prospective motion correction sequence is robust for measuring gray matter volume regardless of the toolbox used to calculate volumes. It also endorses the assumption that the MPRAGE+PMC sequence provides us more reliable results compared to MPRAGE, independent of when the structural sequence is performed within the session, beginning or end. Outliers are cases where the brain extraction failed in at least one of the images, mostly caused by high head motion.

Fig. 5.

Fig. 5.

The absolute difference in gray matter volume within the test-retest group. Gray matter was measured using MindBoggle and SIENAX.

3.5. How does motion affect structural measurements between sequences?

With the larger dataset, we performed an analysis to investigate if the differences in measurements of cortical thickness are affected by head motion. For each region, a partial correlation was calculated between the difference in cortical thickness measured with the MPRAGE and MPRAGE+PMC images (MPRAGE - MPRAGE+PMC) and the mean FDpm across the functional scans, controlling for age and sex. Of the 62 regions in the atlas, 26 showed a significant negative correlation (p<0.05) between the difference in cortical thickness in the images and the motion estimation, mostly located in the frontal, parietal and temporal lobes. Only one region showed a significant positive correlation, the right Isthmus of the cingulate cortex. These results indicate that, as there was an increase in subject head motion the difference in the measurement of cortical thickness between MPRAGE and MPRAGE+PMC increases, with a larger cortical thickness estimate in the MPRAGE+PMC sequence in 26 regions (see Fig. 6A and Supplementary Table ST3 for the partial correlation scores for all regions).

Fig. 6.

Fig. 6.

A) Desikan Atlas regions that showed a significant partial correlation (p<0.05), corrected by age and sex, between the difference in cortical thickness measurements (MPRAGE-MPRAGE+PMC) and mean FD across the functional scans. B) The distribution of the effect size (correlation of cortical thickness and motion estimates) across cortical regions for each sequence.

To evaluate motion related bias, the effect size (correlation) was calculated between the estimated cortical thickness values and the mean FDpm for each sequence separately. The distribution of the effect size across cortical regions is shown in Fig. 6B. A paired t-test shows that the effect size across all brain regions are significantly different between the MPRAGE and MPRAGE+PMC sequences (p < 0.0001, MPRAGE mean = −0.055, std = 0.211; MPRAGE+PMC mean = 0.036, std = 0.152).

We also calculated pairwise t-tests to compare the cortical thickness measurements between MPRAGE and MPRAGE+PMC in the 62 cortical regions from the Desikan Atlas. The t-tests were controlled for age, sex, and mean FD for the functional scans. Results showed that there was a significant difference (p<0.05) in 13 of the 62 regions. Of these 13, 11 showed a larger cortical thickness for MPRAGE and 2 for MPRAGE+PMC (See Supplementary Fig. SF4). Statistical scores for all the regions are shown in Supplementary Table ST4.

3.6. Age-related differences

Fig. 7 shows development curves for total volume, gray and white matter volume, and ventricle volume for male and female participants. Only a smaller subset of subjects (N = 248, 92 females) was used to calculate the development curves since there were very few subjects older than 16 to obtain adequate development estimation curves at higher ages. Hence, development curves are shown only for ages 6 to 16. Black dots represent volumes calculated with the MPRAGE sequence while red dots represent the MPRAGE+PMC sequence. For each sequence, a quadratic curve was fit for estimating development growth. For the “All Subjects” the development graphs appear to be similar for both imaging sequences. With a median split, participants were grouped by low and high motion. Even for the subjects with large motion, the development curves also appear to be similar, just deviating at the higher ages for both groups. This deviation in curvature is possibly caused by the low amount of subjects that are older with a higher amount of motion. The development curves are shown for cortical thickness measurements for males and females are shown in Supplementary Figs. SF5 and SF6, respectively.

Fig. 7.

Fig. 7.

Black dots and lines (with 95% confidence intervals) are developmental measures for the MPRAGE sequence, while the red dots and lines are for the MPRAGE+PMC sequence. GM: Gray Matter; WM: White Matter.

To evaluate the effect of sequence type on volume measurement, we constructed 24 ANCOVAs, with age and mean FDpm across the functional runs as covariates (Savalia et al., 2017). Volume measurement (total brain, gray matter volume, white matter, and ventricle volume) was defined as the dependent variable and the sequence type (MPRAGE or MPRAGE+PMC) as the between factor. Including all the male participants in the statistical analysis, a statistically significant difference between the sequences was only found for white matter volume (F(2675)=3.083, uncorrected P = 0.046). For females, the only significant difference between sequences was found for ventricle volume (F(2378)=3.061, uncorrected P = 0.028). Within the low motion subjects, there are no statistically significant differences (p<0.05) between sequences for all volume measurements and both sexes. For the high motion group, the only significant result found was for ventricle volume in females(F(3138)=2.771, uncorrected P = 0.044). However, if we were to apply the Bonferroni correction for multiple comparisons, these significant findings would then be considered non-significant.

3.7. Quality control metrics

The MPRAGE+PMC pulse sequence is derived from the MPRAGE sequence and includes a navigator acquisition and registration block, lasting 355 milliseconds, during the inversion recovery time and just before the parent sequence’s readout (Tisdall et al., 2012). Other aspects of the sequence remain unchanged. In previous comparisons between these sequences, the MPRAGE+PMC sequence resulted in an approximately 1% reduction in contrast and a 3% reduction in image intensities (Tisdall et al., 2012). Importantly, these reductions were spatially uniform, so did not increase regional variation in image intensity (e.g., the ‘bias’ field). The MPRAGE+PMC sequence has been shown to result in more artifacts, such as ghosting, in the background, but since they did not overlap with the brain, they were not considered problematic (Tisdall et al., 2012).

In our study, acquisition protocol parameters were identical between sequences, with the exception of voxel resolution, matrix size, number of partitions, bandwidth, and partial Fourier. These differences are a consequence of MPRAGE+PMC’s navigate and register block reducing the amount of time available for parent sequence readout. From MRI theory, SNR is proportional to voxel volume (V) and inversely proportional to the square root of bandwidth (BW) and the square root of the partial Fourier reduction factor (R). The relative SNR from the MPRAGE+PMC sequence to the MPRAGE sequence can be calculated by:

SNRMPRAGE+PMCSNRMPRAGE=VMPRAGE+PMCBWMPRAGE+PMCRMPRAGE+PMCVMPRAGEBWMPRAGERMPRAGE=1324010.831301.14=1.535

From these relationships, the SNR of the MPRAGE+PMC sequence is expected to be about 1.535 times greater than the SNR of the MPRAGE sequence (Craddock et al., 2013; Brown et al., 2014).

Matrix size and number of partitions impact the readout echo train length (or turbo factor) of the protocols, longer echo trains are expected to result in broader point spread functions and in turn smoother images (Mugler and Brookeman 1991). The turbo factor of the MPRAGE+PMC sequence (256) is greater than that for the MPRAGE sequence (196), which would lead us to predict that the MPRAGE+PMC sequence will appear smoother.

Fig. 8 and shows the quality control metrics for the 348 participants. Paired t-tests were calculated at each measure to statistically compare sequences. Results showed significant differences (p<0.05) for all measures. Statistical scores are included in Fig. 8. When comparing MPRAGE and MPRAGE+PMC, MPRAGE+PMC had a better score for CNR, ASR, and Euler number. MPRAGE exhibited a better score in all the other measures. Plots showing the quality control metrics separated by low and high-movers and also for the test-retest group are shown in Supplementary Figs. SF7 and SF8, respectively.

Fig. 8.

Fig. 8.

Quality control metrics for the MPRAGE and MPRAGE+PMC images across 287 participants. Metrics include; Contrast to Noise Ratio (CNR), Signal to Noise Ratio (SNR), (FBER), Smoothness of Voxels (FWHM), Percent Artifact Voxels (PAV), Entropy Focus Criterion (EFC), Anterior-to-Superior Ratio (ASR), and Freesurfer’s Euler number. Results of the paired t-tests comparing each of the quality control metrics are also shown. The t-scores and p-values are color-coded to indicate which image (MPRAGE or MPRAGE+PMC) performed better at each paired comparison, blue for MPRAGE and orange for MPRAGE+PMC.

These results are a bit unexpected, especially for SNR, since theoretically, the MPRAGE+PMC sequence should have an SNR 1.54 times greater than MPRAGE. Tisdall et al. (2012) reported that the MPRAGE+PMC images had an increased ghosting effect that was only observed in the background. We are calculating SNR of each image by measuring the mean intensity within the gray matter and dividing by the standard deviation of the voxels outside of the brain. The increase in ghosting artifacts in the background would justify the reduction in SNR for the MPRAGE+PMC images. The same holds for justifying the inferior scores for MPRAGE+PMC in FBER, PAV, and EFC, which all depend on the background signal to calculate their metrics. The larger receive bandwidth (RBW) of the vNav sequence (240 Hz/px) compared to the RBW of the MPRAGE (130 Hz/px) might justify the increase in background noise, since larger RBW lets in more noise in the echo. The lower FWHM for the MPRAGE image compared to the MPRAGE+PMC image are likely due to the aforementioned differences in echo trail length.

3.8. Motion estimation

Head motion occurring during fMRI scans has been proposed as a surrogate for sMRI motion when no other method for estimating motion from the data exists (Pardoe et al., 2016; Savalia et al., 2017). The potential accuracy of fMRI as a surrogate of sMRI motion is supported by observations of high test-retest reliability for motion parameters across scans and sessions (Yan et al., 2013). But, fatigue, discomfort, and other factors are known to increase motion over time, which will likely degrade the surrogate’s accuracy. We directly tested the validity of using fMRI motion as a surrogate for sMRI motion by correlating sMRI motion estimates from the MPRAGE+PMC sequence with the motion from each of the fMRI scans collected in the same session with the test-retest dataset (see Supplementary Tables ST1 and ST2 and Alexander (Alexander et al., 2017) for details on the full imaging session.). We additionally tested how well the average motion across all fMRI scans correlates with the motion calculated in the MPRAGE+PMC run (Fig. 9). In Fig. 9 runs are listed in the order that they were collected.

Fig. 9.

Fig. 9.

Correlation of the FDpm of all the runs. The main diagonal shows the distribution of FDpm each run (MPRAGE+PMC1 to movieTP) and the average FDpm of the functional runs (“Mean”). The bottom left of the diagonal shows the scatter plot of the motion parameters across runs, while the top right of the diagonal. The values on the left column show the average FDpm for each run.

The leftmost column of Fig. 9 shows the average FDpm. As expected, there is a tendency for an increase in head motion as the session prolonged. There were two runs that were repeated in the first half and in the second half of the session, MPRAGE+PMC1–2 and peer1–3.4 For the vMPRAGE+PMC runs, there was an increase in average FDpm from 7.50 to 15.34 for MPRAGE+PMC1 and MPRAGE+PMC2 respectively. A large increase in motion also occurs for the peer runs, from 11.29 in peer1 to 17.43 in peer3. An exception to this increase in head motion was MovieTP, which is a short animated and engaging movie (“The Present”), which could have been the reason for lower head motion during that run.

Results indicate that runs that were collected close in time showed higher correlations than runs that were collected farther apart. For example, rest1 has a much higher correlation with peer1 in FDpm (r = 0.79) which is collected immediately after rest1, than it did to movieTP (r = 0.40) which occurred at the very end of the scanning session. The exception to this order effect was rest1 and movieDM, which were separated in time, with a correlation of r = 0.80. The average FDpm across the functional runs (“Mean”) exhibited a high correlation with all the runs, with values ranging from r=[0.41, 0.83]. The correlation of FDpm across the functional runs with the two structural runs was r = 0.41 and r = 0.70 for MPRAGE+PMC1 and MPRAGE+PMC2, respectively. Therefore, as previously suggested, the mean FD across the functional scans is a decent surrogate measure for the head motion for the structural scans (Pardoe et al., 2016; Savalia et al., 2017).

4. Discussion

The present study examined the relative advantages and interchangeability of the traditional MPRAGE and MPRAGE+PMC pulse sequences. Intra-sequence reliability demonstrated a clear advantage for the MPRAGE+PMC sequence in a hyperkinetic population, largely owing to the compromises in MPRAGE reliability among the higher movers. Inter-sequence reliabilities among low-motion participants demonstrated high comparability for the assessment of individual differences, suggesting the potential to change sequences mid-study when possible. In comparison to other studies that directly contrast the MPRAGE and MPRAGE+PMC sequences in a controlled environment, we tested the MPRAGE+PMC sequence in a “real world” scenario, where we did not explicitly ask subjects to move or maintain still during the acquisition of the structural images (Tisdall et al., 2016; Sarlls et al., 2018; Andersen et al., 2019). All subjects were requested to maintain their head as still as possible throughout the imaging session.

4.1. Advantages and disadvantages

Intra-sequence reliability scores of the two sequences revealed a clear superiority of the newer pulse sequence (MPRAGE-PMC). This was demonstrated across the broad range of morphometric measurements tested. The higher robustness to head motion observed for the MPRAGE-PMC sequence is not only owing to the adaptation of the gradients to motion, but the acquisition of TRs with large displacement (Tisdall et al., 2012), which is a similar strategy that was previously developed for the PROMO sequence for the GE platform (White et al., 2010).

It is worth noting that not all measures favored the sequence with PMC. As observed with the quality control indexes, there is a decrease in signal quality in the MPRAGE+PMC compared to MPRAGE. The MPRAGE sequence is superior to the MPRAGE+PMC sequence in 5 out of the 8 quality control measurements. Nonetheless, most of the measures in which the MPRAGE sequence is superior depends on the level of noise in the background, which in most part do not affect brain segmentation algorithms (i.e. Freesurfer, Mindboggle, Siena). The Euler number, in which MPRAGE+PMC is superior, actually can be considered a crucial quality control metric since it has been shown to directly correlate with manual ratings (Rosen et al., 2018). Additionally, the CNR is superior for the MPRAGE+PMC sequence. CNR is also a central quality control metric since it measures the contrast between the gray matter and the white matter intensities. This contrast is necessary for accurately finding the gray matter - white matter boundary, which is imperative for performing segmentation of brain areas/volumes and measuring cortical thickness.

4.2. Should researchers switch sequences?

Inter-sequence reliability scores showed excellent mean ICC scores (>0.8) for the majority of the morphometric measures tested. The only exception is cortical thickness, which showed a mean ICC score of 0.512 between MPRAGE1 and MPRAGE+PMC1. Nonetheless, our results show higher inter-sequence reliability (MPRAGE1 x MPRAGE+PMC1) than intra-sequence reliability of the more traditional sequence (MPRAGE1 x MPRAGE2) in all the morphometric measures. As expected, inter- and intra-sequence reliability is higher for lower motion subjects compared to the higher motion subjects. Analogous results between the two sequences were also obtained for the development curves. This further corroborates with the notion that brain quantitative measures obtained in the different sequences are more equivalent then different. Additionally, the results obtained through visual inspection (using Braindr) showed that the images generated by the MPRAGE+PMC sequence were preferred by the raters.

Taking into account all considerations, we recommend that researchers: 1) use MPRAGE+PMC as their structural T1 weighted pulse imaging sequence for future studies, and 2) consider switching to the MPRAGE+PMC for ongoing studies. The first recommendation is relatively obvious given our findings that there are higher intra-sequence reliability scores for the MPRAGE+PMC pair (MPRAGE+PMC1 x MPRAGE+PMC1) compared to all other pairs of sequences. In contrast, the second recommendation may be somewhat surprising to some; however, it reflects our findings of high inter-sequence reliability, especially in the MPRAGE1 x MPRAGE-PMC1 pair. The immediate switch to MPRAGE+PMC sequence is likely most important to studies dealing with hyperkinetic populations, where findings are increasingly being questioned in view of associations with head motion Aaron (Reuter et al., 2015; Alexander-Bloch et al., 2016; Pardoe et al., 2016). Neuroimaging researchers with projects studying low head motion participants may very well consider staying with the MPRAGE sequence, possibly finding some advantage given the higher quality control measures.

Beyond the quality control metrics, the only downside that we can identify for adopting the MPRAGE-PMC sequence is the potential increase in acquisition time. However, this increase in acquisition time is mostly caused by the repetition of TRs that surpass a motion threshold. If you are studying a population with high motion, on average this is actually an overall reduction in scan time, especially if researchers are considering repeating a full acquisition for high movers. The HBN initiative with participants aged 6–21 adopted a maximum repeat of 24 TRs. If time is of the essence and the study is with a low moving population, the maximum number of repeated TRs can be reduced to save scanner time.

It is important to note that the MPRAGE+PMC sequence is not entirely immune to head motion and other measures to restrain motion should be used in conjunction with this new sequence. Fortunately, the PMC pulse sequences can be used in conjunction with other strategies for minimizing head movements, such as training the subject in a mock scanner to get acclimated to the environment (Bie et al., 2010), movie watching to reduce motion (Vanderwal et al., 2015; Greene et al., 2018), and other methods such as using customized head restraints have also been proposed (Power et al., 2019). Additionally, methods that quickly quantify the quality of the structural images have also been proposed (White et al., 2018), hence if necessary, a structural scan can quickly be repeated within the same session.

4.3. Limitations

This study is limited in the sense that we do not have a direct measurement for motion during the MPRAGE sequence. However, we have attempted to estimate the motion by using the average motion across the functional runs. We have also not performed any rigorous visual inspection (Iscan et al., 2015) or post-processing quality control on the morphometric measurements (Ducharme et al., 2016). We did not want to discard any data due to poor image quality through visual inspection, hence directly comparing the two sequences. As can be seen in Fig. 1, though a visual inspection for the high motion participant, we would probably discard the MPRAGE image but not the MPRAGE+PMC image. Another limitation of this study is that the voxel size of the sequences that we are testing are of different sizes and that the Bandwidth and Partial Fourier values differ between sequences. However, these parameters were independently optimized by the HCP and ABCD groups for the MPRAGE and MPRAGE+PMC sequences, respectively. Previous work by Tisdal et al. (2016) has directly compared the MPRAGE sequence with and without PMC using the same parameters. Attempting to find parameters that would be acceptable for both the MPRAGE and MPRAGE+PMC sequences is beyond the scope of this project, and could also entail that we would be using suboptimal parameters for both sequences. The objective of this study is to compare two T1-weighted MRI sequences that are used by a broad amount of researchers and by large imaging studies, such as the HCP and ABCD studies. Nevertheless, even with different voxel sizes our results showed high reliability between the two sequences. Finally, we did not perform any statistical corrections for multiple comparisons in any of our tests. The objective of this paper was to uncover if the two sequences are equivalent, not find the differences. Therefore, using any form of correction for multiple comparisons for our statistical tests would cloud our findings.

5. Conclusions

Our results indicate that researchers should adopt or switch to the MPRAGE+PMC sequence in their new studies, especially if there are studying populations with high levels of head motion. Morphometric results obtained from the MPRAGE+PMC sequences are comparable to MPRAGE, especially with the low motion images. Hence, there is no loss if researchers would choose to switch from MPRAGE to MPRAGE+PMC. Additionally, our data from a developmental study, shows that T1’s obtained with PMC have much higher reliability compared to the traditional MPRAGE sequence. However, quality control metrics have shown higher scores for MPRAGE compared to MPRAGE+PMC, mostly caused by increased background noise in the MPRAGE+PMC sequence. Hence, if the population being studied has minimal head motion and the researcher would like to maximize data quality (i.e. SNR), the MPRAGE sequence might be preferred.

Supplementary Material

1

Acknowledgments

We would like to thank the participants and parents for participating in the Healthy Brain Network Initiative. We would also like to thank the many individuals who have provided financial support to the CMI Healthy Brain Network to make the creation and sharing of this resource possible and the partial support the NIH grant R01MH091864 to NT and MM. Finally, we would like to thank the support of the NYS Office of Mental Health (SC, MM, and ARF).

Footnotes

Declaration of Competing Interest

All authors declare that they do not have any conflicts of interest.

1

MPRAGE is the sequence used by Siemens MRIs and the equivalent of this sequence for GE machines is the 3-D Fast SPGR and for Philips is its 3D TFE.

2

MPRAGE is the recommended sequence to be used by Freesurfer

3

It is possible to directly obtain the RMS motion estimation scores from the Dicom files using a python function available here: https://github.com/MRIMotionCorrection/parse_vNav_Motion. However, we choose to recalculate the motion estimation parameters with QAP to maintain consistency with the functional data. To check consistency across methods, we compared the mean RMS motion from the Dicom files and the mean FD from QAP. A correlation of r = 0.992 was obtained, indicating a very high consistency across the two methods to estimate head motion.

4

Peer (Peer Eye Estimation Regression) is a short (<2 min) functional run to calibrate an fMRI-based eye-tracking algorithm. See Son et al. (2019) for more details. In the initial HBN protocol, there was a peer2 run which was later dropped given time constraints and no need to have 3 calibration runs.

Supplementary materials

Supplementary material associated with this article can be found, in the online version, at doi:10.1016/j.neuroimage.2020.1175851.

Data and code availability statements

All data used in this manuscript is available through the Healthy Brain Network’s Scientific Data Portal: http://fcon_1000.projects.nitrc.org/indi/cmi_healthy_brain_network/

Data processed though Mindboggle are also available through the portal.

References

  1. Alexander-Bloch A, Clasen L, Stockman M, Ronan L, Lalonde F, Giedd J, Raznahan A, 2016. Subtle in-scanner motion biases automated measurement of brain anatomy from in vivo MRI. Hum. Brain Mapp. 37 (7), 2385–2397. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Alexander-Bloch AF, Shou H, Liu S, Satterthwaite TD, Glahn DC, Shinohara RT, Vandekar SN, Raznahan A, 2018. On testing for spatial correspondence between maps of human brain structure and function. Neuroimage 178 (September), 540–551. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Alexander LM, Escalera J, Ai L, Andreotti C, Febre K, Mangone A, Vega-Potler N, et al. , 2017. An open resource for transdiagnostic research in pediatric mental health and learning disorders. Sci. Data 4 (December), 170181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Andersen M, Björkman-Burtscher IM, Marsman A, Petersen ET, Boer VO, 2019. Improvement in diagnostic quality of structural and angiographic MRI of the brain using motion correction with interleaved, volumetric navigators. PLoS ONE 14 (5), e0217145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Atkinson D, Hill DL, Stoyle PN, Summers PE, Keevil SF, 1997. Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterion. IEEE Trans. Med. Imaging 16 (6), 903–910. [DOI] [PubMed] [Google Scholar]
  6. Barish MA, Jara H, 1999. Motion artifact control in body MR imaging. Magn. Reson. Imaging Clin. N. Am. 7 (2), 289–301. [PubMed] [Google Scholar]
  7. Bie HMA, Boersma M, Wattjes MP, Adriaanse S, Jeroen Vermeulen R, Oostrom KJ, Huisman J, Veltman DJ, Delemarre-Van de Waal HA, 2010. Preparing children with a mock scanner training protocol results in high quality structural and functional MRI scans. Eur. J. Pediatr. 169 (9), 1079–1085. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bookheimer SY, Salat DH, Terpstra M, Ances BM, Barch DM, Buckner RL, Burgess GC, et al. , 2019. The lifespan human connectome project in aging: an overview. Neuroimage 185 (January), 335–348. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Bookheimer SY, 2000. Methodological issues in pediatric neuroimaging. Ment. Retard. Dev. Disabil. Res. Rev. 6 (3), 161–165. [DOI] [PubMed] [Google Scholar]
  10. Brant-Zawadzki M, Gillan GD, Nitz WR, 1992. MP RAGE: a three-dimensional, T1-weighted, gradient-echo sequence–initial experience in the brain. Radiology 182 (3), 769–775. [DOI] [PubMed] [Google Scholar]
  11. Brown RW, Norman Cheng Y-C, Mark Haacke E, Thompson MR, Venkatesan R, 2014. Magnetic Resonance Imaging: Physical Principles and Sequence Design. John Wiley & Sons. [Google Scholar]
  12. Casey BJ, Cannonier T, Conley MI, Cohen AO, Barch DM, Heitzeg MM, Soules ME, et al. , 2018. The adolescent brain cognitive development (ABCD) study: imaging acquisition across 21 Sites. Dev. Cogn. Neurosci. doi: 10.1016/j.dcn.2018.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Cox RW, 2012. AFNI: what a long strange trip it’s been. Neuroimage 62 (2), 743–747. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Craddock RC, Jbabdi S, Yan C-G, Vogelstein JT, Xavier Castellanos F, Martino AD, Kelly C, Heberlein K, Colcombe S, Milham MP, 2013. Imaging human connectomes at the macroscale. Nat. Methods 10 (6), 524–539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, et al. , 2006. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31 (3), 968–980. [DOI] [PubMed] [Google Scholar]
  16. Ducharme S, Albaugh MD, Nguyen T-V, Hudziak JJ, Mateos-Pérez JM, Labbe A, Evans AC, Karama S Brain Development Cooperative Group, and Others, 2016. Trajectories of cortical thickness maturation in normal brain development —the importance of quality control procedures. Neuroimage 125, 267–279. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Fischl B, 2012. FreeSurfer. Neuroimage 62 (2), 774–781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Giard J, Alface PR, Gala J-L, Macq B, 2011. Fast surface-based travel depth estimation algorithm for macromolecule surface shape description. IEEE ACM Trans. Comput. Biol. Bioinform. 8 (1), 59–68. [DOI] [PubMed] [Google Scholar]
  19. Gilmore A, Buser N, Hanson JL, 2019. Variations in structural MRI quality impact measures of brain anatomy: relations with age and other sociodemographic variables. bioRxiv doi: 10.1101/581876. [DOI] [Google Scholar]
  20. Glasser MF, Smith SM, Marcus DS, Andersson JLR, Auerbach EJ, Behrens TEJ, Coalson TS, et al. , 2016. The human connectome project’s neuroimaging approach. Nat. Neurosci. 19 (9), 1175–1187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Glasser MF, Sotiropoulos SN, Anthony Wilson J, Coalson TS, Fischl B, Andersson JL, Xu J, et al. , 2013. The minimal preprocessing pipelines for the human connectome project. Neuroimage 80 (October), 105–124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Greene DJ, Koller JM, Hampton JM, Wesevich V, Van AN, Nguyen AL, Hoyt CR, et al. , 2018. Behavioral interventions for reducing head motion during MRI scans in children. Neuroimage 171 (May), 234–245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Harms MP, Somerville LH, Ances BM, Andersson J, Barch DM, Bastiani M, Bookheimer SY, et al. , 2018. Extending the human connectome project across ages: imaging protocols for the lifespan development and aging projects. Neuroimage 183 (December), 972–984. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Howell BR, Styner MA, Gao W, Yap P-T, Wang L, Baluyot K, Yacoub E, et al. , 2019. The UNC/UMN baby connectome project (BCP): an overview of the study design and protocol development. Neuroimage 185 (January), 891–905. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Iscan Z, Jin TB, Kendrick A, Szeglin B, Lu H, Trivedi M, Fava M, et al. , 2015. Test-retest reliability of freesurfer measurements within and between sites: effects of visual approval process. Hum. Brain Mapp. 36 (9), 3472–3485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Jack CR Jr, Bernstein MA, Fox NC, Thompson P, Alexander G, Harvey D, Borowski B, et al. , 2008. The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. J. Magn. Reson. Imaging 27 (4), 685–691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Jenkinson M, Bannister P, Brady M, Smith S, 2002. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17 (2), 825–841. [DOI] [PubMed] [Google Scholar]
  28. Keshavan A, Yeatman JD, Rokem A, 2019. Combining citizen science and deep learning to amplify expertise in neuroimaging. Front. Neuroinform. 13 (May), 29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Klein A, Ghosh SS, Bao FS, Giard J, Häme Y, Stavsky E, Lee N, et al. , 2017. Mindboggling morphometry of human brains. PLoS Comput. Biol. 13 (2), e1005350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Magnotta VA, Friedman L, First BIRN, 2006. Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging study. J. Digit. Imaging 19 (2), 140–147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. McNEMAR Q, 1947. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12 (2), 153–157. [DOI] [PubMed] [Google Scholar]
  32. Mortamet B, Bernstein MA, Jack CR Jr, Gunter JL, Ward C, Britson PJ, Meuli R, Thiran J-P, Krueger G Alzheimer’s Disease Neuroimaging Initiative, 2009. Automatic quality assessment in structural brain magnetic resonance imaging. Magn. Reson. Med. Off. J. Soc. Magn. Reson. Med. Soc. Magn. Reson. Med. 62 (2), 365–372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Mugler JP 3rd, and Brookeman JR. 1990. “Three-dimensional magnetization-prepared rapid gradient-echo imaging (3D MP RAGE).” Magn. Reson. Med. Off. J. Soc. Magn. Reson. Med. Soc. Magn. Reson. Med. 15 (1): 152–57. [DOI] [PubMed] [Google Scholar]
  34. Mugler JP 3rd, and Brookeman JR. 1991. “Rapid three-dimensional T1-weighted MR imaging with the MP-RAGE sequence.” J. Magn. Reson. Imaging 1 (5): 561–67. [DOI] [PubMed] [Google Scholar]
  35. Nooner KB, Colcombe SJ, Tobe RH, Mennes M, Benedict MM, Moreno AL, Panek LJ, et al. , 2012. The NKI-Rockland sample: a model for accelerating the pace of discovery science in psychiatry. Front. Neurosci. 6 (October), 152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Pardoe HR, Hiess RK, Kuzniecky R, 2016. Motion and morphometry in clinical and nonclinical populations. Neuroimage 135 (July), 177–185. [DOI] [PubMed] [Google Scholar]
  37. Power JD, Silver BM, Silverman MR, Ajodan EL, Bos DJ, Jones RM, 2019. Customized head molds reduce motion during resting state fMRI scans. Neuroimage 189 (April), 141–149. [DOI] [PubMed] [Google Scholar]
  38. Reuter M, Dylan Tisdall M, Qureshi A, Buckner RL, van der Kouwe AJW, Fischl B, 2015. Head motion during MRI acquisition reduces gray matter volume and thickness estimates. Neuroimage 107 (February), 107–115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Rosen AFG, Roalf DR, Ruparel K, Blake J, Seelaus K, Villa LP, Ciric R, et al. , 2018. Quantitative assessment of structural image quality. Neuroimage 169 (April), 407–418. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Sarlls JE, Lalonde F, Rettmann D, Shankaranarayanan A, Roopchansingh V, Lalith Talagala S, 2018. Effectiveness of navigator-based prospective motion correction in MPRAGE data acquired at 3T. PLoS ONE 13 (6), e0199372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Savalia NK, Agres PF, Chan MY, Feczko EJ, Kennedy KM, Wig GS, 2017. Motion-related artifacts in structural brain images revealed with independent estimates of in-scanner head motion. Hum. Brain Mapp. 38 (1), 472–492. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Shrout PE, Fleiss JL, 1979. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 86 (2), 420–428. [DOI] [PubMed] [Google Scholar]
  43. Smith SM, Zhang Y, Jenkinson M, Chen J, Matthews PM, Federico A, De Stefano N, 2002. Accurate, robust, and automated longitudinal and cross-sectional brain change analysis. Neuroimage 17 (1), 479–489. [DOI] [PubMed] [Google Scholar]
  44. Somerville LH, Bookheimer SY, Buckner RL, Burgess GC, Curtiss SW, Dapretto M, Elam JS, et al. , 2018. The lifespan human connectome project in development: a large-scale study of brain connectivity development in 5–21 year olds. Neuroimage 183 (December), 456–468. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Son J, Ai L, Lim R, Xu T, Colcombe S, Franco AR, Cloud J, et al. , 2019. Evaluating fMRI-based estimation of eye gaze during naturalistic viewing. Cereb. Cortex doi: 10.1093/cercor/bhz157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, Downey P, et al. , 2015. UK Biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 12 (3), e1001779. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Tisdall MD, Hess AT, Reuter M, Meintjes EM, Fischl B, van der Kouwe AJW, 2012. Volumetric navigators for prospective motion correction and selective reacquisition in neuroanatomical MRI. Magn. Reson. Med. Off. J. Soc. Magn. Reson. Med. Soc. Magn. Reson. Med. 68 (2), 389–399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Tisdall MD, Reuter M, Qureshi A, Buckner RL, Fischl B, van der Kouwe AJW, 2016. Prospective motion correction with volumetric navigators (vNavs) reduces the bias and variance in brain morphometry induced by subject motion. Neuroimage 127 (February), 11–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Vanderwal T, Kelly C, Eilbott J, Mayes LC, Xavier Castellanos F, 2015. Inscapes: a movie paradigm to improve compliance in functional magnetic resonance imaging. Neuroimage 122 (November), 222–232. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. van der Kouwe AJW, Benner T, Salat DH, Fischl B, 2008. Brain morphometry with multiecho MPRAGE. Neuroimage 40, 559–569. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Van Essen DC, Smith SM, Barch DM, Behrens TEJ, Yacoub E, Ugurbil K WU-Minn HCP Consortium, 2013. The WU-Minn human connectome project: an overview. Neuroimage 80 (October), 62–79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. White N, Roddey C, Shankaranarayanan A, Han E, Rettmann D, Santos J, Kuperman J, Dale A, 2010. PROMO: real-time prospective motion correction in MRI using image-based tracking. Magn. Reson. Med. Off. J. Soc. Magn. Reson. Med. Soc. Magn. Reson. Med. 63 (1), 91–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. White T, Jansen PR, Muetzel RL, Sudre G, El Marroun H, Tiemeier H, Qiu A, Shaw P, Michael AM, Verhulst FC, 2018. Automated quality assessment of structural magnetic resonance images in children: comparison with visual inspection and surface-based reconstruction. Hum. Brain Mapp. 39 (3), 1218–1231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Wonderlick JS, Ziegler DA, Hosseini-Varnamkhasti P, Locascio JJ, Bakkour A, van der Kouwe A, Triantafyllou C, Corkin S, Dickerson BC, 2009. Reliability of MRI-derived cortical and subcortical morphometric measures: effects of pulse sequence, voxel geometry, and parallel imaging. Neuroimage 44 (4), 1324–1333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Yan C-G, Cameron Craddock R, He Y, Milham MP, 2013. Addressing head motion dependencies for small-world topologies in functional connectomics. Front. Hum. Neurosci. 7 (December), 910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Yeo BTT, Krienen FM, Sepulcre J, Sabuncu MR, Lashkari D, Hollinshead M, Roffman JL, et al. , 2011. The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J. Neurophysiol. 106 (3), 1125–1165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Zarrar S, Steven G, Qingyang L, Yassine B, Chaogan Y, Zhen Y, Michael M, Pierre B, Cameron C, 2015. The preprocessed connectomes project quality assessment protocol - a resource for measuring the quality of MRI data. Front. Neurosci. doi: 10.3389/conf.fnins.2015.91.00047. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1

Data Availability Statement

All data used in this manuscript is available through the Healthy Brain Network’s Scientific Data Portal: http://fcon_1000.projects.nitrc.org/indi/cmi_healthy_brain_network/

Data processed though Mindboggle are also available through the portal.

RESOURCES