Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jul 16.
Published in final edited form as: Comput Diffus MRI. 2019 May 3;2019:183–191. doi: 10.1007/978-3-030-05831-9_15

Longitudinal Harmonization for Improving Tractography in Baby Diffusion MRI

Khoi Minh Huynh 1,2, Jaeil Kim 3, Geng Chen 4, Ye Wu 5, Dinggang Shen 6,7, Pew-Thian Yap 8,9
PMCID: PMC8283964  NIHMSID: NIHMS1717213  PMID: 34278385

Abstract

The human brain develops very rapidly in the first years of life, resulting in significant changes in water diffusion anisotropy. Developmental changes pose significant challenges to longitudinally consistent white matter tractography. In this paper, we will introduce a method to harmonize infant diffusion MRI data longitudinally across time. Specifically, we harmonize diffusion MRI data collected at an earlier time point to data collected at a later time point. This will promote longitudinal consistency and allow sharpening of fiber orientation distribution functions (ODFs) based on information available at the later time point. For this purpose, we will introduce an approach that is based on the method of moments, which allows harmonization to be performed directly on the diffusion-attenuated signal without the need to fit any diffusion models to the data. Given two diffusion MRI datasets, our method harmonizes them voxel-wise using well-behaving mapping functions (i.e., monotonic, diffeomorphic, etc.), parameters of which are determined by matching the spherical moments (i.e., mean, variance, skewness, etc.) of signal measurements on each shell. The mapping functions we use is isotropic and does not introduce new orientations that are not already in the original data. Our analysis indicates that longitudinal harmonization sharpens ODFs and improves tractography in infant diffusion MRI.

Keywords: Longitudinal harmonization, Diffusion MRI, Method of moments, Tractography

1. Introduction

White matter contains axonal tracts that relay and coordinate communication between different brain regions. Myelination begins in the last trimester with myelin sheaths wrapping around axons and significantly boosting nerve conduction velocity [1]. Rapidly ongoing myelination during infancy leads to dynamic development in verbal, motor, and cognitive functions [2]. As a fatty substance, myelin sheath limits water diffusion in direction perpendicular, but not parallel, to the tracts, causing diffusion anisotropy and giving contrast to diffusion-weighted (DW) images.

Tractography is significantly affected by changes in diffusion anisotropy. This stems from the fact that, in general, tractography methods are designed to traverse areas of high anisotropy and avoid areas of low anisotropy. In the developing brain where the anisotropy is typically low and progressively increases with maturation, far fewer voxels are included in the pathway at birth than at successive time points. As a result, even there is a profusion of tracts in an infant brain, incomplete myelination makes reconstruction of the tracts via diffusion tractography challenging. An often used remedy is to lower the anisotropy threshold to allow a tractography algorithm to generate streamlines that traverse some regions with low anisotropy. This approach, however, might result in spurious streamlines owing to directional uncertainty caused by the lack of anisotropy.

To tackle the problem, we propose in this paper a longitudinal harmonization method to improve tractography for infant diffusion MRI. Based on the method of moments, our approach involves a model-free harmonization strategy that can be applied directly on longitudinal data without fitting of diffusion models. This is achieved with mapping functions that are designed to be smooth (no abrupt changes), one-to-one (topology preserving), non-decreasingly monotonic (contrast preserving), and invertible (data recoverable). The parameters of the mapping functions are determined by matching the spherical moments (i.e., mean, variance, skewness, etc.) of signal measurements on each shell. These functions are applied isotropically and do not introduce new orientations that are not already in the original data. Our analyses indicate that longitudinal harmonization sharpens fiber orientation distribution functions (ODFs) and improves tractography without introducing false-positive streamlines.

2. Methods

In shell-based sampling, the diffusion-attenuated signal Sb is sampled using a set of non-collinear gradient directions with a fixed diffusion weighting (i.e., b-value). The n-th raw spherical moment is defined as

E[Sbn]=S2Sbn(g)dg. (1)

The spherical mean (M1,Sb) and variance (M2,Sb) can be defined based on the first and second raw spherical moments as

M1,Sb=S¯b=E[Sb], (2)
M2,Sb=E[(SbE[Sb])2]. (3)

Taking the dataset at a later time point as the reference R and the dataset at an earlier time point as the target T, we want to determine a mapping function fθ(S) that results in the matching of the two moments:

M1,R=E[R]=M1,fθ(T)=E[fθ(T)], (4)
M2,R=E[(RE[R])2]=M2,fθ(T)=E[(fθ(T)E[fθ(T)])2], (5)

where Mn,fθ(T) is the n-th moment of the target after mapping via fθ(S) whereas Mn,T is the moment before mapping. It is shown in [3] that the spherical mean is independent of the fiber orientation distribution and can be used to characterize per-axon microstructural properties. The spherical variance can be seen as a measure of fiber orientation consistency (opposite to fiber dispersion).

To maintain signal contrast, the mapping function must be monotonic. In this work, using the first two moments, we employ a first-order mapping function fθ={α,β}(S) = αS + β and (4) and (5) can therefore be written as

M1,R=αM1,T+βandM2,R=α2M2,T, (6)

allowing the parameters to be determined as

α=M2,R/M2,Tandβ=M1,RαM1,T. (7)

To ensure that the contrast is not inverted, we constrain α > 0. The estimation of parameter α is problematic in isotropic regions where the variance is a primarily due to noise, resulting in instability in parameter estimation. For greater robustness, we estimate the parameters using regularized least-squares, as described next.

Assuming that the reference and target moment images are spatially aligned, moment matching is performed voxel-wise. For each voxel υ, the mapping parameters are determined by minimizing the cost function J(α(υ),β(υ)) of the unconstrained multivariable optimization problem with Quasi-Newton algorithm:

J(α(v),β(v))=(M1,R(ϕ1(v))M1,T(fθ={α(v),β(v)}(v))M2,R(ϕ1(v))M2,T(fθ={α(v),β(v)}(v)))22+ψ(α(v),β(v)), (8)

where φ(υ) is a deformation field that spatially aligns the reference to the target. The regularizer is defined as

ψ(α,β)=λ{[1e(α1)22]+[1eβ22]}, (9)

where λ is a tunning parameter. The signal Sb(g|υ) at spatial location v and for gradient direction g is harmonized via

Sb(gv)=α(v)Sb(gv)+β(v). (10)

Note that the mapping does not change with the gradient direction. We found that the first order mapping function is sufficient for our application. Our method allows more sophisticated mapping functions to be used as long as basic properties, such as nondecreasing monotonicity, are met. The parameters, if more than two, can be estimated using higher-order moments. Our method only requires warping of the moment images, but not the DW images, for matching; therefore issues related to signal reorientation [4] can be avoided.

3. Experiments

We study the effects of longitudinal harmonization using both synthetic and real in-vivo baby diffusion MRI data.

3.1. Synthetic Data

We generated multi-shell synthetic data simulating a complex phantom using Phantomas with 90 DW images in each shell (b = 1000, 2000, and 3000s/mm2) and 18 non-diffusion-weighted B0 images [5]. The reference was created using a 27-bundle configuration with λ1 = 1.7 × 10−3 mm2/s and λ2 = λ3 = 4.35 × 10−4 mm2/s to simulate high fractional anisotropy (FA = 0.7). The target was created using only a 8-bundle configuration (subset of the 27 bundles) with λ1 = 1.7 × 10−3 mm2/s and λ2 = λ3 = 1.2 × 10−3mm2/s to simulate low anisotropy (FA = 0.2). Rician noise was added.

To illustrate the effects of harmonization, we performed global tractography [6] on both unharmonized and harmonized datasets. Figure 1 shows that after harmonization, the streamlines are cleaner and denser with less false positives. Harmonization also increases the anisotropy of the diffusion signal profiles. Table 1 summarizes the Tractometer [7] statistics, indicating that harmonization increases valid connections and decrease invalid connections. With harmonization, the 8 streamline bundles can be fully recovered without any false positives that may be introduced by the reference.

Fig. 1. Synthetic Data.

Fig. 1

Tractography results of the 8-bundle phantom (middle) and exemplar diffusion signal profiles (right) before and after harmonization. Note that even though the reference has 27 bundles, harmonization does not introduce any false-positive bundles

Table 1.

Tractometer statistics for synthetic data

Tracts VC(%) IC (%) NC(%) VCVC+IC (%) VB IB
Unharmonized 4870   2.5 7.1 90.4 26.04   8 12
Harmonized 8052 11.5 3.2 85.3 78.2   8 9
Reference 10962 12.89 3.22 83.89 80.01 27 127

3.2. Real Data

We used a diffusion MRI dataset of a 9-month old subject as the reference to harmonize the dataset of the same subject collected at 3 months of age. Each dataset consist of 74 DW images distributed on two shells (b = 1500 and 3000s/mm2) and 5 non-DW B0 images. Eddy-current distortion, motion, and susceptibility artifacts were corrected prior to harmonization [8]. The dataset of the later time point was registered to the earlier time point using multi-channel diffeomorphic registration [9] with fractional anisotropy (FA) and B0 images. Signal normalization was carried out by dividing the DW images with the average of the non-DW images.

Diffusion Indices:

Fractional anisotropy (FA), mean diffusivity (MD), per-axon FA (μFA), and per-axon MD (μMD) were compared before and after harmonization. Figure 2 illustrates the effects of harmonization on the indices. The anisotropy of the 3-month dataset increases noticeably after harmonization.

Fig. 2. Diffusion Indices.

Fig. 2

Fractional anisotropy (FA), mean diffusivity (MD), per-axon FA (μFA), and per-axon MD (μMD) of the 3-month dataset before (top) and after (middle) harmonization, and the 9-month reference dataset (bottom)

Fiber ODFs:

Multi-tissue constrained spherical deconvolution [10] was performed to estimate the fiber ODFs. From Fig. 3, one can appreciate the increase in sharpness of the FODFs after harmonization. The tissue volume fraction map also reveals greater details with further extension into cortical regions.

Fig. 3. Fiber ODFs.

Fig. 3

Left to Right: DW image, tissue volume fraction map (Blue: White matter; Green: Gray matter; Red: Cerebrospinal fluid), Close-up view of forceps minor, and an FODF in forceps minor before and after harmonization

Tract Probability:

The tract probability maps shown in Fig. 4 were obtained using tractography with second-order integration over the fiber ODFs [11]. After harmonization, all 20 major tracts described in [12] show increased tract probabilities. Detailed quantitative results are provided in Table 2.

Fig. 4. Tract Probability.

Fig. 4

Probability (%) of the presence of a tract at a particular location, determined via probabilistic tractography using unharmonized and harmonized data

Table 2.

Probalility (%) of major tracts before and after harmonization

Tract Unharmonized Harmonized
Anterior thalamic radiation (L) 10.79 20.57
Anterior thalamic radiation (R)   8.45 16.37
Corticospinal tract (L) 16.42 22.21
Corticospinal tract (R) 21.38 33.81
Cingulum (cingulate gyrus) (L)   7.63 13.96
Cingulum (cingulate gyrus) (R)   5.40 11.65
Cingulum (hippocampus) (L)   6.65 11.52
Cingulum (hippocampus) (R)   6.45 10.83
Forceps major 14.90 23.56
Forceps minor 12.86 24.03
Inferior fronto-occipital fasciculus (L) 14.24 25.37
Inferior fronto-occipital fasciculus (R) 13.78 23.77
Inferior longitudinal fasciculus (L)   9.06 16.50
Inferior longitudinal fasciculus (R) 12.27 23.57
Superior longitudinal fasciculus (L) 13.36 25.92
Superior longitudinal fasciculus (R) 13.96 25.44
Uncinate fasciculus (L) 10.48 24.25
Uncinate fasciculus (R)   9.76 16.60
Superior longitudinal fasciculus (L) 13.29 25.60
Superior longitudinal fasciculus (R) 12.70 29.82

Tractogram:

Whole brain tractograms were constructed using global tractography [13]. Figure 5 confirms the effectiveness of harmonization as it significantly improved tractography results.

Fig. 5. Tractograms.

Fig. 5

The effects of harmonization shown using tractograms

4. Conclusion

We have introduced a model-free approach, based on the method of moments, for longitudinal harmonization. We have demonstrated its effectiveness in sharpening fiber ODFs and in improving tractography in infant diffusion MRI.

Acknowledgements

This work was supported in part by NIH grants (1U01MH110274, NS093842, EB022880, and MH100217) and the efforts of the UNC/UMN Baby Connectome Project Consortium.

Footnotes

Declarations The authors declare that there is no conflict or commercial interest and the work is in compliance with the IRB regulations.

Contributor Information

Khoi Minh Huynh, Biomedical Engineering Department, University of North Carolina, Chapel Hill, USA; Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

Jaeil Kim, Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

Geng Chen, Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

Ye Wu, Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

Dinggang Shen, Biomedical Engineering Department, University of North Carolina, Chapel Hill, USA; Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

Pew-Thian Yap, Biomedical Engineering Department, University of North Carolina, Chapel Hill, USA; Department of Radiology and BRIC, University of North Carolina, Chapel Hill, USA.

References

  • 1.Hüppi PS, Maier SE, Peled S, Zientara GP, Barnes PD, Jolesz FA, Volpe JJ: Microstructural development of human newborn cerebral white matter assessed in vivo by diffusion tensor magnetic resonance imaging. Pediat. Res. 44(4), 584 (1998) [DOI] [PubMed] [Google Scholar]
  • 2.Dubois J, Dehaene-Lambertz G, Kulikova S, Poupon C, Hüppi PS, Hertz-Pannier L: The early development of brain white matter: a review of imaging studies in fetuses, newborns and infants. Neuroscience 276, 48–71 (2014) [DOI] [PubMed] [Google Scholar]
  • 3.Kaden E, Kruggel F, Alexander DC: Quantitative mapping of the per-axon diffusion coefficients in brain white matter. Magn. Reson. Med. 75(4), 1752–1763 (2016) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Yap PT, Shen D: Spatial transformation of DWI data using non-negative sparse representation. IEEE Trans. Med. Imaging 31(11), 2035–2049 (2012) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Caruyer E, Daducci A, Descoteaux M, Houde JC, Thiran JP, Verma R: Phantomas: a flexible software library to simulate diffusion MR phantoms. In: The Annual Meeting of the International Society for Magnetic Resonance in Medicine (2014) [Google Scholar]
  • 6.Wu H, Chen G, Jin Y, Shen D, Yap PT: Embarrassingly parallel acceleration of global tractography via dynamic domain partitioning. Front. Neuroinformatics 10(25) (2016) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Côté MA, Girard G, Boré A, Garyfallidis E, Houde JC, Descoteaux M: Tractometer: towards validation of tractography pipelines. Med. Image Anal. 17(7), 844–857 (2013) [DOI] [PubMed] [Google Scholar]
  • 8.Andersson JL, Sotiropoulos SN: An integrated approach to correction for off-resonance effects and subject movement in diffusion MR imaging. NeuroImage 125, 1063–1078 (2016) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Avants BB, Tustison N, Song G: Advanced normalization tools (ANTS). Insight J. 2, 1–35 (2009) [Google Scholar]
  • 10.Jeurissen B, Tournier JD, Dhollander T, Connelly A, Sijbers J: Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data. NeuroImage 103, 411–426 (2014) [DOI] [PubMed] [Google Scholar]
  • 11.Tournier JD, Calamante F, Connelly A: Improved probabilistic streamlines tractography by 2nd order integration over fibre orientation distributions. In: The Annual Meeting of the International Society for Magnetic Resonance in Medicine (2010) 1670 [Google Scholar]
  • 12.Mori S, Wakana S, Van Zijl PC, Nagae-Poetscher L: MRI Atlas of Human White Matter. Elsevier; (2005) [DOI] [PubMed] [Google Scholar]
  • 13.Christiaens D, Reisert M, Dhollander T, Sunaert S, Suetens P, Maes F: Global tractography of multi-shell diffusion-weighted imaging data using a multi-tissue model. NeuroImage 123, 89–101 (2015) [DOI] [PubMed] [Google Scholar]

RESOURCES