Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Mar 3.
Published in final edited form as: Med Image Comput Comput Assist Interv. 2019 Oct 10;11765:815–822. doi: 10.1007/978-3-030-32245-8_90

Surface-Volume Consistent Construction of Longitudinal Atlases for the Early Developing Brain

Sahar Ahmad 1, Zhengwang Wu 1, Gang Li 1, Li Wang 1, Weili Lin 1, Pew-Thian Yap 1, Dinggang Shen 1; UNC/UMN Baby Connectome Project Consortium1
PMCID: PMC7052685  NIHMSID: NIHMS1564565  PMID: 32128521

Abstract

Infant brain atlases are essential for characterizing structural changes in the developing brain. Volumetric and cortical atlases are typically constructed independently, potentially causing discrepancies between tissue boundaries and cortical surfaces. In this paper, we present a method for surface-volume consistent construction of longitudinal brain atlases of infants from 2 weeks to 12 months of age. We first construct the 12-month atlas via groupwise surface-constrained volumetric registration. The longitudinal displacements of each subject with respect to different time points are then transported parallelly to the 12-month atlas space. The 12-month cortico-volumetric atlas is finally warped temporally to each month prior to the 12th month using the transported displacements. Experimental results indicate that the longitudinal atlases generated are consistent in terms of tissue boundaries and cortical surfaces, hence allowing joint surface-volume analysis to be performed in a common space.

Keywords: Infant brain atlas, Cortical surface, Neurodevelopment, Longitudinal trajectory

1. Introduction

A brain atlas is an anatomical representation of the brain, encapsulating population-wise brain features. Infant atlases are constructed to capture normative growth trajectories that are essential for understanding brain maturation during infancy and for early diagnosis of neurodevelopmental abnormalities [6]. Volumetric atlases facilitate the analysis of cortical and subcortical structures whereas cortical atlases provide additional information for studying cortical attributes, such as thickness, curvature, and convexity, as well as cortico-cortical connectivity [8,13,15].

Existing research focuses on constructing either volumetric or cortical atlases. For instance, Serag et al. [11] constructed spatio-temporal volumetric brain atlases of infants scanned between 28 and 44 weeks of age. Shi et al. [12] constructed a volumetric neonatal atlas using unbiased group-wise registration and patch-based sparse representation. Zhang et al. [17] constructed a volumetric neonatal brain atlas by combining spatial and frequency information using patch-based sparse representation. Bozek et al. [2] constructed neonatal cortical surface atlases for nine time points between 36–44 weeks of age. Multimodal surface matching [10] was used to align the features on the cortical surface and then temporal adaptive kernel regression was employed to generate the atlases. Li et al. [7] constructed infant cortical surface atlases for seven time points between 1- and 24-months of age using longitudinally consistent and unbiased group-wise registration.

Volumetric and cortical atlases are typically constructed independently, causing the following problems: (i) Misalignment of tissue boundaries in the volumetric atlas, and the pial and white matter surfaces of the cortical atlas. (ii) Blurred cortical structures in the volumetric atlas due to not using the geometry of the cortical surfaces in guiding registration. (iii) Cortical surface registration disregarding the image volume results in deformations that will unrealistically deform the brain. (iv) The volumetric and surface atlases do not reside in the same space, complicating concurrent analysis of the two entities. (v) Alignment inconsistency and inaccuracy can diminish the detectability of true but subtle longitudinal changes.

To overcome these problems, we present in this paper a method to construct longitudinal surface-volume consistent atlases for infants from 2 weeks to 12 months of age. We construct the cortical and volumetric atlases simultaneously, such that the boundaries of white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) are consistently aligned, in both volumetric and surface spaces. This allows surface and volumetric analyses to be conducted consistently in a single atlas space.

2. Methods

Our surface-volume consistent atlas construction method consists of two steps (see Fig. 1) (i) Construct the cortico-volumetric atlas at the 12-month time point; and (ii) Construct longitudinal month-specific cortico-volumetric atlases prior to the 12th month via parallel transport of displacement fields.

Fig. 1.

Fig. 1.

Construction of cortico-volumetric atlases.

2.1. Construction of 12-Month Atlas

Groupwise Surface-Constrained Volumetric Registration –

We first construct the 12-month atlas via group-wise registration using subjects scanned at either 11, 12 or 13 months of age. Group-wise registration simultaneously registers all the images to a hidden common space by (i) selecting as reference the image with the minimum dissimilarity to the other images and (ii) iteratively updating the reference by averaging all the images registered to it. The registration of infant brain MR images is challenging owing to the dramatic contrast changes during the first year of life. To overcome this problem, we propose to register the segmented tissue maps instead of the intensity images. We use a surface-constrained dynamic elasticity model (SCDEM) [1] as the underlying transformation model for cross-sectional group-wise registration. The SCDEM registration algorithm determines the volumetric displacement field ϕ that matches a pair of images, constrained by the surface displacement field ψ computed as vertex-wise displacements between cortical surfaces given by Spherical Demons [16]. The volumetric displacement field is estimated using the following hyperbolic wave equation:

α2ϕ(x)+α(ϕ(x))+βfv(x)+γfs(x)=2ϕ(x)t2, (1)

where the volumetric force field fv measures the discrepancies between the warped and reference segmented tissue maps. The surface force field fs is computed as the error between the surface displacement field estimated by ϕ and the pre-computed surface displacement field ψ. α, β, and γ are parameters that control the smoothness of the displacement field, and the contributions of fv and fs, respectively. The two force fields recede gradually and eventually balance the smoothness terms in (1), causing the displacement field to converge. Once the dataset has been registered in a group-wise manner, the aligned cortical surfaces and segmented tissue maps are subsequently used to compute the 12-month cortico-volumetric atlas.

Construction of Cortical Atlas –

The cortical surface atlas at the 12th month (366 days) is constructed via temporal kernel regression. Let {Si|i = 1, …, N} be the cortical surface (left/right, white matter/pial) of the i-th subject scanned at ti days. Let S^i be the corresponding cortical surface registered as described in the previous step. The cortical surface atlas A12s is obtained by weighted averaging of the vertex coordinates:

A12s=i=1NwiS^ii=1Nwi  with  wi=1σ2πexp((ti366)22σ2), (2)

where σ2 = 15.25 days. The constructed cortical surface atlas will be used to guide the construction of the volumetric atlas.

Construction of Volumetric Atlas –

The volumetric atlas A12v at the 12th month is constructed by correcting the alignment of the segmented tissue maps based on the cortical atlas A12s. The correspondences are updated by first computing the vertex-wise surface displacement field between S^i and A12s, i.e., Δψ, and then extrapolating it over the volumetric space. More specifically, this is carried out by generating the cortical surface mesh using Delaunay triangulation and then, for each voxel location x, finding the mesh triangle, with vertices {yj|j = 1, …, 3}, that contains the voxel. The corrective volumetric displacement field Δϕ(x) is computed from the surface transformation Δψ using Gaussian interpolation:

Δϕ(x)=j=13wjΔψ(yj)j=13wj  with  wj=1σg2πexp(xyj22σg2), (3)

where σg2=9 is set to ensure that the displacement at the tissue interfaces is smooth. This correspondence update step ensures that the segmented tissue maps are well-aligned with the cortical atlas. After warping each segmented tissue map with its respective final displacement field ϕ + Δϕ, the volumetric atlas is computed via majority-voting fusion. The atlases at other time points are constructed based on A12v and A12s.

2.2. Construction of Longitudinal Atlases

Age-dependent cortico-volumetric atlases prior to the 12th month are constructed by determining the longitudinal change of each subject with respect to either 11-, 12- or 13-month scan of the subject (see Fig. 2) and then transporting this change to the 12-month atlas space. The within-subject longitudinal changes are represented by longitudinal displacement fields estimated via SCDEM intra-subject registration.

Fig. 2.

Fig. 2.

Longitudinal and cross-sectional displacements used to construct the 6-month atlas via parallel transport

Parallel Transport of Longitudinal Displacements –

Each longitudinal displacement field encodes the within-subject growth from an earlier time ti to time ti. To characterize growth without the confound of inter-subject variability, the longitudinal displacement fields of each subject are normalized by parallel transport to the common space defined by the 12-month atlas (A12v). The 12-month atlas is warped by the inverse of the averaged transported displacement fields to construct the atlas at each time point. Figure 2 shows the longitudinal displacement fields ϕtiti and the cross-sectional displacement field ϕtiA12v of the i-th subject. Parallel transport is implemented by reorienting the displacement vectors [5,9] using the Jacobian matrix of cross-sectional deformation field ΦtiA12v=x+ϕtiA12v, which is computed as Ji=DΦtiA12v2. The transported longitudinal displacement field is given as Jiϕtiti.

Temporal Kernel Regression of Transported Displacements –

The displacement field from time t to the 12th month time point, φtA12v, is generated via weight averaging of the transported longitudinal displacement fields:

φtA12v=i=1NwiwiJiϕtitii=1Nwiwi, (4)

where N′ is the total number of subjects used to construct the month-specific atlases and,

wi=1σ2πexp((tit)22σ2),  wi=1σ2πexp((ti366)22σ2). (5)

The inverse of the computed displacement field φtA12v is used to warp the 12-month cortico-volumetric atlas to time t.

3. Results

The dataset consisted of T1- and T2-weighted images of 29 infant subjects enrolled as part of the UNC/UMN baby connectome project (BCP). The subjects were divided into three cohorts according to their first scheduled visits: 2 weeks, 1 month and 2 months. These subjects were scanned every three months, using a 3T Siemens Prisma MRI scanner with 320 × 320 × 208 voxels and 0.8 mm3 resolution. The images were segmented into WM, GM, and CSF and the cortical surfaces were reconstructed. 34 cortical ROIs were also delineated for evaluation, by first parcellating the cortical surfaces using FreeSurfer [3] and then labeling each voxel in the GM cortical ribbon according to the cortical surface vertex nearest to the voxel.

We compared our results with those generated using diffeomorphic demons [14] (i.e., the baseline method) instead of SCDEM registration. Figure 4 shows the results in terms of consistency between the cortical surfaces and volumetric atlases for all thirteen time points. These results indicate that the cortico-volumetric atlases constructed by our method are more consistent than the baseline method. The baseline method shows greater discrepancies at the gray-white matter interface, which is more convoluted than the pial surface. From Fig. 4, it is evident that the atlases constructed by the proposed method preserve more cortical details. Figure 3 shows the quantitative results in terms of Dice ratio over different tissue types and cortical ROIs, and a modified Hausdorff distance [4] for surfaces. These metrics were computed between the 11-, 12- and 13-month registered volumes and surfaces, and the 12-month atlases constructed by the two methods. The improvements given by the proposed method, quantified using these metrics, are statistically significant (p < 0.01).

Fig. 4.

Fig. 4.

Cortical surface atlases overlaid onto the volumetric atlases constructed by the proposed and baseline methods

Fig. 3.

Fig. 3.

(a) Dice ratios for different tissue types. (b) Modified Hausdorff distance (mm) for the cortical surfaces. (c) Dice ratios for cortical ROIs. All results are statistically significant (p < 0.01, paired t-test)

4. Conclusion

In this paper, we proposed a novel method for consistent construction of cortico-volumetric atlases for the infant brain. The results show that the cortical surface and volumetric atlases constructed by our method are consistent and preserve more anatomical details.

Acknowledgment.

This work utilizes approaches developed in part by NIH grants (AG053867, EB008374, MH107815, MH116225, MH117943, 1U01MH110274) and the efforts of the UNC/UMN Baby Connectome Project Consortium.

References

  • 1.Ahmad S, et al. : Surface-constrained volumetric registration for the early developing brain. Med. Image Anal 58, 101540 (2019). 10.1016/j.media.2019.101540 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Bozek J, et al. : Construction of a neonatal cortical surface atlas using multimodal surface matching in the developing human connectome project. NeuroImage 179, 11–29 (2018). 10.1016/j.neuroimage.2018.06.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Dale AM, Fischl B, Sereno MI: Cortical surface-based analysis: I. Segmentation surface reconstruction. NeuroImage 9(2), 179–194 (1999). 10.1006/nimg.1998.0395 [DOI] [PubMed] [Google Scholar]
  • 4.Dubuisson MP, Jain AK: A modified Hausdorff distance for object matching. In: Proceedings of 12th International Conference on Pattern Recognition, vol. 1, pp. 566–568 (1994). 10.1109/ICPR.1994.576361 [DOI] [Google Scholar]
  • 5.Duchateau N, De Craene M, Pennec X, Merino B, Sitges M, Bijnens B: Which reorientation framework for the atlas-based comparison of motion from cardiac image sequences? In: Durrleman S, Fletcher T, Gerig G, Niethammer M (eds.) STIA 2012. LNCS, vol. 7570, pp. 25–37. Springer, Heidelberg: (2012). 10.1007/978-3-642-33555-6_3 [DOI] [Google Scholar]
  • 6.Gilmore JH, et al. : Longitudinal development of cortical and subcortical gray matter from birth to 2 years. Cereb. Cortex 22(11), 2478–2485 (2012). 10.1093/cercor/bhr327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Li G, Wang L, Shi F, Gilmore JH, Lin W, Shen D: Construction of 4D high-definition cortical surface atlases of infants: methods and applications. Med. Image Anal 25(1), 22–36 (2015). 10.1016/j.media.2015.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Li G, et al. : Computational neuroanatomy of baby brains: a review. NeuroImage 185, 906–925 (2019). 10.1016/j.neuroimage.2018.03.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lorenzi M, Pennec X: Efficient parallel transport of deformations in time series of images: from Schild’s to pole ladder. J. Math. Imaging Vis 50(1), 5–17 (2014). 10.1007/s10851-013-0470-3 [DOI] [Google Scholar]
  • 10.Robinson EC, et al. : Multimodal surface matching with higher-order smoothness constraints. NeuroImage 167, 453–465 (2018). 10.1016/j.neuroimage.2017.10.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Serag A, et al. : Construction of a consistent high-definition spatio-temporal atlas of the developing brain using adaptive kernel regression. NeuroImage 59(3), 2255–2265 (2012). 10.1016/j.neuroimage.2011.09.062 [DOI] [PubMed] [Google Scholar]
  • 12.Shi F, et al. : Neonatal atlas construction using sparse representation. Hum. Brain Mapp 35(9), 4663–4677 (2014). 10.1002/hbm.22502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Wong KCL, Moradi M, Tang H, Syeda-Mahmood T: 3D segmentation with exponential logarithmic loss for highly unbalanced object sizes In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G (eds.) MICCAI 2018. LNCS, vol. 11072, pp. 612–619. Springer, Cham: (2018). 10.1007/978-3-030-00931-1_70 [DOI] [Google Scholar]
  • 14.Vercauteren T, Pennec X, Perchant A, Ayache N: Diffeomorphic demons: efficient non-parametric image registration. NeuroImage 45(Suppl. 1), S61–S72 (2009). 10.1016/j.neuroimage.2008.10.040 [DOI] [PubMed] [Google Scholar]
  • 15.Wright R, et al. : Construction of a fetal spatio-temporal cortical surface atlas from in utero MRI: application of spectral surface matching. NeuroImage 120, 467–480 (2015). 10.1016/j.neuroimage.2015.05.087 [DOI] [PubMed] [Google Scholar]
  • 16.Yeo BTT, Sabuncu MR, Vercauteren T, Ayache N, Fischl B, Golland P: Spherical demons: fast diffeomorphic landmark-free surface registration. IEEE Trans. Med. Imaging 29(3), 650–668 (2010). 10.1109/TMI.2009.2030797 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Zhang Y, Shi F, Yap PT, Shen D: Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum. Brain Mapp 37(6), 2133–2150 (2016). 10.1002/hbm.23160 [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES