Fig. 1:

The pipeline of the proposed multimodal brain network fusion with longitudinal couplings (MMLC) framework. Three levels of information couplings are considered: cross-sectional coupling, longitudinal coupling, and multimodal coupling. First, each single modality brain network in a given scan (left column) is decomposed into two matrices (middle column), U and V. We force U to be shared across modalities (green arrows) and V of a group of subjects similar to the estimated consensus matrix V* (purple arrows). Furthermore, the consensus matrices of structural brain networks (bottom right) are aligned by rotation mappings, i.e. matrix R (red arrows), which manipulate the time consistency. Eventually, after solving these 3 coupling strategy, the new individual network representation at a given scan time is the concatenation of V^f and V^d.