Fig 1. Overall pipeline, including feature extraction steps, for each of our methods: LeFMSF uses all of these steps (as it uses both MRI and fMRI data); LeFMS does not use the red “fMRI feature extraction” box; and LeFMF does not use the grey “MRI feature extraction” box.
In each case, in addition to the learner that utilizes the combined features, our system also learns the most effective features from the MRI data (grey box) and from the fMRI data (red box); those features are used to pre-process the test data (see boxes of the same color).