Fig. 1.

Overview of the proposed analysis. The convolutional neural network (CNN) automatically extracts predictors (P) from the minimally processed MRI. Based on P, the classifier computes a prediction score (S) that assigns the MRI to either sex. This deep learning analysis operates directly on voxel-level data omitting any hypothesis or assumption related to brain regions or tissue measurements (like regional volumes). Statistical analysis relates obtained results to NIH Toolbox cognitive test scores, creates confounder-free visualization of the patterns predicting sex (a.k.a. saliency map), and examines volume scores of those regions that contribute significantly to the prediction according to the saliency map.