Table 3.

Rater reliability measures: Shown are the intra-class correlation (ICC) and average Jaccard similarity measures for delineation reliability. For each structure, delineation labels on six image volumes were produced by two raters; multiple pairs of raters were used to delineate the full set of structures. ICC values were computed on measures of structure volume during training to ensure that pairs of raters produced concordant results; raters who did achieve ICC scores of 0.9 or greater were retrained, and Jaccard similarity scores were computed on the same labeled volumes after the training had been completed to assess similarity between the delineated areas.

		ICC		Jaccard
	Rater pair	left	right	left	right
Angular Gyrus	1,2	0.916	0.957	0.855	0.864
Caudate	1,2	0.991	0.979	0.755	0.749
Cingulate Gyrus	7,2	0.935	0.921	0.699	0.639
Cuneus	9,10	0.961	0.923	0.794	0.774
Fusiform Gyrus	1,2	0.987	0.943	0.820	0.804
Gyrus Rectus	1,2	0.917	0.922	0.966	0.980
Hippocampus	4,5	0.933	0.982	0.796	0.787
Inferior Frontal Gyrus	1,2	0.963	0.973	0.937	0.945
Inferior Occipital Gyrus	1,2	0.931	0.982	0.850	0.829
Inferior Temporal Gyrus	1,2	0.928	0.924	0.785	0.788
Insular Cortex	7, 8	0.992	0.935	0.827	0.830
Lateral Orbitofrontal Gyrus	1,2	0.900	0.925	0.888	0.880
Lingual Gyrus	3,6	0.966	0.977	0.833	0.813
Middle Frontal Gyrus	12,11	0.962	0.992	0.848	0.851
Middle Orbitofrontal Gyrus	1,2	0.980	0.968	0.917	0.917
Middle Occipital Gyrus	1,2	0.997	0.964	0.917	0.946
Middle Temporal Gyrus	1,2	0.955	0.945	0.784	0.775
Parrahippocampal Gyrus	1,2	0.943	0.927	0.755	0.773
Postcentral Gyrus	1,2	0.948	0.968	0.826	0.855
Precentral Gyrus	1,2	0.911	0.943	0.928	0.918
Precuneus	1,2	0.944	0.970	0.816	0.739
Putamen	1,2	0.931	0.982	0.761	0.758
Superior Frontal Gyrus	13,14	0.957	0.975	0.840	0.852
Superior Occipital Gyrus	1,2	0.977	0.947	0.811	0.801
Superior Parietal Gyrus	1,2	0.952	0.945	0.809	0.833
Superior Temporal Gyrus	1,2	0.939	0.982	0.849	0.796
Supramarginal Gyrus	1,2	0.943	0.969	0.697	0.686
Cerebellum	13,14	0.926		0.903
Brainstem	3,15	0.979		0.841