TABLE V.

Effect of annotation errors in segmentation and classification performance.

	DICE		[M2] + [CT] vs. [S3 S6 M2 T1 M3]
Error (x, y, z) in voxel	Mean, Std [Min,Max]	No. < 0.7	AUCL	AUCR	AUCL − AUCR [95% CI]	p-value
+(0, 0, 0)	0.83, 0.058 [0.7,0.93]	0	0.81	0.86	−0.05 [−0.12,0.018]	0.152
+(1, 0, 0)	0.82, 0.078 [0.59,0.93]	9	0.81	0.84	0.028 [−0.05,0.11]	0.481
+(0, 1, 0)	0.82, 0.074 [0.59,0.94]	7	0.8	0.83	0.03 [−0.055,0.11]	0.494
+(0, 0, 1)	0.81, 0.102 [0.14,0.93]	10	0.81	0.82	0.0095 [−0.065,0.084]	0.803
+(2, 0, 0)	0.82, 0.089 [0.32,0.93]	9	0.81	0.84	0.033 [−0.04,0.11]	0.377
+(0, 2, 0)	0.82, 0.076 [0.59,0.93]	7	0.81	0.82	0.0098 [−0.069,0.089]	0.808
+(0, 0, 2)	0.81, 0.122 [0.14,0.93]	10	0.82	0.81	−0.0092 [−0.079,0.06]	0.796
+(5, 0, 0)	0.77,a 0.15 [0.02,0.93]	16	0.69	0.8	0.1 [0.025,0.18]	0.01
+(0, 5, 0)	0.78,a 0.171 [0.03,0.93]	12	0.8	0.76	−0.043 [−0.11,0.028]	0.234
+(0, 0, 5)	0.79, 0.143 [0.05,0.92]	11	0.83	0.81	−0.017 [-0.092,0.057]	0.645

^aDifference was statistically significant compared to the case without error (p-value < 0.0056).