Table 2.

Figure of merits (FOM), 95% confidence intervals (CI) and standard error (StdErr) for wAFROC metrics. The weighted lesion localization fraction (wLLF score) was retrieved at an x-axis 0.2 operating point for all readers and CNNs on the wAFROC curve.

	wAFROC
	FOM	CI Lower	CI Upper	StdErr	wLLF
RetinaNet	0.81	0.75	0.87	0.028	0.71
U-Net	0.58	0.47	0.68	0.052	0.41
Reader 1	0.82	0.79	0.86	0.017	0.71
Reader 2	0.87	0.83	0.90	0.017	0.79
Reader 3	0.74	0.68	0.79	0.029	0.57
Reader 4	0.74	0.70	0.78	0.022	0.59
Reader 5	0.78	0.75	0.81	0.015	0.65
Reader 6	0.87	0.83	0.91	0.020	0.79
Reader 7	0.83	0.79	0.88	0.022	0.74
Reader 8	0.54	0.44	0.63	0.048	0.31
Reader 9	0.84	0.79	0.88	0.023	0.75