Table 1.

Results of low sensitivity, high specificity simulation experiment. Comparison of a) sensitivity and b) specificity estimates of a CAD assisted group from simulation experiment with four readers per group, 1000 lesion candidates. The fraction of nodule candidates that are actually positive is ρ=0.10. Operating characteristics of individual readers in the reference panel are given in rows as sensitivity (Se) and in columns as specificity (Sp). The operating characteristics of the CAD assisted group are set as: sensitivity=0.70, specificity=0.95. White columns (RP, reader panel) are estimated apparent sensitivities using lesions identified by three or more reference readers as gold standard. Gray shaded columns (LCA) are estimated sensitivities using LCA in the same datasets. Each reported value is the average of 500 replicates. For sensitivity, average standard deviations of the reader panel and LCA based estimates are 0.02 and 0.03, respectively. For specificity, average standard deviations of the reader panel and LCA based estimates are 0.005 and 0.007, respectively.

Sp	0.6		0.7		0.8		0.9		0.95
Se	RP	LCA	RP	LCA	RP	LCA	RP	LCA	RP	LCA
a
0.6	0.20	0.67	0.30	0.65	0.48	0.66	0.66	0.70	0.69	0.70
0.7	0.24	0.65	0.35	0.65	0.52	0.69	0.67	0.70	0.70	0.70
0.8	0.27	0.65	0.39	0.68	0.55	0.70	0.67	0.70	0.70	0.70
0.9	0.29	0.69	0.41	0.70	0.57	0.70	0.68	0.70	0.70	0.70
0.95	0.30	0.70	0.42	0.70	0.57	0.70	0.68	0.70	0.70	0.70
b
0.6	0.92	0.97	0.93	0.97	0.93	0.96	0.94	0.95	0.94	0.95
0.7	0.94	0.97	0.94	0.96	0.94	0.95	0.94	0.95	0.94	0.95
0.8	0.95	0.96	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95
0.9	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95
0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95	0.95