Table 3.

Optimum threshold, AUC, sensitivity, specificity, and accuracy from ROC analysis with 10-fnld r.rnss validation

	Threshold	AUC	Youden’s Index, J1	Sensitivity2	Specificity3	Accuracy4
Reader 1	9.3±1.0%	0.83±0.0	0.63±0.03	73±33%	93±17%	83±18%
Reader 2	8.9±1.7%	0.84±0.0	0.59±0.03	76±33%	84±24%	80±18%
Reader 3	23.3±6.2%	0.75±0.0	0.49±0.04	57±36%	84 ±2 5%	72 ±21%
Reader 4	10.4±0.0%	0.77±0.0	0.56±0.04	67±35%	83±25%	74±19%
Reader 5	10.2±1.6%	0.85±0.0	0.61 ±0.03	72±34%	89±21%	80±19%

Values are calculated from 100 iterations of 10-fold cross validation analysis and expressed as mean ± one standard deviation

¹Younden’s Index, J = max (sensitivity + specificity − 1)

² $Sensititvity=\frac{TP}{TP+FN}$

³ $Specificity=\frac{TN}{TN+FP}$

⁴ $Accuracy=\frac{TP+TN}{TP+TN+FP+FN}$