Table 4 Comparison of diagnostic performance of physicians with and without M-F-RCNN assistance.

	AUC (95%CI)	P value	Sensitivity (95%CI)	P value	Specificity (95%CI)	P value	Accuracy	P value
AUC, area under the receiver operating characteristic; M-F-RCNN, Modified Faster Region-based Convolutional Neural Network; AI, artificial Intelligence.
Expert 1+AI	0.946 (0.931,0.960)	<0.001	0.954 (0.937, 0.971)	<0.001	0.937 (0.914,0.960)	<0.001	0.947	<0.001
Expert 2+AI	0.959 (0.947,0.972)	<0.001	0.963 (0.947, 0.978)	<0.001	0.956 (0.937, 0.976)	<0.001	0.960	<0.001
Novice 1+AI	0.919 (0.902,0.935)	<0.001	0.881 (0.855, 0.907)	<0.001	0.956 (0.937, 0.976)	<0.001	0.912	<0.001
Novice 2+AI	0.797 (0.774,0.819)	0.008	0.644 (0.605, 0.683)	<0.001	0.949 (0.928, 0.970)	0.317	0.770	<0.001
Novice 3+AI	0.910 (0.891,0.928)	<0.001	0.945 (0.927, 0.964)	<0.001	0.874 (0.842, 0.906)	<0.001	0.916	<0.001