Table 3.

Results of scan level analysis of radiologists and AI system.

	AI system	Radiologists	p-value
Per scan sensitivity*,%(95% CI)	89.1 (41/46)(75.6–95.9)	84.8 (39/46)(70.5–93.2)	0.727
Per scan specificity**,%(95% CI)	85.7 (36/42)(70.8–94.1)	83.3 (35/42)(68.0–92.5)	1.000
Per scan accuracy***,%(95% CI)	87.5 (77/88)(78.8–93.0)	84.1 (74/88)(74.9–90.4)	0.804
AUC	0.934	n/a	n/a

Note: The p-values are calculated by comparing the AI system with radiologists using a 2-sided McNemar test. *Per scan sensitivity is the ratio of true positive identified to all CT scans with COVID-19 lesions; **Per scan specificity is the ratio of true negative identified to all CT scans without COVID-19 lesions; ***Per patient accuracy is the ratio of all true values identified to all CT scans. AI: artificial intelligence; CI: confidence interval; AUC: area under the receiver operating characteristic curve. n/a: not applicable.