Table 3.

Comparison of AUC and Cohen's kappa-values between the three criteria.

Criteria	AUC [mean, (95 % CI)]	Cohen's kappa [mean, (95 % CI)]
CO-RADS	0.89 (0.87–0.90)	0.52 (0.45–0.60)
COVID-RADS	0.78 (0.75–0.80)	0.51 (0.41–0.61)
RSNA consensus statement	0.88 (0.86–0.90)	0.57 (0.49–0.64)
P-value for one-way repeated measures analysis of variance	<0.001∗	0.076
P-value for paired t-test
CO-RADS vs COVID-RADS	0.0019∗∗
CO-RADS vs RSNA consensus statement	0.49
COVID-RADS vs RSNA consensus statement	0.0050∗∗

Each AUC and Cohen's kappa value are derived from the average of each observer's value.

AUC, area under receiver operating characteristic curves; CI, confidence interval; CO-RADS, COVID-19 Reporting and Data System; COVID-RADS, COVID-19 Imaging Reporting and Data system; RSNA, Radiological Society of North America.

^∗Statistically significant.

^∗∗Statistically significant after family-wise error correction.