Table 3.

Agreement analysis of Safety, Efficiency, and DIGEST grades at different frame rates (excluding MBSs with DIGEST = 0 at 30 FPS)

Grade	FPS	No. of disagreements	Agreement percentage (%)	Simple Cohen’s Kappa (95% CI)	Weighted Cohen’s Kappa (95% CI)	PABAK (95% CI)	AC1 (95% CI)
Safety	30 vs. 15	39	83.40	0.780 (0.715, 0.837)	0.828 (0.777, 0.878)	0.793 (0.734, 0.851)	0.795 (0.736, 0.854)
	30 vs. 7.5	37	84.26	0.792 (0.730, 0.852)	0.837 (0.788, 0.886)	0.803 (0.745, 0.856)	0.806 (0.748, 0.864)
	15 vs. 7.5	37	84.26	0.791 (0.729, 0.848)	0.831 (0.779, 0.882)	0.803 (0.745, 0.856)	0.806 (0.748, 0.864)
Efficiency	30 vs. 15	35	85.11	0.779 (0.709, 0.843)	0.821 (0.766, 0.876)	0.814 (0.755, 0.867)	0.821 (0.765, 0.876)
	30 vs. 7.5	40	82.98	0.745 (0.676, 0.807)	0.796 (0.738, 0.853)	0.787 (0.729, 0.846)	0.796 (0.737, 0.854)
	15 vs. 7.5	39	83.40	0.752 (0.677, 0.811)	0.799 (0.741, 0.857)	0.793 (0.729, 0.851)	0.801 (0.743, 0.859)
DIGEST	30 vs. 15	42	82.13	0.741 (0.669, 0.808)	0.778 (0.717, 0.838)	0.777 (0.713, 0.835)	0.784 (0.724, 0.844)
	30 vs. 7.5	37	84.26	0.771 (0.701, 0.832)	0.805 (0.747, 0.863)	0.803 (0.745, 0.862)	0.81 (0.753, 0.867)
	15 vs. 7.5	36	84.68	0.779 (0.714, 0.841)	0.810 (0.752, 0.867)	0.809 (0.750, 0.862)	0.815 (0.759, 0.871)