Table 1. Index for patient-based analysis of five neurosurgery specialists, five nonspecialists, and AI.

	Rater 1	Rater 2	Rater 3	Rater 4	Rater 5	Rater 6	Rater 7	Rater 8	Rater 9	Rater 10	AI
TP	135	135	135	132	134	130	130	132	131	131	133
FP	11	12	6	0	5	5	2	2	0	10	15
FN	0	0	0	3	1	5	5	3	4	4	2
TN	185	184	190	196	191	191	194	194	196	186	181
Sensitivity	1.00	1.00	1.00	0.98	0.99	0.96	0.96	0.98	0.97	0.97	0.99
Specificity	0.94	0.94	0.97	1.00	0.97	0.97	0.99	0.99	1.00	0.95	0.92
Accuracy	0.97	0.96	0.98	0.99	0.98	0.97	0.98	0.98	0.99	0.96	0.95
Precision	0.92	0.92	0.96	1.00	0.96	0.96	0.98	0.99	1.00	0.93	0.90
F	0.96	0.96	0.98	0.99	0.98	0.96	0.97	0.98	0.98	0.95	0.94
MCC	0.93	0.93	0.96	0.98	0.96	0.94	0.96	0.97	0.98	0.91	0.90

Raters 1 to 5 are neurosurgery specialists and Raters 6 to 10 are nonspecialists.

AI: artificial intelligence, F: F-measure, FN: false negative, FP: false positive, MCC: Matthews correlation coefficient, TN: true negative, TP: true positive.