Table 4.

Summary of the overall annotation rounds. Agreement was calculated using the Scikit-learn accuracy and Cohen κ function [21] on the annotations.

Annotation round	Documents, n	Annotations, n	Cohen κ	Agreement (%)
Round 1	195	181	0.77	81
Round 2	195	205	0.83	84
Round 3	200	246	0.87	82
Round 4	200	297	0.88	90