Table 4:

Agreements (ie, diagonal elements) and disagreements (off-diagonal elements) between the two annotators across the three prior annotation rounds (ie, 1st (2nd) [3rd]) and five categories

Annotator: category	PS: Iccco	PS: iCcco	PS: icCco	PS: iccCo	PS: icccO	Agreement %
MJ: Iccco	20 (64) [90]	3 (2) [0]	0 (1) [0]	1 (1) [0]		83 (94) [100]
MJ: iCcco	3 (2) [0]	20 (72) [64]		0 (1) [2]		87 (96) [97]
MJ: icCco	0 (1) [0]		8 (48) [72]	3 (6) [3]		73 (87) [96]
MJ: iccCo	1 (1) [0]	0 (1) [2]	3 (6) [3]	12 (304) [272]	5 (2) [1]	57 (97) [98]
MJ: icccO				5 (2) [1]	8 (32) [28]	62 (94) [97]
Agreement %	83 (94) [100]	87 (96) [97]	73 (87) [96]	57 (97) [98]	62 (94) [97]

Empty cells refer to cases with no disagreements.