Table 2:

Pair-wise agreement at span and document levels. Document level agreement is calculated for categories with sub-classes only.

	Ann1 vs. Ann2		Ann2 vs. Ann 3		Ann1 vs. Ann3
	Cohen’s κ	F 1	Cohen’s κ	F 1	Cohen’s κ	F 1
Span level		0.94		0.90		0.90
Document level	0.83	0.95	0.74	0.92	0.79	0.93