Table 3.

Reliability rounds summary.

	Inter-Rater Agreement
Reliability Round	Play Type 1 Primary	Play Type 1 Subtype	Play Type 2 Primary	Play Type 2 Subtype	Overall IRR	Overall: Primary Play types	Overall: Play Subtypes
Round 1 (Phase 3)	0.941	0.843	0.657	0.545	0.746	0.799	0.694
Round 2 (Phase 3)	0.922	0.901	0.681	0.56	0.78	0.819	0.74
Round 3 (Phase 5)	1	0.991	0.735	0.615	0.835	0.868	0.803
						kappa: 0.80	kappa: 0.75