Table 1. Krippendorff alpha inter-rater reliability test.

LL: lower limit; UL: upper limit; CI: confidence interval

Values range from 0 and 1, where 0 is perfect disagreement and 1 is perfect agreement. Values of the Krippendorff alpha test result range from 0 to 1, where 0 is perfect disagreement and 1 is perfect agreement. Krippendorff suggests that it is customary to require an alpha greater than 0.800, but where tentative conclusions are still deemed acceptable (as in communication research for instance), an alpha value greater than 0.667 is the accepted lowest conceivable limit.

	Alpha	LL 95% CI	UL 95% CI	Units	Observers	Pairs
Nominal	0.9589	0.9403	0.9753	178.0000	5.0000	1,780.0000