. 2021 Oct 4;5(10):e28957. doi: 10.2196/28957

Table 1.

Interrater agreement for coding of Reddit post themes appearing in military personnel subreddits from 2009 to 2019 (N=64 posts).

Themes	κ value (95% CI)	P value
Operation Supplement Safety	0.85 (0.56-1.0)	<.001
Other research cited^a	0.74 (0.39-1.0)	<.001
Drug testing/positive test result	0.92 (0.75-1.0)	<.001
Products and ingredients	0.97 (0.91-1.0)	<.001
Reasons for use	0.97 (0.91-1.0)	<.001
Adverse effects	1.0^b (1.0-1.0)	N/A^c

^aResearch from sources other than Operation Supplement Safety (eg, the US Food and Drug Administration website).

^bVariance was estimated to be zero as a result of perfect agreement between coders.

^cN/A: not applicable.