Table 3.

Intra-class correlation value for the agreement between the first human rater and the automated sentiment analysis per participant.

	ICC	95% CI		F-statistics
		Lower	Upper	Value	df1	df2
Participant 1 (OFSED)	0.13	−0.47	0.48	1.14	56	56
Participant 2 (AN)	0.63	0.34	0.79	2.65**	49	49
Participant 3 (BN)	0.50	−0.29	0.82	2.10	15	15
Participant 4 (AN)	0.37	−0.18	0.67	1.58	41	41
Participant 5 (BED)	0.60	0.25	0.78	2.42**	43	43
Participant 6 (BN)	0.38	−0.60	0.75	1.57	20	20
Participant 7 (BN)	0.69	0.19	0.87	3.05*	19	19
Participant 8 (OFSED)	0.60	−0.11	0.85	2.41*	17	17

ICC, intra-class correlation; CI, confidence intervals, * < 0.05, ** < 0.01.