Table 4.
Intra-class correlation value for the agreement between the second human rater and the automated sentiment analysis per participant.
| ICC | 95% CI | F-statistics | ||||
|---|---|---|---|---|---|---|
| Lower | Upper | Value | df1 | df2 | ||
| Participant 1 (OFSED) | 0.30 | −0.18 | 0.59 | 1.44 | 55 | 55 |
| Participant 2 (AN) | 0.72 | 0.51 | 0.84 | 3.52** | 49 | 49 |
| Participant 3 (BN) | 0.66 | −0.05 | 0.88 | 2.93* | 15 | 15 |
| Participant 4 (AN) | 0.41 | −0.09 | 0.68 | 1.69* | 41 | 41 |
| Participant 5 (BED) | 0.40 | 0.10 | 0.67 | 1.66* | 43 | 43 |
| Participant 6 (BN) | 0.69 | 0.21 | 0.88 | 3.24* | 18 | 18 |
| Participant 7 (BN) | 0.68 | 0.14 | 0.88 | 3.07* | 17 | 17 |
| Participant 8 (OFSED) | 0.54 | −0.26 | 0.83 | 2.12 | 17 | 17 |
ICC, intra-class correlation; CI, confidence intervals, * < 0.05, ** < 0.01.