TABLE 5.
Rating | Average Alpha (min.,max.) | Average Num Clips (min., max.) | Average Num Raters (min., max.) |
---|---|---|---|
Emotion label | 0.42 [0.25, 0.57] | 134.3 [105,177] | 9.5 [4, 12] |
Emotion intensity | 0.47 [0.18, 0.71] | 134.3 [105,177] | 9.5 [4, 12] |
Emotion label (agreement > 0.8) | 0.79 [0.58, 0.96] | 42.9 [16, 78] | 9.6 [5, 12] |
Average, min and max reliability score for emotion class and intensity for the entire dataset, as well as for emotion class on clips unambiguous clips.