Table 4.
Observed frequencies oi,j | |||||||
---|---|---|---|---|---|---|---|
Rater 2 | |||||||
1 | 2 | 3 | 4 | 5 | Row sums oi,* | ||
Rater 1 | 1 | 7 | 5 | 2 | 1 | 3 | 18 |
2 | 5 | 13 | 10 | 7 | 8 | 43 | |
3 | 11 | 4 | 15 | 6 | 9 | 45 | |
4 | 8 | 11 | 7 | 9 | 6 | 41 | |
5 | 11 | 5 | 15 | 6 | 16 | 53 | |
Column sums | o*j | 42 | 38 | 49 | 29 | 42 | N = 200 |
Expected frequencies ei,j | |||||||
Rater 2 | Row sums | ||||||
1 | 2 | 3 | 4 | 5 | ei,* | ||
Rater 1 | 1 | 3.78 | 3.42 | 4.41 | 2.61 | 3.78 | 18 |
2 | 9.03 | 8.17 | 10.53 | 6.24 | 9.03 | 43 | |
3 | 9.45 | 8.55 | 11.02 | 6.53 | 9.45 | 45 | |
4 | 8.61 | 7.79 | 10.05 | 5.95 | 8.61 | 41 | |
5 | 11.13 | 10.07 | 12.98 | 7.68 | 11.13 | 53 | |
Column sums e*,j | 42 | 38 | 49 | 29 | 42 | N = 200 | |
Standardized differences zi,j | |||||||
Rater 2 | |||||||
1 | 2 | 3 | 4 | 5 | |||
Rater 1 | 1 | +1.656 | +0.854 | −1.148 | −0.997 | −0.401 | |
2 | −1.341 | +1.690 | −0.165 | +0.306 | −0.343 | ||
3 | +0.504 | −1.556 | +1.197 | −0.206 | −0.146 | ||
4 | −0.208 | +1.150 | −0.961 | +1.253 | −0.889 | ||
5 | −0.039 | −1.598 | +0.559 | −0.608 | +1.460 |