Skip to main content
. 2015 Mar 25;75(6):979–1001. doi: 10.1177/0013164415574086

Table 4.

Cross-Classification Data From Two Simulated Raters, Indicating (Top) the Number of Ratings oi,j in Each i, j Cell, (Middle) Its Corresponding Theoretical Value ei,j, and (Bottom) the Standardized Differences zi,j (N = 200).

Observed frequencies oi,j
Rater 2
1 2 3 4 5 Row sums oi,*
Rater 1 1 7 5 2 1 3 18
2 5 13 10 7 8 43
3 11 4 15 6 9 45
4 8 11 7 9 6 41
5 11 5 15 6 16 53
Column sums o*j 42 38 49 29 42 N = 200
Expected frequencies ei,j
Rater 2 Row sums
1 2 3 4 5 ei,*
Rater 1 1 3.78 3.42 4.41 2.61 3.78 18
2 9.03 8.17 10.53 6.24 9.03 43
3 9.45 8.55 11.02 6.53 9.45 45
4 8.61 7.79 10.05 5.95 8.61 41
5 11.13 10.07 12.98 7.68 11.13 53
Column sums e*,j 42 38 49 29 42 N = 200
Standardized differences zi,j
Rater 2
1 2 3 4 5
Rater 1 1 +1.656 +0.854 −1.148 −0.997 −0.401
2 −1.341 +1.690 −0.165 +0.306 −0.343
3 +0.504 −1.556 +1.197 −0.206 −0.146
4 −0.208 +1.150 −0.961 +1.253 −0.889
5 −0.039 −1.598 +0.559 −0.608 +1.460