Table 2. Confusion matrices Judge 1 (side) against Judge 2 (top).
In the top section counts of words assigned to F, P, R and O categories are shown. This matrix is decomposed into the separate F × P, F × R and F × O confusion matrices in the following section.
| Overall | |||||
| Judge 2 | |||||
| F | P | R | O | ||
| F | 3700 | 205 | 14 | 116 | |
| P | 8 | 82 | 2 | 3 | |
| Judge 1 | |||||
| R | 2 | 13 | 181 | 20 | |
| O | 70 | 24 | 4 | 56 | |
| Overall agreement = 89.3% | |||||