Table 5.
Average percentage interrater agreement.
| Interrater agreement | Informativeness, % | Fluency, % | Factuality, % | Coherence, % | Adequacy, % |
| A1a and A2b | 82.35 | 82.35 | 82.35 | 70.59 | 82.35 |
| A1 and A3c | 70.59 | 58.82 | 70.59 | 70.59 | 70.59 |
| A3 and A2 | 52.94 | 70.59 | 74.51 | 74.51 | 64.71 |
| Average (% agreement) | 68.63 | 70.59 | 74.51 | 74.51 | 72.55 |
aA1: annotator 1.
bA2: annotator 2.
cA3: annotator 3.