Table 7.
IAA (%) for relationships, between 7 trainee annotators, two expert development annotators (D1 and D2), and a consensus C created from D1 and D2
D2 | 63 | ||||||||
1 | 54 | 44 | |||||||
2 | 55 | 44 | 41 | ||||||
3 | 65 | 60 | 60 | 49 | |||||
4 | 74 | 64 | 54 | 59 | 62 | ||||
5 | 66 | 48 | 43 | 47 | 54 | 54 | |||
6 | 56 | 51 | 50 | 54 | 66 | 56 | 46 | ||
7 | 69 | 54 | 52 | 52 | 59 | 61 | 64 | 57 | |
C | 87 | 74 | 52 | 52 | 61 | 68 | 57 | 61 | 71 |
D1 | D2 | 1 | 2 | 3 | 4 | 5 | 6 | 7 |