Table 3:
Inter-annotator analysis across the three prior annotation rounds and five categories
| Category | Round | Inter annotator agreement [%] | No. of matches | No. of non-matches |
|---|---|---|---|---|
| Iccco | 10 records in Nov 2012 | 44.44 | 30 | 24 |
| 50 records in Jan 2013 | 33.01 | 138 | 68 | |
| 50 records in Feb 2013 | 75.63 | 29 | 90 | |
| iCcco | 10 records in Nov 2012 | 46.00 | 27 | 23 |
| 50 records in Jan 2013 | 58.82 | 67 | 75 | |
| 50 records in Feb 2013 | 50.77 | 64 | 66 | |
| icCco | 10 records in Nov 2012 | 28.95 | 27 | 11 |
| 50 records in Jan 2013 | 40.74 | 80 | 50 | |
| 50 records in Feb 2013 | 46.01 | 88 | 75 | |
| iccCo | 10 records in Nov 2012 | 13.38 | 136 | 21 |
| 50 records in Jan 2013 | 37.07 | 533 | 314 | |
| 50 records in Feb 2013 | 35.69 | 501 | 278 | |
| icccO | 10 records in Nov 2012 | 48.15 | 14 | 13 |
| 50 records in Jan 2013 | 53.12 | 30 | 34 | |
| 50 records in Feb 2013 | 50.00 | 29 | 29 |