Table 1:
Experimental set-ups of the four pre-annotation rounds and the main annotation round (multiply annotated documents only) with count of documents (Doc.) and annotation decisions to be made (Items)
| Iteration 1 | Iteration 2 | Iteration 3 | Iteration 4 | Main Annotation | |
|---|---|---|---|---|---|
| Doc. Items | Doc. Items | Doc. Items | Doc. Items | Doc. Items | |
| Raw data | 10 2,071 | - | - | - | - |
| Paragraphs | 10 329 | 15 1,856 | - | - | - |
| JCoRe & Framed | 10 3,010 | 15 5,225 | - | - | - |
| Manual sentence annotation | - | 20 4,256 | 49 7,492 | 50 7,314 | 50 7,394 |
| £ per annotator | 30 5,410 | 50 11,337 | 49 7,492 | 50 7,314 | 50 7,394 |
| £ all annotators | 240 43,280 | 400 90,696 | 396 59,936 | 400 58,512 | 400 59,152 |