Table 2. Identification of permission-sentences based on number of annotators.
Agreement by 3 annotators | Agreement by ≥2 annotators | Annotation by ≥1 annotator | |
---|---|---|---|
Positive: this is a permission-sentence | 211 | 351 | 635 |
211/739 (28.6%) | 351/739 (47.5%) | 635/739 (85.9%) | |
211/6,399 (3.3%) | 351/6,399 (5.5%) | 635/6,399 (9.9%) | |
Indeterminate: this might be a permission-sentence | 0 | 5 | 139 |
0/739 (0%) | 5/739 (0.7%) | 139/739 (18.8%) | |
0/6,399 (0%) | 5/6,399 (0.0%) | 139/6,399 (2.1%) | |
Negative: this is not a permission-sentence | 5,660 | 6,028 | 6,168 |
– | – | – | |
5,660/6,399 (88.5%) | 6,028/6,399 (94.8%) | 6,168/6,399 (96.4%) | |
Total sentences 6,399 |
Note: Percentages indicate the proportion of identified sentences to possible permission-sentences ( n = 739) and the entire corpus ( n = 6,399).