Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Confusion matrix for inter-annotator agreement on the CRA corpus: linguist (L) vs. domain expert (E) - S3
| HYP | MOT | BKG | GOAL | OBJT | EXP | MOD | METH | OBS | RES | CON | L/E |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 16 | 0 | 12 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 5 | HYP |
| 5 | 48 | 13 | 0 | 2 | 0 | 0 | 4 | 0 | 1 | 0 | MOT |
| 11 | 6 | 316 | 0 | 3 | 0 | 0 | 4 | 1 | 1 | 2 | BKG |
| 2 | 4 | 4 | 87 | 80 | 7 | 0 | 10 | 0 | 0 | 0 | GOAL |
| 0 | 0 | 0 | 2 | 39 | 3 | 0 | 9 | 0 | 0 | 0 | OBJT |
| 0 | 0 | 1 | 1 | 7 | 190 | 0 | 66 | 5 | 8 | 0 | EXP |
| 0 | 0 | 3 | 1 | 4 | 7 | 5 | 13 | 0 | 2 | 1 | MOD |
| 0 | 0 | 8 | 7 | 25 | 63 | 5 | 92 | 3 | 10 | 1 | METH |
| 0 | 0 | 4 | 0 | 1 | 3 | 0 | 9 | 183 | 285 | 1 | OBS |
| 0 | 0 | 3 | 0 | 0 | 2 | 3 | 8 | 53 | 466 | 10 | RES |
| 0 | 1 | 5 | 1 | 1 | 0 | 1 | 3 | 9 | 105 | 337 | CON |
