Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Table 3 Kappa Metric Overall for the Test Set
| Test All Textual | ||||
|---|---|---|---|---|
| Y | N | Q | U | |
| Y | 2098 | 9 | 5 | 94 |
| N | 10 | 34 | 0 | 22 |
| Q | 6 | 0 | 8 | 1 |
| U | 78 | 22 | 4 | 5653 |
| K1 | NA | |||
| K2 | 92.4 | |||
| Test All Intuitive | ||||
|---|---|---|---|---|
| Y | N | Q | U | |
| Y | 2131 | 102 | 5 | 22 |
| N | 10148 | 4998 | 9 | 0 |
| Q | 6 | 0 | 0 | 0 |
| U | 0 | 0 | 0 | 0 |
| K1 | NA | |||
| K2 | 91.4 | |||
X-Axis: Gold Scoring; Y-Axis: Program Scoring.
K1: Annotator Kappa agreement overall – not available.
K2: Overall results for program versus gold Kappa on the Test set.
