Table 8.
Inter-annotator agreement
| Metric | Average |
| MUC | 0.684 |
| Class-B3 | 0.858 |
| Entity-B3 | 0.750 |
| Mention-based CEAF | 0.644 |
| Entity-based CEAF | 0.480 |
| Krippendorff’s alpha | 0.619 |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.