Table 3.
Inter-annotator agreement on a sample of 10 radiology reports (F-measure)
| Category | Exact match | Inexact match |
|---|---|---|
| Entities (overall IAA) | 77.3 | 87.8 |
| Anatomy | 73.5 | 90.9 |
| ThromboPat* | 95.7 | 99.1 |
| Exam | 89.3 | 89.3 |
| K* | 78.4 | 78.4 |
| Relations (overall IAA) | 62.4 | 71.8 |
| Anatomy Location_of K* | 80 | 80 |
| Anatomy Location_of ThromboPat* | 50 | 66.7 |
IAA = inter-annotator agreement.
*ThromboPat for thrombopathology concepts.
*K for clinically relevant findings.