Table 8.
Subtask IAA statistics
|
Feature |
F-score |
---|---|---|
|
Exact relation |
51.28% |
|
Relaxed relation |
65.81% |
|
Exact trigger |
64.10% |
Relaxed trigger | 65.81% | |
ET |
Exact Cause arg. |
82.67% |
|
Relaxed Cause arg. |
90.67% |
|
Exact Effect arg. |
94.67% |
|
Relaxed Effect arg. |
98.67% |
RT |
Exact Cause arg. |
82.52% |
|
Relaxed Cause arg. |
90.91% |
|
Exact Effect arg. |
93.51% |
Relaxed Effect arg. | 98.70% |
Inter-annotator agreement for relations, triggers and the two arguments in the case of exact-match triggers (ET) and relaxed-match triggers (RT).