Table 7.
Recall, Precision, and F-measure for ConText with alternative definitions of scope for the contextual properties negated, historical, hypothetical, and other, evaluated for the 2377 annotated conditions in the development set. N is the number (proportion) of conditions in the reference standard for which a contextual property was assigned a non-default value. The two definitions of scope are: six-token window (“stw”) and end-of-sentence (“eos”). The highest score for a given measure, report type, and contextual property is in bold.
| N | Recall | Precision | F-measure | ||||
|---|---|---|---|---|---|---|---|
| stw | eos | stw | eos | stw | eos | ||
| Development set: 2377 annotated conditions | |||||||
| negated | 491 / 21% | .96 | .98 | .99 | .98 | .97 | .98 |
| historical | 256 / 11% | .70 | .79 | .78 | .77 | .74 | .78 |
| hypothetical | 56 / 2% | .34 | .93 | 1.0 | 1.0 | .51 | .96 |
| other | 6 / 0% | .67 | .67 | 1.0 | 1.0 | .80 | .80 |