Table 2.
Detailed results by test set, “most specific” term length and expert.
| Linguistic Approach | Current Approach (linguistic and statistical filters applied) | |||||
|---|---|---|---|---|---|---|
| Term length (number of content words) | RECALL method: all NPs, VPs | RECALL method: frequency = 0 | RECALL method: frequency = 2 | RECALL method: frequency = 3 | RECALL method: frequency = 5 | RECALL method: frequency = 7 |
| RESULTS: EXPERT 1 | ||||||
| 1 | 100% | 100% | 67% | 52% | 52% | not extracted |
| 2 | 99% | 99% | 95% | 92% | 81% | not extracted |
| 3 | 97% | 97% | 96% | 94% | 89% | not extracted |
| 4 | 91% | 90% | 88% | 87% | 87% | not extracted |
| 5 | 85% | 85% | 82% | 82% | 60% | not extracted |
| > 5 | 63% | not extracted | not extracted | not extracted | not extracted | not extracted |
| RESULTS: EXPERT 2 | ||||||
| 1 | 86% | 86% | 78% | 70% | 62% | not extracted |
| 2 | 92% | 91% | 90% | 85% | 71% | not extracted |
| 3 | 91% | 91% | 87% | 85% | 78% | not extracted |
| 4 | 86% | 82% | 82% | 81% | 81% | not extracted |
| 5 | 78% | 72% | 72% | 72% | 72% | not extracted |
| > 5 | 71% | not extracted | not extracted | not extracted | not extracted | not extracted |
| RESULTS: EXPERT 3 | ||||||
| 1 | 94% | 94% | 85% | 80% | 71% | 69% |
| 2 | 87% | 86% | 84% | 82% | 76% | 72% |
| 3 | 80% | 85% | 83% | 83% | 82% | 81% |
| 4 | 72% | 71% | 68% | 68% | 68% | 68% |
| 5 | 58% | 59% | 59% | 58% | 58% | 58% |
| > 5 | 63% | not extracted | not extracted | not extracted | not extracted | not extracted |