Table 1.
The performance of different approaches on the test set.
| Category | System Description | Precision (PPV) | Recall (Sensitivity) | F-score |
|---|---|---|---|---|
| Rule | Rule-based with temporality information | 92.1% | 80.2% | 85.74% |
| Rule-based with explicit evidence | 96.9% | 28.9% | 44.52% | |
| Rule-based with both temporality and explicit evidence | 91.83% | 82.5% | 86.92% | |
| ML | ML with bleeding and clopidogrel information | 84.6% | 99.8% | 91.57% |
| ML with temporality information | 86.8% | 95.3% | 90.85% | |
| ML with explicit evidence | 96.9% | 28.9% | 44.52% | |
| ML with temporality and explicit | 88.7% | 96.6% | 92.48% | |
| Scoring | Scorig-based system (cutoff = 1) | 86.4% | 98.0% | 91.84% |
| Scoring-based system (cutoff = 3) | 90.4% | 90.2% | 90.30% | |
| Scoring-based system (cutoff = 6) | 95.0% | 65.3% | 77.40% |