Table 3.
Document-Level Test Results of Predictions Models
| Model | Accuracy | Precision (SI) | Recall (SI) | F1-Score (SI) | AUC |
|---|---|---|---|---|---|
| TF-IDF Logistic Regression | 0.81 | 0.69 | 0.69 | 0.69 | 0.929 |
| TF-IDF SVM | 0.89 | 0.64 | 0.80 | 0.71 | 0.930 |
| Random CNN | 0.93 | 0.80 | 0.82 | 0.81 | 0.962 |
| Word2vec CNN | 0.94 | 0.81 | 0.83 | 0.82 | 0.946 |
| Rule-Based Approach | 0.92 | 0.73 | 0.87 | 0.79 | N/A* |
AUC is not available for rule-based deterministic approaches