Table 8.
Performance evaluation metrics of DistilBERT.
| Batch size | Learning rate | Macro precision | Macro recall | Macro F1-score | Accuracy | Time |
|---|---|---|---|---|---|---|
| 32 | 1e−5 | 82.60% | 82.16% | 82.32% | 83.78% | 619 s |
| 2e−5 | 83.13% | 82.95% | 82.96% | 84.29% | ||
| 3e−5 | 79.61% | 79.58% | 79.55% | 81.30% | ||
| 4e−5 | 80.05% | 79.52% | 79.70% | 81.37% | ||
| 5e−5 | 80.22% | 79.70% | 79.90% | 81.56% | ||
| 16 | 1e−5 | 83.62% | 83.35% | 83.41% | 84.86% | 691 s |
| 2e−5 | 83.84% | 83.39% | 83.52% | 84.86% | ||
| 3e−5 | 79.61% | 79.58% | 79.55% | 81.30% | ||
| 4e−5 | 81.86% | 81.66% | 81.64% | 83.31% | ||
| 5e−5 | 82.27% | 81.92% | 81.90% | 83.36% | ||
| 8 | 1e−5 | 82.08% | 82.66% | 81.81% | 83.34% | 572 s |
| 2e−5 | 83.30% | 82.83% | 82.92% | 84.24% | ||
| 3e−5 | 81.94% | 81.88% | 81.86% | 83.28% | ||
| 4e−5 | 81.12% | 80.70% | 80.88% | 82.44% | ||
| 5e−5 | 80.13% | 79.59% | 79.77% | 81.36% | ||