Table 3. Accuracy, recall, specificity, precision and F1 score for different network architectures used for classification of image quality into “good,” “off-center,” “signal-shielded,” and “other.” The best option within each metric is in bold.
Network | class | Re (%) | SP (%) | PR (%) | OA (%) | OR (%) | OS (%) | OP (%) | F1 score (%) |
---|---|---|---|---|---|---|---|---|---|
VGG | Good | 97 | 95.33 | 87.39 | 95 | 95.33 | 97 | 98.96 | 97.11 |
Off-center | 94 | 98.33 | 94.95 | ||||||
S-shield | 92 | 99.33 | 97.87 | ||||||
Other | 95 | 99.67 | 98.96 | ||||||
| |||||||||
ResNet-18 | Good | 98 | 96.67 | 90.74 | 95.75 | 96.67 | 98 | 99.32 | 97.98 |
Off-center | 97 | 98.33 | 95.1 | ||||||
S-shield | 92 | 99.67 | 98.93 | ||||||
Other | 96 | 99.67 | 98.97 | ||||||
| |||||||||
ResNet-50 | Good | 97 | 97.33 | 92.38 | 96.25 | 97 | 98.98 | 98.15 | 98.15 |
Off-center | 92 | 98.67 | 95.83 | ||||||
S-shield | 96 | 98.33 | 95.05 | ||||||
Other | 97 | 99.67 | 98.98 | ||||||
| |||||||||
Inception-V3 | Good | 95 | 96.67 | 90.48 | 96.25 | 96.67 | 95 | 98.31 | 97.48 |
Off-center | 93 | 99.33 | 97.89 | ||||||
S-shield | 99 | 98.33 | 95.19 | ||||||
Other | 95 | 99.67 | 98.96 |
S-shield: Signal-shield