Table 7.
Model performance evaluation(Class names are indicated by their initials).
| Measures | 101HS | HY22 | HY25 | LN13 | LH11 | LH9 | QH6 | TF3 | YH2 | YH4 | YH5 | ZN108 | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MODEL: AlexNet | |||||||||||||
| Accuracy(%) | 98.5 | 96.1 | 98.8 | 96.4 | 99.4 | 98.8 | 99.4 | 99.4 | 96.4 | 97.0 | 95.3 | 97.0 | 97.7 |
| Precision(%) | 100 | 80.8 | 90.3 | 75.8 | 92.9 | 92.9 | 93.8 | 96.7 | 82.1 | 79.4 | 68.6 | 95.5 | 87.4 |
| Recall(%) | 82.8 | 72.4 | 96.6 | 86.2 | 92.9 | 92.9 | 100 | 96.7 | 76.7 | 90.0 | 82.8 | 70.0 | 86.7 |
| F1-Score(%) | 90.6 | 76.4 | 93.3 | 80.7 | 92.9 | 92.9 | 96.8 | 96.7 | 79.3 | 84.4 | 75.0 | 80.8 | 86.7 |
| MODEL: VGG16 | |||||||||||||
| Accuracy(%) | 98.5 | 95.8 | 99.1 | 97.0 | 100 | 98.5 | 97.9 | 99.1 | 98.5 | 96.1 | 97.3 | 98.8 | 98.1 |
| Precision(%) | 100 | 70.3 | 93.3 | 88.0 | 100 | 100 | 82.9 | 100 | 100 | 69.8 | 88.5 | 96.4 | 90.8 |
| Recall(%) | 82.8 | 89.7 | 96.6 | 75.9 | 100 | 82.1 | 96.7 | 90.0 | 83.3 | 100 | 79.3 | 90.0 | 88.9 |
| F1-Score(%) | 90.6 | 78.8 | 94.9 | 81.5 | 100 | 90.2 | 89.3 | 94.7 | 90.9 | 82.2 | 83.6 | 93.1 | 89.2 |
| MODEL: GoogLeNet | |||||||||||||
| Accuracy(%) | 99.4 | 97.6 | 98.5 | 97.3 | 99.7 | 98.5 | 98.5 | 97.6 | 95.0 | 97.9 | 95.5 | 97.0 | 97.7 |
| Precision(%) | 100 | 83.9 | 96.2 | 88.5 | 93.3 | 96.0 | 85.7 | 92.3 | 66.7 | 89.7 | 69.4 | 95.5 | 88.1 |
| Recall(%) | 93.1 | 89.7 | 86.2 | 79.3 | 100 | 85.7 | 100 | 80.0 | 86.7 | 86.7 | 86.2 | 70.0 | 87.0 |
| F1-Score(%) | 96.4 | 86.7 | 90.9 | 83.6 | 96.5 | 90.6 | 92.3 | 85.7 | 75.4 | 88.2 | 76.9 | 80.8 | 87.0 |
| MODEL: ResNet18 | |||||||||||||
| Accuracy(%) | 99.7 | 98.5 | 99.7 | 98.8 | 100 | 100 | 99.7 | 99.1 | 99.1 | 99.4 | 96.7 | 96.7 | 99.0 |
| Precision(%) | 100 | 87.5 | 100 | 96.3 | 100 | 100 | 96.8 | 93.5 | 93.5 | 96.7 | 78.1 | 88.0 | 94.2 |
| Recall(%) | 96.6 | 96.6 | 96.6 | 89.7 | 100 | 100 | 100 | 96.7 | 96.7 | 96.7 | 86.2 | 73.3 | 94.1 |
| F1-Score(%) | 98.3 | 91.8 | 98.3 | 92.9 | 100 | 100 | 98.4 | 95.1 | 95.1 | 96.7 | 82.0 | 80.0 | 94.1 |
| MODEL: ResNet50 | |||||||||||||
| Accuracy(%) | 99.1 | 97.6 | 99.1 | 98.8 | 99.7 | 99.7 | 99.7 | 100 | 100 | 99.4 | 97.9 | 98.2 | 99.1 |
| Precision(%) | 96.4 | 81.8 | 96.4 | 100 | 93.3 | 100 | 96.8 | 100 | 100 | 96.7 | 86.7 | 90.0 | 94.8 |
| Recall(%) | 93.1 | 93.1 | 93.1 | 86.2 | 100 | 96.4 | 100 | 100 | 100 | 96.7 | 89.7 | 90.0 | 94.9 |
| F1-Score(%) | 94.7 | 87.1 | 94.7 | 92.6 | 96.5 | 98.2 | 98.4 | 100 | 100 | 96.7 | 88.2 | 90.0 | 94.8 |
| MODEL: SqueezeNet | |||||||||||||
| Accuracy(%) | 99.4 | 96.1 | 98.8 | 96.7 | 99.1 | 98.8 | 98.8 | 98.8 | 96.1 | 97.0 | 95.5 | 96.7 | 97.7 |
| Precision(%) | 100 | 78.6 | 90.3 | 87.5 | 82.4 | 87.5 | 88.2 | 96.4 | 77.4 | 81.3 | 70.6 | 100 | 86.7 |
| Recall(%) | 93.1 | 75.9 | 96.6 | 72.4 | 100 | 100 | 100 | 90.0 | 80.0 | 86.7 | 82.8 | 63.3 | 86.7 |
| F1-Score(%) | 96.4 | 77.2 | 93.3 | 79.2 | 90.4 | 93.3 | 93.7 | 93.1 | 78.7 | 83.9 | 76.2 | 77.5 | 86.1 |
| MODEL: DenseNet201 | |||||||||||||
| Accuracy(%) | 99.7 | 99.4 | 99.4 | 100 | 100 | 99.1 | 99.7 | 99.4 | 100 | 99.7 | 97.6 | 98.2 | 99.4 |
| Precision(%) | 100 | 96.6 | 96.6 | 100 | 100 | 96.3 | 96.8 | 100 | 100 | 96.8 | 81.8 | 92.9 | 96.5 |
| Recall(%) | 96.6 | 96.6 | 96.6 | 100 | 100 | 92.9 | 100 | 93.3 | 100 | 100 | 93.1 | 86.7 | 96.3 |
| F1-Score(%) | 98.3 | 96.6 | 96.6 | 100 | 100 | 94.6 | 98.4 | 96.5 | 100 | 98.4 | 87.1 | 89.7 | 96.4 |
| MODEL: MobileNetv2 | |||||||||||||
| Accuracy(%) | 98.5 | 97.0 | 98.8 | 96.7 | 99.7 | 99.7 | 99.1 | 99.1 | 98.2 | 98.8 | 96.1 | 97.9 | 98.3 |
| Precision(%) | 100 | 88.0 | 90.3 | 75.0 | 93.3 | 100 | 96.6 | 96.6 | 96.2 | 96.4 | 70.0 | 92.6 | 91.3 |
| Recall(%) | 82.8 | 75.9 | 96.6 | 93.1 | 100 | 96.4 | 93.3 | 93.3 | 83.3 | 90.0 | 96.6 | 83.3 | 90.4 |
| F1-Score(%) | 90.6 | 81.5 | 93.3 | 83.1 | 96.5 | 98.2 | 94.9 | 94.9 | 89.3 | 93.1 | 81.2 | 87.7 | 90.4 |
| MODEL: our model | |||||||||||||
| Accuracy(%) | 100 | 99.7 | 99.1 | 99.7 | 100 | 99.7 | 99.7 | 100 | 100 | 99.4 | 98.2 | 98.5 | 99.5 |
| Precision(%) | 100 | 100 | 96.4 | 96.7 | 100 | 100 | 96.8 | 100 | 100 | 93.8 | 89.7 | 93.1 | 97.2 |
| Recall(%) | 100 | 96.6 | 93.1 | 100 | 100 | 96.4 | 100 | 100 | 100 | 100 | 89.7 | 90.0 | 97.2 |
| F1-Score(%) | 100 | 98.3 | 94.7 | 98.3 | 100 | 98.2 | 98.4 | 100 | 100 | 96.8 | 89.7 | 91.5 | 97.2 |