Table 2.
Results of measure in conducted experiments. The best result per network architecture is in bold, while the following two highest results are underlined.
Method | SCNN | VGG16 | Res50 |
---|---|---|---|
Experiment 1 (GTSRB*) | |||
Grad-based | 0.6616 | 0.8955 | 0.8071 |
Smooth-grad | 0.5760 | 0.8657 | 0.8576 |
Guided Grad-CAM | 0.7879 | 0.8695 | 0.8663 |
Guided GradProp | 0.6444 | 0.8693 | 0.8659 |
Grad-CAM | 0.6550 | 0.8519 | 0.8367 |
Smooth Grad-CAM++ | 0.6626 | 0.8635 | 0.8366 |
Grad-CAM++ | 0.6558 | 0.8548 | 0.8367 |
Fast-CAM | 0.5865 | 0.4893 | 0.6465 |
Fast-CAM++ | 0.5721 | 0.4906 | 0.6465 |
Eigen-CAM | 0.5760 | 0.8657 | 0.8576 |
Eigen Grad-CAM | 0.7879 | 0.8695 | 0.8663 |
LayerCAM | 0.6444 | 0.8693 | 0.8659 |
Poly-CAM | 0.6550 | 0.8519 | 0.8367 |
Method | SCNN | VGG16 | Res50 |
---|---|---|---|
Experiment 2 (Zings) | |||
Grad-based | 0.5332 | 0.6354 | 0.5330 |
Smooth-grad | 0.3256 | 0.3813 | 0.3273 |
Guided Grad-CAM | 0.3544 | 0.5608 | 0.4668 |
Guided GradProp | 0.3566 | 0.5023 | 0.4589 |
Grad-CAM | 0.1740 | 0.5380 | 0.3088 |
Smooth Grad-CAM++ | 0.1581 | 0.4823 | 0.2986 |
Grad-CAM++ | 0.1712 | 0.5231 | 0.3080 |
Fast-CAM | 0.2119 | 0.3603 | 0.2651 |
Fast-CAM++ | 0.2146 | 0.3802 | 0.2632 |
Eigen-CAM | 0.0993 | 0.2576 | 0.2949 |
Eigen Grad-CAM | 0.1707 | 0.3409 | 0.3203 |
LayerCAM | 0.1941 | 0.6647 | 0.3226 |
Poly-CAM | 0.2131 | 0.5769 | 0.3303 |
Method | SCNN | VGG16 | Res50 |
---|---|---|---|
Experiment 3 (LISA*) | |||
Grad-based | 0.6052 | 0.3893 | 0.5298 |
Smooth-grad | 0.4434 | 0.5388 | 0.4959 |
Guided Grad-CAM | 0.6885 | 0.6279 | 0.6478 |
Guided GradProp | 0.6427 | 0.5722 | 0.6007 |
Grad-CAM | 0.4144 | 0.3803 | 0.3014 |
Smooth Grad-CAM++ | 0.4392 | 0.3260 | 0.3082 |
Grad-CAM++ | 0.4323 | 0.3382 | 0.3014 |
Fast-CAM | 0.5246 | 0.5430 | 0.5315 |
Fast-CAM++ | 0.5395 | 0.5949 | 0.5307 |
Eigen-CAM | 0.4361 | 0.5069 | 0.4751 |
Eigen Grad-CAM | 0.6726 | 0.6389 | 0.6256 |
LayerCAM | 0.6309 | 0.5818 | 0.5954 |
Poly-CAM | 0.4155 | 0.4488 | 0.3193 |
Method | VGG16 | Res50 | ResNext50 |
---|---|---|---|
Experiment 4 (ImageNet-S) | |||
Grad-based | 0.5349 | 0.5493 | 0.4927 |
Smooth-grad | 0.4674 | 0.4758 | 0.4294 |
Guided Grad-CAM | 0.5162 | 0.5249 | 0.4746 |
Guided GradProp | 0.4677 | 0.4744 | 0.4305 |
Grad-CAM | 0.6368 | 0.6489 | 0.6080 |
Smooth Grad-CAM++ | 0.6273 | 0.6484 | 0.6058 |
Grad-CAM++ | 0.6312 | 0.6500 | 0.6077 |
Fast-CAM | 0.6351 | 0.6403 | 0.6081 |
Fast-CAM++ | 0.6308 | 0.6411 | 0.6083 |
Eigen-CAM | 0.2220 | 0.6111 | 0.5793 |
Eigen Grad-CAM | 0.2448 | 0.6275 | 0.6042 |
LayerCAM | 0.5871 | 0.6525 | 0.6094 |
Poly-CAM | 0.4720 | 0.5508 | 0.5307 |