Table 9.
Topology | MI | Top1r | Top2r | Top3r | Top4r |
---|---|---|---|---|---|
ResNet50 | 1 | MeLU + GaLU | SRS | PDELU | Soft Learnable v2 |
ResNet50 | 255 | MeLU (k = 8) | Splash | MeLU (k = 4) | 2D MeLU |
VGG16 | 1 | SReLU | MeLU + GaLU | MeLU (k = 4) | ReLU |
VGG16 | 255 | GaLU | MeLU (k = 4) | SReLU | APLU |