Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Various activation functions compared in terms of accuracy measure.
| Model | Sigmoid | Tanh | ReLU | Leaky-ReLU | GELU |
|---|---|---|---|---|---|
| ShuffleNet | 89% | 89% | 88% | 92% | 90% |
| ShuffleNet-Light+Inception-v3 | 96% | 96% | 97% | 96% | 99% |
| ShuffleNet-Light+AlexNet | 90% | 91% | 89% | 89% | 90% |
| ShuffleNet-Light+MobileNet | 90% | 90% | 88% | 87% | 89% |
Tanh: hyperbolic tangent function, ReLU: rectified linear unit, Leaky-ReLU: leaky rectified linear unit, GELU: Gaussian error linear unit.
