Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Values of critical hyperparameters in our architecture.
| Hyperparameter | Value |
|---|---|
| Number of layers | 394 |
| Learning rate | 1e−3 for 1–100 epochs |
| 5e−4 for 101–200 epochs | |
| 1e−5 for 201–400 epochs | |
| 1e−6 for 401–500 epochs | |
| Optimizer | SGD |
| Momentum | 0.9 |
| Weight decay | 0.001 |
| Number of epochs | 500 |
