Table 1.
Specification of the hyperparameter space for the model B family. Minibatch size and dropout rate are quantified to avoid an exhaustive search.
Model | Hyperparameter | Original value range | Quantified values |
B1 | Minibatch size | {1-infinity} | {32, 64, 128, 256, 512} |
B2 | Batch normalization | {on, off} | {on, off} |
B3 | Weight normalization | {on, off} | {on, off} |
B4 | Dropout rate | {0-1} | {0, 0.1, 0.2, 0.3, 0.4, 0.5} |