Table 2.
Candidate values for each hyperparameter
Hyperparameter | Values |
---|---|
Number of convolutional layers | − 4~ + 4 |
Number of max-pooling layers | − 3~ + 3 |
Number of fully connected layers | − 2~ + 1 |
Filter size | 3~9 |
Number of filters | 48~576 |
Number of units in fully connected layer | 2048~6144 |
Minibatch size | 4~20 |
Dropout | 0.25~0.75 |
Initial learning rates | 0.5e−4~1.5e−4 |
Momentum | 0.8~0.95 |
L2 Regularization | 1e−10~1e−2 |