Skip to main content
. 2020 Jun 19;8:115041–115050. doi: 10.1109/ACCESS.2020.3003810

TABLE 2. Optimal Values for the Parameters and Hyperparameters for the Custom and Pretrained Models Obtained Through Optimization Tools (M = Momentum, ILR = Initial Learning Rate, L2=L2-Weight Decay, and D = Dropout Ratio).

Models Optimal values
M ILR L2 D Optimizer Activation
Custom 0.5 SGD ReLU
Pretrained 0.95 1e-3 1e-6