Table 2.

Grid search hyperparameters

Hyperparameters	Values
Batch size	10, 20, 40, 60, 80, 100
Epcohes	10, 50, 100
Optimization	SGD, RMSprop, Adagrad, Adadelta, Adam, Adamax, Nadam
Drop regularization	0.0, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9
Neurons in hidden layer	1, 5, 10, 15, 20, 25, 30