Table 7. Initial ANN Model.

model	hidden layer	activation function	training algorithm	accuracy	MAPE	R-squared
MODEL_5_RELU_SGD	5	rectified linear unit	stochastic gradient descent	53.23	1.1153 × 1014	0.9245
MODEL_7_RELU_SGD	7	rectified linear unit	stochastic gradient descent	53.66	1.28855 × 1014	0.9231
MODEL_9_RELU_SGD	9	rectified linear unit	stochastic gradient descent	53.02	9.97446 × 1013	0.9239
MODEL_11_RELU_SGD	11	rectified linear unit	stochastic gradient descent	52.8	1.02458 × 1014	0.9117
MODEL_5_RELU_ADAM	5	rectified linear unit	Adam	52.8	6.96513 × 1013	0.9191
MODEL_7_RELU_ADAM	7	rectified linear unit	Adam	53.23	7.31115 × 1013	0.939
MODEL_9_RELU_ADAM	9	rectified linear unit	Adam	53.23	6.97803 × 1013	0.9386
MODEL_11_RELU_ADAM	11	rectified linear unit	Adam	53.02	8.01304 × 1013	0.9124
MODEL_5_RELU_RMSPROP	5	rectified linear unit	RMSprop	53.23	6.11124 × 1013	0.95
MODEL_7_RELU_RMSPROP	7	rectified linear unit	RMSprop	52.59	5.42407 × 1013	0.9094
MODEL_9_RELU_RMSPROP	9	rectified linear unit	RMSprop	53.02	5.01291 × 1013	0.9375
MODEL_11_RELU_RMSPROP	11	rectified linear unit	RMSprop	52.8	6.84404 × 1013	0.901
MODEL_5_SIGMOID_SGD	5	sigmoid	stochastic gradient descent	53.66	3.26599 × 1014	0.8545
MODEL_7_SIGMOID_SGD	7	sigmoid	stochastic gradient descent	53.02	2.40028 × 1014	0.8896
MODEL_9_SIGMOID_SGD	9	sigmoid	stochastic gradient descent	53.23	2.64108 × 1014	0.8765
MODEL_11_SIGMOID_SGD	11	sigmoid	stochastic gradient descent	53.66	3.67715 × 1014	0.8318
MODEL_5_SIGMOID_ADAM	5	sigmoid	Adam	53.23	2.05152 × 1014	0.9223
MODEL_7_SIGMOID_ADAM	7	sigmoid	Adam	53.23	1.05645 × 1014	0.9359
MODEL_9_SIGMOID_ADAM	9	sigmoid	Adam	53.23	9.49081 × 1013	0.9336
MODEL_11_SIGMOID_ADAM	11	sigmoid	Adam	53.23	9.15691 × 1013	0.9411
MODEL_5_SIGMOID_RMSPROP	5	sigmoid	RMSprop	53.02	1.00003 × 1014	0.939
MODEL_7_SIGMOID_RMSPROP	7	sigmoid	RMSprop	53.23	7.54171 × 1013	0.9399
MODEL_9_SIGMOID_RMSPROP	9	sigmoid	RMSprop	53.23	6.71535 × 1013	0.9426
MODEL_11_SIGMOID_RMSPROP	11	sigmoid	RMSprop	53.02	6.63556 × 1013	0.9385
MODEL_5_TANH_SGD	5	tanH	stochastic gradient descent	53.23	1.19568 × 1014	0.9201
MODEL_7_TANH_SGD	7	tanH	stochastic gradient descent	53.02	1.19444 × 1014	0.9059
MODEL_9_TANH_SGD	9	tanH	stochastic gradient descent	52.37	9.90017 × 1013	0.9278
MODEL_11_TANH_SGD	11	tanH	stochastic gradient descent	53.02	1.06792 × 1014	0.9271
MODEL_5_TANH_ADAM	5	tanH	Adam	53.02	7.31876 × 1013	0.9389
MODEL_7_TANH_ADAM	7	tanH	Adam	53.02	7.22532 × 1013	0.9385
MODEL_9_TANH_ADAM	9	tanH	Adam	53.02	6.62239 × 1013	0.9314
MODEL_11_TANH_ADAM	11	tanH	Adam	53.02	6.71126 × 1013	0.9329
MODEL_5_TANH_RMSPRO	5	tanH	RMSprop	53.02	6.07054 × 1013	0.9399
MODEL_7_TANH_RMSPROP	7	tanH	RMSprop	53.02	7.29403 × 1013	0.9313
MODEL_9_TANH_RMSPROP	9	tanH	RMSprop	53.02	5.83226 × 1013	0.9338
MODEL_11_TANH_RMSPROP	11	tanH	RMSprop	53.02	5.80706 × 1013	0.9322