Table 1.
The summary of LSTM hyper-parameters investigated in this study, the recommended configurations, and the impact level of each parameter.
| Hyper-parameter | Range | Recommended configuration | Impact |
|---|---|---|---|
| Number of layers | {1, 2, 3, 5, 10} | 3 | High |
| Number of hidden units per layer | {3, 5, 10, 15, 20, 30, 40} | 15 | Low |
| Learning rate | {0.0001, 0.001, 0.005,0.01,0.1} | 0.001 | Intermediate |
| Number of epochs | {10, 20, 30, 50, 100, 500} | 30 | Low |
| Length of time lags | {1, 5, 15, 20, 50, 100} | 20 | Low |
| Optimizer | {SGD,RMSprop,Adagrad,Adadelta,Adam,Adamax,Nadam} | Adam | Intermediate |