Table 8.
Hyperparameters | Meanings | Search ranges | Optimal values |
---|---|---|---|
learning_rate | Learning rate | (0.01, 1.0) | 0.0274 |
max_depth | Maximum depth of the tree | (1, 50) | 20 |
max_bin | The max number of bins that feature values will be bucketed in | (10, 100) | 10 |
reg_alpha | L1 regularization | (1e-9, 1.0) | 0.9647 |
boosting_type | Training method | gbdt; goss; rf; dart | goss |
num_leaves | Number of leaf nodes | (1, 50) | 11 |
n_estimators | Number of iterations | (100, 600) | 600 |