Skip to main content
. 2020 Apr;10(4):808–823. doi: 10.21037/qims.2020.03.08

Table 2. Hyperparameter selection.

GBM NNet RF SVM
Hyperparameter range per machine learning model during training
   Interaction.depth =1,2,3,4,5
N.trees =1–350, by steps of 50
Shrinkage =0.1, 0.01
N.minobsinnode =1–10, by steps of 1
Size =1–10, by steps of 1
Decay =10−1−5
Mtry =1–5, by steps of 1
Splitrule = gini or splitrule
Min.node.size =1–5, by steps of 1
Cost =0.1–1, by steps of 0.1
Sigma =0.1–1, by steps of 0.1
Best hyperparameter selection for testing
   Interaction.depth =5
N.trees =251
Shrinkage =0.1
N.minobsinnode =1
Size =10
Decay =10−1
Mtry =1
Splitrule = gini
Min.node.size =2
Cost =0.9
Sigma =1

GBM, gradient boosting machines; NNet, neural network; RF, random forest; SVM, support vector machines.