Table 4.
Results of the Holm test for significance level α = 0.05.
i | α/i | Method | RMSE | Method | RMSEm | ||||
---|---|---|---|---|---|---|---|---|---|
zi | pi | Hypothesis | zi | pi | Hypothesis | ||||
3 | 0.017 | A717 | 5.69 | 1.25·10-8 | Rejected | A717 | 2.53 | 1.14·10-2 | Rejected |
2 | 0.025 | DASA | 3.16 | 1.57·10-3 | Rejected | DASA | 1.58 | 1.14·10-1 | Accepted |
1 | 0.050 | PSO | 2.53 | 1.14·10-2 | Rejected | DE | 1.58 | 1.14·10-1 | Accepted |
The table summarizes the outcome of the Holm test performed on the median values of the RMSE and RMSEm results obtained by parameter estimation with the four optimization methods from artificial data. In the first test based on median values of the RMSE measure, DE is the reference method with rank i = 0. In the second test based on median values of the RMSEm measure, PSO is the reference method with rank i = 0. The hypothesis "there is no difference in performance between DE (PSO) and the i-th ranked method" is rejected if the statement pi <α/i holds.