Skip to main content
. Author manuscript; available in PMC: 2014 Oct 3.
Published in final edited form as: J Mach Learn Res. 2013 Feb;14:499–566.

Table 4.

Ranks of methods based on individual and combined criteria. Smaller ranks correspond to better methods according to each criterion. As described in text, ranks were obtained using formal statistical comparison of the observed differences between methods; that is why they do not necessarily range between 1 and 27 (total number of tested methods).

Method Rank
N PV AUC (PV, AUC)
TIE* max-k = 3, α = 0.05 4 5 2 1
KIAMB Number ofruns = 5000, α = 0.05, K = 0.7 4 2 4 5
Number of runs = 5000, α = 0.05, K = 0.8 4 2 4 5
Number of runs = 5000, α = 0.05, K = 0.9 4 2 4 5
EGS-NCMIGS l = 7, δ = 0.015 6 1 4 3
l = 7, K = 10 6 5 3 6
l = 7, K = 50 6 9 3 11
l = 5000, δ = 0.015 3 2 4 5
l = 5000, K = 10 3 4 3 4
l = 5000, K = 50 3 9 3 11
EGS-CMIM l = 1, K = 10 6 5 3 6
l = 7, K = 50 6 9 2 8
l = 5000, K = 10 3 3 3 2
l = 5000, K = 50 3 9 2 8
EGSG Number of Markov boundaries = 30, t = 5 5 6 4 10
Number of Markov boundaries = 30, t = 10 5 6 4 10
Number of Markov boundaries = 30, t = 15 5 6 5 13
Number of Markov boundaries = 5,000, t = 5 2 9 4 14
Number of Markov boundaries = 5,000, t = 10 2 8 4 12
Number of Markov boundaries = 5,000, t = 15 1 7 5 15
Resampling+RFE without statistical comparison 2 10 2 9
with statistical comparison (α = 0.05) 2 9 3 11
Resampling+UAF without statistical comparison 3 11 1 7
with statistical comparison (α = 0.05) 3 10 2 9
IR-HITON-PC max-k = 3, α = 0.05 6 5 3 6
IR-SPLR without statistical comparison 6 10 2 9
with statistical comparison (α = 0.05) 5 9 3 11