Skip to main content
. 2019 Oct 23;7:701. doi: 10.3389/fchem.2019.00701

Table 7.

Summary of the performance of similarity search methods on 40 DUDa and 102 DUDEb datasets.

Metric Mean Max-Sim valuec Mean%diffd Diff ≥ 0%e Diff < 0%f Diff ≥ 1%g Diff < −1%h
MaxZ vs. Max-Sim method on 40 DUD datasets
ROC_AUC 0.91 1.0 30 10 13 0
BEDROC 0.79 1.7 30 10 16 1
AS vs. Max-Sim method on 40 DUD datasets
ROC_AUC 0.90 1.2 28 12 15 3
BEDROC 0.76 1.1 25 15 16 10
MaxZ vs. Max-Sim method on 102 DUDE datasets
ROC_AUC 0.96 0.5 90 12 18 0
BEDROC 0.90 0.7 87 15 28 2
AS vs. Max-Sim method on 102 DUD datasets
ROC_AUC 0.96 0.2 55 47 13 3
BEDROC 0.90 0.2 58 44 27 20
a

DUD: Directory of Useful Decoys, http://dud.docking.org/.

b

DUDE: Database of Useful Decoys: Enhanced, http://dude.docking.org/.

c

Mean ROC_AUC or BEDROC value calculated from the Max-Sim method over 40 DUD or 102 DUDE datasets.

d

Mean percentage difference between ROC_AUC or BEDROC values derived from the maxZ or AS methods and the Max-Sim method.

e

Number of datasets for which ROC_AUC or BEDROC values calculated from the maxZ or AS methods were higher than or equal to the corresponding values calculated from the Max-Sim method, i.e., the number of datasets on which the maxZ or AS method performed comparable to or better than the Max-Sim method did.

f

Number of datasets for which ROC_AUC or BEDROC values calculated from the maxZ or AS methods were lower than the corresponding values calculated from the Max-Sim method, i.e., the number of datasets on which the maxZ or AS method performed worse than the Max-Sim method.

g

Number of datasets for which ROC_AUC or BEDROC values calculated from the maxZ or AS methods were at least 1% higher than the corresponding values calculated from the Max-Sim method.

h

Number of datasets for which ROC_AUC or BEDROC values calculated from the Max-Sim method was more than 1% higher than the corresponding values calculated from the maxZ or AS methods.