Skip to main content
. 2021 May 26;21:171. doi: 10.1186/s12911-021-01518-6

Table 7.

Robustness evaluation of our classifiers

Data set Accuracy AUC F1-score
DILIshuffled 0.52 0.49 0.36
DILIrandom1 0.92 0.91 0.89
DILIrandom2 0.92 0.91 0.89
DILIrandom3 0.93 0.92 0.91
DILIrandom4 0.93 0.92 0.90
DILIrandom5 0.92 0.91 0.90
SCARshuffled 0.63 0.51 0.26
SCARrandom1 0.93 0.89 0.86
SCARrandom2 0.94 0.90 0.88
SCARrandom3 0.93 0.90 0.86
SCARrandom4 0.92 0.89 0.85
SCARrandom5 0.93 0.89 0.86

·shuffled corresponds to an experiment where class labels (i.e., or ) are randomly affected to drugs. ·randomi correspond to experiments where negative examples (i.e., ) are replaced by drugs randomly picked in the knowledge graph. Indices i from 1 to 5 refer to 5 different draws