Table 2. Results of graphDelta Evaluation on the CSAR Data Compared to Kdeep and RF-Scorea.
graphDelta |
Kdeep(33) |
RF-score33 |
||||||
---|---|---|---|---|---|---|---|---|
dataset | epochs | MT/ST | r | RMSE | r | RMSE | r | RMSE |
CASP2016 | 500 | true | 0.82 | 1.22 | 0.82 | 1.27 | 0.80 | 1.39 |
500 | false | 0.84 | 1.17 | |||||
1000 | true | 0.86 | 1.11 | |||||
1000 | false | 0.84 | 1.16 | |||||
2000 | true | 0.84 | 1.17 | |||||
2000 | false | 0.87 | 1.05 | |||||
CSAR NRC HiQ set1 | 500 | true | 0.74 | 1.67 | 0.72 | 2.08 | 0.77 | 1.99 |
500 | false | 0.64 | 1.81 | |||||
1000 | true | 0.71 | 1.70 | |||||
1000 | false | 0.71 | 1.66 | |||||
2000 | true | 0.74 | 1.59 | |||||
2000 | false | 0.74 | 1.59 | |||||
CSAR NRC HiQ set2 | 500 | true | 0.60 | 1.86 | 0.65 | 1.91 | 0.75 | 1.66 |
500 | false | 0.59 | 1.72 | |||||
1000 | true | 0.56 | 1.92 | |||||
1000 | false | 0.71 | 1.52 | |||||
2000 | true | 0.64 | 1.73 | |||||
2000 | false | 0.71 | 1.53 | |||||
CSAR12 | 500 | true | 0.52 | 1.16 | 0.37 | 1.59 | 0.46 | 1.00 |
500 | false | 0.41 | 1.37 | |||||
1000 | true | 0.59 | 0.94 | |||||
1000 | false | 0.54 | 1.11 | |||||
2000 | true | 0.52 | 1.10 | |||||
2000 | false | 0.48 | 1.14 | |||||
CSAR14 | 500 | true | 0.72 | 1.40 | 0.61 | 1.75 | 0.80 | 0.87 |
500 | false | 0.66 | 1.51 | |||||
1000 | true | 0.65 | 1.34 | |||||
1000 | false | 0.59 | 1.67 | |||||
2000 | true | 0.70 | 1.32 | |||||
2000 | false | 0.74 | 1.22 | |||||
average | 500 | true | 0.68 | 1.46 | 0.62 | 1.72 | 0.72 | 1.38 |
500 | false | 0.63 | 1.52 | |||||
1000 | true | 0.67 | 1.40 | |||||
1000 | false | 0.68 | 1.42 | |||||
2000 | true | 0.69 | 1.38 | |||||
2000 | false | 0.71 | 1.31 |
Bold font is used to stress the best correlation coefficient and RMSE for the selected data set.