Table 5.
Comparison of Bias Correction techniques for improving bias angle and overall error. From top to bottom we have our best individual predictor RF GE (bolded). RF GE ensembled with our KNN utilizing the drug targets. RF GE ensembled with NN GE alone. RF GE ensembled with RF Phys Residual. Linear ensemble of all methods that are bolded in Table 2. For each method we shows correlation coefficient between predicted and actual AUCs (correlation), normalized mean squared error(NMSE), mean θ across all drugs (θμ), and 95% bootstrap confidence interval lower and upper bounds, (θL and θH respectively) BC1 and RRot denote our RF GE corrected using techniques found in [5]
Correlation | NMSE | θ μ | θ L | θ H | |
---|---|---|---|---|---|
RF GE | 0.7276 | 0.7910 | 38.27° | 37.34° | 39.04° |
RF GE + KNN Residual | 0.7550 | 0.7225 | 35.23° | 34.07° | 36.30° |
RF GE + NNGE | 0.7258 | 0.7919 | 38.22° | 37.39° | 39.03° |
RF GE + RF Phys Residual | 0.7504 | 0.7341 | 35.26° | 34.23° | 36.12° |
Linear StackingEnsemble | 0.7746 | 0.6705 | 34.25° | 33.15° | 35.26° |
BC1 | 0.7184 | 0.8092 | 40.61° | 40.00° | 41.11° |
RRot | 0.7084 | 0.8382 | 40.60° | 40.02° | 41.12° |