Table 3.
Comparative assessment of the cross-predictions and the over-predictions of the eight selected sequence-based predictors of RBRs and the meta-predictor, HybridRNAbind, on the test dataset and the two subsets of the dataset that cover the structure-annotated and the disorder-annotated test proteins. The best results for each column are identified with the bold font. Results of the statistical significance test are shown next to the reported values using the ‘x/y’ format where x represent comparison against the current method with the best AUC (i.e. MTDsite for the structure-annotated proteins, and DeepDISOBind for the disorder-annotated proteins and the complete test set) and y represent comparison against HybridRNAbind; +/ = /− means that the best current predictor or HybridRNAbind is significantly better/not different/significantly worse than another method at P-value < 0.01
| Structure annotated proteins | Disorder annotated proteins | All proteins | |||||
|---|---|---|---|---|---|---|---|
| Predictor type | Predictor | AUCPC | AUOPC | AUCPC | AUOPC | AUCPC | AUOPC |
| Structure-trained | Pprint | 0.319−/+ | 0.253+/+ | 0.417−/+ | 0.387+/+ | 0.388−/+ | 0.351+/+ |
| BindN+ | 0.484+/+ | 0.528+/+ | 0.470+/+ | 0.504+/+ | 0.474+/+ | 0.510+/+ | |
| DRNApred | 0.552+/+ | 0.552+/+ | 0.418 = /+ | 0.402+/+ | 0.449+/+ | 0.429+/+ | |
| NCBRPred | 0.325−/+ | 0.276+/+ | 0.406−/= | 0.359+/+ | 0.385−/+ | 0.336+/+ | |
| ProNA2020 | 0.457+/+ | 0.367+/+ | 0.627+/+ | 0.534+/+ | 0.579+/+ | 0.486+/+ | |
| MTDsite | 0.333 /+ | 0.225 /− | 0.466+/+ | 0.389+/+ | 0.429+/+ | 0.345+/+ | |
| Disorder-trained | DisoRDPbind | 0.338 = /+ | 0.316+/+ | 0.364−/− | 0.453+/+ | 0.355−/− | 0.416+/+ |
| DeepDISObind | 0.333 = /+ | 0.367+/+ | 0.422 /+ | 0.259 /= | 0.419 /+ | 0.292 /+ | |
| Meta | HybridRNAbind | 0.263−/ | 0.242+/ | 0.403−/ | 0.256 = / | 0.368−/ | 0.252 −/ |