Table II.
Performance of various methods on the SL329 dataset.
| Method | AUC | Sensitivity | Specificity | MCC | Sw | QLa | QSb | MSEc |
|---|---|---|---|---|---|---|---|---|
| SPINE-D | 0.886 | 0.78 (0.78d) | 0.85 (0.85) | 0.63 (0.63) | 0.63 (0.63) | −(0.81) | −(0.64) | −(0.070) |
| MFDp | 0.873 | 0.88 (0.76) | 0.62 (0.85) | 0.51 (0.61) | 0.50 (0.61) | −(0.80) | −(0.52) | −(0.113) |
| Disopred2 | 0.858 | 0.69 (0.74) | 0.90 (0.85) | 0.59 (0.60) | 0.61 (0.59) | −(0.76) | −(0.60) | −(0.093) |
| MD | 0.864 | 0.66 (0.72) | 0.89 (0.85) | 0.58 (0.59) | 0.55 (0.58) | −(0.75) | −(0.57) | −(0.110) |
| DISOClust | 0.846 | 0.81 (0.72) | 0.70 (0.85) | 0.51 (0.57) | 0.51 (0.57) | −(0.73) | −(0.60) | −(0.093) |
| PONDR-FIT | 0.843 | 0.61 (0.69) | 0.91 (0.85) | 0.55 (0.55) | 0.51 (0.54) | −(0.72) | −(0.54) | −(0.086) |
| IUlong | 0.839 | 0.60 (0.69) | 0.92 (0.85) | 0.55 (0.55) | 0.52 (0.54) | −(0.74) | −(0.41) | −(0.118) |
| Dispro | 0.837 | 0.28 (0.69) | 0.99 (0.85) | 0.40 (0.55) | 0.27 (0.54) | −(0.70) | −(0.63) | −(0.077) |
| IUshort | 0.829 | 0.50 (0.67) | 0.94 (0.85) | 0.50 (0.54) | 0.44 (0.53) | −(0.71) | −(0.47) | −(0.096) |
| NORSnet | 0.815 | 0.54 (0.65) | 0.92 (0.85) | 0.51 (0.51) | 0.46 (0.50) | −(0.69) | −(0.42) | −(0.144) |
| UCON | 0.779 | 0.59 (0.54) | 0.81 (0.85) | 0.42 (0.41) | 0.40 (0.39) | −(0.57) | −(0.38) | −(0.148) |
| PONDR®VLXT | 0.755 | 0.59 (0.51) | 0.78 (0.85) | 0.38 (0.39) | 0.38 (0.36) | −(0.53) | −(0.44) | −(0.140) |
Predictors are ranked according to Sw. Highest number in each column is shown in bold. We did not calculate QL, QS and MSE of disorder content based on default binary predictions because without fixing specificity, those two quality measures are strongly depending on how the methods were trained.
Fraction of correctly predicted residues in long disordered regions (>30 residues).
Fraction of correctly predicted residues in short disordered regions (≤30 residues).
Mean square errors on predicting disorder content.
The number in parentheses is when all thresholds are adjusted to a specificity of 85%. (Thresholds are 0.670 for MFDp, 0.039 for Disopred2, 0.476 for MD, 0.658 for DISOClust, 0.434 for IUlong, 0.061 for Dispro, 0.389 for IUshort, 0.400 for NORSnet, 0.621 for UCON, 0.620 for PONDR®VLXT, and 0.390 for PONDR-FIT, respectively.).