Table 4.
Comparison of Sensitivity, Specificity, Matthews Correlation Coefficient (MCC) and Area Under the Curve (AUC) for different classifiers and signal peptide-bearing proteins from members of Plasmodiidae. The abbreviations ’tm’ and ’no tm’ indicate version considering and not considering transmembrane domains, whereas ’ident. 50%’ means removal from the learning set sequences with the sequence identity larger than 50%.
| Sensitivity | Specificity | MCC | AUC | |
|---|---|---|---|---|
| SignalP 4.1 (no tm) [33] | 0.8235 | 0.9100 | 0.6872 | 0.8667 |
| SignalP 4.1 (tm) [33] | 0.6471 | 0.9431 | 0.6196 | 0.7951 |
| SignalP 3.0 (NN) [40] | 0.8824 | 0.9052 | 0.7220 | 0.8938 |
| SignalP 3.0 (HMM) [40] | 0.6275 | 0.9194 | 0.5553 | 0.7734 |
| PrediSi [37] | 0.3333 | 0.9573 | 0.3849 | 0.6453 |
| Philius [39] | 0.6078 | 0.9336 | 0.5684 | 0.7707 |
| Phobius [38] | 0.6471 | 0.9289 | 0.5895 | 0.7880 |
| signalHsmm-2010 | 0.9804 | 0.8720 | 0.7409 | 0.9262 |
| signalHsmm-2010 (ident. 50%) | 1.0000 | 0.8768 | 0.7621 | 0.9384 |
| signalHsmm-2010 (raw aa) | 0.8431 | 0.9005 | 0.6853 | 0.8718 |
| signalHsmm-1987 | 0.9216 | 0.8910 | 0.7271 | 0.9063 |
| signalHsmm-1987 (ident. 50%) | 0.9412 | 0.8768 | 0.7194 | 0.9090 |
| signalHsmm-1987 (raw aa) | 0.7647 | 0.9052 | 0.6350 | 0.8350 |