TABLE 6.
ACC a , b | REC | PRE | F1 | AUC | ||
---|---|---|---|---|---|---|
McPAS
-TCR |
ERGO-LSTM | 0.748 ± 0.004 | 0.747 ± 0.013 | 0.748 ± 0.007 | 0.747 ± 0.006 | 0.831 ± 0.005 |
ERGO-AE | 0.734 ± 0.004 | 0.696 ± 0.020 | 0.754 ± 0.009 | 0.722 ± 0.008 | 0.808 ± 0.004 | |
ImRex | 0.631 ± 0.003 | 0.625 ± 0.005 | 0.648 ± 0.005 | 0.636 ± 0.004 | 0.694 ± 0.003 | |
DLpTCR | 0.502 ± 0.003 | 0.500 ± 0.004 | 0.861 ± 0.003 | 0.633 ± 0.003 | 0.529 ± 0.004 | |
NetTCR-2.0 | 0.728 ± 0.004 | 0.734 ± 0.010 | 0.715 ± 0.018 | 0.722 ± 0.006 | 0.799 ± 0.004 | |
AttnTAP | 0.758 ± 0.003 | 0.769 ± 0.013 | 0.752 ± 0.007 | 0.760 ± 0.005 | 0.840 ± 0.003 | |
VDJdb | ERGO-LSTM | 0.834 ± 0.003 | 0.790 ± 0.004 | 0.864 ± 0.004 | 0.825 ± 0.003 | 0.889 ± 0.003 |
ERGO-AE | 0.837 ± 0.003 | 0.798 ± 0.006 | 0.864 ± 0.006 | 0.829 ± 0.004 | 0.891 ± 0.003 | |
ImRex | 0.561 ± 0.004 | 0.556 ± 0.005 | 0.571 ± 0.006 | 0.564 ± 0.005 | 0.598 ± 0.004 | |
DLpTCR | 0.482 ± 0.005 | 0.487 ± 0.004 | 0.861 ± 0.004 | 0.622 ± 0.004 | 0.503 ± 0.005 | |
NetTCR-2.0 | 0.832 ± 0.003 | 0.851 ± 0.008 | 0.802 ± 0.007 | 0.826 ± 0.003 | 0.890 ± 0.002 | |
AttnTAP | 0.839 ± 0.003 | 0.801 ± 0.006 | 0.865 ± 0.004 | 0.831 ± 0.003 | 0.894 ± 0.002 |
The results show 95% confidence intervals for all the validations (totally 30 validations for each cross-validation).
Abbreviations: ACC: accuracy; REC: recall; PRE: precision; F1: F1 score; AUC: area under the receiver operating characteristic curve.