TABLE 4.

Result of the benchmark dataset of VDJdb-without10x. APS stands for the average precision score.

Model	Features in addition to peptides	ROC AUC	APS
Cross-TCR-interpreter (Ours)	CDR3s of α- and β-chains	0.9445	0.7600
NetTCR-2.0	CDR3s of α- and β-chains	0.9492	0.7262
PanPep	CDR3 sequence of the β-chain with biochemical features	0.9009	0.6435
AttnTAP a	CDR3 sequence of the β-chain	0.894	-
DLpTCR a	CDR3 sequence of the β chain	0.622	-
ERGO-II, LSTM b	CDR3s of α- and β-chains	0.800	-
ERGO-II, LSTM b	CDR3s of α- and β-chains, VJ genes, and MHC type	0.866	-

^a The numbers were derived from the AttnTAP paper because we observed that both DLpTCR and AttnTAP achieved only poor scores in our experiments. Hence, to avoid potential misinterpretation due to poor scores, we opted not to display the average precision score in this context. Regarding our experiments of AttnTAP, ROC AUC and APS on McPAS were 0.5934 and 0.3073, respectively. Those of VDJdb-without10x were 0.3951 and 0.1400, respectively. Those of our DLpTCR experiments on McPAS were 0.5346 and 0.1941, respectively, and those of DLpTCR on VDJdb-without10x were 0.5187 and 0.1914, respectively.

^b The numbers were derived from the ERGO-II paper.