Table 3.
Overall tool performance at different overlap thresholds. The AUC of the PRC is given for the tools with each of the four organism datasets (whole translatome ORF set) at the prediction overlap thresholds of 1%, 70% and 90%. The overlap threshold is the percentage of the ORF length that the prediction must satisfy.
Organism: | E. coli (AUC) | L. monocytogenes (AUC) | P. aeruginosa (AUC) | S. typhimurium (AUC) | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Overlap: | 1% | 70% | 90% | 1% | 70% | 90% | 1% | 70% | 90% | 1% | 70% | 90% |
DeepRibo | 0.97 | 0.96 | 0.95 | 0.88 | 0.88 | 0.88 | 0.95 | 0.95 | 0.95 | 0.97 | 0.96 | 0.95 |
REPARATION_blast | 0.82 | 0.82 | 0.82 | 0.93 | 0.93 | 0.93 | 0.88 | 0.87 | 0.87 | 0.88 | 0.90 | 0.89 |
Ribo-TISH | 0.85 | 0.60 | 0.60 | 0.83 | 0.75 | 0.75 | 0.85 | 0.68 | 0.65 | 0.87 | 0.73 | 0.73 |
IRSOM | 0.67 | 0.67 | 0.67 | 0.78 | 0.78 | 0.78 | 0.68 | 0.68 | 0.68 | 0.68 | 0.69 | 0.69 |
SPECtre | 0.76 | 0.76 | 0.76 | — | — | — | 0.48 | 0.48 | 0.48 | 0.46 | 0.46 | 0.46 |
smORFer | 0.94 | 0.82 | 0.78 | — | — | — | — | — | — | — | — | — |
PRICE | 0.57 | 0.77 | 0.77 | 0.74 | 0.86 | 0.86 | 0.6 | 0.68 | 0.71 | 0.62 | 0.76 | 0.77 |
ribotricer | 0.61 | 0.61 | 0.61 | 0.75 | 0.75 | 0.75 | 0.69 | 0.69 | 0.69 | 0.62 | 0.63 | 0.63 |