Table 1. Mutation extraction systems evaluation on existing corpora.
The results in precision, recall and F1 measure are obtained from already published studies or the tool website like SETH. A dash(-) is used to indicate that no results are available. The tools are MutationFinder (MF), OpenMutationMiner (OMM), Extractor of Mutations (EMU), tmVar and SNP Extraction Tool for Human Variations (SETH). The corpora used for evaluation are MutationFinder corpora (MF), OpenMutationMiner corpora (OMM), EMU Prostate Cancer set (PCa), the tmVar corpora, the OSIRIS corpora and the corpora made available by Thomas et al. 24 (Thomas).
| Corpus | |||||||
|---|---|---|---|---|---|---|---|
| Tool | Performance
measure |
MF | OMM | PCa | tmVar | Osiris | Thomas |
| MF | P
R F |
0.98
0.82 0.89 |
-
- - |
-
- - |
-
- - |
-
- - |
-
- - |
| OMM | P
R F |
-
- - |
0.99
0.96 0.97 |
-
- - |
-
- - |
-
- - |
-
- - |
| EMU | P
R F |
0.99
0.81 0.89 |
-
- - |
0.92
0.92 0.92 |
-
- - |
-
- - |
-
- - |
| tmVar | P
R F |
0.99
0.90 0.94 |
-
- - |
-
- - |
0.91
0.91 0.91 |
-
- - |
-
- - |
| SETH | P
R F |
0.97
0.83 0.89 |
-
- - |
-
- - |
0.94
0.81 0.87 |
0.98
0.85 0.91 |
0.95
0.58 0.72 |