Table 2. Benchmark of the abilities of classifiers to distinguish different ions from one another in the blind, curated test set.
Shown here are the unmodified decision-tree algorithm as well as SVMs trained on the curated training set using all features of a site and the same SVM with a simple filter applied to the predictions. The pairs of numbers for each SVM and ion pair indicate the number of correct identifications of the first and second ion, respectively.
Total sites | Decision tree | All features | All features (filtered predictions) | ||||||
---|---|---|---|---|---|---|---|---|---|
Ion 1 | Ion 2 | Ion 1 | Ion 2 | Ion 1 | Ion 2 | Ion 1 | Ion 2 | Ion 1 | Ion 2 |
Ca2+ | Mn2+ | 108 | 70 | 60, 0 | 31, 2 | 86, 9 | 59, 8 | 84, 5 | 61, 10 |
Ca2+ | Fe2+/3+ | 108 | 17 | 60, 0 | 9, 0 | 92, 0 | 17, 0 | 90, 0 | 14, 1 |
Ca2+ | Ni2+ | 108 | 49 | 60, 0 | 32, 0 | 91, 0 | 48, 1 | 90, 0 | 38, 2 |
Ca2+ | Zn2+ | 108 | 64 | 60, 0 | 47, 0 | 92, 0 | 60, 0 | 90, 0 | 52, 1 |
Mn2+ | Fe2+/3+ | 70 | 17 | 11, 1 | 6, 0 | 51, 2 | 15, 17 | 50, 2 | 12, 16 |
Mn2+ | Ni2+ | 70 | 49 | 22, 0 | 28, 0 | 52, 2 | 46, 16 | 51, 7 | 36, 15 |
Mn2+ | Zn2+ | 70 | 64 | 26, 0 | 33, 0 | 46, 3 | 57, 22 | 45, 5 | 50, 21 |
Fe2+/3+ | Ni2+ | 17 | 49 | 2, 0 | 27, 0 | 11, 5 | 43, 6 | 8, 9 | 33, 6 |
Fe2+/3+ | Zn2+ | 17 | 64 | 2, 0 | 35, 1 | 11, 2 | 58, 6 | 9, 3 | 50, 5 |
Ni2+ | Zn2+ | 49 | 64 | 1, 0 | 24, 0 | 18, 5 | 55, 30 | 17, 3 | 49, 21 |
Total true positives | 569 | 1008 | 929 | ||||||
Total false positives | 4 | 134 | 132 |