Table 1.
Performance increase by using BOTM after an initial spike sorting on benchmark 3 (Q)
| Method: | Wave_clus | Correct templates + BOTM | Correct templates + BOTM + SIC | Wave_clus + BOTM + SIC | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Error type: | Det | Class | Total | Det | Class | Total | Det | Class | Total | Det | Class | Total | |
| Name | Noise | ||||||||||||
| Easy 1 | 0.05 | 921 (73.8) | 1 (100.0) | 922 (86.9) | 76 (97.8) | 2 (99.9) | 78 (98.9) | 13 (99.6) | 4 (99.9) | 17 (99.8) | 11 (99.7) | 2 (99.9) | 13 (99.8) |
| 0.10 | 236 (93.3) | 5 (99.9) | 241 (96.6) | 45 (98.7) | 3 (99.9) | 48 (99.3) | 5 (99.9) | 2 (99.9) | 7 (99.9) | 4 (99.9) | 2 (99.9) | 6 (99.9) | |
| 0.15 | 374 (89.2) | 5 (99.9) | 379 (94.5) | 59 (98.3) | 5 (99.9) | 64 (99.1) | 5 (99.9) | 0 (100.0) | 5 (99.9) | 8 (99.8) | 0 (100.0) | 8 (99.9) | |
| 0.20 | 999 (71.2) | 12 (99.7) | 1011 (85.4) | 61 (98.2) | 9 (99.7) | 70 (99.0) | 9 (99.7) | 3 (99.9) | 12 (99.8) | 9 (99.7) | 3 (99.9) | 12 (99.8) | |
| Easy 2 | 0.05 | 174 (94.9) | 3 (99.9) | 177 (97.4) | 51 (98.5) | 19 (99.4) | 70 (99.0) | 2 (99.9) | 1 (100.0) | 3 (100.0) | 2 (99.9) | 2 (99.9) | 4 (99.9) |
| 0.10 | 193 (94.5) | 10 (99.7) | 203 (97.1) | 39 (98.9) | 21 (99.4) | 60 (99.1) | 7 (99.8) | 1 (100.0) | 8 (99.9) | 6 (99.8) | 2 (99.9) | 8 (99.9) | |
| 0.15 | 184 (94.6) | 45 (98.7) | 229 (96.6) | 43 (98.7) | 36 (98.9) | 79 (98.8) | 4 (99.9) | 2 (99.9) | 6 (99.9) | 4 (99.9) | 6 (99.8) | 10 (99.9) | |
| 0.20 | 637 (81.9) | 306 (91.3) | 943 (86.6) | 85 (97.6) | 93 (97.4) | 178 (97.5) | 6 (99.8) | 2 (99.9) | 8 (99.9) | 6 (99.8) | 7 (99.8) | 13 (99.8) | |
| Difficult 1 | 0.05 | 274 (91.9) | 0 (100.0) | 274 (96.0) | 37 (98.9) | 17 (99.5) | 54 (99.2) | 3 (99.9) | 17 (99.5) | 20 (99.7) | 2 (99.9) | 18 (99.5) | 20 (99.7) |
| 0.10 | 201 (94.2) | 41 (98.8) | 242 (96.5) | 39 (98.9) | 50 (98.5) | 89 (98.7) | 18 (99.5) | 11 (99.7) | 29 (99.6) | 18 (99.5) | 12 (99.7) | 30 (99.6) | |
| 0.15 | 217 (93.8) | 81 (97.7) | 298 (95.7) | 46 (98.7) | 132 (96.2) | 178 (97.4) | 11 (99.7) | 17 (99.5) | 28 (99.6) | 9 (99.7) | 17 (99.5) | 26 (99.6) | |
| 0.20 | 405 (88.1) | 651 (80.9) | 1056 (84.5) | 45 (98.7) | 278 (91.9) | 323 (95.3) | 19 (99.4) | 10 (99.7) | 29 (99.6) | 20 (99.4) | 10 (99.7) | 30 (99.6) | |
| Difficult 2 | 0.05 | 183 (94.6) | 1 (100.0) | 184 (97.3) | 45 (98.7) | 34 (99.0) | 79 (98.8) | 9 (99.7) | 8 (99.8) | 17 (99.7) | 8 (99.8) | 9 (99.7) | 17 (99.7) |
| 0.10 | 157 (95.5) | 8 (99.8) | 165 (97.6) | 33 (99.0) | 38 (98.9) | 71 (99.0) | 4 (99.9) | 7 (99.8) | 11 (99.8) | 5 (99.9) | 9 (99.7) | 14 (99.8) | |
| 0.15 | 193 (94.4) | 443 (87.1) | 636 (90.8) | 51 (98.5) | 153 (95.6) | 204 (97.0) | 5 (99.9) | 8 (99.8) | 13 (99.8) | 8 (99.8) | 9 (99.7) | 17 (99.8) | |
| 0.20 | 492 (85.9) | 1462 (58.1) | 1954 (72.0) | 104 (97.0) | 386 (88.9) | 490 (93.0) | 7 (99.8) | 14 (99.6) | 21 (99.7) | 36 (99.0) | 1124 (67.8) | 1160 (83.4) | |
| Total | 5840 (89.4) | 3074 (94.4) | 8914 (83.9) | 859 (98.4) | 1276 (97.7) | 2135 (96.1) | 127 (99.8) | 107 (99.8) | 234 (99.6) | 156 (99.7) | 1232 (97.8) | 1388 (97.5) | |
Numbers indicate absolute numbers of respective errors, numbers in brackets indicate performance as defined for benchmark 1 (Q) in percent, rounded to one decimal digit. Spike sorting errors for “Wave_clus” as reported in reported in (Quiroga et al. 2004) (leftmost columns), the proposed methods BOTM (center-left columns), BOTM with subtractive overlap resolution (SIC) (center-right columns, and BOTM + SIC on using the result of “Wave_clus” as an initialization (rightmost columns), are given. “Det” are detection errors, “Class” classification errors and “Total” their sum. Values in column “Noise” indicate the standard deviation of the noise relative to the peak of the templates. For “Wave_clus” the errors were estimated independently for detection and classification. Classification errors were computed using all spikes in the data. Thus, spikes that were not detected were still used for the classification task. For BOTM the spike detection and classification were done in the same step without using the ground truth to align the spikes. Spikes that were not detected were also not classified. On the dataset “Difficult 2, 0.20” “Wave_clus“found only 2 of the three units. This is reflected in higher error rates for “Wave_clus + BOTM + SIC” since one template was missing for the template matching