Table 3. Results from published P300 papers reevaluated using different metrics.
| Study | Method | ACC | SR | ITR | WSR | PBR | CPM | OCM | MI0 | MI2 | MI2e |
| Kaper (22) | inner | 54.38 | 13.85 | 25.21 | 0.13 | 9.41 | 1.82 | * | 21.13 | 12.94 | 18.06 |
| outer | 47.88 | 9.70 | 14.47 | 0.23 | 3.10 | 0.60 | * | 12.21 | 7.51 | 11.59 | |
| Serby (11) | ML | 90.02 | 3.66 | 15.79 | 2.45 | 15.54 | 3.01 | * | 12.63 | 7.49 | 7.77 |
| ICA | 92.12 | 4.56 | 19.88 | 3.13 | 19.66 | 3.80 | * | 15.90 | 9.43 | 9.74 | |
| online | 79.53 | 3.89 | 13.77 | 1.72 | 12.35 | 2.39 | * | 11.11 | 6.64 | 7.27 | |
| Blankertz (16) | * | * | * | * | * | * | 4.88 | 19.95 | 11.73 | 11.73 | |
| Sellers (6) | 3×3,175 | 61.25 | 3.87 | 4.53 | 0.32 | 3.99 | 1.26 | * | 2.43 | 1.58 | 1.82 |
| 3×3,350 | 69.38 | 2.31 | 3.19 | 0.10 | 2.83 | 0.89 | * | 1.70 | 1.11 | 1.21 | |
| 6×6,175 | 53.75 | 2.31 | 4.50 | 0.26 | 2.68 | 0.52 | * | 3.72 | 2.26 | 3.10 | |
| 6×6,350 | 48.13 | 1.28 | 1.93 | 0.00 | 0.08 | 0.02 | * | 1.64 | 1.01 | 1.54 | |
| Furdea (14) | auditory | 88.08 | 1.15 | 4.66 | 0.91 | 4.65 | 1.00 | * | 3.59 | 2.22 | 2.26 |
| visual | 98.08 | 3.54 | 15.75 | 3.24 | 15.79 | 3.40 | * | 12.15 | 7.46 | 7.49 | |
| Ceocetti (17) | 92.25 | 19.64 | 35.34 | * | * | * | 5.51 | 22.54 | 13.25 | 13.25 | |
| Townsend (3) | cb72 | 91.52 | 4.33 | 23.01 | 3.12 | 22.45 | 3.64 | * | 15.67 | 9.25 | 9.28 |
| rc72 | 77.34 | 4.64 | 19.70 | 2.07 | 16.51 | 2.68 | * | 13.68 | 8.12 | 8.59 | |
| Jin (4) | 9-P | 87.33 | 5.82 | 29.32 | 3.35 | 27.14 | 4.25 | * | 18.65 | 11.09 | 11.09 |
| 12-P | 88.00 | 5.40 | 27.49 | 3.20 | 25.97 | 4.06 | * | 17.48 | 10.39 | 10.39 | |
| 14-P | 93.26 | 3.77 | 20.93 | 2.78 | 20.55 | 3.21 | * | 13.34 | 7.90 | 7.90 | |
| 16-P | 93.23 | 5.26 | 29.14 | 3.85 | 28.36 | 4.44 | * | 18.58 | 11.00 | 11.00 | |
| 19-P | 93.99 | 4.70 | 26.39 | 3.56 | 25.86 | 4.05 | * | 16.83 | 9.96 | 9.96 | |
| Ryan (12) | PS | 84.92 | 3.78 | 17.85 | 2.03 | 16.46 | 2.67 | 5.28 | 21.64 | 12.71 | 12.71 |
| NS | 89.80 | 3.74 | 19.28 | 2.51 | 18.52 | 3.00 | 3.12 | 12.79 | 7.51 | 7.51 | |
| Schreuder (15) | S1 | 87.99 | 2.08 | 3.75 | * | * | * | 0.62 | 2.54 | 1.49 | 1.49 |
| S2a | 86.16 | 3.05 | 5.27 | * | * | * | 0.91 | 3.71 | 2.18 | 2.18 | |
| S2b | 86.07 | 2.96 | 5.26 | * | * | * | 0.94 | 3.83 | 2.25 | 2.25 | |
| Speier (13) | Static | 82.97 | 5.91 | 22.06 | 2.65 | 20.24 | 3.91 | * | 17.78 | 10.60 | 11.42 |
| Dynamic | 89.63 | 6.45 | 27.38 | 4.14 | 26.61 | 5.15 | * | 21.92 | 13.00 | 13.55 | |
| NLP | 92.59 | 7.31 | 33.15 | 5.51 | 32.91 | 6.37 | * | 26.44 | 15.65 | 16.05 |
Bold numbers refer to the leading method using that metric and bold method names refer to the results found in the original publication. Asterisks denote methods that cannot be computed for the target system.
*
method cannot be computed for the target system