Table 5.
Mean performance data of every variation of between 5 and 18 ER assays for the two ER models and how they compare to using the burst flag hit-call data in isolation. Values in parentheses are 95% confidence intervals. MCC – Matthews Correlation Coefficient.
| No. Assays | Burst Only | Burst AND Alert | Burst OR Alert | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sensitivity | Specificity | Accuracy | MCC | Sensitivity | Specificity | Accuracy | MCC | Sensitivity | Specificity | Accuracy | MCC | |
| 5 | 71 (54–81%) | 90 (84–96%) | 89 (83–94%) | 0.457 (0.379–0.554) | 55 (43–62%) | 97 (96–99%) | 94 (93–95%) | 0.545 (0.493–0.607) | 85 (79–90%) | 65 (61–70%) | 67 (63–71%) | 0.269 (0.245–0.291) |
| 6 | 73 (57–82%) | 89 (82–95%) | 88 (82–93%) | 0.447 (0.377–0.537) | 56 (46–63%) | 97 (95–99%) | 94 (93–95%) | 0.542 (0.496–0.597) | 86 (80–90%) | 64 (60–69%) | 66 (62–70%) | 0.268 (0.245–0.289) |
| 7 | 75 (60–83%) | 87 (82–95%) | 87 (81–92%) | 0.438 (0.374–0.523) | 58 (48–63%) | 97 (95–98%) | 94 (92–95%) | 0.538 (0.495–0.586) | 87 (81–90%) | 64 (59–69%) | 65 (61–70%) | 0.266 (0.245–0.288) |
| 8 | 77 (64–84%) | 86 (81–94%) | 86 (81–92%) | 0.429 (0.37–0.509) | 59 (50–63%) | 96 (95–98%) | 94 (92–95%) | 0.534 (0.495–0.577) | 88 (82–91%) | 63 (58–68%) | 64 (60–69%) | 0.265 (0.243–0.286) |
| 9 | 79 (66–84%) | 85 (80–93%) | 85 (80–91%) | 0.421 (0.368–0.494) | 60 (52–63%) | 96 (95–98%) | 93 (92–95%) | 0.530 (0.493–0.572) | 88 (84–91%) | 62 (58–68%) | 64 (60–69%) | 0.263 (0.241–0.285) |
| 10 | 80 (69–85%) | 84 (79–91%) | 84 (80–89%) | 0.414 (0.366–0.483) | 60 (53–63%) | 96 (95–97%) | 93 (92–94%) | 0.525 (0.493–0.567) | 89 (85–91%) | 61 (57–66%) | 63 (60–67%) | 0.260 (0.240–0.282) |
| 11 | 81 (72–85%) | 83 (79–89%) | 83 (79–88%) | 0.407 (0.364–0.472) | 61 (53–63%) | 95 (94–97%) | 93 (92–94%) | 0.521 (0.491–0.563) | 89 (85–91%) | 60 (57–65%) | 63 (60–67%) | 0.258 (0.239–0.280) |
| 12 | 82 (73–85%) | 82 (79–88%) | 82 (79–88%) | 0.401 (0.363–0.459) | 61 (55–63%) | 95 (94–97%) | 93 (92–94%) | 0.517 (0.491–0.557) | 89 (86–91%) | 60 (57–64%) | 62 (59–66%) | 0.256 (0.239–0.277) |
| 13 | 82 (75–85%) | 82 (79–87%) | 82 (79–87%) | 0.394 (0.362–0.446) | 62 (56–63%) | 95 (94–96%) | 93 (92–94%) | 0.513 (0.491–0.552) | 90 (88–91%) | 59 (57–64%) | 61 (59–65%) | 0.254 (0.238–0.275) |
| 14 | 83 (76–85%) | 81 (78–85%) | 81 (79–85%) | 0.389 (0.361–0.439) | 62 (56–63%) | 95 (94–96%) | 93 (92–94%) | 0.509 (0.489–0.544) | 90 (88–91%) | 59 (57–62%) | 61 (59–64%) | 0.253 (0.237–0.273) |
| 15 | 83 (80–85%) | 80 (78–85%) | 80 (79–84%) | 0.383 (0.361–0.431) | 62 (60–63%) | 95 (94–96%) | 92 (92–93%) | 0.504 (0.49–0.534) | 90 (88–91%) | 58 (57–61%) | 60 (59–63%) | 0.251 (0.238–0.268) |
| 16 | 84 (82–85%) | 79 (78–83%) | 80 (79–83%) | 0.378 (0.361–0.406) | 62 (62–63%) | 95 (94–95%) | 92 (92–93%) | 0.500 (0.49–0.529) | 90 (89–91%) | 58 (57–60%) | 60 (59–62%) | 0.249 (0.238–0.261) |
| 17 | 84 (83–85%) | 79 (78–81%) | 79 (79–81%) | 0.372 (0.362–0.4) | 63 (62–63%) | 94 (94–95%) | 92 (92–93%) | 0.500 (0.49–0.517) | 91 (89–91%) | 57 (57–59%) | 60 (59–61%) | 0.248 (0.241–0.258) |
| 18 | 85 | 78 | 79 | 0.368 | 63 | 94 | 92 | 0.491 | 91 | 57 | 59 | 0.246 |