Table 2. Overall performance of TBProfiler and Mykrobe measured in terms of sensitivity (sensi), specificity (speci), precision, and macro-accuracy (macro), defined as the average between sensitivity and specificity.
TBProfiler | Mykrobe | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Sensi | Speci | Precision | Macro | Thresh | Sensi | Speci | Precision | Macro | Thresh | |
Amikacin | 92.1 (89.3–94.9) | 87.9 (86–89.8) | 71.7 (67.6–75.8) | 90.0 | 0.00 | 82.6 (78.7–86.5) | 98.5 (97.8–99.2) | 94.7 (92.2–97.2) | 90.5 | 0.00 |
Capreomycin | 80.9 (76.8–85) | 95.9 (94.7–97.1) | 86.4 (82.7–90.1) | 88.4 | 0.10 | 78.3 (74–82.6) | 94 (92.6–95.4) | 80.7 (76.5–84.9) | 86.2 | 0.00 |
Ethambutol | 92.5 (90.6–94.4) | 92.5 (91.7–93.3) | 67.8 (65–70.6) | 92.5 | 0.25 | 87.5 (85.1–89.9) | 93.7 (93–94.4) | 70.1 (67.2–73) | 90.6 | 0.35 |
Ethionamide | 85.3 (80.8–89.8) | 61.5 (56.7–66.3) | 57.2 (52.1–62.3) | 73.4 | 0.10 | – | – | – | – | – |
Fluoroquinolones | 89 (85.7–92.3) | 95.8 (94.7–96.9) | 85.9 (82.3–89.5) | 92.4 | 0.00 | 85.1 (81.4–88.8) | 97.2 (96.3–98.1) | 89.6 (86.3–92.9) | 91.2 | 0.00 |
Isoniazid | 89.3 (87.8–90.8) | 97 (96.5–97.5) | 91.3 (89.9–92.7) | 93.2 | 0.30 | 88.5 (87–90) | 98.3 (97.9–98.7) | 94.8 (93.7–95.9) | 93.4 | 0.00 |
Kanamycin | 91.7 (88.8–94.6) | 95.7 (94.3–97.1) | 89.9 (86.7–93.1) | 93.7 | 0.00 | 81.7 (77.6–85.8) | 98 (97–99) | 94.5 (91.9–97.1) | 89.8 | 0.00 |
Pyrazinamide | 59.1 (53.9–64.3) | 97.1 (96–98.2) | 89.5 (85.5–93.5) | 78.1 | 0.25 | 34.4 (29.4–39.4) | 99.2 (98.6–99.8) | 94.4 (90.4–98.4) | 66.8 | 0.35 |
Rifampicin | 91.4 (89.8–93) | 98.3 (97.9–98.7) | 92.6 (91.1–94.1) | 94.8 | 0.20 | 92.4 (90.9–93.9) | 98.3 (97.9–98.7) | 92.8 (91.4–94.2) | 95.3 | 0.00 |
Streptomycin | 77.4 (74.8–80) | 91 (89.9–92.1) | 77.7 (75.1–80.3) | 84.2 | 0.30 | 81.4 (79–83.8) | 96.7 (96–97.4) | 91.1 (89.2–93) | 89.1 | 0.40 |
Note:
For each software and antibiotic, the minimum frequency threshold considered to call a marker present was chosen to maximize the macro-accuracy. 95% confidence intervals are provided for sensitivity, specificity, and precision.