Table 4. Smartphone classification and performance bias analysis of binary cough model.
The classification results are represented for different demographic, clinical, and TB presentations in T1 dataset. Table S6 represents aggregated result from multiple folds using bootstrapping.
| Category | Subcategory | ROC-AUC score (average of 5 folds ± SD across folds) |
Sensitivity (average of 5 folds ± SD across folds, threshold = 0.5) |
Specificity (average of 5 folds ± SD across folds, threshold = 0.5) |
Sensitivity @70% speci ficity (average of 5 folds ± SD across folds) |
Combined ROC- AUC score of 5 folds (average after combin ing results from all 5 folds (DeLong’s CI) |
|
|---|---|---|---|---|---|---|---|
| Overall model device: Smartphone Scalogram: 10 Hz to 4 kHz Sampling rate: 44.1 kHz |
All inclusive | – | 0.83 ± 0.11 | 0.76 ± 0.12 | 0.74 ± 0.10 | 0.76 ± 0.20 | 0.85 (0.84–0.85) |
| Demographic bias | Gender | Male | 0.87 ± 0.15 | 0.85 ± 0.14 | 0.72 ± 0.13 | 0.84 ± 0.25 | 0.89 (0.89–0.90) |
| Female | 0.78 ± 0.12 | 0.56 ± 0.13 | 0.81 ± 0.14 | 0.70 ± 0.23 | 0.76 (0.74–0.78) | ||
| Age group | (18,40) | 0.80 ± 0.15 | 0.74 ± 0.16 | 0.71 ± 0.14 | 0.70 ± 0.25 | 0.85 (0.84–0.86) | |
| (40,60) | 0.87 ± 0.11 | 0.81 ± 0.12 | 0.78 ± 0.16 | 0.86 ± 0.16 | 0.83 (0.81–0.84) | ||
| Clinical bias | HIV history | No HIV history | 0.82 ± 0.10 | 0.74 ± 0.13 | 0.72 ± 0.13 | 0.77 ± 0.17 | 0.84 (0.83–0.85) |
| With HIV history | 0.92 ± 0.08 | 0.89 ± 0.07 | 0.81 ± 0.17 | 0.90 ± 0.10 | 0.91 (0.90–0.93) | ||
| Smoking history | No smoking history |
0.80 ± 0.10 | 0.71 ± 0.11 | 0.73 ± 0.10 | 0.72 ± 0.18 | 0.81 (0.80–0.83) | |
| With smoking history |
0.87 ± 0.17 | 0.83 ± 0.15 | 0.81 ± 0.18 | 0.83 ± 0.27 | 0.90 (0.89–0.91) | ||
| TB presentations | GeneXpert | Low bacterial load |
0.69 ± 0.12 | 0.52 ± 0.22 | 0.74 ± 0.1 | 0.58 ± 0.24 | 0.74 (0.73–0.76) |
| High bacterial load |
0.86 ± 0.12 | 0.82 ± 0.13 | 0.74 ± 0.1 | 0.82 ± 0.21 | 0.87 (0.87–0.88) | ||
| Sputum smear | Low bacterial load | 0.84 ± 0.15 | 0.76 ± 0.21 | 0.74 ± 0.1 | 0.78 ± 0.23 | 0.85 (0.83–0.87) | |
| High bacterial load |
0.85 ± 0.11 | 0.79 ± 0.12 | 0.74 ± 0.1 | 0.80 ± 0.21 | 0.86 (0.85–0.87) | ||
| Lung cavity | No cavity | 0.71 ± 0.05 | 0.52 ± 0.1 | 0.74 ± 0.1 | 0.56 ± 0.13 | 0.71 (0.69–0.72) | |
| With cavity | 0.86 ± 0.12 | 0.83 ± 0.12 | 0.74 ± 0.1 | 0.83 ± 0.21 | 0.89 (0.88–0.89) |