Table 2.
Model Training Set | Test set | AUROC | AUPRC | Sensitivity | Specificity |
---|---|---|---|---|---|
| |||||
North America | North America | 0.99 | 0.98 | 94% | 96% |
North America | Nepal | 0.96 | 0.88 | 52% | 99% |
Nepal | North America | 0.62 | 0.36 | 44% | 69% |
Nepal | Nepal | 0.97 | 0.91 | 73% | 99% |
North America + Nepal | North America | 0.99 | 0.98 | 98% | 96% |
North America + Nepal | Nepal | 0.98 | 0.92 | 82% | 99% |
AUROC, AUPRC, sensitivity, and specificity of all 3 models evaluated on the North American and Nepali test sets are reported. The model trained on both datasets resulted in slightly increased performance compared to models trained on individual datasets, most notably seen in sensitivity. For example, sensitivity increased from 94% when trained on North American data alone to 98% and from 73% when trained on Nepali data alone to 82%.