TABLE 4.
Performance metrics of the final risk model applied to the replication cohort. Sensitivity = number predicted to have disease, as a proportion of those with actual disease; Specificity = number predicted to have no disease, as a proportion of those with no actual disease; Precision = number with actual disease, as a proportion of those predicted to have disease; Misclassification/error rate = number of false positive and false negatives, as a proportion of the grand total; Accuracy = number of true positives and true negatives, as a proportion of the grand total; F1 score = harmonic mean of precision and sensitivity [possible range 0.0–1.0]; AUC = area under the curve, an overall measure of model performance [possible range 0.5–1.0].
Value | 95% Confidence Interval | P-Value | |
---|---|---|---|
Sensitivity | 0.786 | 0.723, 0.842 | << 0.0001 |
Specificity | 0.724 | 0.706, 0.741 | << 0.0001 |
Precision | 0.179 | 0.154, 0.206 | << 0.0001 |
Error Rate | 0.272 | 0.255, 0.289 | << 0.0001 |
Accuracy | 0.728 | 0.711, 0.745 | << 0.0001 |
F1 score | 0.291 | 0.256, 0.326 | << 0.0001 |
AUC | 0.755 | 0.725, 0.785 | << 0.0001 |