Table 2.
Area under the curve (AUC), accuracy, sensitivity, specificity, and Brier scores of predicting AKI onset using data from individual days and all 4 days before AKI onset, (A) without and (B) with comorbidities and demographic data from the Montefiore health system test dataset. (C) performance indices of the Stony Brook Hospital testing dataset.
(A) Without comorbidities and demographic data | |||||
---|---|---|---|---|---|
AUC | Accuracy | Sensitivity | Specificity | Brier Score | |
Day −3 | 0.75 ± 0.01 | 65.05 ± 1.92% | 0.75 ± 0.03 | 0.61 ± 0.03 | 0.21 ± 0.01 |
Day −2 | 0.82 ± 0.01 | 73.94 ± 1.22% | 0.57 ± 0.05 | 0.87 ± 0.01 | 0.17 ± 0.01 |
Day −1 | 0.75 ± 0.01 | 69.47 ± 0.33% | 0.64 ± 0.02 | 0.78 ± 0.03 | 0.20 ± 0.01 |
Day 0 | 0.79 ± 0.01 | 66.61 ± 0.03% | 0.64 ± 0.03 | 0.81 ± 0.03 | 0.19 ± 0.01 |
All time points | 0.956 ± 0.005 | 87.98 ± 1.75% | 0.88 ± 0.05 | 0.87 ± 0.05 | 0.09 ± 0.01 |
(B) With comorbidities and demographic data | |||||
---|---|---|---|---|---|
Day −3 | 0.77 ± 0.01 | 69.10 ± 1.24% | 0.68 ± 0.03 | 0.70 ± 0.02 | 0.20 ± 0.01 |
Day −2 | 0.84 ± 0.01 | 76.46 ± 0.43% | 0.68 ± 0.03 | 0.82 ± 0.03 | 0.17 ± 0.01 |
Day −1 | 0.80 ± 0.01 | 70.53 ± 1.29% | 0.65 ± 0.04 | 0.79 ± 0.04 | 0.19 ± 0.01 |
Day 0 | 0.83 ± 0.01 | 65.45 ± 1.05% | 0.63 ± 0.02 | 0.82 ± 0.01 | 0.19 ± 0.01 |
All time points | 0.965 ± 0.003 | 89.57 ± 1.64% | 0.95 ± 0.03 | 0.84 ± 0.05 | 0.08 ± 0.01 |
(C) Stony Brook Hospital data prediction performance | |||||
---|---|---|---|---|---|
All time points | 0.83 ± 0.03 | 78.93 ± 2.74% | 0.73 ± 0.09 | 0.80 ± 0.05 | 0.16 ± 0.01 |
All time points + comorbidities and demographics | 0.86 ± 0.01 | 83.66 ± 2.53% | 0.66 ± 0.10 | 0.89 ± 0.03 | 0.12 ± 0.01 |