Table 3.
MNIST with MR | Model | Classification Accuracy |
TNR at TPR 95% |
AUROC | Detection Accuracy |
AUPR In |
AUPR Out |
---|---|---|---|---|---|---|---|
MR = 0.1 | BBP | 88.76 ± 1.73 | 33.17 ± 5.09 | 87.77 ± 2.03 | 83.75 ± 2.32 | 85.85 ± 3.21 | 94.02 ± 3.42 |
MC-dropout | 98.90 ± 0.06 | 88.66 ± 0.04 | 96.22 ± 0.04 | 92.18 ± 0.02 | 89.23 ± 0.05 | 98.44 ± 0.03 | |
ConvCNPs–SDE-Net | 99.32 ± 0.06 | 98.69 ± 0.04 | 99.68 ± 0.00 | 97.99 ± 0.02 | 99.01 ± 0.01 | 99.89 ± 0.00 | |
SDE-Net | 98.87 ± 0.06 | 99.40 ± 0.03 | 99.86 ± 0.01 | 98.82 ± 0.04 | 99.61 ± 0.02 | 99.94 ± 0.01 | |
MR = 0.3 | BBP | 78.37 ± 3.10 | 24.90 ± 3.12 | 82.06 ± 4.12 | 74.46 ± 2.27 | 73.86 ± 2.15 | 90.22 ± 2.30 |
MC-dropout | 93.47 ± 0.06 | 50.10 ± 0.06 | 92.01 ± 0.03 | 86.84 ± 0.06 | 84.68 ± 0.03 | 95.75 ± 0.05 | |
ConvCNPs–SDE-Net | 98.94 ± 0.07 | 99.04 ± 0.04 | 99.78 ± 0.01 | 98.27 ± 0.06 | 99.34 ± 0.03 | 99.92 ± 0.01 | |
SDE-Net | 94.98 ± 0.19 | 99.47 ± 0.02 | 99.70 ± 0.03 | 98.96 ± 0.03 | 99.51 ± 0.06 | 99.82 ± 0.04 | |
MR = 0.5 | BBP | 52.50 ± 4.15 | 16.70 ± 2.10 | 70.47 ± 3.12 | 78.37 ± 3.10 | 54.43 ± 3.34 | 84.60 ± 2.12 |
MC-dropout | 75.88 ± 0.10 | 21.72 ± 0.09 | 81.64 ± 0.09 | 75.87 ± 0.06 | 70.73 ± 0.04 | 89.60 ± 0.05 | |
ConvCNPs–SDE-Net | 97.45 ± 0.17 | 98.58 ± 0.03 | 99.70 ± 0.01 | 98.15 ± 0.05 | 99.17 ± 0.02 | 99.87 ± 0.01 | |
SDE-Net | 80.54 ± 0.36 | 99.17 ± 0.05 | 98.45 ± 0.08 | 97.26 ± 0.04 | 98.06 ± 0.05 | 98.96 ± 0.07 | |
MR = 0.7 | BBP | 23.71 ± 4.11 | 17.40 ± 2.23 | 66.36 ± 3.12 | 61.91 ± 3.23 | 43.01 ± 2.44 | 83.18 ± 2.23 |
MC-dropout | 46.48 ± 0.10 | 12.16 ± 0.16 | 70.32 ± 0.11 | 65.67 ± 0.16 | 53.76 ± 0.21 | 83.06 ± 0.15 | |
ConvCNPs–SDE-Net | 88.96 ± 0.33 | 97.45 ± 0.06 | 99.20 ± 0.03 | 97.47 ± 0.07 | 98.03 ± 0.04 | 99.62 ± 0.03 | |
SDE-Net | 49.25 ± 0.11 | 45.25 ± 1.36 | 93.53 ± 0.13 | 90.68 ± 0.15 | 92.36 ± 0.16 | 95.68 ± 0.12 | |
MR = 0.9 | BBP | 10.08 ± 1.14 | 54.34 ± 2.34 | 84.13 ± 4.34 | 77.78 ± 1.44 | 59.63 ± 2.33 | 93.72 ± 1.34 |
MC-dropout | 17.15 ± 0.54 | 8.41 ± 0.44 | 60.38 ± 0.35 | 57.66 ± 0.34 | 38.11 ± 0.24 | 77.82 ± 0.36 | |
ConvCNPs–SDE-Net | 36.54 ± 0.58 | 79.72 ± 0.65 | 96.20 ± 0.06 | 93.82 ± 0.14 | 92.86 ± 0.16 | 97.81 ± 0.08 | |
SDE-Net | 14.56 ± 0.34 | 10.30 ± 0.49 | 71.82 ± 0.25 | 67.83 ± 0.18 | 64.34 ± 0.30 | 82.80 ± 0.23 | |
MR = RMR | BBP | 36.90 ± 10.56 | 26.37 ± 3.63 | 73.05 ± 2.26 | 67.85 ± 1.62 | 51.52 ± 2.56 | 87.43 ± 1.22 |
MC-dropout | 42.97 ± 1.60 | 11.26 ± 2.41 | 69.34 ± 1.43 | 64.95 ± 1.20 | 53.56 ± 2.62 | 82.43 ± 1.12 | |
ConvCNPs–SDE-Net | 68.90 ± 11.66 | 95.72 ± 1.60 | 97.89 ± 0.85 | 95.91 ± 0.96 | 95.70 ± 1.67 | 98.89 ± 0.45 | |
SDE-Net | 45.34 ± 13.66 | 22.73 ± 7.30 | 86.24 ± 5.13 | 83.25 ± 5.82 | 83.74 ± 6.71 | 91.00 ± 3.11 |