Skip to main content
. 2021 May 26;21(11):3708. doi: 10.3390/s21113708

Table 3.

OOD detection results of the BBP, MC-dropout, ConvCNPs–SDE, and SDE-Net models on ID dataset MNIST with MR = [0.1, 0.3, 0.5, 0.7, 0.9, RMR] and OOD dataset SVHN.

MNIST with MR Model Classification
Accuracy
TNR at
TPR 95%
AUROC Detection
Accuracy
AUPR
In
AUPR
Out
MR = 0.1 BBP 88.76 ± 1.73 33.17 ± 5.09 87.77 ± 2.03 83.75 ± 2.32 85.85 ± 3.21 94.02 ± 3.42
MC-dropout 98.90 ± 0.06 88.66 ± 0.04 96.22 ± 0.04 92.18 ± 0.02 89.23 ± 0.05 98.44 ± 0.03
ConvCNPs–SDE-Net 99.32 ± 0.06 98.69 ± 0.04 99.68 ± 0.00 97.99 ± 0.02 99.01 ± 0.01 99.89 ± 0.00
SDE-Net 98.87 ± 0.06 99.40 ± 0.03 99.86 ± 0.01 98.82 ± 0.04 99.61 ± 0.02 99.94 ± 0.01
MR = 0.3 BBP 78.37 ± 3.10 24.90 ± 3.12 82.06 ± 4.12 74.46 ± 2.27 73.86 ± 2.15 90.22 ± 2.30
MC-dropout 93.47 ± 0.06 50.10 ± 0.06 92.01 ± 0.03 86.84 ± 0.06 84.68 ± 0.03 95.75 ± 0.05
ConvCNPs–SDE-Net 98.94 ± 0.07 99.04 ± 0.04 99.78 ± 0.01 98.27 ± 0.06 99.34 ± 0.03 99.92 ± 0.01
SDE-Net 94.98 ± 0.19 99.47 ± 0.02 99.70 ± 0.03 98.96 ± 0.03 99.51 ± 0.06 99.82 ± 0.04
MR = 0.5 BBP 52.50 ± 4.15 16.70 ± 2.10 70.47 ± 3.12 78.37 ± 3.10 54.43 ± 3.34 84.60 ± 2.12
MC-dropout 75.88 ± 0.10 21.72 ± 0.09 81.64 ± 0.09 75.87 ± 0.06 70.73 ± 0.04 89.60 ± 0.05
ConvCNPs–SDE-Net 97.45 ± 0.17 98.58 ± 0.03 99.70 ± 0.01 98.15 ± 0.05 99.17 ± 0.02 99.87 ± 0.01
SDE-Net 80.54 ± 0.36 99.17 ± 0.05 98.45 ± 0.08 97.26 ± 0.04 98.06 ± 0.05 98.96 ± 0.07
MR = 0.7 BBP 23.71 ± 4.11 17.40 ± 2.23 66.36 ± 3.12 61.91 ± 3.23 43.01 ± 2.44 83.18 ± 2.23
MC-dropout 46.48 ± 0.10 12.16 ± 0.16 70.32 ± 0.11 65.67 ± 0.16 53.76 ± 0.21 83.06 ± 0.15
ConvCNPs–SDE-Net 88.96 ± 0.33 97.45 ± 0.06 99.20 ± 0.03 97.47 ± 0.07 98.03 ± 0.04 99.62 ± 0.03
SDE-Net 49.25 ± 0.11 45.25 ± 1.36 93.53 ± 0.13 90.68 ± 0.15 92.36 ± 0.16 95.68 ± 0.12
MR = 0.9 BBP 10.08 ± 1.14 54.34 ± 2.34 84.13 ± 4.34 77.78 ± 1.44 59.63 ± 2.33 93.72 ± 1.34
MC-dropout 17.15 ± 0.54 8.41 ± 0.44 60.38 ± 0.35 57.66 ± 0.34 38.11 ± 0.24 77.82 ± 0.36
ConvCNPs–SDE-Net 36.54 ± 0.58 79.72 ± 0.65 96.20 ± 0.06 93.82 ± 0.14 92.86 ± 0.16 97.81 ± 0.08
SDE-Net 14.56 ± 0.34 10.30 ± 0.49 71.82 ± 0.25 67.83 ± 0.18 64.34 ± 0.30 82.80 ± 0.23
MR = RMR BBP 36.90 ± 10.56 26.37 ± 3.63 73.05 ± 2.26 67.85 ± 1.62 51.52 ± 2.56 87.43 ± 1.22
MC-dropout 42.97 ± 1.60 11.26 ± 2.41 69.34 ± 1.43 64.95 ± 1.20 53.56 ± 2.62 82.43 ± 1.12
ConvCNPs–SDE-Net 68.90 ± 11.66 95.72 ± 1.60 97.89 ± 0.85 95.91 ± 0.96 95.70 ± 1.67 98.89 ± 0.45
SDE-Net 45.34 ± 13.66 22.73 ± 7.30 86.24 ± 5.13 83.25 ± 5.82 83.74 ± 6.71 91.00 ± 3.11