Skip to main content
. 2024 Dec 31;7:384. doi: 10.1038/s41746-024-01403-2

Table 3.

Non-NPC diagnosis performance (Average, standard deviation and 95% CI) of various models

Model AH AR
Precision Sensitivity Specificity F1-score Precision Sensitivity Specificity F1-score
SwinT 0.9922 (±0.0036) (0.9851–0.9993) 0.9869 (±0.0080) (0.9712–1.0000) 0.9989 (±0.0005) (0.9979–0.9999) 0.9895 (±0.0023) (0.9850–0.9940) 0.8599 (±0.0329) (0.7954–0.9244) 0.7951 (±0.0307) (0.7349–0.8553) 0.9873 (±0.0035) (0.9804–0.9942) 0.8256 (±0.0169) (0.7925–0.8587)
MaxViT 0.9877 (±0.0099) (0.9683–1.0000) 0.9863 (±0.0167) (0.9536–1.0000) 0.9983 (±0.0014) (0.9956–1.0000) 0.9869 (±0.0073) (0.9726–1.0000) 0.8774 (±0.0176) (0.8429–0.9119) 0.7068 (±0.0393) (0.6298–0.7838) 0.9904 (±0.0016) (0.9873–0.9935) 0.7824 (±0.0255) (0.7324–0.8324)
PoolF 0.9922 (±0.0037) (0.9849–0.9995) 0.9928 (±0.0043) (0.9844–1.0000) 0.9989 (±0.0005) (0.9979–0.9999) 0.9925 (±0.0038) (0.9851–0.9999) 0.8448 (±0.0346) (0.7770–0.9126) 0.8218 (±0.0365) (0.7503–0.8933) 0.9851 (±0.0044) (0.9765–0.9937) 0.8321 (±0.0133) (0.8060–0.8582)
CaiT 0.9889 (±0.0059) (0.9773–1.0000) 0.9909 (±0.0036) (0.9838–0.9980) 0.9985 (±0.0008) (0.9969–1.0000) 0.9899(±0.0042)(0.9817–0.9981) 0.8211 (±0.0569) (0.7096–0.9326) 0.7994 (±0.0439) (0.7134–0.8854) 0.9825 (±0.0076) (0.9676–0.9974) 0.8076 (±0.0117) (0.7847–0.8305)
ResNet 0.9800 (±0.0085) (0.9633–0.9967) 0.9869 (±0.0066) (0.9740–0.9998) 0.9973 (±0.0012) (0.9949–0.9997) 0.9834 (±0.0046) (0.9744–0.9924) 0.8366 (±0.0230) (0.7915–0.8817) 0.7067 (±0.0599) (0.5893–0.8241) 0.9865 (±0.0028) (0.9810–0.9920) 0.7648 (±0.0340) (0.6982–0.8314)
DenseNet 0.9871 (±0.0163) (0.9552–1.0000) 0.9882 (±0.0037) (0.9809–0.9955) 0.9982 (±0.0023) (0.9937–1.0000) 0.9876 (±0.0095) (0.9690–1.0000) 0.8414 (±0.0311) (0.7804–0.9024) 0.7406 (±0.0476) (0.6473–0.8339) 0.9863 (±0.0038) (0.9789–0.9937) 0.7864 (±0.0219) (0.7435–0.8293)
Xception 0.9928 (±0.0054) (0.9822–1.0000) 0.9889 (±0.0055) (0.9781–0.9997) 0.9990 (±0.0007) (0.9976–1.0000) 0.9908 (±0.0053) (0.9804–1.0000) 0.8379 (±0.0349) (0.7695–0.9063) 0.7780 (±0.0125) (0.7535–0.8025) 0.9852 (±0.0042) (0.9770–0.9934) 0.8064 (±0.0130) (0.7809–0.8319)
ConvNeXt 0.9890 (±0.0117) (0.9661–1.0000) 0.9850 (±0.0085) (0.9683–1.0000) 0.9985 (±0.0016) (0.9954–1.0000) 0.9869 (±0.0064) (0.9744–0.9994) 0.8352 (±0.0505) (0.7362–0.9342) 0.7844 (±0.0547) (0.6772–0.8916) 0.9845 (±0.0067) (0.9714–0.9976) 0.8069 (±0.0251) (0.7577–0.8561)
Model CRP DNS
Precision Sensitivity Specificity F1-score Precision Sensitivity Specificity F1-score
SwinT 0.9605 (±0.0206) (0.9201–1.0000) 0.9563 (±0.0181) (0.9208–0.9918) 0.9954 (±0.0025) (0.9905–1.0000) 0.9582 (±0.0095) (0.9396–0.9768) 0.9493 (±0.0165) (0.9170–0.9816) 0.9512 (±0.0186) (0.9147–0.9877) 0.9884 (±0.0041) (0.9804–0.9964) 0.9500 (±0.0041) (0.9420–0.9580)
MaxViT 0.9642 (±0.0176) (0.9297–0.9987) 0.9134 (±0.0524) (0.8107–1.0000) 0.9960 (±0.0020) (0.9921–0.9999) 0.9373 (±0.0261) (0.8861–0.9885) 0.9336 (±0.0152) (0.9038–0.9634) 0.9461 (±0.0154) (0.9159–0.9763) 0.9848 (±0.0038) (0.9774–0.9922) 0.939s7 (±0.0083) (0.9234–0.9560)
PoolF 0.9702 (±0.0131) (0.9445–0.9959) 0.9410 (±0.0145) (0.9126–0.9694) 0.9967 (±0.0015) (0.9938–0.9996) 0.9553 (±0.0087) (0.9382–0.9724) 0.9441 (±0.0071) (0.9302–0.9580) 0.9452 (±0.0055) (0.9344–0.9560) 0.9873 (±0.0018) (0.9838–0.9908) 0.9446 (±0.0021) (0.9405–0.9487)
CaiT 0.9723 (±0.0185) (0.9360–1.0000) 0.9196 (±0.0288) (0.8632–0.9760) 0.9969 (±0.0022) (0.9926–1.0000) 0.9448 (±0.0111) (0.9230–0.9666) 0.9388 (±0.0203) (0.8990–0.9786) 0.9440 (±0.0083) (0.9277–0.9603) 0.9860 (±0.0050) (0.9762–0.9958) 0.9412 (±0.0083) (0.9249–0.9575)
ResNet 0.9560 (±0.0131) (0.9303–0.9817) 0.8873 (±0.0531) (0.7832–0.9914) 0.9953 (±0.0017) (0.9920–0.9986) 0.9195 (±0.0248) (0.8709–0.9681) 0.9093 (±0.0348) (0.8411–0.9775) 0.9375 (±0.0199) (0.8985–0.9765) 0.9785 (±0.0094) (0.9601–0.9969) 0.9225 (±0.0094) (0.9041–0.9409)
DenseNet 0.9541 (±0.0335) (0.8884–1.0000) 0.9372 (±0.0258) (0.8866–0.9878) 0.9947 (±0.0043) (0.9863–1.0000) 0.9449 (±0.0082) (0.9288–0.9610) 0.9430 (±0.0086) (0.9261–0.9599) 0.9388 (±0.0084) (0.9223–0.9553) 0.9871 (±0.0021) (0.9830–0.9912) 0.9408 (±0.0030) (0.9349–0.9467)
Xception 0.9729 (±0.0119) (0.9496–0.9962) 0.9295 (±0.0246) (0.8813–0.9777) 0.9970 (±0.0014) (0.9943–0.9997) 0.9505 (±0.0131) (0.9248–0.9762) 0.9385 (±0.0136) (0.9118–0.9652) 0.9397 (±0.0192) (0.9021–0.9773) 0.9860 (±0.0036) (0.9789–0.9931) 0.9389 (±0.0035) (0.9320–0.9458)
ConvNeXt 0.9589 (±0.0261) (0.9077–1.0000) 0.9464 (±0.0277) (0.8921–1.0000) 0.9953 (±0.0032) (0.9890–1.0000) 0.9522 (±0.0150) (0.9228–0.9816) 0.9519 (±0.0064) (0.9394–0.9644) 0.9397 (±0.0162) (0.9079–0.9715) 0.9893 (±0.0015) (0.9864–0.9922) 0.9457 (±0.0094) (0.9273–0.9641)
Model NOR RHI
Precision Sensitivity Specificity F1-score Precision Sensitivity Specificity F1-score
SwinT 0.9371 (±0.0105) (0.9165–0.9577) 0.9525 (±0.0128) (0.9274–0.9776) 0.9758 (±0.0046) (0.9668–0.9848) 0.9446 (±0.0045) (0.9358–0.9534) 0.9485 (±0.0227) (0.9040–0.9930) 0.9725 (±0.0147) (0.9437–1.0000) 0.9956 (±0.0020) (0.9917–0.9995) 0.9603 (±0.0179) (0.9252–0.9954)
MaxViT 0.9085 (±0.0139) (0.8813–0.9357) 0.9569 (±0.0100) (0.9373–0.9765) 0.9635 (±0.0064) (0.9510–0.9760) 0.9320 (±0.0049) (0.9224–0.9416) 0.9057 (±0.0430) (0.8214–0.9900) 0.9623 (±0.0224) (0.9184–1.0000) 0.9914 (±0.0045) (0.9826–1.0000) 0.9322 (±0.0139) (0.9050–0.9594)
PoolF 0.9361 (±0.0109) (0.9147–0.9575) 0.9462 (±0.0087) (0.9291–0.9633) 0.9756 (±0.0046) (0.9666–0.9846) 0.9411 (±0.0034) (0.9344–0.9478) 0.9554 (±0.0200) (0.9162–0.9946) 0.9755 (±0.0171) (0.9420–1.0000) 0.9962 (±0.0017) (0.9929–0.9995) 0.9652 (±0.0127) (0.9403–0.9901) *
CaiT 0.9322 (±0.0118) (0.9091–0.9553) 0.9379 (±0.0169) (0.9048–0.9710) 0.9742 (±0.0052) (0.9640–0.9844) 0.9349 (±0.0058) (0.9235–0.9463) 0.9223 (±0.0319) (0.8598–0.9848) 0.9704 (±0.0215) (0.9283–1.000) 0.9931 (±0.0030) (0.9872–0.9990) 0.9455 (±0.0198) (0.9067–0.9843)
ResNet 0.9122 (±0.0240) (0.8652–0.9592) 0.9384 (±0.0280) (0.8835–0.9933) 0.9655 (±0.0114) (0.9432–0.9878) 0.9246 (±0.0066) (0.9117–0.9375) 0.8982 (±0.0491) (0.8020–0.9944) 0.9490 (±0.0252) (0.8996–0.9984) 0.9908 (±0.0049) (0.9812–1.0000) 0.9222 (±0.0272) (0.8689–0.9755)
DenseNet 0.9128 (±0.0190) (0.8756–0.9500) 0.9451 (±0.0215) (0.9030–0.9872) 0.9657 (±0.0087) (0.9486–0.9828) 0.9284 (±0.0077) (0.9133–0.9435) 0.9395 (±0.0124) (0.9152–0.9638) 0.9653 (±0.0167) (0.9326–0.9980) 0.9948 (±0.0011) (0.9926–0.9970) 0.9522 (±0.0114) (0.9299–0.9745)
Xception 0.9283 (±0.0110) (0.9067–0.9499) 0.9456 (±0.0173) (0.9117–0.9795) 0.9723 (±0.0050) (0.9625–0.9821) 0.9367 (±0.0049) (0.9271–0.9463) 0.9196 (±0.0263) (0.8681–0.9711) 0.9827 (±0.0175) (0.9484–1.0000) 0.9928 (±0.0027) (0.9875–0.9981) 0.9498 (±0.0145) (0.9214–0.9782)
ConvNeXt 0.9317 (±0.0129) (0.9064–0.9570) 0.9468 (±0.0086) (0.9299–0.9637) 0.9737 (±0.0055) (0.9629–0.9845) 0.9391 (±0.0060) (0.9273–0.9509) 0.9279 (±0.0142) (0.9001–0.9557) 0.9796 (±0.0187) (0.9429–1.0000) 0.9936 (±0.0015) (0.9907–0.9965) 0.9528 (±0.0065) (0.9401–0.9655)