Skip to main content
. 2024 Sep 17;7(3):e70001. doi: 10.1002/jsp2.70001

TABLE 2.

Brand‐based evaluation of MAIA models, regardless of the presence of cross‐links.

Metrics AP model Lat model Concat model Merge model Average
Dual images AP images Lat images
Accuracy 0.8113 0.9057 0.8585 0.7972 0.7075 0.8868 0.8278
Kappa value 0.7791 0.8894 0.8343 0.7623 0.6580 0.8671 0.7984
Precision
A‐Spine (EVO) 0.8667 0.9444 1.0000 0.8333 0.8000 0.8571 0.8836
Armstrong 0.8235 1.0000 0.8667 0.7429 0.6111 0.8824 0.8211
CDH 1.0000 0.9333 1.0000 1.0000 1.0000 1.0000 0.9889
Expedium 0.4615 0.6667 0.5385 0.4583 0.3077 0.6364 0.5115
Gezen 0.7692 0.8750 0.6667 0.8095 0.5556 1.0000 0.7793
NOVA 0.9167 1.0000 1.0000 0.8800 0.7857 1.0000 0.9304
Xia 3 0.8095 0.8947 0.8947 0.8049 0.7619 0.8500 0.8360
Macro‐average 0.8067 0.9020 0.8524 0.7898 0.6889 0.8894 0.8215
Micro‐average 0.8113 0.9057 0.8585 0.7972 0.7075 0.8868 0.8278
Sensitivity
A‐Spine (EVO) 0.7222 0.9444 0.9444 0.8333 0.6667 1.0000 0.8518
Armstrong 0.8235 0.8235 0.7647 0.7647 0.6471 0.8824 0.7843
CDH 0.9375 0.8750 0.9375 0.9375 1.0000 0.8750 0.9271
Expedium 0.6667 0.8889 0.7778 0.6111 0.4444 0.7778 0.6945
Gezen 0.5882 0.8235 0.5882 0.5000 0.2941 0.7059 0.5833
NOVA 0.9167 1.0000 1.0000 0.9167 0.9167 0.9167 0.9445
Xia 3 1.0000 1.0000 1.0000 0.9706 0.9412 1.0000 0.9853
Macro‐average 0.8078 0.9079 0.8590 0.7906 0.7014 0.8797 0.8244
Micro‐average 0.8113 0.9057 0.8585 0.7972 0.7075 0.8868 0.8278
F1 score
A‐Spine (EVO) 0.7879 0.9444 0.9714 0.8333 0.7273 0.9231 0.8646
Armstrong 0.8235 0.9032 0.8125 0.7536 0.6286 0.8824 0.8006
CDH 0.9677 0.9032 0.9677 0.9677 1.0000 0.9333 0.9566
Expedium 0.5455 0.7619 0.6364 0.5238 0.3636 0.7000 0.5885
Gezen 0.6667 0.8485 0.6250 0.6182 0.3846 0.8276 0.6618
NOVA 0.9167 1.0000 1.0000 0.8980 0.8462 0.9565 0.9362
Xia 3 0.8947 0.9444 0.9444 0.8800 0.8421 0.9189 0.9041
Macro‐average 0.8004 0.9008 0.8511 0.7821 0.6846 0.8774 0.8161
Micro‐average 0.8113 0.9057 0.8585 0.7972 0.7075 0.8868 0.8278
AUC
A‐Spine (EVO) 0.9609 0.9968 0.9994 0.9634 0.9356 0.9968 0.9755
Armstrong 0.9445 0.9947 0.9689 0.9552 0.9359 0.9670 0.9610
CDH 0.9993 0.9972 0.9944 0.9995 1.0000 0.9979 0.9981
Expedium 0.9278 0.9851 0.9393 0.9439 0.8866 0.9805 0.9439
Gezen 0.8612 0.9451 0.9233 0.8946 0.8334 0.9299 0.8979
NOVA 0.9938 1.0000 1.0000 0.9949 0.9911 1.0000 0.9966
Xia 3 0.9782 0.9914 0.9934 0.9835 0.9828 0.9775 0.9845
Macro‐average 0.9560 0.9902 0.9772 0.9643 0.9420 0.9821 0.9686
Micro‐average 0.9542 0.9869 0.9809 0.9644 0.9463 0.9771 0.9683

Abbreviation: Concat, concatenated.

HHS Vulnerability Disclosure