TABLE 3.
Brand‐based evaluation of ensemble models, regardless of the presence of crosslinks.
| Metrics | All | AP + LP | AP + Lat + Concat | AP + Lat + Merge | Lat + Concat | Average |
|---|---|---|---|---|---|---|
| Accuracy | 0.9245 | 0.9434 | 0.9340 | 0.9340 | 0.9340 | 0.9340 |
| Kappa score | 0.9115 | 0.9335 | 0.9225 | 0.9224 | 0.9225 | 0.9225 |
| Precision | ||||||
| A‐Spine (EVO) | 0.9474 | 0.9474 | 0.9474 | 0.9000 | 0.9474 | 0.9379 |
| Armstrong | 0.8889 | 0.9412 | 0.9375 | 0.9412 | 1.0000 | 0.9418 |
| CDH | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9375 | 0.9875 |
| Expedium | 0.7273 | 0.8000 | 0.8000 | 0.8000 | 0.8000 | 0.7855 |
| Gezen | 1.0000 | 1.0000 | 0.9333 | 1.0000 | 0.9333 | 0.9733 |
| NOVA | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| Xia 3 | 0.8947 | 0.8947 | 0.8947 | 0.8947 | 0.8947 | 0.8947 |
| Macro‐average | 0.9226 | 0.9405 | 0.9304 | 0.9337 | 0.9304 | 0.9315 |
| Micro‐average | 0.9245 | 0.9434 | 0.9340 | 0.9340 | 0.9340 | 0.9340 |
| Sensitivity | ||||||
| A‐Spine (EVO) | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| Armstrong | 0.9412 | 0.9412 | 0.8824 | 0.9412 | 0.8824 | 0.9177 |
| CDH | 0.9375 | 0.9375 | 0.9375 | 0.9375 | 0.9375 | 0.9375 |
| Expedium | 0.8889 | 0.8889 | 0.8889 | 0.8889 | 0.8889 | 0.8889 |
| Gezen | 0.7059 | 0.8235 | 0.8235 | 0.8235 | 0.8235 | 0.8000 |
| NOVA | 1.0000 | 1.0000 | 1.0000 | 0.9167 | 1.0000 | 0.9833 |
| Xia 3 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| Macro‐average | 0.9248 | 0.9416 | 0.9332 | 0.9297 | 0.9332 | 0.9325 |
| Micro‐average | 0.9245 | 0.9434 | 0.9340 | 0.9340 | 0.9340 | 0.9340 |
| F1 score | ||||||
| A‐Spine (EVO) | 0.9730 | 0.9730 | 0.9730 | 0.9474 | 0.9730 | 0.9679 |
| Armstrong | 0.9143 | 0.9412 | 0.9091 | 0.9412 | 0.9375 | 0.9287 |
| CDH | 0.9677 | 0.9677 | 0.9677 | 0.9677 | 0.9375 | 0.9617 |
| Expedium | 0.8000 | 0.8421 | 0.8421 | 0.8421 | 0.8421 | 0.8337 |
| Gezen | 0.8276 | 0.9032 | 0.8750 | 0.9032 | 0.8750 | 0.8768 |
| NOVA | 1.0000 | 1.0000 | 1.0000 | 0.9565 | 1.0000 | 0.9913 |
| Xia 3 | 0.9444 | 0.9444 | 0.9444 | 0.9444 | 0.9444 | 0.9444 |
| Macro‐average | 0.9181 | 0.9388 | 0.9302 | 0.9289 | 0.9299 | 0.9292 |
| Micro‐average | 0.9245 | 0.9434 | 0.9340 | 0.9340 | 0.9340 | 0.9340 |
| AUC | ||||||
| A‐Spine (EVO) | 0.9981 | 0.9956 | 0.9987 | 0.9949 | 0.9994 | 0.9973 |
| Armstrong | 0.9828 | 0.9868 | 0.9874 | 0.9822 | 0.9881 | 0.9855 |
| CDH | 0.9993 | 0.9993 | 0.9986 | 1.0000 | 0.9965 | 0.9987 |
| Expedium | 0.9828 | 0.9828 | 0.9794 | 0.9874 | 0.9794 | 0.9824 |
| Gezen | 0.8876 | 0.9048 | 0.9035 | 0.8916 | 0.9161 | 0.9007 |
| NOVA | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| Xia 3 | 0.9848 | 0.9861 | 0.9881 | 0.9835 | 0.9907 | 0.9866 |
| Macro‐average | 0.9811 | 0.9834 | 0.9842 | 0.9842 | 0.9854 | 0.9837 |
| Micro‐average | 0.9746 | 0.9830 | 0.9821 | 0.9748 | 0.9842 | 0.9797 |
Abbreviation: Concat, concatenated.