Table 8. Class-based results comparison for the best, mean, standard deviation, median, and worst of class-based performance based on the GA-CNN, LCBO-CNN, MVO-CNN, SBO-CNN, WOA-CNN, and EOSA-CNN hybrid algorithms and as compared with the basic CNN architecture.
Measure | Metric | GA-CNN | LCBO-CNN | MVO-CNN | SBO-CNN | WOA-CNN | EOSA-CNN | CNN |
---|---|---|---|---|---|---|---|---|
Sensitivity | ||||||||
Normal | Best | 0.8654 | 0.9368 | 0.875 | 0.9712 | 0.9135 | 0.9231 | 0.7115 |
Mean | 0.75772 | 0.81814 | 0.81156 | 0.8154 | 0.78464 | 0.90 | 0.67306 | |
STD | 0.0791 | 0.14166 | 0.06252 | 0.10164 | 0.13072 | 0.04171 | 0.02451 | |
Median | 0.7308 | 0.8558 | 0.8077 | 0.7596 | 0.75 | 0.9231 | 0.6635 | |
Worst | 0.6635 | 0.5962 | 0.7212 | 0.7308 | 0.6058 | 0.8269 | 0.6538 | |
Benign | Best | 0.63333 | 0.76667 | 0.66667 | 0.53333 | 0.4 | 0.36667 | 0.53333 |
Mean | 0.42 | 0.41333 | 0.38665 | 0.34667 | 0.34666 | 0.24 | 0.48666 | |
STD | 0.15741 | 0.21551 | 0.18349 | 0.14259 | 0.06912 | 0.10382 | 0.06498 | |
Median | 0.36667 | 0.36667 | 0.3333 | 0.3333 | 0.36667 | 0.26667 | 0.53333 | |
Worst | 0.26667 | 0.20 | 0.16667 | 0.16667 | 0.23333 | 0.13333 | 0.4 | |
Malignant | Best | 0.9 | 0.9214 | 0.8429 | 0.9071 | 0.9214 | 0.9071 | 0.85 |
Mean | 0.85858 | 0.82858 | 0.82286 | 0.83856 | 0.86856 | 0.86712 | 0.83858 | |
STD | 0.03655 | 0.07676 | 0.01706 | 0.0543 | 0.05613 | 0.04213 | 0.01082 | |
Median | 0.8643 | 0.8143 | 0.8214 | 0.8429 | 0.8786 | 0.8643 | 0.8357 | |
Worst | 0.8143 | 0.7429 | 0.8 | 0.7571 | 0.7786 | 0.8071 | 0.8286 | |
Specificity | ||||||||
Normal | Best | 0.8941 | 0.9588 | 0.8882 | 0.9059 | 0.8824 | 0.8882 | 0.8529 |
Mean | 0.85296 | 0.81882 | 0.81762 | 0.80234 | 0.83412 | 0.81292 | 0.83292 | |
STD | 0.043 | 0.09532 | 0.04138 | 0.06625 | 0.05712 | 0.04893 | 0.01535 | |
Median | 0.8647 | 0.7941 | 0.8059 | 0.7882 | 0.8588 | 0.7941 | 0.8353 | |
Worst | 0.7824 | 0.7059 | 0.7882 | 0.7412 | 0.7588 | 0.7588 | 0.8176 | |
Benign | Best | 0.92623 | 0.93443 | 0.91803 | 0.97131 | 0.94262 | 0.97951 | 0.84836 |
Mean | 0.86803 | 0.8872 | 0.88359 | 0.89342 | 0.88443 | 0.93689 | 0.83361 | |
STD | 0.04351 | 0.05474 | 0.03602 | 0.05011 | 0.05636 | 0.03169 | 0.00943 | |
Median | 0.86066 | 0.90164 | 0.8893 | 0.877 | 0.877 | 0.93443 | 0.83197 | |
Worst | 0.82377 | 0.80328 | 0.84426 | 0.84016 | 0.8115 | 0.89344 | 0.8238 | |
Malignant | Best | 0.985 | 1 | 1 | 1 | 0.9851 | 1 | 0.9851 |
Mean | 0.9612 | 0.98358 | 0.97462 | 0.98656 | 0.97016 | 0.96568 | 0.9776 | |
STD | 0.01932 | 0.01435 | 0.01946 | 0.00973 | 0.01903 | 0.03192 | 0.0053 | |
Median | 0.9552 | 0.9851 | 0.9701 | 0.9851 | 0.9776 | 0.9478 | 0.9776 | |
Worst | 0.9403 | 0.9627 | 0.9478 | 0.9776 | 0.9403 | 0.9328 | 0.9701 | |
Precision | ||||||||
Normal | Best | 0.8065 | 0.8986 | 0.8155 | 0.8261 | 0.7959 | 0.819 | 0.7396 |
Mean | 0.76264 | 0.74924 | 0.73322 | 0.72264 | 0.7482 | 0.74984 | 0.71148 | |
STD | 0.03492 | 0.09224 | 0.04791 | 0.06092 | 0.03739 | 0.04546 | 0.02475 | |
Median | 0.7667 | 0.7177 | 0.7165 | 0.7063 | 0.759 | 0.7328 | 0.7113 | |
Worst | 0.7087 | 0.6599 | 0.6949 | 0.6716 | 0.6985 | 0.7007 | 0.6869 | |
Benign | Best | 0.30769 | 0.40741 | 0.35088 | 0.41667 | 0.42308 | 0.47826 | 0.30189 |
Mean | 0.28194 | 0.31394 | 0.28188 | 0.30389 | 0.29414 | 0.339 | 0.26439 | |
STD | 0.04213 | 0.07393 | 0.06118 | 0.07401 | 0.09156 | 0.12445 | 0.0328 | |
Median | 0.30556 | 0.32394 | 0.2703 | 0.29091 | 0.2857 | 0.33333 | 0.27586 | |
Worst | 0.2093 | 0.21429 | 0.2 | 0.2105 | 0.1786 | 0.18182 | 0.2182 | |
Malignant | Best | 0.9844 | 1 | 1 | 1 | 0.984 | 1 | 0.9835 |
Mean | 0.9585 | 0.98232 | 0.97164 | 0.98464 | 0.96884 | 0.9652 | 0.97508 | |
STD | 0.02039 | 0.01412 | 0.02146 | 0.01097 | 0.018 | 0.03218 | 0.00594 | |
Median | 0.9508 | 0.9818 | 0.9672 | 0.9815 | 0.9732 | 0.9478 | 0.975 | |
Worst | 0.9394 | 0.9627 | 0.9421 | 0.9748 | 0.9407 | 0.9338 | 0.9667 | |
Recall | ||||||||
Normal | Best | 0.8654 | 0.9368 | 0.875 | 0.9712 | 0.9135 | 0.9231 | 0.7115 |
Mean | 0.75772 | 0.81814 | 0.81156 | 0.8154 | 0.78464 | 0.90 | 0.67306 | |
STD | 0.0791 | 0.14166 | 0.06252 | 0.10164 | 0.13072 | 0.04171 | 0.02451 | |
Median | 0.7308 | 0.8558 | 0.8077 | 0.7596 | 0.75 | 0.9231 | 0.6635 | |
Worst | 0.6635 | 0.5962 | 0.7212 | 0.7308 | 0.6058 | 0.8269 | 0.6538 | |
Benign | Best | 0.63333 | 0.76667 | 0.66667 | 0.53333 | 0.4 | 0.36667 | 0.53333 |
Mean | 0.42 | 0.41333 | 0.38665 | 0.34667 | 0.34666 | 0.24 | 0.48666 | |
STD | 0.15741 | 0.21551 | 0.18349 | 0.14259 | 0.06912 | 0.10382 | 0.06498 | |
Median | 0.36667 | 0.36667 | 0.3333 | 0.3333 | 0.36667 | 0.26667 | 0.53333 | |
Worst | 0.26667 | 0.2 | 0.16667 | 0.16667 | 0.23333 | 0.13333 | 0.40 | |
Malignant | Best | 0.9 | 0.9214 | 0.8429 | 0.9071 | 0.9214 | 0.9071 | 0.85 |
Mean | 0.85858 | 0.82858 | 0.82286 | 0.83856 | 0.86856 | 0.86712 | 0.83858 | |
STD | 0.03655 | 0.07676 | 0.01706 | 0.0543 | 0.05613 | 0.04213 | 0.01082 | |
Median | 0.8643 | 0.8143 | 0.8214 | 0.8429 | 0.8786 | 0.8643 | 0.8357 | |
Worst | 0.8143 | 0.7429 | 0.80 | 0.7571 | 0.7786 | 0.8071 | 0.8286 | |
F1 score | ||||||||
Normal | Best | 0.785 | 0.8128 | 0.8116 | 0.8178 | 0.8085 | 0.8384 | 0.722 |
Mean | 0.75714 | 0.76846 | 0.7691 | 0.76138 | 0.7595 | 0.8164 | 0.69172 | |
STD | 0.02938 | 0.03413 | 0.0408 | 0.03759 | 0.05248 | 0.01586 | 0.02356 | |
Median | 0.7614 | 0.7706 | 0.7879 | 0.7563 | 0.7723 | 0.817 | 0.6866 | |
Worst | 0.7113 | 0.7168 | 0.7143 | 0.7215 | 0.6738 | 0.7967 | 0.67 | |
Benign | Best | 0.41304 | 0.45545 | 0.45977 | 0.37647 | 0.39286 | 0.41509 | 0.38554 |
Mean | 0.3293 | 0.34205 | 0.31888 | 0.30383 | 0.30819 | 0.26946 | 0.34253 | |
STD | 0.06568 | 0.09716 | 0.09907 | 0.06419 | 0.06051 | 0.09936 | 0.04303 | |
Median | 0.33333 | 0.38596 | 0.32099 | 0.3226 | 0.3077 | 0.27692 | 0.36364 | |
Worst | 0.24658 | 0.23077 | 0.18182 | 0.2353 | 0.2326 | 0.15385 | 0.2824 | |
Malignant | Best | 0.9403 | 0.9416 | 0.9105 | 0.9513 | 0.9416 | 0.9272 | 0.9119 |
Mean | 0.90558 | 0.897 | 0.89096 | 0.90512 | 0.91492 | 0.9125 | 0.90168 | |
STD | 0.02643 | 0.04082 | 0.01476 | 0.03521 | 0.02937 | 0.01712 | 0.00829 | |
Median | 0.9118 | 0.8976 | 0.888 | 0.9042 | 0.9236 | 0.9203 | 0.90 | |
Worst | 0.8736 | 0.849 | 0.8736 | 0.8548 | 0.8651 | 0.8933 | 0.8923 | |
Balanced Accuracy | ||||||||
Normal | Best | 0.8274 | 0.8655 | 0.848 | 0.862 | 0.8508 | 0.8762 | 0.7764 |
Mean | 0.80532 | 0.81848 | 0.81458 | 0.80886 | 0.80936 | 0.85648 | 0.753 | |
STD | 0.02315 | 0.03129 | 0.03384 | 0.03411 | 0.04133 | 0.01314 | 0.01856 | |
Median | 0.8076 | 0.8161 | 0.8316 | 0.8033 | 0.8162 | 0.8576 | 0.7494 | |
Worst | 0.77 | 0.7775 | 0.7694 | 0.7739 | 0.7441 | 0.841 | 0.7357 | |
Benign | Best | 0.72855 | 0.78497 | 0.75751 | 0.68675 | 0.6526 | 0.65874 | 0.69085 |
Mean | 0.64402 | 0.65027 | 0.63513 | 0.62007 | 0.61554 | 0.58844 | 0.66014 | |
STD | 0.06144 | 0.08653 | 0.07787 | 0.05084 | 0.03404 | 0.04905 | 0.03479 | |
Median | 0.6321 | 0.64929 | 0.6257 | 0.6216 | 0.6262 | 0.59672 | 0.6806 | |
Worst | 0.58033 | 0.56721 | 0.54235 | 0.56899 | 0.5724 | 0.52978 | 0.6119 | |
Malignant | Best | 0.9425 | 0.9421 | 0.9179 | 0.9536 | 0.9421 | 0.9321 | 0.9175 |
Mean | 0.90986 | 0.90608 | 0.89874 | 0.91256 | 0.91936 | 0.91642 | 0.9081 | |
STD | 0.02425 | 0.03313 | 0.01405 | 0.0302 | 0.02448 | 0.0146 | 0.00747 | |
Median | 0.913 | 0.9071 | 0.8958 | 0.9102 | 0.9237 | 0.92 | 0.9067 | |
Worst | 0.881 | 0.8677 | 0.881 | 0.8711 | 0.8781 | 0.8989 | 0.8994 |