Table 9.
WCMS vs. State-of-the-Art Methods Across Project Scenarios (Popt).
Train | Test | Baseline Methods |
RF |
XGB |
LGBM |
||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
EALR | MULTI | DEJIT | LT | AGE | CCUM | FI | MO | FI | MO | FI | MO | ||
BUG | COL | 0.701 | 0.894 | 0.737 | 0.858 | 0.868 | 0.948 | 0.903 | 0.956 | 0.774 | 0.943 | 0.754 | 0.805 |
JDT | 0.592 | 0.923 | 0.823 | 0.815 | 0.769 | 0.897 | 0.888 | 0.933 | 0.678 | 0.935 | 0.687 | 0.920 | |
PLA | 0.695 | 0.922 | 0.884 | 0.770 | 0.740 | 0.899 | 0.883 | 0.928 | 0.739 | 0.893 | 0.714 | 0.804 | |
MOZ | 0.563 | 0.918 | 0.813 | 0.660 | 0.622 | 0.813 | 0.897 | 0.935 | 0.713 | 0.935 | 0.607 | 0.754 | |
POS | 0.603 | 0.918 | 0.907 | 0.810 | 0.762 | 0.908 | 0.925 | 0.929 | 0.682 | 0.828 | 0.636 | 0.805 | |
COL | BUG | 0.633 | 0.945 | 0.932 | 0.726 | 0.758 | 0.932 | 0.871 | 0.962 | 0.749 | 0.962 | 0.714 | 0.845 |
JDT | 0.418 | 0.945 | 0.882 | 0.815 | 0.769 | 0.897 | 0.877 | 0.951 | 0.741 | 0.882 | 0.753 | 0.905 | |
PLA | 0.506 | 0.944 | 0.878 | 0.770 | 0.740 | 0.899 | 0.881 | 0.963 | 0.736 | 0.926 | 0.712 | 0.838 | |
MOZ | 0.476 | 0.946 | 0.768 | 0.660 | 0.622 | 0.813 | 0.926 | 0.959 | 0.777 | 0.887 | 0.720 | 0.903 | |
POS | 0.426 | 0.943 | 0.876 | 0.810 | 0.762 | 0.908 | 0.881 | 0.947 | 0.774 | 0.901 | 0.681 | 0.888 | |
JDT | BUG | 0.674 | 0.895 | 0.925 | 0.726 | 0.758 | 0.932 | 0.862 | 0.944 | 0.677 | 0.867 | 0.812 | 0.972 |
COL | 0.564 | 0.876 | 0.937 | 0.858 | 0.868 | 0.948 | 0.927 | 0.956 | 0.711 | 0.959 | 0.766 | 0.860 | |
PLA | 0.555 | 0.883 | 0.899 | 0.770 | 0.740 | 0.899 | 0.903 | 0.904 | 0.745 | 0.921 | 0.802 | 0.957 | |
MOZ | 0.502 | 0.885 | 0.814 | 0.660 | 0.622 | 0.813 | 0.925 | 0.927 | 0.658 | 0.879 | 0.800 | 0.941 | |
POS | 0.514 | 0.891 | 0.906 | 0.810 | 0.762 | 0.908 | 0.93 | 0.930 | 0.696 | 0.900 | 0.83 | 0.984 | |
PLA | BUG | 0.685 | 0.895 | 0.929 | 0.726 | 0.758 | 0.932 | 0.892 | 0.952 | 0.777 | 0.941 | 0.764 | 0.986 |
COL | 0.564 | 0.889 | 0.857 | 0.858 | 0.868 | 0.948 | 0.931 | 0.955 | 0.700 | 0.866 | 0.791 | 0.963 | |
JDT | 0.458 | 0.897 | 0.896 | 0.815 | 0.769 | 0.897 | 0.908 | 0.909 | 0.720 | 0.862 | 0.789 | 0.943 | |
MOZ | 0.498 | 0.899 | 0.814 | 0.660 | 0.622 | 0.813 | 0.936 | 0.937 | 0.688 | 0.893 | 0.717 | 0.903 | |
POS | 0.478 | 0.899 | 0.898 | 0.810 | 0.762 | 0.908 | 0.879 | 0.913 | 0.691 | 0.895 | 0.755 | 0.933 | |
MOZ | BUG | 0.619 | 0.806 | 0.932 | 0.726 | 0.758 | 0.932 | 0.885 | 0.939 | 0.789 | 0.963 | 0.791 | 0.879 |
COL | 0.482 | 0.793 | 0.948 | 0.858 | 0.868 | 0.948 | 0.905 | 0.963 | 0.708 | 0.939 | 0.682 | 0.838 | |
JDT | 0.367 | 0.803 | 0.807 | 0.815 | 0.769 | 0.897 | 0.892 | 0.906 | 0.713 | 0.875 | 0.743 | 0.895 | |
PLA | 0.414 | 0.799 | 0.889 | 0.770 | 0.740 | 0.899 | 0.895 | 0.911 | 0.734 | 0.960 | 0.757 | 0.840 | |
POS | 0.382 | 0.800 | 0.908 | 0.810 | 0.762 | 0.908 | 0.919 | 0.925 | 0.759 | 0.953 | 0.806 | 0.935 | |
POS | BUG | 0.629 | 0.902 | 0.913 | 0.726 | 0.758 | 0.932 | 0.847 | 0.942 | 0.727 | 0.964 | 0.718 | 0.846 |
COL | 0.617 | 0.884 | 0.929 | 0.858 | 0.868 | 0.948 | 0.905 | 0.965 | 0.742 | 0.948 | 0.700 | 0.866 | |
JDT | 0.459 | 0.897 | 0.888 | 0.815 | 0.769 | 0.897 | 0.889 | 0.912 | 0.760 | 0.957 | 0.740 | 0.869 | |
PLA | 0.544 | 0.894 | 0.897 | 0.770 | 0.740 | 0.813 | 0.885 | 0.899 | 0.767 | 0.895 | 0.760 | 0.866 | |
MOZ | 0.497 | 0.898 | 0.785 | 0.660 | 0.753 | 0.899 | 0.916 | 0.923 | 0.762 | 0.892 | 0.753 | 0.894 | |
MEAN | 0.537 | 0.889 | 0.876 | 0.773 | 0.758 | 0.900 | 0.899 | 0.935 | 0.730 | 0.914 | 0.742 | 0.888 |