Table 8.
WCMS vs. State-of-the-Art Methods Across Project Scenarios (ACC).
Train | Test | Baseline Methods |
RF |
XGB |
LGBM |
||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
EALR | MULTI | DEJIT | LT | AGE | CCUM | FI | MO | FI | MO | FI | MO | ||
BUG | COL | 0.497 | 0.716 | 0.661 | 0.641 | 0.702 | 0.836 | 0.737 | 0.851 | 0.526 | 0.779 | 0.577 | 0.730 |
JDT | 0.281 | 0.773 | 0.698 | 0.582 | 0.490 | 0.761 | 0.691 | 0.782 | 0.422 | 0.691 | 0.442 | 0.712 | |
PLA | 0.429 | 0.772 | 0.768 | 0.494 | 0.427 | 0.774 | 0.684 | 0.793 | 0.489 | 0.721 | 0.423 | 0.675 | |
MOZ | 0.219 | 0.763 | 0.605 | 0.367 | 0.240 | 0.605 | 0.728 | 0.775 | 0.515 | 0.681 | 0.393 | 0.641 | |
POS | 0.349 | 0.765 | 0.726 | 0.533 | 0.432 | 0.726 | 0.761 | 0.786 | 0.399 | 0.549 | 0.393 | 0.731 | |
COL | BUG | 0.336 | 0.821 | 0.790 | 0.435 | 0.432 | 0.790 | 0.535 | 0.823 | 0.438 | 0.657 | 0.376 | 0.684 |
JDT | 0.113 | 0.828 | 0.760 | 0.582 | 0.490 | 0.761 | 0.688 | 0.836 | 0.502 | 0.731 | 0.539 | 0.772 | |
PLA | 0.239 | 0.824 | 0.770 | 0.494 | 0.427 | 0.774 | 0.681 | 0.832 | 0.540 | 0.749 | 0.478 | 0.641 | |
MOZ | 0.148 | 0.830 | 0.591 | 0.367 | 0.240 | 0.605 | 0.800 | 0.851 | 0.640 | 0.819 | 0.436 | 0.749 | |
POS | 0.167 | 0.825 | 0.726 | 0.533 | 0.432 | 0.726 | 0.672 | 0.836 | 0.589 | 0.77 | 0.481 | 0.725 | |
JDT | BUG | 0.376 | 0.757 | 0.789 | 0.435 | 0.432 | 0.790 | 0.561 | 0.822 | 0.428 | 0.584 | 0.469 | 0.673 |
COL | 0.378 | 0.721 | 0.833 | 0.641 | 0.702 | 0.836 | 0.779 | 0.853 | 0.503 | 0.775 | 0.594 | 0.761 | |
PLA | 0.277 | 0.733 | 0.775 | 0.494 | 0.427 | 0.774 | 0.716 | 0.796 | 0.524 | 0.725 | 0.556 | 0.754 | |
MOZ | 0.168 | 0.740 | 0.605 | 0.367 | 0.240 | 0.605 | 0.815 | 0.817 | 0.352 | 0.755 | 0.637 | 0.796 | |
POS | 0.299 | 0.749 | 0.727 | 0.533 | 0.432 | 0.726 | 0.754 | 0.763 | 0.332 | 0.659 | 0.639 | 0.804 | |
PLA | BUG | 0.367 | 0.768 | 0.787 | 0.435 | 0.432 | 0.790 | 0.532 | 0.792 | 0.428 | 0.641 | 0.351 | 0.715 |
COL | 0.363 | 0.763 | 0.760 | 0.641 | 0.702 | 0.836 | 0.778 | 0.863 | 0.479 | 0.636 | 0.514 | 0.784 | |
JDT | 0.152 | 0.772 | 0.760 | 0.582 | 0.490 | 0.761 | 0.719 | 0.852 | 0.422 | 0.672 | 0.490 | 0.737 | |
MOZ | 0.168 | 0.780 | 0.605 | 0.367 | 0.240 | 0.605 | 0.811 | 0.814 | 0.425 | 0.709 | 0.521 | 0.794 | |
POS | 0.230 | 0.780 | 0.719 | 0.533 | 0.432 | 0.726 | 0.515 | 0.812 | 0.432 | 0.571 | 0.312 | 0.685 | |
MOZ | BUG | 0.350 | 0.592 | 0.790 | 0.435 | 0.432 | 0.790 | 0.534 | 0.833 | 0.522 | 0.644 | 0.473 | 0.694 |
COL | 0.247 | 0.572 | 0.836 | 0.641 | 0.702 | 0.836 | 0.742 | 0.852 | 0.528 | 0.739 | 0.499 | 0.745 | |
JDT | 0.057 | 0.587 | 0.696 | 0.582 | 0.490 | 0.761 | 0.704 | 0.786 | 0.486 | 0.646 | 0.512 | 0.785 | |
PLA | 0.173 | 0.580 | 0.770 | 0.494 | 0.427 | 0.774 | 0.69 | 0.783 | 0.502 | 0.724 | 0.515 | 0.750 | |
POS | 0.135 | 0.584 | 0.726 | 0.533 | 0.432 | 0.726 | 0.722 | 0.767 | 0.467 | 0.723 | 0.474 | 0.794 | |
POS | BUG | 0.351 | 0.711 | 0.782 | 0.435 | 0.432 | 0.790 | 0.556 | 0.822 | 0.423 | 0.687 | 0.385 | 0.711 |
COL | 0.439 | 0.690 | 0.828 | 0.641 | 0.702 | 0.836 | 0.748 | 0.865 | 0.578 | 0.703 | 0.451 | 0.701 | |
JDT | 0.159 | 0.703 | 0.762 | 0.582 | 0.490 | 0.761 | 0.699 | 0.786 | 0.466 | 0.742 | 0.472 | 0.719 | |
PLA | 0.261 | 0.700 | 0.774 | 0.494 | 0.427 | 0.774 | 0.677 | 0.781 | 0.562 | 0.752 | 0.508 | 0.745 | |
MOZ | 0.159 | 0.706 | 0.598 | 0.367 | 0.240 | 0.605 | 0.793 | 0.815 | 0.597 | 0.780 | 0.565 | 0.790 | |
MEAN | 0.263 | 0.73 | 0.734 | 0.509 | 0.454 | 0.749 | 0.694 | 0.810 | 0.484 | 0.700 | 0.483 | 0.733 |