Table 7.
Ablation study results of refinement model on HG001 and HG002
| Train data | Test data | Training Feature | Suboptimal SA | Optimal SA | ||
|---|---|---|---|---|---|---|
| F1 score | AUC-ROC | F1 score | AUC-ROC | |||
| HG001 | HG002 | all | 0.949 | 0.905 | 0.946 | 0.909 |
| w/o AF | 0.946 | 0.882 | 0.955 | 0.914 | ||
| w/o CF | 0.944 | 0.894 | 0.939 | 0.890 | ||
| w/o AF + CF | 0.921 | 0.819 | 0.932 | 0.822 | ||
| HG002 | HG001 | all | 0.934 | 0.861 | 0.948 | 0.889 |
| w/o AF | 0.934 | 0.85 | 0.944 | 0.880 | ||
| w/o CF | 0.929 | 0.852 | 0.949 | 0.894 | ||
| w/o AF + CF | 0.909 | 0.807 | 0.930 | 0.833 | ||
| Mixed 50% | Mixed 50% | all | 0.946 | 0.894 | * | |
| w/o AF | 0.941 | 0.876 | ||||
| w/o CF | 0.94 | 0.883 | ||||
| w/o AF + CF | 0.915 | 0.812 | ||||
*By considering data leakage, this experiment was not performed