Table 2.

Performance of model in Test Set.

Datasets (Model)	Feature Encoding	Independent test (before WD)					Independent test (after WD)
		Acc	Sen	Spe	MCC	AUC	Acc	Sen	Spe	MCC	AUC
ACPmain (SVM)	CPSR	0.750	0.756	0.744	0.500	0.796	0.746	0.696	0.797	0.495	0.819
	HOG-PSSM	0.564	0.401	0.727	0.135	0.578	0.681	0.522	0.841	0.382	0.652
	ProtT5	0.715	0.721	0.709	0.430	0.793	0.725	0.725	0.725	0.449	0.769
	ESM-2	0.654	0.674	0.634	0.308	0.706	0.910	0.913	0.907	0.820	0.958
	F1 + F2	0.669	0.581	0.756	0.342	0.727	0.855	0.725	0.986	0.736	0.975
	F1 + F2 + F3	0.773	0.791	0.756	0.547	0.866	0.738	0.645	0.831	0.485	0.820
	F1 + F2 + F4	0.715	0.721	0.709	0.430	0.793	0.741	0.634	0.849	0.494	0.832
ACPmain (CDF)	CPSR	0.738	0.669	0.808	0.481	0.794	0.750	0.727	0.773	0.501	0.794
	HOG-PSSM	0.721	0.721	0.721	0.442	0.803	0.689	0.680	0.698	0.378	0.743
	ProtT5	0.759	0.733	0.785	0.518	0.828	0.724	0.715	0.733	0.448	0.786
	ESM-2	0.727	0.721	0.733	0.454	0.818	0.939	0.959	0.919	0.879	0.966
	F1 + F2	0.718	0.657	0.779	0.439	0.807	0.887	0.872	0.901	0.774	0.920
	F1 + F2 + F3	0.948	0.977	0.919	0.897	0.966	0.948	0.971	0.924	0.896	0.975
	F1 + F2 + F4	0.901	0.849	0.953	0.807	0.931	0.892	0.866	0.919	0.786	0.936
ACPmain (NB)	CPSR	0.645	0.773	0.517	0.301	0.701	0.660	0.552	0.767	0.327	0.719
	HOG-PSSM	0.584	0.477	0.692	0.173	0.605	0.663	0.581	0.744	0.330	0.753
	ProtT5	0.674	0.773	0.576	0.356	0.709	0.709	0.689	0.729	0.421	0.755
	ESM-2	0.616	0.692	0.541	0.235	0.648	0.831	0.860	0.802	0.664	0.858
	F1 + F2	0.628	0.535	0.721	0.260	0.665	0.802	0.744	0.860	0.609	0.865
	F1 + F2 + F3	0.846	0.878	0.814	0.693	0.859	0.849	0.884	0.814	0.699	0.864
	F1 + F2 + F4	0.802	0.738	0.866	0.610	0.873	0.817	0.750	0.884	0.639	0.877
ACPAlter (SVM)	CPSR	0.884	0.887	0.881	0.768	0.947	0.752	0.505	0.999	0.580	0.936
	HOG-PSSM	0.750	0.582	0.918	0.531	0.762	0.840	0.817	0.862	0.683	0.909
	ProtT5	0.899	0.887	0.912	0.799	0.952	0.884	0.897	0.870	0.768	0.925
	ESM-2	0.915	0.948	0.881	0.832	0.954	0.923	0.923	0.923	0.846	0.972
	F1 + F2	0.907	0.876	0.938	0.816	0.952	0.916	0.935	0.897	0.833	0.970
	F1 + F2 + F3	0.845	0.716	0.974	0.715	0.946	0.846	0.718	0.974	0.716	0.953
	F1 + F2 + F4	0.809	0.639	0.979	0.658	0.943	0.839	0.701	0.974	0.703	0.921
ACPAlter (CDF)	CPSR	0.883	0.866	0.899	0.766	0.921	0.920	0.938	0.902	0.841	0.967
	HOG-PSSM	0.861	0.794	0.928	0.728	0.921	0.853	0.789	0.918	0.712	0.915
	ProtT5	0.910	0.897	0.923	0.820	0.965	0.912	0.892	0.933	0.825	0.969
	ESM-2	0.930	0.974	0.887	0.864	0.965	0.990	0.979	1.000	0.980	0.997
	F1 + F2	0.933	0.892	0.974	0.869	0.971	0.997	0.995	1.000	0.995	1.000
	F1 + F2 + F3	0.948	0.985	0.912	0.899	0.983	0.990	0.979	1.000	0.980	0.996
	F1 + F2 + F4	0.964	0.943	0.985	0.929	0.990	0.997	0.995	1.000	0.995	1.000
ACPAlter (NB)	CPSR	0.817	0.820	0.814	0.634	0.869	0.809	0.897	0.722	0.628	0.911
	HOG-PSSM	0.794	0.758	0.830	0.589	0.872	0.826	0.756	0.896	0.659	0.887
	ProtT5	0.835	0.799	0.871	0.672	0.907	0.740	0.546	0.933	0.520	0.870
	ESM-2	0.869	0.918	0.820	0.741	0.900	0.903	0.805	1.000	0.822	0.916
	F1 + F2	0.866	0.820	0.912	0.735	0.913	0.903	0.839	1.000	0.842	0.925
	F1 + F2 + F3	0.892	0.928	0.856	0.786	0.928	0.858	0.805	0.910	0.720	0.921
	F1 + F2 + F4	0.897	0.861	0.933	0.796	0.941	0.884	0.872	0.896	0.768	0.948
ACP740 (SVM)	CPSR	0.705	0.474	0.945	0.473	0.892	0.839	0.789	0.890	0.682	0.932
	HOG-PSSM	0.852	0.882	0.822	0.705	0.885	0.859	0.868	0.849	0.718	0.914
	ProtT5	0.698	0.474	0.932	0.454	0.887	0.906	0.908	0.904	0.812	0.963
	ESM-2	0.886	0.895	0.877	0.772	0.952	0.899	0.960	0.836	0.819	0.988
	F1 + F2	0.872	0.868	0.877	0.745	0.941	0.926	0.895	0.959	0.854	0.981
	F1 + F2 + F3	0.866	0.855	0.877	0.732	0.948	0.919	0.921	0.918	0.839	0.967
	F1 + F2 + F4	0.510	1.000	0.000	0.000	0.674	0.864	0.833	0.897	0.731	0.947
ACP740 (CDF)	CPSR	0.839	0.789	0.890	0.682	0.933	0.859	0.842	0.877	0.719	0.945
	HOG-PSSM	0.819	0.829	0.808	0.637	0.873	0.819	0.829	0.808	0.637	0.886
	ProtT5	0.948	0.985	0.912	0.899	0.983	0.859	0.855	0.863	0.718	0.938
	ESM-2	0.872	0.882	0.863	0.745	0.947	0.980	0.987	0.973	0.960	0.997
	F1 + F2	0.886	0.895	0.877	0.772	0.955	0.987	0.987	0.986	0.973	0.997
	F1 + F2 + F3	0.893	0.882	0.904	0.786	0.952	0.987	1.000	0.973	0.973	0.995
	F1 + F2 + F4	0.948	0.985	0.912	0.899	0.983	0.987	0.987	0.986	0.973	0.999
ACP740 (NB)	CPSR	0.892	0.928	0.856	0.786	0.928	0.765	0.645	0.890	0.550	0.840
	HOG-PSSM	0.859	0.882	0.836	0.718	0.923	0.859	0.882	0.836	0.718	0.923
	ProtT5	0.852	0.789	0.918	0.712	0.940	0.852	0.789	0.918	0.712	0.940
	ESM-2	0.819	0.724	0.918	0.652	0.860	0.814	0.700	0.931	0.647	0.915
	F1 + F2	0.779	0.684	0.877	0.570	0.844	0.948	0.940	0.997	0.940	0.973
	F1 + F2 + F3	0.846	0.763	0.932	0.703	0.892	0.898	0.800	1.000	0.814	0.933
	F1 + F2 + F4	0.503	0.132	0.890	0.034	0.540	0.917	0.867	0.967	0.838	0.944

Best results highlighted in bold.