Table 2.
Average AUCs of eight methods on the 34 UCI machine learning datasets.
Dataset | SVM
|
SVMROC
|
RankBoost
|
OPAUC
|
SVMlin
|
SSRankBoost
|
SSLROC1
|
SSLROC2
|
||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Avg | Std | Avg | Std | Avg | Std | Avg | Std | Avg | Std | Avg | Std | Avg | Std | Avg | Std | |
1 | 0.700 | 0.078 | 0.699 | 0.079 | 0.620 | 0.083 | 0.701 | 0.075 | 0.704 | 0.078 | 0.654 | 0.080 | 0.703 | 0.077 | 0.702 | 0.078 |
2 | 0.806 | 0.092 | 0.806 | 0.092 | 0.659 | 0.086 | 0.701 | 0.126 | 0.811 | 0.094 | 0.707 | 0.083 | 0.815 | 0.072 | 0.818 | 0.069 |
3 | 0.735 | 0.039 | 0.735 | 0.036 | 0.689 | 0.072 | 0.716 | 0.056 | 0.725 | 0.045 | 0.691 | 0.077 | 0.737 | 0.042 | 0.736 | 0.048 |
4 | 0.906 | 0.026 | 0.927 | 0.038 | 0.946 | 0.015 | 0.877 | 0.030 | 0.926 | 0.031 | 0.915 | 0.026 | 0.910 | 0.038 | 0.930 | 0.026 |
5 | 0.631 | 0.086 | 0.627 | 0.088 | 0.631 | 0.059 | 0.641 | 0.082 | 0.648 | 0.095 | 0.652 | 0.088 | 0.638 | 0.081 | 0.632 | 0.084 |
6 | 0.993 | 0.006 | 0.993 | 0.006 | 0.974 | 0.030 | 0.993 | 0.006 | 0.994 | 0.006 | 0.984 | 0.013 | 0.994 | 0.005 | 0.993 | 0.005 |
7 | 0.984 | 0.013 | 0.979 | 0.013 | 0.963 | 0.045 | 0.984 | 0.015 | 0.982 | 0.013 | 0.978 | 0.016 | 0.983 | 0.013 | 0.979 | 0.012 |
8 | 1.00 | 0.001 | 1.00 | 0.001 | 1.00 | 0.000 | 1.00 | 0.001 | 1.00 | 0.001 | 1.00 | 0.000 | 0.999 | 0.001 | 1.00 | 0.001 |
9 | 0.932 | 0.046 | 0.938 | 0.049 | 0.904 | 0.056 | 0.958 | 0.021 | 0.959 | 0.025 | 0.927 | 0.043 | 0.943 | 0.043 | 0.943 | 0.043 |
10 | 0.734 | 0.092 | 0.734 | 0.092 | 0.700 | 0.096 | 0.725 | 0.088 | 0.719 | 0.099 | 0.699 | 0.087 | 0.733 | 0.092 | 0.734 | 0.091 |
11 | 0.993 | 0.008 | 0.994 | 0.007 | 0.960 | 0.032 | 0.994 | 0.007 | 0.991 | 0.011 | 0.981 | 0.012 | 0.996 | 0.005 | 0.996 | 0.005 |
12 | 0.948 | 0.037 | 0.952 | 0.044 | 0.860 | 0.112 | 0.931 | 0.052 | 0.917 | 0.070 | 0.922 | 0.069 | 0.947 | 0.050 | 0.951 | 0.047 |
13 | 0.963 | 0.044 | 0.964 | 0.045 | 0.905 | 0.110 | 0.954 | 0.061 | 0.964 | 0.034 | 0.934 | 0.063 | 0.970 | 0.030 | 0.970 | 0.036 |
14 | 0.923 | 0.039 | 0.925 | 0.036 | 0.880 | 0.051 | 0.928 | 0.038 | 0.923 | 0.038 | 0.892 | 0.050 | 0.925 | 0.037 | 0.925 | 0.038 |
15 | 0.856 | 0.061 | 0.853 | 0.061 | 0.753 | 0.080 | 0.842 | 0.056 | 0.854 | 0.052 | 0.803 | 0.065 | 0.854 | 0.057 | 0.851 | 0.060 |
16 | 0.988 | 0.012 | 0.988 | 0.011 | 0.983 | 0.016 | 0.989 | 0.010 | 0.989 | 0.010 | 0.984 | 0.016 | 0.991 | 0.006 | 0.990 | 0.009 |
17 | 0.951 | 0.037 | 0.946 | 0.044 | 0.914 | 0.049 | 0.889 | 0.049 | 0.933 | 0.023 | 0.901 | 0.059 | 0.964 | 0.026 | 0.962 | 0.028 |
18 | 1.00 | 0.000 | 1.00 | 0.000 | 0.998 | 0.006 | 1.00 | 0.000 | 1.00 | 0.000 | 0.999 | 0.002 | 1.00 | 0.000 | 1.00 | 0.000 |
19 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 | 1.00 | 0.000 |
20 | 0.884 | 0.035 | 0.884 | 0.046 | 0.934 | 0.042 | 0.873 | 0.045 | 0.891 | 0.049 | 0.934 | 0.042 | 0.892 | 0.033 | 0.888 | 0.041 |
21 | 0.954 | 0.037 | 0.957 | 0.036 | 0.955 | 0.040 | 0.954 | 0.039 | 0.949 | 0.041 | 0.956 | 0.035 | 0.961 | 0.023 | 0.961 | 0.023 |
22 | 0.878 | 0.040 | 0.878 | 0.041 | 0.885 | 0.047 | 0.879 | 0.043 | 0.877 | 0.037 | 0.885 | 0.039 | 0.878 | 0.040 | 0.879 | 0.041 |
23 | 0.766 | 0.066 | 0.767 | 0.066 | 0.729 | 0.060 | 0.766 | 0.076 | 0.778 | 0.045 | 0.736 | 0.043 | 0.784 | 0.054 | 0.777 | 0.049 |
24 | 0.604 | 0.070 | 0.606 | 0.072 | 0.593 | 0.059 | 0.607 | 0.069 | 0.595 | 0.082 | 0.606 | 0.062 | 0.607 | 0.081 | 0.606 | 0.065 |
25 | 0.830 | 0.059 | 0.850 | 0.045 | 0.842 | 0.048 | 0.839 | 0.045 | 0.833 | 0.043 | 0.837 | 0.055 | 0.845 | 0.039 | 0.849 | 0.047 |
26 | 0.852 | 0.064 | 0.852 | 0.064 | 0.736 | 0.101 | 0.852 | 0.068 | 0.834 | 0.081 | 0.783 | 0.058 | 0.849 | 0.063 | 0.852 | 0.065 |
27 | 0.928 | 0.032 | 0.925 | 0.027 | 0.887 | 0.036 | 0.924 | 0.030 | 0.926 | 0.034 | 0.885 | 0.046 | 0.928 | 0.028 | 0.927 | 0.031 |
28 | 0.646 | 0.102 | 0.644 | 0.101 | 0.616 | 0.067 | 0.646 | 0.086 | 0.642 | 0.106 | 0.616 | 0.077 | 0.647 | 0.069 | 0.658 | 0.084 |
29 | 0.708 | 0.074 | 0.710 | 0.086 | 0.684 | 0.062 | 0.670 | 0.079 | 0.675 | 0.093 | 0.700 | 0.068 | 0.731 | 0.053 | 0.726 | 0.049 |
30 | 0.750 | 0.105 | 0.744 | 0.110 | 0.762 | 0.091 | 0.679 | 0.070 | 0.692 | 0.083 | 0.765 | 0.089 | 0.774 | 0.074 | 0.782 | 0.064 |
31 | 0.949 | 0.033 | 0.951 | 0.036 | 0.859 | 0.050 | 0.850 | 0.074 | 0.937 | 0.041 | 0.877 | 0.034 | 0.956 | 0.029 | 0.966 | 0.024 |
32 | 0.988 | 0.009 | 0.989 | 0.009 | 0.958 | 0.028 | 0.974 | 0.013 | 0.988 | 0.010 | 0.913 | 0.034 | 0.988 | 0.013 | 0.988 | 0.013 |
33 | 1.00 | 0.001 | 1.00 | 0.001 | 0.976 | 0.053 | 1.00 | 0.001 | 1.00 | 0.001 | 0.994 | 0.008 | 1.00 | 0.000 | 1.00 | 0.000 |
34 | 0.989 | 0.010 | 0.990 | 0.009 | 0.992 | 0.007 | 0.990 | 0.010 | 0.991 | 0.011 | 0.991 | 0.009 | 0.991 | 0.008 | 0.991 | 0.008 |
Avg | 0.875 | 0.043 | 0.877 | 0.044 | 0.845 | 0.053 | 0.863 | 0.045 | 0.872 | 0.044 | 0.856 | 0.045 | 0.880 | 0.038 | 0.881 | 0.038 |