Table 8.
Performance assessments of existing techniques on the DRIVE and STARE datasets.
Method | Year | DRIVE | STARE | ||||||
---|---|---|---|---|---|---|---|---|---|
Acc | Sn | Sp | AUC | Acc | Sn | Sp | AUC | ||
Human observer | 0.947 | 0.779 | 0.972 | 0.874 | 0.935 | 0.895 | 0.938 | 0.917 | |
Unsupervised techniques | |||||||||
Chauduri [31] | 1989 | 0.877 | — | — | 0.788 | — | — | — | — |
Zana and Klein [42] | 2001 | 0.938 | 0.697 | — | — | — | — | — | — |
Martinez-Perez [45] | 2007 | 0.934 | 0.725 | 0.965 | 0.845 | 0.941 | 0.751 | 0.955 | 0.853 |
Zhang [27] | 2010 | 0.938 | — | — | — | 0.948 | — | — | — |
Bankhead [38] | 2012 | 0.937 | 0.703 | 0.971 | 0.837 | 0.932 | 0.758 | 0.950 | 0.854 |
Fraz [44] | 2012 | 0.943 | 0.715 | 0.976 | 0.845 | 0.944 | 0.731 | 0.968 | 0.850 |
Azzopardi [5] | 2015 | 0.944 | 0.766 | 0.970 | 0.868 | 0.950 | 0.772 | 0.970 | 0.871 |
Oliveira [33] | 2016 | 0.946 | 0.864 | 0.956 | 0.910 | 0.953 | 0.825 | 0.965 | 0.895 |
Khan [40] | 2016 | 0.961 | 0.746 | 0.980 | 0.863 | 0.946 | 0.758 | 0.963 | 0.861 |
Biswal [29] | 2017 | 0.950 | 0.710 | 0.970 | 0.840 | 0.950 | 0.700 | 0.970 | 0.835 |
Khan [32] | 2017 | 0.944 | 0.754 | 0.964 | 0.859 | 0.948 | 0.752 | 0.956 | 0.854 |
Soomro [63] | 2017 | 0.943 | 0.752 | 0.976 | 0.864 | 0.961 | 0.784 | 0.981 | 0.883 |
Badawi [3] | 2018 | 0.955 | 0.791 | 0.971 | 0.881 | 0.953 | 0.865 | 0.961 | 0.913 |
Yue [50] | 2018 | 0.945 | 0.753 | 0.973 | 0.863 | — | — | — | — |
Soomro [9] | 2018 | 0.948 | 0.745 | 0.962 | 0.854 | 0.951 | 0.784 | 0.976 | 0.880 |
Soomro [64] | 2018 | 0.953 | 0.752 | 0.976 | 0.864 | 0.967 | 0.786 | 0.982 | 0.884 |
Fan [60] | 2018 | 0.960 | 0.736 | 0.981 | 0.858 | 0.957 | 0.791 | 0.970 | 0.880 |
Khan [65] | 2019 | 0.951 | 0.770 | 0.965 | 0.868 | 0.951 | 0.752 | 0.981 | 0.867 |
Memari [59] | 2019 | 0.961 | 0.761 | 0.981 | 0.871 | 0.951 | 0.782 | 0.965 | 0.873 |
Proposed | 2020 | 0.958 | 0.797 | 0.973 | 0.885 | 0.996 | 0.792 | 0.998 | 0.895 |
Supervised techniques | |||||||||
Niemeijer [11] | 2004 | 0.942 | 0.690 | 0.970 | 0.830 | — | — | — | — |
Staal [12] | 2004 | 0.944 | 0.719 | 0.977 | 0.848 | 0.952 | 0.697 | 0.981 | 0.839 |
Ricci [14] | 2007 | 0.959 | — | — | — | 0.964 | — | — | — |
Lupascu [15] | 2010 | 0.959 | 0.673 | 0.987 | 0.830 | — | — | — | — |
MarÃn [13] | 2011 | 0.945 | 0.707 | 0.980 | 0.844 | 0.953 | 0.694 | 0.982 | 0.838 |
Wang [16] | 2015 | 0.977 | 0.817 | 0.973 | 0.895 | 0.981 | 0.810 | 0.979 | 0.894 |
Roychowdhury [17] | 2015 | 0.952 | 0.725 | 0.983 | 0.854 | 0.951 | 0.772 | 0.973 | 0.873 |
Aslani [20] | 2016 | 0.951 | 0.754 | 0.980 | 0.867 | 0.961 | 0.755 | 0.983 | 0.869 |
Zhu [18] | 2017 | 0.961 | 0.714 | 0.987 | 0.851 | — | — | — | — |
Thangaraj [22] | 2017 | 0.961 | 0.801 | 0.975 | 0.888 | 0.943 | 0.834 | 0.954 | 0.893 |
Memari [23] | 2017 | 0.972 | 0.872 | 0.988 | 0.930 | 0.951 | 0.809 | 0.979 | 0.894 |
Dharmawan [21] | 2018 | — | 0.831 | 0.972 | 0.902 | — | 0.792 | 0.983 | 0.887 |
Yan [24] | 2018 | 0.954 | 0.763 | 0.982 | 0.873 | 0.964 | 0.774 | 0.986 | 0.880 |
Guo [25] | 2019 | 0.955 | 0.780 | 0.981 | 0.881 | 0.966 | 0.820 | 0.983 | 0.902 |
Khowaja [26] | 2019 | 0.975 | 0.818 | 0.971 | 0.895 | 0.975 | 0.824 | 0.975 | 0.899 |
Soomro [8] | 2019 | 0.959 | 0.802 | 0.974 | 0.948 | 0.961 | 0.801 | 0.969 | 0.945 |
Soomro [62] | 2019 | 0.956 | 0.870 | 0.985 | 0.986 | 0.968 | 0.848 | 0.986 | 0.988 |
Fan [61] | 2019 | 0.966 | 0.796 | 0.982 | 0.889 | 0.974 | 0.816 | 0.987 | 0.901 |