Table 2. Performance of proposed predictors on alternative datasets.
| Dataset | Methoda | Recall | Precision | F1 | ACC | MCC | AUC |
|---|---|---|---|---|---|---|---|
| EF_family | Feature (Str|Seq) | 0.503b (0.486)c | 0.208 (0.206) | 0.292 (0.289) | 0.973 (0.974) | 0.311 (0.305) | 0.937 (0.931) |
| Template(Str|Seq) | 0.229 (0.200) | 0.303 (0.451) | 0.260 (0.276) | 0.986 (0.989) | 0.256 (0.295) | N/A | |
| Hunter(Str|Seq) | 0.489 (0.509) | 0.258 (0.226) | 0.336 (0.313) | 0.979 (0.976) | 0.345 (0.328) | 0.941 (0.936) | |
| CRHunter | 0.497 | 0.305 | 0.376 | 0.982 | 0.380 | 0.949 | |
| EF_superfamily | Feature(Str|Seq) | 0.509 (0.452) | 0.211 (0.193) | 0.297 (0.270) | 0.973 (0.972) | 0.315 (0.283) | 0.938 (0.924) |
| Template(Str|Seq) | 0.032 (0.023) | 0.056 (0.149) | 0.040 (0.040) | 0.983 (0.988) | 0.034 (0.054) | N/A | |
| Hunter(Str|Seq) | 0.506 (0.536) | 0.189 (0.163) | 0.274 (0.250) | 0.970 (0.964) | 0.296 (0.282) | 0.937 (0.925) | |
| CRHunter | 0.523 | 0.218 | 0.307 | 0.974 | 0.326 | 0.944 | |
| EF_fold | Feature(Str|Seq) | 0.448 (0.363) | 0.210 (0.182) | 0.282 (0.241) | 0.971 (0.971) | 0.292 (0.243) | 0.918 (0.907) |
| Template(Str|Seq) | 0.017 (0.018) | 0.030 (0.124) | 0.021 (0.031) | 0.981 (0.986) | 0.013 (0.042) | N/A | |
| Hunter(Str|Seq) | 0.505 (0.497) | 0.178 (0.160) | 0.259 (0.241) | 0.964 (0.961) | 0.283 (0.265) | 0.918 (0.907) | |
| CRHunter | 0.504 | 0.211 | 0.293 | 0.970 | 0.311 | 0.926 | |
| HA_superfamily | Feature(Str|Seq) | 0.539 (0.497) | 0.198 (0.182) | 0.289 (0.266) | 0.974 (0.973) | 0.316 (0.290) | 0.944 (0.933) |
| Template(Str|Seq) | 0.103 (0.091) | 0.150 (0.326) | 0.121 (0.141) | 0.986 (0.990) | 0.117 (0.168) | N/A | |
| Hunter(Str|Seq) | 0.557 (0.556) | 0.186 (0.174) | 0.278 (0.265) | 0.972 (0.970) | 0.310 (0.299) | 0.944 (0.936) | |
| CRHunter | 0.575 | 0.233 | 0.330 | 0.977 | 0.356 | 0.952 | |
| NN | Feature(Str|Seq) | 0.475 (0.468) | 0.207 (0.201) | 0.286 (0.280) | 0.974 (0.974) | 0.301 (0.295) | 0.935 (0.932) |
| Template(Str|Seq) | 0.108 (0.088) | 0.141 (0.393) | 0.122 (0.139) | 0.983 (0.989) | 0.115 (0.177) | N/A | |
| Hunter(Str|Seq) | 0.541 (0.543) | 0.196 (0.178) | 0.285 (0.267) | 0.971 (0.968) | 0.312 (0.298) | 0.939 (0.934) | |
| CRHunter | 0.551 | 0.243 | 0.335 | 0.977 | 0.354 | 0.949 | |
| PC | Feature(Str|Seq) | 0.478 (0.383) | 0.214 (0.181) | 0.285 (0.242) | 0.972 (0.972) | 0.302 (0.249) | 0.936 (0.923) |
| Template(Str|Seq) | 0.061 (0.019) | 0.088 (0.075) | 0.072 (0.030) | 0.982 (0.988) | 0.064 (0.034) | N/A | |
| Hunter(Str|Seq) | 0.524 (0.469) | 0.189 (0.161) | 0.274 (0.234) | 0.967 (0.964) | 0.299 (0.257) | 0.937 (0.924) | |
| CRHunter | 0.493 | 0.231 | 0.306 | 0.974 | 0.321 | 0.945 |
aFeature(Str|Seq) denotes our feature predictor based on structural or sequence information. Template(Str|Seq) denotes our template predictor based on structure or profile alignment. Hunter(Str|Seq) is the combined structural or sequence module. CRHunter is our final prediction algorithm.
bResults generated by structure-based predictors.
cResults generated by sequence-based predictors.