Skip to main content
. Author manuscript; available in PMC: 2018 Apr 30.
Published in final edited form as: Nat Methods. 2017 Oct 30;14(12):1141–1152. doi: 10.1038/nmeth.4473

Table 4. Usability evaluation of the top-three ranked algorithms based on the overall performance measure.

Legend: NP: number of parameters; GP: Generalizability measure, normalized between 0 (no generalizability) and 1 (complete generalizability); TIM: execution time in seconds.

Color code: For each dataset and parameter, red background means the worst value of the three methods, yellow means the intermediate value, and green means the best value out of the three listed.

1st ranked 2nd ranked 3rd ranked
NP GP TIM NP GP TIM NP GP TIM
DIC-C2DH-HeLa FR-Ro-GE 0.828 KTH-SE (4) 0.629 IMCB-SG (1) 0.523
4 0.912 4818 14 0.928 622 5 0.924 236
Fluo-C2DL-MSC KTH-SE (1) 0.676 FR-Ro-GE 0.636 NOTT-UK 0.546
17 0.893 79 4 0.893 2630 5 0.920 342
Fluo-C3DH-H157 KTH-SE (1) 0.938 HD-Har-GE 0.885 CUNI-CZ 0.870
17 0.966 16156 10 0.882 14110 8 0.836 952
Fluo-C3DL-MDA231 KTH-SE (1) 0.757 LEID-NL 0.745 IMCB-SG (2) 0.659
16 0.947 217 9 0.958 992 9 0.936 3506
Fluo-N2DH-GOWT1 KTH-SE (1) 0.951 LEID-NL 0.902 CUNI-CZ 0.902
17 0.955 632 9 0.932 1333 8 0.950 479
Fluo-N2DL-HeLa KTH-SE (1) 0.942 FR-Ro-GE 0.940 HD-Har-GE 0.901
17 0.967 304 3 0.963 22878 10 0.966 609
Fluo-N3DH-CE KTH-SE (1) 0.688 HD-Har-GE 0.601 KIT-GE 0.507
17 0.895 13475 9 0.889 14518 10 0.872 4258
Fluo-N3DH-CHO KTH-SE (1) 0.926 MU-CZ 0.912 HD-Har-GE 0.906
17 0.954 202 8 0.936 223 10 0.923 1495
Fluo-N3DL-DRO KTH-SE (2) 0.609 UP-PT 0.285 CUL-UK 0.220
20 0.885 85272 8 0.916 13772 3 0.973 6902
PhC-C2DH-U373 FR-Ro-GE 0.951 FR-Be-GE 0.896 KTH-SE (3) 0.886
5 0.965 11450 8 0.953 621 11 0.964 81
PhC-C2DL-PSC HD-Hau-GE 0.804 KTH-SE (1) 0.772 UP-PT 0.735
15 0.952 924 17 0.971 3481 11 0.959 8246
Fluo-N2DH-SIM+ FR-Ro-GE 0.878 KTH-SE (1) 0.874 PAST-FR 0.859
3 0.979 20124 17 0.983 301 9 0.978 370
Fluo-N3DH-SIM+ KTH-SE (1) 0.848 LEID-NL 0.798 IMCB-SG (2) 0.714
17 0.985 13115 9 0.973 66773 9 0.988 69549