Table 1.
Comparing the performance of the three servers.
| Set | Property | PISA | EPPIC | ClusPro |
|---|---|---|---|---|
| Training set | ||||
| Dimers: 120 | Dimer correct | 111 (92.5 %) | 111 (92.5 %) | 110 (91.7%) |
| Monomers: 89 | Monomer correct | 41 (46.1%) | 68 (76.4%) | 71 (79.8%) |
| Total: 209 | Total correct | 152 (72.7%) | 179 (85.6%) | 181 (86.6%) |
| Sensitivity & Specificity | 0.93 & 0.46 | 0.93 & 0.76 | 0.92 & 0.80 | |
| F1 value | 0.80 | 0.88 | 0.89 | |
| DC set | ||||
| DC Bio: 63 | Dimer correct | 42 (66.7%) | 59 (93.7%) | 58 (92.1%) |
| DC Xtal: 78 | Monomer correct | 42 (53.8%) | 51 (65.4%) | 47 (60.3%) |
| Total: 141 | Total correct | 84 (59.6%) | 110 (78.0%) | 105 (74.5%) |
| Sensitivity & Specificity | 0.67& 0.54 | 0.94 & 0.65 | 0.92 & 0.60 | |
| F1 value | 0.60 | 0.79 | 0.76 | |
| Test set | ||||
| Dimers: 293 | Dimer correct | 208 (69.8%) | 223 (74.8%) | 223 (74.8%) |
| Monomers: 490 | Monomer correct | 378 (77.1%) | 385 (78.6%) | 395 (80.6%) |
| Total: 783 | Total correct | 586 (74.8%) | 608 (77.7%) | 618 (78.9%) |
| Sensitivity & Specificity | 0.71 & 0.77 | 0.76 & 0.79 | 0.76 & 0.81 | |
| F1 value | 0.68 | 0.72 | 0.73 | |
| “Difficult” subset | ||||
| Dimers: 56 | Dimer correct | 34 (60.7%) | 15 (26.8%) | 31 (55.4%) |
| Monomers: 86 | Monomer correct | 31 (36.0%) | 39 (45.3%) | 55 (64.0%) |
| Total: 142 | Total correct | 65 (45.8%) | 54 (38.0%) | 86 (60.6%) |
| Sensitivity & Specificity | 0.61 & 0.36 | 0.27 & 0.45 | 0.55 & 0.64 | |
| F1 value | 0.47 | 0.25 | 0.53 | |