Table 3.

Performance comparison on blind tests

Method	Data set	Validation	Pearson’s ρ	σ (kcal/mol)
mCSMa	SP1	5-fold Positionc	0.54	1.23
MAESTRO	SP1	5-fold Positionc	0.67	1.12
mCSMa	SP1	5-fold Proteinc	0.51	1.26
MAESTRO	SP1	5-fold Proteind	0.63	1.17
mCSMa	SP1 351d	Blind Position	0.67	1.19
DUETb	SP1 351d	Blind Position	0.71	1.13
MAESTRO	SP1 351e	Blind Position	0.71	1.16

^aResults derived from Pires et al. [14], supplementary material. ^bResults derived from Pires et al. [15]. ^c5-fold cross validation on position level. All mutations of a certain mutation site are either in the test or training set. ^d5-fold cross validation on protein level. All mutations of a certain protein are either in the test or training set. ^eBlind test on a subset of the SP1 data set, provided by Pires et al. [14]. The set includes 351 mutants, whose positions are not in the remaining training set.