. Author manuscript; available in PMC: 2011 Oct 1.

Published in final edited form as: J Biomed Inform. 2010 May 5;43(5):669–685. doi: 10.1016/j.jbi.2010.04.009

Table 6.

Wilcoxon paired-samples signed-rank test comparing the performance of PSMBl-MA with other algorithms at small training sample sizes of 64 and 128. PSMBl-MS denotes the single best MB model with local structure and LR is the logistic regression model. For each performance measure the number on top is the Z statistic and the number at the bottom is the corresponding p-value. The Z statistic is negative when PSMBl-MA has a lower (i.e., better) score on a performance measure than the competing algorithm. Thus, a negative Z statistic indicates better performance by PSMBl-MA. Underlined results indicate the two-tailed p-values of 0.05 or smaller, indicating that PSMBl-MA performed statistically significantly better at that level.

Performance measure	PSMBl-MS	PSMBg-MA	LR

Misclassification error	-2.521	-1.120	-1.680
Misclassification error	0.012	0.263	0.093

1 - AUC	-1.120	-1.120	-0.420
1 - AUC	0.263	0.263	0.674

Logarithmic loss	-2.521	-2.380	-2.380
Logarithmic loss	0.012	0.017	0.017

Squared error	-2.380	-2.380	-2.380
Squared error	0.017	0.017	0.017

CAL score	-2.380	-1.120	-2.521
CAL score	0.017	0.263	0.012