. Author manuscript; available in PMC: 2016 Aug 23.

Published in final edited form as: J Biomed Inform. 2015 Aug 1;58(Suppl):S92–S102. doi: 10.1016/j.jbi.2015.07.016

Table 7.

Diabetes: Comparison of F1 measure for diabetes models between 2008, 2014 and combined 2008/2014 broken down by SVM kernel, weighting scheme, and feature space.

Kernel	Weight	Feature Space	2008	2014	Combined 2008/2014	% Change 2008, 2014	% Change 2008, Comb.	% Change 2014, Comb.
RBF	tf-idf	Min & CUI	0.932^††	0.957	0.964	2.63^**	3.48^**	0.83
RBF	tf-idf	Min, Lex & CUI	0.946^††	0.959	0.963	1.30	1.78^**	0.47
RBF	tf-idf	Lex & CUI	0.926^††	0.958	0.959	3.46^**	3.56^**	0.10
RBF	tf-idf	Min & Lex	0.939^††	0.956	0.959	1.81^**	2.09^**	0.27
Linear	tf-idf	Min, Lex & CUI	0.939^††	0.941^††	0.958	0.19	2.08^**	1.88^**
Linear	tf-idf	Min & CUI	0.934^††	0.945^††	0.956^†	1.22	2.41^**	1.18
Linear	tf-idf	Lex	0.907^††	0.946^††	0.956	4.23^**	5.32^**	1.05
Linear	tf-idf	Lex & CUI	0.910^††	0.942^††	0.955	3.46^**	4.95^**	1.44
RBF	tf-idf	Lex	0.927^††	0.958	0.954^†	3.27^**	2.91^**	−0.35
RBF	Count	Min	0.870^††	0.949^††	0.954	9.11^**	9.72^**	0.55
RBF	tf-idf	Min	0.909^††	0.956^†	0.953^††	5.15^**	4.86^**	−0.27
RBF	Count	Min & Lex	0.880^††	0.946^††	0.953	7.43^**	8.25^**	0.77
RBF	Count	Min, Lex & CUI	0.880^††	0.942^††	0.953	7.08^**	8.37^**	1.20
Linear	tf-idf	Min	0.927^††	0.952^††	0.949^††	2.63^**	2.33^**	−0.29
Linear	tf-idf	Min & Lex	0.911^††	0.949^††	0.948^††	4.13^**	4.08^**	−0.05
RBF	Count	Lex & CUI	0.877^††	0.950^††	0.948^††	8.39^**	8.12^**	−0.24
RBF	Count	Lex	0.911^††	0.950^††	0.948^††	4.27^**	4.02^**	−0.24
Linear	Count	Min & CUI	0.842^††	0.943^††	0.946^††	11.99^**	12.26^**	0.24
Linear	Count	Lex & CUI	0.916^††	0.946^††	0.945^††	3.28^**	3.09^**	−0.19
Linear	Count	Lex	0.830^††	0.946^††	0.943^††	13.99^**	13.64^**	−0.31
Linear	Count	Min	0.830^††	0.943^††	0.943^††	13.72^**	13.68^**	−0.03
RBF	Count	Min & CUI	0.870^††	0.949^††	0.943^††	9.06^**	8.36^**	−0.65
Linear	Count	Min, Lex & CUI	0.796^††	0.944^††	0.942^††	18.53^**	18.27^**	−0.22
Linear	Count	Min & Lex	0.850^††	0.944^††	0.942^††	11.06^**	10.82^**	−0.22
RBF	tf-idf	CUI	0.869^††	0.866^††	0.883^††	−0.29	1.64	1.94
Linear	tf-idf	CUI	0.864^††	0.844^††	0.877^††	−2.32	1.50	3.91^**
RBF	Count	CUI	0.882^††	0.789^††	0.812^††	−10.52^**	−7.88^**	2.96
Linear	Count	CUI	0.811^††	0.799^††	0.804^††	−1.47	−0.95	0.53

* percent change significant at alpha = 0.05

^**

percent change significant at alpha = 0.1

^†

statistically significantly different from highest performing model (emphasized above) at alpha = 0.05

^††

statistically significantly different from highest performing model (emphasized above) at alpha =0.1

Note: For visual reference, models which are not statistically significantly different from the emphasized model at alpha = 0.1 are shaded in dark grey. Models which are not statistically significantly different from the emphasized model at alpha = 0.05 are shaded in light grey