TABLE V.

Performance Metrics (Weighted Average) Computed Using Only All SAP Features for Different Classifiers

Classifier	TPR	FPR	F- Measure	MCC	AUPRC	Sensitivity (80% specificity)	Sensitivity (90% specificity)	AUROC (95% CI)
Bayesian Net	0.61	0.63	0.51	0.03	0.57	0.28	0.18	0.53 [0.49,0.58]
Lazy K Star	0.70	0.22	0.71	0.48	0.87	0.70	0.56	0.82 [0.79,0.86]
Meta Classification Regression	0.65	0.43	0.64	0.22	0.65	0.39	0.24	0.65 [0.61,0.69]
Meta Ensemble Selection	0.69	0.45	0.67	0.28	0.69	0.41	0.25	0.68 [0.64,0.72]
Alternating Decision Tree	0.63	0.49	0.61	0.15	0.65	0.41	0.25	0.64 [0.60,0.68]
Random Forest Tree	0.73	0.40	0.71	0.40	0.80	0.63	0.50	0.80 [0.76,0.83]
Classification And Regression Tree (CART)	0.65	0.46	0.64	0.20	0.62	0.28	0.18	0.61 [0.57,0.65]