Table 6.

Training and testing performance by submission.

Submission	Rules	STM			Weights			Cutpoint	Results
		DT	kNN	SVM	DT	LR	SVM		F1	Precision	Recall	N
Training
1	✓							20%	0.8396	0.9908	0.7284	1,854
2	✓				✓	✓		20%	0.7420	0.6795	0.8172	3,033
3	✓	✓		✓				20%	0.7228	0.6457	0.8208	3,206
Testing
1	✓							20%	0.3408	0.5667	0.2437	547
2	✓				✓	✓		20%	0.4770	0.4865	0.4678	1,223
3	✓	✓		✓				20%	0.5023	0.4992	0.5055	1,288