Table 15:

Macro-F1 scores of RF, XGBoost and Bio-ClinicalBERT for Drug Use.

	With Oversampling			Without Oversampling
	RF	XGBoost	Bio-ClinicalBERT	RF	XGBoost	Bio-ClinicalBERT
Present	0.5221 ± 0.0428	0.5194 ± 0.0796	0.2999 ± 0.102	0.4538 ± 0.0823	0.4776 ± 0.0688	0.1735 ± 0.1204
Past	0.4547 ± 0.0151	0.5582 ± 0.0462	0.4749 ± 0.0636	0.3119 ± 0.0711	0.4821 ± 0.0312	0.3698 ± 0.1631
Never	0.9194 ± 0.013	0.9188 ± 0.0126	0.8606 ± 0.0625	0.908 ± 0.0138	0.9172 ± 0.0094	0.8989 ± 0.0186
Unsure	0.4793 ± 0.0301	0.5011 ± 0.0706	0.3355 ± 0.0714	0.4437 ± 0.0732	0.4535 ± 0.0496	0.0 ± 0.0
None	0.9732 ± 0.0049	0.9736 ± 0.0061	0.935 ± 0.0077	0.9761 ± 0.0055	0.9723 ± 0.007	0.9719 ± 0.004