Table 4.

Performance of each label category with pretrained MIMIC models on i2b2 2010 task.

	word2vec	GloVe	fastText	ELMo	BERTBASE	BERTLARGE
PROBLEM	84.16	85.08	84.32	88.76	89.61 a	89.26
TEST	85.93	84.96	84.01	87.39	88.09	88.8 a
TREATMENT	83.14	84.73	83.89	86.98	88.3	89.14 a

i2b2: Informatics for Integrating Biology and the Bedside; MIMIC: Medical Information Mart for Intensive Care;

^aThe best performing result in the respective task.