Table 4.

Sentence and note level performance comparison (F1 score).

Entity Type	Sentence Level			Note Level
LM-LSTM-CRF	BioBERT	Baseline	LM-LSTM-CRF	BioBERT	Baseline
Bleeding event	0.8785	0.8761	0.1492	0.9985	1.0	1.0
Bleeding anatomic site	0.8083	0.8043	0.0592	0.9454	0.9338	0.8478
Suspected alternative cause	0.6356	0.6371	0.0658	0.8838	0.8931	0.8734
Severity	0.8902	0.8973	0.0609	0.9574	0.9642	0.8506
Medication	0.9484	0.9388	0.1242	0.9985	0.9993	1.0
Bleeding lab evaluation	0.8934	0.8976	0.0593	0.9575	0.9620	0.8506
Macro	0.8424	0.8419	0.0864	0.9569	0.9587	0.9154