Table 5.

The category-level performances for subtask 2 (relation identification).

Model and relation		Precision		Recall		F1
LSTM-CRFsa,b + BERTc-cls + BERT-rel
	Family member—living status		0.7039		0.6132		0.6554
	Family member—observation		0.7452		0.5269		0.6174
LSTM-CRFs-EN + BERT-cls + BERT-rel
	Family member—living status		0.6773		0.6676		0.6724
	Family member—observation		0.7071		0.5993		0.6487
BERT-ner + BERT-cls + BERT-rel
	Family member—living status		0.6583		0.6734		0.6657
	Family member—observation		0.7341		0.6111		0.6670
BERT-ner-EN + BERT-cls + BERT-rel
	Family member—living status		0.6912		0.6734		0.6821
	Family member—observation		0.7603		0.6086		0.6760

^aLSTM: long short-term memory.

^bCRFs: conditional random fields.

^cBERT: bidirectional encoder representations from transformers.