Table 2.

The inter-annotator agreement for the main phase for 800 sentences, measured with F1-score, showed good agreement in the two sets of annotations for biomarkers as well as very high agreement in the variant annotation task. The sentences from the multiple test phases are not included in these numbers and were discarded from further analysis

	Annotator 2	Annotator 3
Annotator 1	0.74	0.73
Annotator 2	NA	0.74
Annotator 1	0.78	0.85
Annotator 2	NA	0.79
Annotator 1	0.96	0.96
Annotator 2	NA	0.96