Skip to main content

View full-text article in PMC

. 2019 Sep 18;10:14. doi: 10.1186/s13326-019-0207-3

Table 4.

F-scores calculated from the evaluation outcomes

			Development set (n = 30)				Test set (n = 68)
Algorithm	Concept	Approach	UMLS2011	UMLS2016	UMLS2016D	DIRECT	UMLS2011	UMLS2016	UMLS2016D	DIRECT
Named-entity recognition	Lung cancer^a	Implied	0.698	0.541	0.920	0.920	0.814	0.725	0.828	0.828
	Lung cancer^a	Strict	0.769	0.606	1.000	1.000	0.880	0.841	0.947	0.947
	Non-small cell lung cancer^b	Implied	0.759	0.455	0.867	1.000	0.879	0.655	0.746	0.862
	Non-small cell lung cancer^b	Strict	0.759	0.455	0.867	1.000	0.951	0.720	0.815	0.933
	Recurrence^c		0.000	0.000	1.000	1.000	0.000	0.000	0.938	0.921
Relationship detection	Recurrent lung cancer^d					1.000				0.857

^aSNOMED CT concept 93880001 | Primary malignant neoplasm of lung (disorder)

^bSNOMED CT concept 254637007 | Non-small cell lung cancer (disorder)

^cSNOMED CT concept 255227004 | Recurrent (qualifier value)

^dRelationship between three SNOMED CT concepts: 93880001 | Primary malignant neoplasm of lung (disorder) |: 263502005 | Clinical course (attribute) | = 255227004 | Recurrent (qualifier value)