Table 2.

Exact and inexact evaluation on the concept extraction task

Concept extraction
System by	Medical experts	Method	External?	Exact F measure	Inexact F measure
deBruijn et al25	N	Semi-supervised	N	0.852	0.924
Jiang et al16	Y	Hybrid	Y	0.839	0.913
Kang et al17	N	Hybrid	Y	0.821	0.904
Gurulingappa et al18	N	Supervised	Y	0.818	0.905
Patrick et al19	N	Supervised	Y	0.818	0.898
Torii and Liu20	N	Supervised	N	0.813	0.898
Jonnalagadda and Gonzalez21	N	Semi-supervised	N	0.809	0.901
Sasaki et al22	N	Supervised	N	0.802	0.887
Roberts et al23	N	Supervised	N	0.796	0.893
Pai et al24	Y	Hybrid	N	0.788	0.884