Table 3.

SemRep 1.8 evaluation against the test collection

	Precision	Recall	F 1
Strict evaluation	0.55	0.34	0.42
Relaxed evaluation	0.69	0.42	0.52

Relaxed evaluation allows interchangeable concepts and ignores test collection annotation errors