Table 2.

Inter-annotator agreement on the PhenoCHF annotations.

	Discharge summaries		Articles
Phenotypic class	Exact	Relaxed	Exact	Relaxed
Cause	0.84	0.95	0.59	0.78
Risk factor	0.84	0.94	0.86	0.79
Sign & symptom	0.69	0.97	0.53	0.82
Non-traditional risk factor	0.77	0.83	0.81	0.72
Macro-average	0.82	0.92	0.69	0.77

F-scores were calculated using both exact and relaxed matching.