Table 5.

Performance metrics for cTakes automated annotation. Metrics were calculated taking into account all annotations, only unique annotations, and only unique annotations while also ignoring polarity. 95% confidence interval is provided for sensitivity, precision, and accuracy measurements

	All annotations	Unique annotations	Unique, ignoring polarity
True positive	137	102	108
False positive	71	44	44
False negative	23	15	9
Total	231	161	161
Sensitivity	0.86 (0.79–0.91)	0.87 (0.80–0.93)	0.92 (0.86–0.96)
Precision	0.66 (0.59–0.72)	0.70 (0.62–0.77)	0.71 (0.63–0.78)
Accuracy	0.59 (0.53–0.66)	0.63 (0.55–0.71)	0.67 (0.59–0.74)
F1	0.74	0.78	0.80