Table 4.

Performance of Allergy and Keyword Algorithms

	Originial2 (95% CI) Corrected2 (95% CI)
	(n)	Sensitivity	Specificity	PPV1	NPV1
Allergy Algorithms
Problem List	75	0.58 (0.49–0.67)	0.98 (0.94–0.99)	0.95 (0.87–0.99)	0.77 (0.71–0.83)
	71	0.57 (0.48–0.66)	1.00 (0.97–1.00)	1.00 (0.93–1.00)	0.77 (0.71–0.82)
High Value Documents	86	0.62 (0.53–0.71)	0.94 (0.90–0.97)	0.88 (0.80–0.94)	0.79 (0.72–0.84)
	78	0.61 (0.52–0.70)	0.99 (0.96–1.00)	0.97 (0.91–1.00)	0.78 (0.72–0.84)
Combined	89	0.64 (0.55–0.72)	0.94 (0.89–0.97)	0.88 (0.79–0.94)	0.79 (0.73–0.84)
	80	0.63 (0.54–0.71)	0.99 (0.96–1.00)	0.97 (0.91–1.00)	0.79 (0.73–0.84)
Keyword Algorithms
Clinical Comm.	65	0.45 (0.36–0.54)	0.94 (0.90–0.97)	0.85 (0.74–0.92)	0.71 (0.65–0.77)
	60	0.46 (0.37–0.55)	0.98 (0.95–1.00)	0.98 (0.95–1.00)	0.72 (0.66–0.78)
High Value Documents	104	0.68 (0.59–0.76)	0.88 (0.83–0.93)	0.80 (0.71–0.87)	0.80 (0.74–0.85)
	108	0.75 (0.66–0.82)	0.91 (0.86–0.95)	0.86 (0.78–0.92)	0.84 (0.78–0.89)
Combined	122	0.78 (0.69–0.85)	0.85 (0.79–0.90)	0.78 (0.69–0.85)	0.85 (0.79–0.90)
	117	0.81 (0.73–0.87)	0.90 (0.85–0.94)	0.85 (0.78–0.91)	0.87 (0.81–0.91)

¹PPV (Positive Predictive Value), NPV (Negative Predictive Value);

²Original: algorithm built on training dataset. Corrected: revised algorithm with text extracted from the gold standard set.