Table 3.

Validation results

Drug class	Number of orders	F1-score	Precision	Recall
Insulin	TP: 141 349 FP: 1910 FN: 1580	0.988	98.7	98.9
Non-insulin glucose lowering drugs	TP: 106 463 FP: 9480 FN: 39	0.957	91.8	>99.9
Vitamin K antagonists	TP: 100 023 FP: 4632 FN: 0	0.977	95.6	100
P2Y12 inhibitors	TP: 42 720 FP: 0 FN: 0	1.00	100	100
Ace inhibitors/Angiotensin II receptor blockers	TP: 133 398 FP: 6548 FN: 86	0.976	95.3	99.9
Benzodiazepines	TP: 167 577 FP: 2268 FN: 1465	0.989	98.7	99.1
Direct-acting oral anticoagulants	TP: 22 970 FP: 82 FN: 0	0.998	99.6	100
Antipsychotics	TP: 149 213 FP: 128 FN: 287	0.999	99.9	99.8
Dementia meds	TP: 16 262 FP: 0 FN: 0	1.00	100	100
Furosemide	TP: 220 422 FP: 14 FN: 52	>0.99	>99.9	>99.9
Steroids	TP: 147 470 FP: 26 286 FN: 0	0.918	84.9	100
Puffers	TP: 242 622 FP: 22 232 FN: 3261	0.950	91.6	98.7
Antibiotics	TP: 450 900 FP: 97 906 FN: 658	0.902	82.2	99.9

Notes: Results of the validation for the 13 drug classification queries. For each query, the pharmacy orders returned by GEMINI-RxNorm (with no limitations on match scores) were compared with the gold standard manual mappings. TP, true positive; FP, false positive; FN, false negative.