Table 4.

Classification and decision tree performance

TAE	Precision (SD)	Recall (SD)	F1 (SD)	Specificity (SD)	Accuracy (SD)	N	PRR025	Lab	Max
FAERS	0.57 (0.14)	0.78 (0.2)	0.64 (0.13)	0.61 (0.18)	0.69 (0.10)	78	1.06	NA	F1
Labels	0.67 (0.17)	0.75 (0.18)	0.68 (0.12)	0.72 (0.16)	0.74 (0.11)	NA	NA	0.18	F1
FAERS + labels	0.67 (0.15)	0.81 (0.15)	0.71 (0.10)	0.71 (0.19)	0.76 (0.09)	170	1.52	0.45	F1

F1, harmonic mean of precision and recall; FAERS, US Food and Drug Administration Adverse Event Reporting System; FDA, US Food and Drug Administration; Lab, label score; Max, the performance metric maximized by the genetic algorithm; N, case count; NA, not applicable; PRR025, proportional reporting ratio lower bound of 95% confidence interval; TAE, target adverse‐event profile(s) used.

Performance is compared for three sets of predictions: (i) target‐adverse events profiles generated from FAERS data only; (ii) target‐adverse events profiles generated from the FDA label data only; (iii) target‐adverse events generated from a combination of the FAERS and the FDA labels. A genetic algorithm was used to specify N, PRR025, and label score to maximize F1.