Table 2:

Algorithm performance

	Development Set (Institution 1)	Internal test set (Institution 1)	External test set (Institution 2)
Total clinic encounter notes reviewed	417 (from which 48 were excluded due to ambiguous or absent seizure frequency)		100 (from which 4 were excluded due to ambiguous or absent seizure frequency)
Total clinic encounter notes included	150	219	96
Total number of unique seizure frequency elements by reviewer annotation, “gold standard”	194	248	124
Total number of unique seizure frequency elements by algorithm report	169	182	37
Number of correct algorithm-reported elements	161	173	27
Recall (%)	161/194 (83%)	173/248 (70%)	27/124 (22%)
Precision (%)	161/169 (95%)	173/182 (95%)	27/37 (73%)
F1 score	0.89	0.82	0.40