Table 6.

Performance of the algorithm to detect implant model catalog numbers in 1592 operative notes

NLP labels⟍Gold standard	Catalog number in gold standard	Catalog number not in gold standard
Catalog number detected by NLP	6809	12
Catalog number not detected by NLP	4	4†
Sensitivity = 99.9% Precision = 99.8% F1-score = 99.9% ( 2*(precision*sensitivity) / (precision + sensitivity) )
Rules: Review “Implant Name” section  Detects implant model number  Normalizes model numbers and map to Unique Device Identifier (UDI)

^†No. of operative notes without catalog number