Table 2.

Metrics Used to Evaluate Machine Learning Algorithms Ability CPT Codes Overall.

	Long Short Term Memory Network	Random Forest Machine Learning
Accuracy to senior billing coder	59.0%	87.0%
Area under the receiver operating curve	.72	.94
Area under the precision-recall curve	.44	.85