Table 2:

Manual Review of Pathology Reports vs CRCP-NLP Reportable Cancer Case Detection

System	Patients entering process	CTR-reviewed patients	CTR-validated patients	CTR-rejected patients	Precisiona	Recallb
Manual review	2125	2125	344	1781	0.162	0.586
CRCP-NLP	2382	1864	445	1419*	0.239	0.621

CRCP-NLP, Cancer Registry Control Panel – natural language processing; CTR, Certified Tumor Registrar. *The CRCP-NLP process rejected an additional 518 patients (2382-1864) without CTR review, because those patients had no NLP-identified cancer mentions in any of their documents. ^aP < .0001. ^bP = .2342.