Table 2.

Attribute agreements

	Positive document for suicidality	Non-relevant document for suicidality	Non-suicidal documents	Positive mention of self-harm	Relevant mention of self-harm	Negative mention of self-harm
Precision	0.80	0.98	0.58	0.96	0.89	0.59
Recall	0.82	0.92	0.87	0.91	0.72	0.79
F1-score	0.81	0.95	0.70	0.94	0.80	0.68
No of documents/mentions	114	106	55	528	385	86

Attribute agreements reflect the comparison of the NLP tool output to the gold standard set of manually annotated documents. annotations are document level for suicidality and mention-level for self-harm. The results from the study that developed and evaluated the suicidality tool reported 0.58–0.72 precision, 0.70–0.87 for recall and 0.69–0.75 F1-score³⁵ and the results from the study that developed and evaluated the self-harm tool reported 0.88–0.96 precision, 0.88–0.96 recall and 0.88–0.96 F1 score.⁴⁰

NLP, natural language processing.