Table 7.

Experiments: flagged/not flagged with users diagnosed with a single mental disorder (flagged/not flagged + single mental disorder), flagged/not flagged with users diagnosed with multiple mental disorders (flagged/not flagged + multiple mental disorders), flagged/not flagged with multiple mental disorders and evaluated on the expert annotated data, flagged/not flagged with users diagnosed with PTSD or depression (flagged/not flagged using tweets).

Experiments	Multi-task	Ps	Pm	Rs	Rm	F1s	F1m	ACCs (%)	ACCm (%)	AUCs	AUCm
Flagged/not flagged + single mental disorder	Suicide + adhd	0.737	0.726	0.722	0.726	0.728	0.726	80.00	79.20	0.814	0.814
	Adhd baseline	–	0.686	–	0.730	–	0.694	–	73.60	–	0.837
	Suicide + anxiety	0.780	0.780	0.774	0.774	0.777	0.777	83.20	83.20	0.860	0.860
	Anxiety baseline	–	0.776	–	0.845	–	0.789	–	81.60	–	0.902
	Suicide + autism	0.742	0.742	0.691	0.691	0.708	0.708	80.00	80.00	0.829	0.827
	Autism baseline	–	0.732	–	0.757	–	0.742	–	79.20	–	0.831
	Suicide + bipolar	0.778	0.778	0.805	0.805	0.789	0.789	83.20	83.20	0.889	0.889
	Bipolar baseline	–	0.799	–	0.846	–	0.816	–	84.80	–	0.920
	Suicide + depress	0.795	0.795	0.769	0.769	0.780	0.780	84.00	84.00	0.880	0.880
	Depress baseline	–	0.730	–	0.792	–	0.738	–	76.80	–	0.876
	Suicide + ocd	0.790	0.785	0.743	0.753	0.761	0.767	83.20	83.20	0.872	0.871
	Ocd baseline	–	0.781	–	0.825	–	0.796	–	83.20	–	0.895
	Suicide + ptsd	0.831	0.831	0.831	0.831	0.831	0.831	87.20	87.20	0.944	0.946
	Ptsd baseline	–	0.828	–	0.893	–	0.848	–	87.20	–	0.946
	Suicide + sch	0.820	0.829	0.826	0.842	0.823	0.835	86.40	87.20	0.874	0.873
	Schizophrenia baseline	–	0.776	–	0.845	–	0.789	–	81.60	–	0.885
	Suicide baseline	0.647	–	0.673	–	0.654	–	71.20	–	0.726	-
Flagged/not flagged + multiple mental disorders	Suicide + adhd	0.749	0.749	0.768	0.768	0.757	0.757	80.80	80.80	0.874	0.875
	Adhd baseline	–	0.783	–	0.835	–	0.800	–	83.20	–	0.916
	Suicide + anxiety	0.785	0.785	0.753	0.753	0.767	0.767	83.20	83.20	0.892	0.893
	Anxiety baseline	–	0.799	–	0.846	–	0.816	–	84.80	–	0.930
	Suicide + autism	0.778	0.778	0.784	0.784	0.781	0.781	83.20	83.20	0.876	0.877
	Autism baseline	–	0.764	–	0.834	–	0.774	–	80.00	–	0.882
	Suicide + bipolar	0.872	0.864	0.848	0.832	0.859	0.846	89.60	88.80	0.940	0.939
	Bipolar baseline	–	0.801	–	0.856	–	0.819	–	84.80	–	0.925
	Suicide + depress	0.758	0.748	0.753	0.758	0.755	0.752	81.60	80.80	0.870	0.871
	Depress baseline	–	0.789	–	0.856	–	0.805	–	83.20	–	0.904
	Suicide + ocd	0.768	0.778	0.789	0.794	0.777	0.785	82.40	83.20	0.888	0.889
	Ocd baseline	–	0.765	–	0.814	–	0.780	–	81.60	–	0.906
	Suicide + ptsd	0.896	0.896	0.843	0.843	0.865	0.865	90.40	90.40	0.967	0.966
	Suicide + ptsd + EMPATH	0.915	0.915	0.848	0.848	0.875	0.875	91.20	91.20	0.952	0.951
	Suicide + ptsd + fastText	0.872	0.872	0.848	0.848	0.859	0.859	89.60	89.60	0.958	0.959
	Ptsd baseline	–	0.836	–	0.868	–	0.849	–	88.00	–	0.942
	Suicide + sch	0.778	0.778	0.784	0.784	0.781	0.781	83.20	83.20	0.895	0.889
	Schizophrenia baseline	–	0.743	–	0.818	–	0.739	–	76.00	–	0.922
Expert	Suicide + ptsd	0.843	0.843	0.851	0.851	0.847	0.847	92.245	92.245	0.955	0.955
	Suicide baseline (expert)	0.587	–	0.652	–	0.585	–	70.204	–	0.729	-
Flagged/not flagged using tweets	suicide + more_ptsd	0.857	0.857	0.842	0.842	0.849	0.849	88.80	88.80	0.956	0.955
	Suicide + more_depress	0.793	0.783	0.851	0.835	0.810	0.799	84.00	83.20	0.928	0.928
	Suicide + ptsd_depress	0.861	0.861	0.868	0.868	0.864	0.864	89.60	89.60	0.960	0.960
	Suicide + ptsd_depress + embed	0.846	0.836	0.873	0.868	0.858	0.849	88.80	88.00	0.946	0.946
	Suicide + ptsd_depress + empath	0.869	0.869	0.884	0.884	0.876	0.876	90.40	90.40	0.960	0.959
	Baseline (ptsd + depress)	–	0.806	–	0.877	–	0.824	–	84.80	–	0.951

The bold values represent the highest F1 score for suicide ideation and mental disorder detection.