Table 2.

Influence of selection bias on model comparison with different performance metrics

		Accuracy			Informedness			F1-score			AUC
		Model 1	Model 2		Model 1	Model 2		Model 1	Model 2		Model 1	Model 2
Overall		0.70	0.70		0.41	0.41		0.68	0.68		0.76	0.76
ρ = 0.25		0.60	0.71		0.13	0.37		0.74	0.79		0.59	0.74
ρ = 0.75		0.60	0.66		0.14	0.25		0.74	0.76		0.59	0.66
ρ = 0.95		0.61	0.63		0.14	0.15		0.75	0.75		0.59	0.61

All performance measures are obtained from the simulations in Fig. 6