Table 6.

Performance of models with different numbers of heads.

Num-heads	Accuracy	Precision	Recall	F1-score
16	0.9813	0.9809	0.9817	0.9812
8	0.9787	0.9783	0.9789	0.9786
4	0.9733	0.9728	0.9742	0.9732
2	0.9773	0.9769	0.9778	0.9773