Table 2.

Subject-Dependent Results. Subject-dependent results for subjects 1, 2, and 3. This setting aims to determine whether the model can learn specific features from brain activities. The bold value stands for the best result among all models.

Modality	Models	Accuracy	Precision	Recall	F1	AUROC
fNIRS	SVM	$92.44\pm 8.71$	$92.99\pm 8.98$	$91.97\pm 8.42$	$92.26\pm 8.98$	$92.56\pm 8.51$
	RF	$92.44\pm 2.83$	$91.76\pm 5.20$	$93.75\pm 0.45$	$92.57\pm 2.93$	$92.65\pm 2.74$
	KNN	$82.10\pm 15.38$	$82.85\pm 16.91$	$81.40\pm 15.43$	$82.02\pm 16.10$	$81.91\pm 15.10$
	Resnet50	$88.43\pm 13.57$	$89.41\pm 12.43$	$86.51\pm 16.79$	$87.88\pm 14.70$	$89.42\pm 14.62$
	VGG16	$92.90\pm 7.53$	$93.28\pm 7.65$	$92.44\pm 7.95$	$92.75\pm 7.87$	$95.82\pm 4.95$
	EF-Net	$\mathbf{99.69}\pm \mathbf{0.27}$	$\mathbf{100.00}\pm \mathbf{0.00}$	$\mathbf{99.39}\pm \mathbf{0.53}$	$\mathbf{99.69}\pm \mathbf{0.27}$	$\mathbf{99.80}\pm \mathbf{0.33}$
EEG	SVM	$71.14\pm 11.81$	$73.14\pm 12.51$	$72.44\pm 8.98$	$72.42\pm 10.13$	$71.40\pm 11.67$
	RF	$84.57\pm 3.08$	$88.24\pm 4.63$	$80.79\pm 3.31$	$84.30\pm 3.94$	$84.69\pm 3.38$
	KNN	$75.15\pm 8.86$	$77.88\pm 4.88$	$71.22\pm 21.35$	$73.31\pm 13.91$	$74.93\pm 8.32$
	Resnet50	$93.83\pm 5.40$	$93.14\pm 8.10$	$95.17\pm 3.55$	$93.99\pm 5.36$	$95.90\pm 4.73$
	VGG19	$\mathbf{97.38}\pm \mathbf{2.55}$	$\mathbf{97.64}\pm \mathbf{1.27}$	$\mathbf{97.19}\pm \mathbf{4.03}$	$\mathbf{97.36}\pm \mathbf{2.71}$	$\mathbf{98.02}\pm \mathbf{1.84}$
	EF-Net	$96.45\pm 2.38$	$97.28\pm 1.85$	$95.89\pm 3.29$	$96.53\pm 2.26$	$97.09\pm 1.70$
fNIRS+EEG	SVM	$86.27\pm 6.11$	$87.25\pm 4.50$	$85.74\pm 8.43$	$86.30\pm 6.69$	$86.19\pm 5.70$
	RF	$86.88\pm 8.16$	$90.47\pm 5.95$	$82.83\pm 12.22$	$85.91\pm 9.99$	$87.11\pm 7.80$
	KNN	$74.69\pm 8.80$	$78.38\pm 4.47$	$68.92\pm 20.99$	$72.24\pm 13.97$	$74.43\pm 8.21$
	V16 + R50	$94.60\pm 6.95$	$94.47\pm 8.00$	$94.91\pm 5.69$	$94.57\pm 7.02$	$96.44\pm 5.13$
	V16 + V19	$97.53\pm 0.71$	$97.75\pm 2.03$	$97.49\pm 3.62$	$97.53\pm 0.90$	$98.30\pm 0.98$
	EF-Net	$\mathbf{99.38}\pm \mathbf{0.71}$	$\mathbf{99.72}\pm \mathbf{0.49}$	$\mathbf{99.03}\pm \mathbf{0.98}$	$\mathbf{99.36}\pm \mathbf{0.73}$	$\mathbf{99.70}\pm \mathbf{0.41}$