Table 1.

Number of optimal layers L taking from Fig. 6.

Structure	Optimizer	N
		2 ()	3 ()	4 ()	5 ()
${\mathcal{W}}_{\mathrm{chain}}$	SGD	$L=1$	$L=2$	$L=5$	$L=5$
	Adam	$L=1$	$L=2$	$L=2$	$L=4$
	QNG	$L=1$	$L=2$	$L=3$	$L=5$
	in Fig 3d	()	()	()	()
${\mathcal{W}}_{\mathrm{alternating}}$	SGD	$L=3$	$L=5$	$L=5$	$L=5$
	Adam	$L=1$	$L=3$	$L=4$	$L=5$
	QNG	$L=1$	$L=3$	$L=5$	$L=3$
	In Fig. 3e	()	()	()	()
${\mathcal{W}}_{\mathrm{all}-\mathrm{to}-\mathrm{all}}$	SGD	$L=3$	$L=5$	$L=5$	$L=5$
	Adam	$L=1$	$L=2$	$L=3$	$L=3$
	QNG	$L=2$	$L=3$	$L=4$	$L=5$
	In Fig. 3f	()	()	()	()