Table 1.

The hyper-parameters in the ResNet.

Symbol	Description	Value
K	Kernel matrix	$3\times 3$
p	Number of kernels in convolutional layers	32
b	Mini-batch size	10
${\eta }_0$	Initial value of learning rate	0.001
$\upsilon$	The decay rate of learning rate	0.0002
$f_0$	Initial value of the first-order moment	0
$s_0$	Initial value of the second-order moment	0
${ϵ}_1$	The exponential decay rate of the first-order moment estimation	0.9
${ϵ}_2$	The exponential decay rate of the second-order moment estimation	0.999
$\delta$	A minimum value close to zero	${10}^{-7}$