Table C.3.2:

Test Accuracy(%) of CIFAR100 for ResNets18.

Method	50th epoch	150th epoch	250th epoch	best perfomance
S-Momentum	59.98 ± 1.31	63.32 ± 1.61	77.19 ± 0.36	77.50 ± 0.25
Adam	63.40 ± 1.42	66.18 ± 1.02	75.68 ± 0.49	76.14 ± 0.24
AMSGrad	63.16 ± 0.47	66.59 ± 1.42	75.92 ± 0.26	76.32 ± 0.11
PAdam	56.28 ± 0.87	58.71 ± 1.66	77.18 ± 0.21	77.51 ± 0.19
PAMSGrad	54.34 ± 2.21	58.81 ± 1.95	77.41 ± 0.17	77.67 ± 0.14
AdaBound	61.13 ± 0.84	64.30 ± 1.84	77.18 ± 0.38	77.50 ± 0.29
AmsBound	61.05 ± 1.59	62.04 ± 2.10	77.08 ± 0.19	77.34 ± 0.13
Adam+	46.5 ± 2.12	48.68 ± 4.06	76.86 ± 0.36	77.19 ± 0.28
AMSGrad+	49.06 ± 3.23	50.75 ± 2.45	76.58 ± 0.21	76.91 ± 0.12
Sadam	59.00 ± 1.09	62.75 ± 1.03	77.26 ± 0.30	77.61 ± 0.19
SAMSgrad	59.63 ± 1.27	63.44 ± 1.84	77.31 ± 0.40	77.70 ± 0.31