Table 2.

Performance comparison of different optimizers for four network models.

Model	Optimizers	Params	Average Accuracy (%)
ShuffleNet	SGD	2.3 M	62.3
	Adam		90.2
	RAdam		77.9
	Ranger		72.1
MobileNetV3	SGD	5.4 M	89.9
	Adam		93.4
	RAdam		93.1
	Ranger		93.2
EfficientNet-B0	SGD	5.3 M	86.4
	Adam		94.3
	RAdam		94
	Ranger		93.4
RegNet	SGD	5.2 M	98.2
	Adam		99.8
	RAdam		99.8
	Ranger		99.9