Table 2.

The training optimizer and hyper-parameters.

Model\hyper params	Optimizer	learning rate	weight decay	betas	momentum	alpha
Generator	Adam	4e-4	1e-4	(0.9, 0.999)	/	/
Discriminator	RMSprop	4e-4	1e-4	/	0	0.99