Table 1.

Hyperparameter Configuration.

Configuration	Value
Optimizer	RectifiedAdam
Epoch	200
Batch size	16 for ViT-B16/32 and 4 for ViT-L32
Learning rate	$1\times {10}^{-4}$
Batch Normalization	True