Table 4.

The parameter settings of downstream tasks

Mode	Blr	Lr_updated	Optimizer	Warm	Epochs	Batch
Linear probing	1.5e−3	Cosine annealing	SGD	5	100	384/512 256 64 64 32
Fine-tuning	5e−4	Cosine annealing	AdamW	5	50	384/512 256 64 64 32