Table 2. Model parameter settings.

Parm type	Parm value
Batch size	24
Learning rate	1e−5
Epoch	20, 30
Max length	512
Dropout	0.15
Seed	66
Gradient accumulation steps	6
Warm-up proportion	0.1
Optimization function	Adam