Table 1.

Hyperparameters based on fine-tuning BERT (Sci BERT).

Parameters	Value range
Batch Size	4 or 1
Dropout Parameters	0.2
BERT parameters are frozen	No
optimizer	RAdam
Learning rate	2e-5