Table 5.

hyper parameters

Hyperparameter	Value
Learning rate	3e-5
Epochs	3
Max sequence length	178
Batch size	16
Optimizer	Adam
Activation function	Softmax

Information of fine-tuning process using pre-trained BERT, such as learning rate, epochs, max sequence length, batch size, optimizer, and activation function