Table 5.
Hyperparameter values of BERT
| Name of the hyperparameter | Hyperparameter value |
|---|---|
| Learning rate | 0.1 |
| Batch size | 32 |
| Anneal factor | 0.5 |
| Patience | 5 |
| Max. number of epochs | 5 |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.