Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
| Model | Epoch | Weight decay | Batch size | Learning rate |
|---|---|---|---|---|
| BETO | 10 | 0.0448468569 | 16 | 0.000034 |
| ALBETO | 10 | 0.0139110539 | 16 | 0.000039 |
| DistilBETO | 10 | 0.1950135486 | 8 | 0.000028 |
| MarIA | 7 | 0.0734046361 | 16 | 0.000038 |
| BERTIN | 8 | 0.0139110539 | 16 | 0.000039 |
