Table 2.
Parameters for BERT-Large
| Parameter Name | Value of Parameter |
|---|---|
| Number of Layers | 24 |
| Hidden Size | 1024 |
| Attention Heads | 16 |
| Number of Parameters | 340M |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.