Table 4.
Hyperparameters for the proposed model.
Hyperparameters | Values |
---|---|
batch size | 64 |
epoch | 20 |
number of feed-forward networks | 512 |
number of head | 4 |
embedding dimension | 512 |
dropout | 0.3 |
learning rate | 0.0015 |
Hyperparameters for the proposed model.
Hyperparameters | Values |
---|---|
batch size | 64 |
epoch | 20 |
number of feed-forward networks | 512 |
number of head | 4 |
embedding dimension | 512 |
dropout | 0.3 |
learning rate | 0.0015 |