Table 3:
OntoNotes | TACRED | OpenI | |
---|---|---|---|
Label Model Training | |||
| |||
Step Size | 5e-3 | 1e-2 | 5e-4 |
Regularization | 1e-4 | 4e-4 | 1e-3 |
Step Number | 50 | 25 | 50 |
| |||
End Model Architecture | |||
| |||
Embedding Initialization | PubMed | FastText EN | Random |
Embedding Size | 100 | 300 | 200 |
LSTM Hidden Size | 150 | 250 | 150 |
LSTM Layers | 1 | 2 | 1 |
Intermediate Layer Dimensions | 200, 50 | 200, 50, 25 | 200, 50 |
| |||
End Model Training | |||
| |||
Learning Rate | 1e-2 | 1e-3 | 1e-3 |
Regularization | 1e-4 | 1e-4 | 1e-3 |
Epochs | 20 | 30 | 50 |
Dropout | 0.25 | 0.25 | 0.1 |