Table 3:
Model architecture and training parameter details.
| OntoNotes | TACRED | OpenI | |
|---|---|---|---|
| Label Model Training | |||
|
| |||
| Step Size | 5e-3 | 1e-2 | 5e-4 |
| Regularization | 1e-4 | 4e-4 | 1e-3 |
| Step Number | 50 | 25 | 50 |
|
| |||
| End Model Architecture | |||
|
| |||
| Embedding Initialization | PubMed | FastText EN | Random |
| Embedding Size | 100 | 300 | 200 |
| LSTM Hidden Size | 150 | 250 | 150 |
| LSTM Layers | 1 | 2 | 1 |
| Intermediate Layer Dimensions | 200, 50 | 200, 50, 25 | 200, 50 |
|
| |||
| End Model Training | |||
|
| |||
| Learning Rate | 1e-2 | 1e-3 | 1e-3 |
| Regularization | 1e-4 | 1e-4 | 1e-3 |
| Epochs | 20 | 30 | 50 |
| Dropout | 0.25 | 0.25 | 0.1 |