Table 3.
Experimental results for Agency and Sociality.
| Models | Agency | Sociality | ||
|
|
Accuracy | F1 | Accuracy | F1 |
| bert_base | 0.8543 | 0.8969 | 0.9249 | 0.9332 |
| happybert_base | 0.8545 | 0.8959 | 0.9264 | 0.9347 |
| bert+attention | 0.8515 | 0.8955 | 0.9247 | 0.9330 |
| happybert+attention | 0.8516 | 0.8943 | 0.9244 | 0.9324 |
| bert+grulstm | 0.8531 | 0.8983 | 0.9203 | 0.9289 |
| happybert+grulstm | 0.8491 | 0.8968 | 0.9197 | 0.9289 |
| bert_last2embeddingcls | 0.8512 | 0.8980 | 0.9157 | 0.9291 |
| happybert_last2embeddingcls | 0.8530 | 0.8982 | 0.9197 | 0.9289 |
| bert_last3embedding | 0.8516 | 0.8955 | 0.9159 | 0.9278 |
| happybert_last3embedding | 0.8528 | 0.8986 | 0.9189 | 0.9305 |
| bert+gru | 0.8497 | 0.8964 | 0.9255 | 0.9335 |
| happybert+gru | 0.8532 | 0.8969 | 0.9260 | 0.9340 |
| bert+dpcnn | 0.8514 | 0.8948 | 0.9253 | 0.9332 |
| happybert+dpcnn | 0.8567 | 0.8958 | 0.9268 | 0.9350 |
| bert_last3embeddingcls | 0.8522 | 0.8978 | 0.9200 | 0.9285 |
| happybert_last3embeddingcls | 0.8536 | 0.8987 | 0.9180 | 0.9272 |
| all_voting | 0.8554 | 0.8997 | 0.9268 | 0.9349 |
| best_com_voting | 0.8574 | 0.9000 | 0.9280 | 0.9360 |
| best_com_pse | 0.8653 | 0.9126 | 0.9367 | 0.9491 |