| MLM | Masked Language Modelling |
| NLP | Natural Language Processing |
| NLU | Natural Language Understanding |
| NSP | Next Sentence Prediction |
| RNN | Recurrent Neural Networks |
| SOP | Sentence-Order Prediction |
| MLM | Masked Language Modelling |
| NLP | Natural Language Processing |
| NLU | Natural Language Understanding |
| NSP | Next Sentence Prediction |
| RNN | Recurrent Neural Networks |
| SOP | Sentence-Order Prediction |