Table 11. Comparison graph of TL AND DL results based on F1-score.
| DATASETS | SIZE | Transfer Learning | Deep Learning | ||||
|---|---|---|---|---|---|---|---|
| ULMFIT | BERT | ROBERTA | ELECTRA | LSTM | CNN | ||
| F1 | F1 | F1 | F1 | F1 | F1 | ||
| HOTEL REVIEW | 7K | 0.927 | 0.941 | 0.945 | 0.917 | 0.924 | 0.901 |
| 10K | 0.927 | 0.941 | 0.945 | 0.917 | 0.924 | 0.901 | |
| 15K | 0.941 | 0.948 | 0.949 | 0.923 | 0.920 | 0.882 | |
| 20K | 0.951 | 0.947 | 0.954 | 0.930 | 0.940 | 0.903 | |
| MOVIE REVIEW | 7K | 0.921 | 0.917 | 0.936 | 0.944 | 0.801 | 0.839 |
| 10K | 0.921 | 0.908 | 0.941 | 0.936 | 0.820 | 0.840 | |
| 15K | 0.926 | 0.918 | 0.935 | 0.938 | 0.862 | 0.856 | |
| 20K | 0.931 | 0.911 | 0.940 | 0.941 | 0.885 | 0.866 | |
| SENTIMENT140 | 7K | 0.754 | 0.804 | 0.836 | 0.795 | 0.690 | 0.654 |
| 10K | 0.770 | 0.804 | 0.823 | 0.800 | 0.730 | 0.683 | |
| 15K | 0.770 | 0.810 | 0.834 | 0.801 | 0.729 | 0.691 | |
| 20K | 0.780 | 0.814 | 0.836 | 0.812 | 0.757 | 0.726 | |
| CITATION SENTIMENT CORPUS (CSC) | 8K | 0.897 | 0.902 | 0.902 | 0.898 | 0.863 | 0.842 |
| BIOINFORMATICS CITATION CORPUS (BCC) | 4K | 0.853 | 0.880 | 0.840 | 0.829 | 0.696 | 0.691 |