Table 8.
Results for synonym expression patterns in English terms and acronyms.(FT: fastText, W2V:Word2vec, SKIP:skip-gram, number: vector dimensions).
| Model | English terms | English acronyms | English terms (Output alphabetic-only words) |
English acronyms (Output alphabetic-only words) |
||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Precition | Recall | F1-score | Accuracy | Precition | Recall | F1 | Accuracy | Precition | Recall | F1-score | Accuracy | Precition | Recall | F1-score | Accuracy | |
| FT_CBOW_100 | 0.0813 | 0.1289 | 0.0997 | 0.0525 | 0.3143 | 1.0000 | 0.4783 | 0.3143 | 0.2395 | 0.3034 | 0.2677 | 0.1545 | 0.4214 | 1.0000 | 0.5930 | 0.4214 |
| FT_CBOW_200 | 0.0708 | 0.1141 | 0.0874 | 0.0457 | 0.3429 | 1.0000 | 0.5106 | 0.3429 | 0.2575 | 0.3190 | 0.2850 | 0.1662 | 0.5071 | 1.0000 | 0.6730 | 0.5071 |
| FT_CBOW_300 | 0.0678 | 0.1098 | 0.0838 | 0.0437 | 0.3286 | 1.0000 | 0.4946 | 0.3286 | 0.2801 | 0.3376 | 0.3062 | 0.1808 | 0.5143 | 1.0000 | 0.6792 | 0.5143 |
| FT_CBOW_400 | 0.0633 | 0.1032 | 0.0784 | 0.0408 | 0.3000 | 1.0000 | 0.4615 | 0.3000 | 0.2786 | 0.3364 | 0.3048 | 0.1798 | 0.5500 | 1.0000 | 0.7097 | 0.5500 |
| FT_CBOW_500 | 0.0602 | 0.0988 | 0.0748 | 0.0389 | 0.2857 | 1.0000 | 0.4444 | 0.2857 | 0.2741 | 0.3327 | 0.3006 | 0.1769 | 0.5357 | 1.0000 | 0.6977 | 0.5357 |
| FT_CBOW_600 | 0.0512 | 0.0852 | 0.0640 | 0.0330 | 0.2571 | 1.0000 | 0.4091 | 0.2571 | 0.2651 | 0.3253 | 0.2921 | 0.1710 | 0.5143 | 1.0000 | 0.6792 | 0.5143 |
| FT_CBOW_700 | 0.0452 | 0.0759 | 0.0567 | 0.0292 | 0.2500 | 1.0000 | 0.4000 | 0.2500 | 0.2937 | 0.3482 | 0.3186 | 0.1895 | 0.4929 | 1.0000 | 0.6603 | 0.4929 |
| FT_CBOW_800 | 0.0407 | 0.0689 | 0.0511 | 0.0262 | 0.2286 | 1.0000 | 0.3721 | 0.2286 | 0.2741 | 0.3327 | 0.3006 | 0.1769 | 0.5357 | 1.0000 | 0.6977 | 0.5357 |
| FT_CBOW_900 | 0.0346 | 0.0593 | 0.0437 | 0.0224 | 0.2429 | 1.0000 | 0.3908 | 0.2429 | 0.2696 | 0.3290 | 0.2964 | 0.1740 | 0.5214 | 1.0000 | 0.6854 | 0.5214 |
| FT_SKIP_100 | 0.1009 | 0.1551 | 0.1223 | 0.0651 | 0.3857 | 1.0000 | 0.5567 | 0.3857 | 0.2395 | 0.3034 | 0.2677 | 0.1545 | 0.4214 | 1.0000 | 0.5930 | 0.4214 |
| FT_SKIP_200 | 0.1250 | 0.1853 | 0.1493 | 0.0807 | 0.4357 | 1.0000 | 0.6070 | 0.4357 | 0.2907 | 0.3459 | 0.3159 | 0.1876 | 0.5143 | 1.0000 | 0.6792 | 0.5143 |
| FT_SKIP_300 | 0.1099 | 0.1667 | 0.1325 | 0.0709 | 0.4357 | 1.0000 | 0.6070 | 0.4357 | 0.3133 | 0.3630 | 0.3363 | 0.2021 | 0.5286 | 1.0000 | 0.6916 | 0.5286 |
| FT_SKIP_400 | 0.1054 | 0.1609 | 0.1274 | 0.0680 | 0.4643 | 1.0000 | 0.6341 | 0.4643 | 0.3178 | 0.3663 | 0.3403 | 0.2051 | 0.5429 | 1.0000 | 0.7037 | 0.5429 |
| FT_SKIP_500 | 0.0994 | 0.1531 | 0.1205 | 0.0641 | 0.4357 | 1.0000 | 0.6070 | 0.4357 | 0.3238 | 0.3707 | 0.3457 | 0.2089 | 0.5500 | 1.0000 | 0.7097 | 0.5500 |
| FT_SKIP_600 | 0.1054 | 0.1609 | 0.1274 | 0.0680 | 0.4357 | 1.0000 | 0.6070 | 0.4357 | 0.3102 | 0.3608 | 0.3336 | 0.2002 | 0.5500 | 1.0000 | 0.7097 | 0.5500 |
| FT_SKIP_700 | 0.0949 | 0.1472 | 0.1154 | 0.0612 | 0.4429 | 1.0000 | 0.6139 | 0.4429 | 0.2997 | 0.3528 | 0.3241 | 0.1934 | 0.5429 | 1.0000 | 0.7037 | 0.5429 |
| FT_SKIP_800 | 0.0904 | 0.1412 | 0.1102 | 0.0583 | 0.4286 | 1.0000 | 0.6000 | 0.4286 | 0.3253 | 0.3718 | 0.3470 | 0.2099 | 0.5429 | 1.0000 | 0.7037 | 0.5429 |
| FT_SKIP_900 | 0.0828 | 0.1310 | 0.1015 | 0.0534 | 0.4214 | 1.0000 | 0.5930 | 0.4214 | 0.3253 | 0.3718 | 0.3470 | 0.2099 | 0.5500 | 1.0000 | 0.7097 | 0.5500 |
| W2V_CBOW_100 | 0.1069 | 0.1628 | 0.1291 | 0.0690 | 0.3429 | 1.0000 | 0.5106 | 0.3429 | 0.1822 | 0.2490 | 0.2104 | 0.1176 | 0.4643 | 1.0000 | 0.6341 | 0.4643 |
| W2V_CBOW_200 | 0.1280 | 0.1889 | 0.1526 | 0.0826 | 0.3857 | 1.0000 | 0.5567 | 0.3857 | 0.2289 | 0.2940 | 0.2574 | 0.1477 | 0.4214 | 1.0000 | 0.5930 | 0.4214 |
| W2V_CBOW_300 | 0.1325 | 0.1943 | 0.1576 | 0.0855 | 0.4000 | 1.0000 | 0.5714 | 0.4000 | 0.2244 | 0.2899 | 0.2530 | 0.1448 | 0.4786 | 1.0000 | 0.6473 | 0.4786 |
| W2V_CBOW_400 | 0.1401 | 0.2031 | 0.1658 | 0.0904 | 0.4143 | 1.0000 | 0.5859 | 0.4143 | 0.2244 | 0.2899 | 0.2530 | 0.1448 | 0.4786 | 1.0000 | 0.6473 | 0.4786 |
| W2V_CBOW_500 | 0.1461 | 0.2100 | 0.1723 | 0.0943 | 0.4000 | 1.0000 | 0.5714 | 0.4000 | 0.2259 | 0.2913 | 0.2545 | 0.1458 | 0.4643 | 1.0000 | 0.6341 | 0.4643 |
| W2V_CBOW_600 | 0.1461 | 0.2100 | 0.1723 | 0.0943 | 0.4071 | 1.0000 | 0.5787 | 0.4071 | 0.2244 | 0.2899 | 0.2530 | 0.1448 | 0.4500 | 1.0000 | 0.6207 | 0.4500 |
| W2V_CBOW_700 | 0.1416 | 0.2048 | 0.1674 | 0.0914 | 0.3929 | 1.0000 | 0.5641 | 0.3929 | 0.2274 | 0.2926 | 0.2559 | 0.1467 | 0.4500 | 1.0000 | 0.6207 | 0.4500 |
| W2V_CBOW_800 | 0.1566 | 0.2217 | 0.1836 | 0.1011 | 0.3857 | 1.0000 | 0.5567 | 0.3857 | 0.2334 | 0.2981 | 0.2618 | 0.1506 | 0.4571 | 1.0000 | 0.6275 | 0.4571 |
| W2V_CBOW_900 | 0.1491 | 0.2134 | 0.1755 | 0.0962 | 0.3786 | 1.0000 | 0.5492 | 0.3786 | 0.2395 | 0.3034 | 0.2677 | 0.1545 | 0.4286 | 1.0000 | 0.6000 | 0.4286 |
| W2V_SKIP_100 | 0.1340 | 0.1960 | 0.1592 | 0.0865 | 0.3714 | 1.0000 | 0.5417 | 0.3714 | 0.2093 | 0.2758 | 0.2380 | 0.1351 | 0.4429 | 1.0000 | 0.6139 | 0.4429 |
| W2V_SKIP_200 | 0.1295 | 0.1907 | 0.1543 | 0.0836 | 0.3929 | 1.0000 | 0.5641 | 0.3929 | 0.2214 | 0.2871 | 0.2500 | 0.1429 | 0.4500 | 1.0000 | 0.6207 | 0.4500 |
| W2V_SKIP_300 | 0.1355 | 0.1978 | 0.1609 | 0.0875 | 0.3929 | 1.0000 | 0.5641 | 0.3929 | 0.2289 | 0.2940 | 0.2574 | 0.1477 | 0.4357 | 1.0000 | 0.6070 | 0.4357 |
| W2V_SKIP_400 | 0.1401 | 0.2031 | 0.1658 | 0.0904 | 0.3929 | 1.0000 | 0.5641 | 0.3929 | 0.2229 | 0.2885 | 0.2515 | 0.1438 | 0.4214 | 1.0000 | 0.5930 | 0.4214 |
| W2V_SKIP_500 | 0.1355 | 0.1978 | 0.1609 | 0.0875 | 0.3571 | 1.0000 | 0.5263 | 0.3571 | 0.2259 | 0.2913 | 0.2545 | 0.1458 | 0.4143 | 1.0000 | 0.5859 | 0.4143 |
| W2V_SKIP_600 | 0.1416 | 0.2048 | 0.1674 | 0.0914 | 0.3643 | 1.0000 | 0.5340 | 0.3643 | 0.2214 | 0.2871 | 0.2500 | 0.1429 | 0.4143 | 1.0000 | 0.5859 | 0.4143 |
| W2V_SKIP_700 | 0.1355 | 0.1978 | 0.1609 | 0.0875 | 0.3500 | 1.0000 | 0.5185 | 0.3500 | 0.2108 | 0.2772 | 0.2395 | 0.1361 | 0.4071 | 1.0000 | 0.5787 | 0.4071 |
| W2V_SKIP_800 | 0.1325 | 0.1943 | 0.1576 | 0.0855 | 0.3571 | 1.0000 | 0.5263 | 0.3571 | 0.2018 | 0.2685 | 0.2304 | 0.1302 | 0.4143 | 1.0000 | 0.5859 | 0.4143 |
| W2V_SKIP_900 | 0.1310 | 0.1925 | 0.1559 | 0.0845 | 0.3571 | 1.0000 | 0.5263 | 0.3571 | 0.2048 | 0.2715 | 0.2335 | 0.1322 | 0.4000 | 1.0000 | 0.5714 | 0.4000 |