Table 7.

Results for synonym expression patterns in Japanese.(FT: fastText, W2V:Word2vec, SKIP:skip-gram, number: vector dimensions).

Model	Different Japanese spellings with the same meaning				Japanese shortened forms				Conversion to transliteration				Transliteration variants				Plural expressions
	Precition	Recall	F1-score	Accuracy	Precition	Recall	F1-score	Accuracy	Precition	Recall	F1-score	Accuracy	Precition	Recall	F1-score	Accuracy	Precition	Recall	F1-score	Accuracy
FT_CBOW_100	0.4721	0.6358	0.5419	0.3716	0.8269	0.8866	0.8557	0.7478	0.1885	0.4894	0.2722	0.1575	0.6667	0.9231	0.7742	0.6316	0.6472	0.9172	0.7589	0.6115
FT_CBOW_200	0.5236	0.6595	0.5837	0.4122	0.8462	0.8889	0.8670	0.7652	0.2049	0.5102	0.2924	0.1712	0.7222	0.9286	0.8125	0.6842	0.6682	0.9196	0.7740	0.6313
FT_CBOW_300	0.5322	0.6631	0.5905	0.4189	0.8654	0.8911	0.8780	0.7826	0.1721	0.4667	0.2515	0.1438	0.7222	0.9286	0.8125	0.6842	0.6706	0.9199	0.7757	0.6336
FT_CBOW_400	0.5365	0.6649	0.5938	0.4223	0.8846	0.8932	0.8889	0.8000	0.1885	0.4894	0.2722	0.1575	0.7222	0.9286	0.8125	0.6842	0.6472	0.9172	0.7589	0.6115
FT_CBOW_500	0.5279	0.6613	0.5871	0.4155	0.8750	0.8922	0.8835	0.7913	0.1721	0.4667	0.2515	0.1438	0.7222	0.9286	0.8125	0.6842	0.6519	0.9178	0.7623	0.6159
FT_CBOW_600	0.5279	0.6613	0.5871	0.4155	0.8942	0.8942	0.8942	0.8087	0.1557	0.4419	0.2303	0.1301	0.7778	0.9333	0.8485	0.7368	0.6379	0.9161	0.7521	0.6026
FT_CBOW_700	0.5150	0.6557	0.5769	0.4054	0.8750	0.8922	0.8835	0.7913	0.1557	0.4419	0.2303	0.1301	0.7222	0.9286	0.8125	0.6842	0.6355	0.9158	0.7503	0.6004
FT_CBOW_800	0.5150	0.6557	0.5769	0.4054	0.8942	0.8942	0.8942	0.8087	0.1557	0.4419	0.2303	0.1301	0.7778	0.9333	0.8485	0.7368	0.6308	0.9153	0.7469	0.5960
FT_CBOW_900	0.4721	0.6358	0.5419	0.3716	0.9038	0.8952	0.8995	0.8174	0.1393	0.4146	0.2086	0.1164	0.7222	0.9286	0.8125	0.6842	0.6379	0.9161	0.7521	0.6026
FT_SKIP_100	0.3562	0.5685	0.4380	0.2804	0.5962	0.8493	0.7006	0.5391	0.1967	0.5000	0.2824	0.1644	0.7778	0.9333	0.8485	0.7368	0.5561	0.9049	0.6889	0.5254
FT_SKIP_200	0.4163	0.6063	0.4936	0.3277	0.6923	0.8675	0.7701	0.6261	0.2377	0.5472	0.3314	0.1986	0.8333	0.9375	0.8824	0.7895	0.6215	0.9141	0.7399	0.5872
FT_SKIP_300	0.4292	0.6135	0.5051	0.3378	0.7115	0.8706	0.7831	0.6435	0.2049	0.5102	0.2924	0.1712	0.7778	0.9333	0.8485	0.7368	0.6215	0.9141	0.7399	0.5872
FT_SKIP_400	0.4764	0.6379	0.5455	0.3750	0.7308	0.8736	0.7958	0.6609	0.2213	0.5294	0.3121	0.1849	0.8333	0.9375	0.8824	0.7895	0.6355	0.9158	0.7503	0.6004
FT_SKIP_500	0.4807	0.6400	0.5490	0.3784	0.7692	0.8791	0.8205	0.6957	0.1967	0.5000	0.2824	0.1644	0.7778	0.9333	0.8485	0.7368	0.6145	0.9132	0.7346	0.5806
FT_SKIP_600	0.4850	0.6420	0.5526	0.3818	0.7692	0.8791	0.8205	0.6957	0.2213	0.5294	0.3121	0.1849	0.7778	0.9333	0.8485	0.7368	0.6472	0.9172	0.7589	0.6115
FT_SKIP_700	0.4893	0.6441	0.5561	0.3851	0.8269	0.8866	0.8557	0.7478	0.2213	0.5294	0.3121	0.1849	0.7222	0.9286	0.8125	0.6842	0.6449	0.9169	0.7572	0.6093
FT_SKIP_800	0.4807	0.6400	0.5490	0.3784	0.7981	0.8830	0.8384	0.7217	0.2213	0.5294	0.3121	0.1849	0.7222	0.9286	0.8125	0.6842	0.6402	0.9164	0.7538	0.6049
FT_SKIP_900	0.4807	0.6400	0.5490	0.3784	0.8173	0.8854	0.8500	0.7391	0.2295	0.5385	0.3218	0.1918	0.7222	0.9286	0.8125	0.6842	0.6379	0.9161	0.7521	0.6026
W2V_CBOW_100	0.2661	0.4960	0.3464	0.2095	0.2308	0.6857	0.3453	0.2087	0.2213	0.5294	0.3121	0.1849	0.6111	0.9167	0.7333	0.5789	0.4065	0.8744	0.5550	0.3841
W2V_CBOW_200	0.3348	0.5532	0.4171	0.2635	0.3077	0.7442	0.4354	0.2783	0.2951	0.6000	0.3956	0.2466	0.6111	0.9167	0.7333	0.5789	0.4766	0.8908	0.6210	0.4503
W2V_CBOW_300	0.3691	0.5772	0.4503	0.2905	0.2885	0.7317	0.4138	0.2609	0.3033	0.6066	0.4044	0.2534	0.5556	0.9091	0.6897	0.5263	0.4743	0.8904	0.6189	0.4481
W2V_CBOW_400	0.3948	0.5935	0.4742	0.3108	0.2885	0.7317	0.4138	0.2609	0.3279	0.6250	0.4301	0.2740	0.6667	0.9231	0.7742	0.6316	0.4813	0.8918	0.6252	0.4547
W2V_CBOW_500	0.3734	0.5800	0.4543	0.2939	0.3077	0.7442	0.4354	0.2783	0.2951	0.6000	0.3956	0.2466	0.6667	0.9231	0.7742	0.6316	0.5047	0.8963	0.6457	0.4768
W2V_CBOW_600	0.3605	0.5714	0.4421	0.2838	0.3077	0.7442	0.4354	0.2783	0.3197	0.6190	0.4216	0.2671	0.5556	0.9091	0.6897	0.5263	0.4930	0.8941	0.6355	0.4658
W2V_CBOW_700	0.3777	0.5828	0.4583	0.2973	0.3173	0.7500	0.4459	0.2870	0.3115	0.6129	0.4130	0.2603	0.5556	0.9091	0.6897	0.5263	0.4953	0.8945	0.6376	0.4680
W2V_CBOW_800	0.3991	0.5962	0.4781	0.3142	0.2981	0.7381	0.4247	0.2696	0.3197	0.6190	0.4216	0.2671	0.7222	0.9286	0.8125	0.6842	0.5070	0.8967	0.6478	0.4790
W2V_CBOW_900	0.3777	0.5828	0.4583	0.2973	0.2692	0.7179	0.3916	0.2435	0.2951	0.6000	0.3956	0.2466	0.5556	0.9091	0.6897	0.5263	0.5070	0.8967	0.6478	0.4790
W2V_SKIP_100	0.2575	0.4878	0.3371	0.2027	0.2692	0.7179	0.3916	0.2435	0.2295	0.5385	0.3218	0.1918	0.4444	0.8889	0.5926	0.4211	0.4276	0.8798	0.5755	0.4040
W2V_SKIP_200	0.2833	0.5116	0.3646	0.2230	0.2788	0.7250	0.4028	0.2522	0.2459	0.5556	0.3409	0.2055	0.4444	0.8889	0.5926	0.4211	0.4252	0.8792	0.5732	0.4018
W2V_SKIP_300	0.2876	0.5154	0.3691	0.2264	0.2885	0.7317	0.4138	0.2609	0.2541	0.5636	0.3503	0.2123	0.4444	0.8889	0.5926	0.4211	0.3995	0.8724	0.5481	0.3775
W2V_SKIP_400	0.3047	0.5299	0.3869	0.2399	0.2885	0.7317	0.4138	0.2609	0.2459	0.5556	0.3409	0.2055	0.4444	0.8889	0.5926	0.4211	0.3925	0.8705	0.5411	0.3709
W2V_SKIP_500	0.2961	0.5227	0.3781	0.2331	0.2788	0.7250	0.4028	0.2522	0.2213	0.5294	0.3121	0.1849	0.4444	0.8889	0.5926	0.4211	0.3785	0.8663	0.5268	0.3576
W2V_SKIP_600	0.2918	0.5191	0.3736	0.2297	0.2692	0.7179	0.3916	0.2435	0.2295	0.5385	0.3218	0.1918	0.3333	0.8571	0.4800	0.3158	0.3598	0.8603	0.5074	0.3400
W2V_SKIP_700	0.2618	0.4919	0.3417	0.2061	0.2692	0.7179	0.3916	0.2435	0.2459	0.5556	0.3409	0.2055	0.3889	0.8750	0.5385	0.3684	0.3505	0.8571	0.4975	0.3311
W2V_SKIP_800	0.2918	0.5191	0.3736	0.2297	0.2981	0.7381	0.4247	0.2696	0.2049	0.5102	0.2924	0.1712	0.4444	0.8889	0.5926	0.4211	0.3411	0.8538	0.4875	0.3223
W2V_SKIP_900	0.2704	0.5000	0.3510	0.2128	0.2788	0.7250	0.4028	0.2522	0.2049	0.5102	0.2924	0.1712	0.3889	0.8750	0.5385	0.3684	0.3505	0.8571	0.4975	0.3311

The underlined (bold) numbers show the highest cumulated accuracy in the different models.