Table 3. Comparison table of main experimental results.

	Dev				Test
Method	EM	Prec	Rec	F1	EM	Prec	Rec	F1
BERT Base	65.70	–	–	–	64.70	–	–	–
BERT Base*	65.67	65.64	65.62	65.58	65.95	66.09	66.05	65.97
RoBERTa Base	67.76	67.67	67.77	67.70	66.98	66.94	66.97	66.91
ALBERT Base	53.87	53.68	53.86	53.68	53.62	53.48	53.66	53.51
BERT Base+SCL	65.85	65.80	65.85	65.78	65.69	65.74	65.78	65.66
RoBERTa Base+SCL	67.85	67.74	67.92	67.81	67.26	67.19	67.26	67.20
ALBERT Base+SCL	55.79	55.68	55.86	55.73	55.54	55.47	55.58	55.48
BERT Base+CTS	65.95	65.86	65.90	65.84	65.80	65.80	65.88	65.76
RoBERTa Base+CTS	68.18	68.07	68.23	68.13	67.54	67.50	67.57	67.51
ALBERT Base+CTS	55.79	55.68	55.86	55.73	55.54	55.47	55.58	55.48

Note:

^*Our re-implementation.