Table 5. Ablation experiment results on Toutiao-S.

Dataset (Toutiao-S)	Validation				Test
Evaluation index (%)	Acc	P	R	F1	Acc	P	R	F1
Chinese-BERT-wwm-GCN	93.89	93.91	93.89	93.89	93.37	93.39	93.37	93.38
Chinese-BERT-wwm-GCN-L	93.97	93.99	93.97	93.97	93.67	93.74	93.67	93.69
Chinese-BERT-wwm-GCN-P	93.97	94.02	93.97	93.98	93.71	93.77	93.71	93.72
Chinese-BERT-wwm-GCN-S	94.30	94.40	94.30	94.34	94.04	94.06	94.04	94.04
Chinese-BERT-wwm-GCN-LP	94.48	94.48	94.48	94.48	94.14	94.15	94.14	94.14
Chinese-BERT-wwm-GCN-LS	94.68	94.69	94.68	94.68	94.44	94.49	94.44	94.45
Chinese-RoBERTa-wwm-GCN	93.84	93.86	93.84	93.84	93.61	93.68	93.61	93.62
Chinese-RoBERTa-wwm-GCN-L	94.16	94.20	94.16	94.16	93.99	94.02	93.99	93.99
Chinese-RoBERTa-wwm-GCN-P	94.24	94.25	94.24	94.24	94.12	94.12	94.12	94.12
Chinese- RoBERTa-wwm-GCN-S	94.50	94.52	94.50	94.50	94.40	94.44	94.40	94.41
Chinese- RoBERTa-wwm-GCN-LP	94.68	94.66	94.68	94.68	94.50	94.54	94.50	94.51
Chinese- RoBERTa-wwm-GCN-LS	94.89	94.89	94.86	94.87	94.76	94.76	94.76	94.76

Note:

Remove one or two modules from our model to verify the effect of each module. We run all models three times and report the mean result on validation and test sets.