Table 10.

Type-based learn to rank on test data

ID	Sys	P	R	F1	ID	Sys	P	R	F1
T019	SVMRank	0.51	0.21	0.29	T047	SVMRank	0.52	0.66	0.58
	ListNet	0.59	0.18	0.28		ListNet	0.41	0.65	0.50
	RankNet	0.54	0.16	0.24		RankNet	0.38	0.51	0.44
	RankBoost	0.47	0.21	0.29		RankBoost	0.45	0.68	0.54
T020	SVMRank	0.29	0.53	0.37	T048	SVMRank	0.48	0.68	0.56
	ListNet	0.34	0.50	0.41		ListNet	0.40	0.49	0.44
	RankNet	0.34	0.48	0.40		RankNet	0.38	0.48	0.43
	RankBoost	0.29	0.55	0.38		RankBoost	0.44	0.68	0.54
T033	SVMRank	0.00	0.07	0.00	T184	SVMRank	0.52	0.62	0.57
	ListNet	0.00	0.27	0.00		ListNet	0.44	0.61	0.51
	RankNet	0.00	0.27	0.01		RankNet	0.40	0.58	0.47
	RankBoost	0.00	0.20	0.00		RankBoost	0.48	0.62	0.54
T037	SVMRank	0.37	0.50	0.43	T190	SVMRank	0.28	0.69	0.40
	ListNet	0.35	0.46	0.40		ListNet	0.28	0.65	0.39
	RankNet	0.31	0.44	0.37		RankNet	0.25	0.55	0.34
	RankBoost	0.35	0.49	0.41		RankBoost	0.28	0.68	0.39
T046	SVMRank	0.37	0.70	0.48	T191	SVMRank	0.27	0.54	0.36
	ListNet	0.37	0.70	0.48		ListNet	0.23	0.34	0.27
	RankNet	0.36	0.56	0.44		RankNet	0.17	0.24	0.20
	RankBoost	0.35	0.70	0.47		RankBoost	0.25	0.53	0.34

Note that the highest scoring system F1 for each semantic type is shown in bold.