Table 1.

Review data sets and corresponding results.

Review				Concept Encoder
Reference	Correct articles, n	Articles screened, n	Trials, n		AUROCa	WSS@100b		WSS@95c
						Mean (SD)	Range	Mean (SD)	Range
[27]	6	410	15		1	0.946 (0.014)	0.937-0.985	0.896 (0.014)	0.887-0.935
[28]	12	560	66		1	0.936 (0.009)	0.930-0.959	0.886 (0.009)	0.880-0.909
[29]	17	5644	136		0.999	0.954 (0.006)	0.946-0.971	0.904 (0.006)	0.896-0.921
[30]	20	6935	190		0.998	0.944 (0.005)	0.941-0.957	0.902 (0.006)	0.897-0.932
[31]	11	830	55		0.998	0.917 (0.023)	0.906-0.975	0.867 (0.023)	0.856-0.925
[32]	5	5839	10		1	0.991 (0.006)	0.981-0.999	0.941 (0.006)	0.931-0.949
[33]	5	138	10		1	0.946 (0.015)	0.935-0.978	0.896 (0.015)	0.885-0.928
[34]	5	2389	10		1	0.991 (0.006)	0.982-0.996	0.941 (0.006)	0.932-0.946
Mean	10	2843	62		0.999	0.953 (0.011)	0.945-0.977	0.904 (0.011)	0.895-0.931

^aAUROC: area under the receiver operating characteristic curve.

^bWSS@100: work saved over sampling at 100%.

^cWSS@95: work saved over sampling at 95%.