Table 9.

Comparison of gold standard vs silver standard results

Data	No. of drug samples	P	R	F	A	Best model
Gold standard	7215	0.9978	0.9978	0.9978	0.9977	BERT
Silver standard	100,000	0.9953	0.9950	0.9951	0.9951	BERT
Silver standard	100,000	0.9852	0.9410	0.9626	0.9634	LSTM
Silver standard	300,000	0.9919	0.9009	0.9442	0.9468	LSTM
Silver standard	500,000	0.9954	0.9374	0.9655	0.9665	RoBERTa
Silver standard	1,000,000	0.9832	0.9953	0.9892	0.9891	RoBERTa
Silver standard	2,000,000	0.9971	0.9500	0.9730	0.9736	RoBERTa
Silver standard	3,000,000	0.9951	0.9500	0.9720	0.9726	BERT