Table 3.

Evaluation Results of Two stage

Stage	Testing sets	TP	FP	FN	TN	P(%)	R(%)	F(%)	A(%)
First	10/1/2017–4/30/2018	50,084	6022	161,478	67,217	89.27	23.67	37.42	41.19
Second	7/1/2018–1/31/2019	85,838	11,291	222,938	82,994	88.38	27.90	42.41	41.89