Table A3.

Training Hyper Parameters.

Parameter	Value
Parallel Environment	150
Maximum time steps per epoch (Stage One)	2000
Learning Rate	1 × 10${}^{-4}$
Discount Factor	0.996
Curriculum Reward Threshold	2300