Table 2.

The parameters assignment of algorithm.

Parameter	Value	Meaning
M	1000	The number of simulation episodes.
T	300	The maximum of steps per episode.
K	32	The training episode of algorithm.
k	32	The size of training batch.
$D_{size}$	5000	The size of experiences memory D.
$\alpha$	$0.5$	The availability exponent of PER.
${\beta }_0$	$0.4$	The initial exponent of IS.
${\beta }_{inc}$	$0.0001$	The increment of exponent of IS.