Table 6.

The parameters assignment of algorithm.

Parameter	Value	Meaning
M	6000	The number of simulation episodes.
T	1000	The maximum of steps per episode.
K	64	The training episode of algorithm.
k	64	The size of training batch.
$D_{size}$	$10,000$	The size of experiences memory D.
$\alpha$	$0.5$	The availability exponent of PER.
${\beta }_0$	$0.4$	The initial exponent of IS.
${\beta }_{inc}$	$0.0001$	The increment of exponent of IS.