Algorithm 1 Reward function of the proposed method
1	Current load of connecting eNB: $L_{t+1}$
2	Ideal load that is control target value: $L_{ideal}$
3	Available bandwidth of connecting eNB: $ABW$
4	Select action at time $t$: $a_t$
5	Episode end time: $t_{end}$
6	Normalization variable: $\beta$
7	if$L_{t+1} \le L_{ideal}$then
8	$r\leftarrow 1+\frac{t}{\beta }$
9	else
10	if $ABW = 0$ and $a_t = 4$ then
11	$r\leftarrow 0$
12	else
13	$r\leftarrow -(\frac{L_{t+1}- L_{ideal}}{L_{ideal}}+\frac{t_{end}-t}{\beta }$)
14	end if
15	end if
16	return$r$