Table 1.

Important notations in RL

Notations	Meaning
$s\in \mathcal{S}$	State
$a\in \mathcal{A}$	Actions
$r\in \mathcal{R}$	Immediate reward
$\gamma$	Discount factor
$G_t$	The long-term reward: $G_t=\sum _{k=0}^{\infty }{\gamma }^k{R}_{t+k+1}$
${\pi }_{\theta }(a|s)$	Actor model with parameters $\theta ;$ it is a distribution of action given the state
$V_{\omega }^{\pi }\left(s\right)$	Critic model with parameters $\omega ;$ it depends on the policy model and can output score