Fig. 3.

The structure of an RNN. The system at each time-point is updated based on the current input data and the status of the system at the previous time-point. Here, f and g are element-wise non-linear functions which are often set to hyperbolic tangent ($\varphi$) and sigmoid ($\sigma$), respectively