Fig. 2.

Generating sequences. Sequence generation by a trained RNN. Every timestep t we sample the next token of the sequence $x^t$ from the probability distribution given by the RNN, which is then fed in as the next input