Figure 12.

Illustration of LSTM architecture. LSTM is consisted of block input, input gate, forget gate, output gate, block output, and memory cell. Computed one hot vector is outputted through the softmax function.