Fig. 3.

The diagram of a single LSTM unit. The red line represents common part, which is the output from last unit. The blue line represents input of current time. Forget gate denoted by cyan line, the pink line represents input gate and the green line represents the output gate. Cell state is denoted by orange line and the output of current unit is denoted by green line.