Figure 4.

Overview of an LSTM cell. In each cell, four different networks are trained (bottom line) to be able to memorise relevant information over long time. According to the information, the internal cell state ${\mathbf{c}}_t$ and the activation ${\mathbf{a}}_t$ are updated and used as further inputs during the next recurrence.