|
= the input vector |
|
= the activation vector of the forget gate at time t
|
|
= the activation vector of input gate at time t
|
|
= the activation vector of the output gate at time t
|
|
= the memory cell activation vector at time t
|
|
= the hidden state activation vector at time t
|
|
, , and
|
= the input kernels for the respective gates |
|
, , and
|
= the recurrent kernels for the respective gates |
|
, , , and
|
= the biases |
|
= the logistic sigmoid function |
| ∘ |
= the matrix product |
|
= the hyperbolic tangent activation function |