Recurrent neural networks

Recurrent neural networks (RNNs) are a paradigm for neural network architectures. They allow to model sequential or temporal data.

LSTM

Solves the problem of vanishing and exploding gradients of previous architectures. Currently it is the prevalent RNN architecture.

Sources

GRU

Similar to LSTM’s structure, but computationally more efficient. Its adoption is on the rise.

Historical