RNNs & LSTMs & GRUs

1 RNNs

1.1 RNN(Recurrent Neural Netwrok)

Resource 1: 用纸笔训练循环神经网络RNN

Figure 1: RNN cell

1.2 Bi-RNN(Bidirectional Recurrent Neural Netwrok)

2 LSTMs

2.1 LSTM (Long Short-Term Memory)

2.2 Bi-LSTM(Bidirectional Long Short-Term Memory)

3 GRUs

3.1 GRU(Gated Recurrent Unit)