survey of attention and transformer

 

Visualizing A Neural Machine Translation Model

　　Visualizing A Neural Machine Translation Model (Mechanics of Seq2seq Models With Attention) – Jay Alammar – Visualizing machine learning one concept at a time. (jalammar.github.io)

 

The Illustrated Transformer

　　The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time. (jalammar.github.io)

 

Dilated Convolution

　　空洞卷积(dilated Convolution) - 知乎 (zhihu.com)