transformer before the need to read the paper

https://arxiv.org/pdf/1705.00108.pdf

Callout appreciated sequence, using Dynamic embedding vector (bilstm)

1, 2 context sensitive, enhanced generalization