Summary of NLP knowledge points [Continuous update]

Basic knowledge

Cross entropy, KL divergence, maximum likelihood estimation and maximum posterior estimation

Word vector

Detailed explanation of word vectors: from word2vec, glove, ELMo to BERT

RNN LSTM

RNN, LSTM

seq2seq

Attention

Detailed introduction of Attention Mechanism in deep learning: principle, classification and application