[Interview & eight-part essay] Search and promotion direction: Interview records (2)

[Interview & eight-part essay] Search and promotion direction: Interview records (2)

1. Introduce yourself

。。。。。。

2. Project introduction

Choose a project that you think is good to introduce. . . . .

3. Transformer related

• The difference between Transformer encoder and decoder

  • Encoder: The Encoder in Transformer is a module used to convert input sequences into hidden representations. It takes the word embedding vector of each position in the input sequence as the initial input, and then encodes the information of each position into a fixed-length hidden vector representation through a multi-layer self-attention mechanism and a fully connected layer. The output of the Encoder can be sent to the Decoder for further processing.
  • Decoder: The Decoder in Transformer is used to generate the output sequence.