task 02 text processing language model neural network infrastructure

Language Model

Some natural language text can be seen as a discrete time series, given a sequence of length T W1 words of ... WT, target language model is to assess the reasonableness of the sequence, ie the sequence probability calculation:
Here Insert Picture Description
the n-gram
Here Insert Picture Description

Recurrent Neural Networks

Here Insert Picture Description

Construction cycle neural networks

Here Insert Picture Description

Released two original articles · won praise 0 · Views 26

Guess you like

Origin blog.csdn.net/qq_41101436/article/details/104313974