What is RNN
The networks are recurrent because they performance same computations for all the elements of a sequence of input, and the output of each element dependents, in addition to current input, from all the previous commutations.
Why RNN
- Sequential type information of the inputs
Video Analysis
Speech Recognition
Machine Translation - RNN have proved to have excellent performance in such problems
RNN Procedure
Sigmoid Gradient
The Vanish Gradient Problem
Consider the recurrent networks:
then,
LSTM Cell
Input Gate
forget gate
output gate
扫描二维码关注公众号,回复: 874545 查看本文章
Reducing The Problem
Reference
- http://adventuresinmachinelearning.com/recurrent-neural-networks-lstm-tutorial-tensorflow/
- Deep Learning with Tensorflow