版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/lz_peter/article/details/81317202
Lecture I : Introduction of Deep Learning
- Introduction of Deep Learning
- Step1 : define a set of function
- Step2 : goodness of function
- Step3 : pick the best function
- Why Deep?
- "Hello World" for Deep Learning
Lecture II : Tips for Training Deep Neural Network
- Recipe of Deep Learning
- Choosing proper loss
- Mini-batch
- New activation function
- Adaptive Learning Rate
- Momentum
- Early Stopping
- Weight Decay
- Regularization
- Dropout
- Network Structure
Lecture III : Variants of Neural Network
- Convolutional Neural Network(CNN)
- Recurrent Neural Network(RNN)
Lecture IV : Next Wave
- Supervised Learning
- Ultra Deep Network
- Attention Model
- Reinforcement Learning
- Unsuperivised Learning
- Image:Realizing what the World Looks Like
- Text:Understanding the Meaning of Words
- Audio:Learning human language without supervision