吴恩达《改善深层神经网络：超参数调试、正则化以及优化》课程总结

版权声明：本文为博主原创文章，未经博主允许不得转载。 https://blog.csdn.net/you1314520me/article/details/80687250

本文新地址点击：此处

Note

This is my personal summary after studying the course, Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization, which belongs to Deep Learning Specialization. and the copyright belongs to deeplearning.ai.

My personal notes

 week 1 : practical-aspects-of-deep-learning

• 01_setting-up-your-machine-learning-application
  • 01_train-dev-test-sets
  • 02_bias-variance
  • 03_basic-recipe-for-machine-learning
• 02_regularizing-your-neural-network
  • 01_regularization
  • 02_why-regularization-reduces-overfitting
  • 03_dropout-regularization
  • 04_understanding-dropout
  • 05_other-regularization-methods
• 03_setting-up-your-optimization-problem
  • 01_normalizing-inputs
  • 02_vanishing-exploding-gradients
  • 03_weight-initialization-for-deep-networks
  • 04_numerical-approximation-of-gradients
  • 05_gradient-checking
  • 06_gradient-checking-implementation-notes

week 2: optimization-algorithms

• 01_mini-batch-gradient-descent
• 02_understanding-mini-batch-gradient-descent
• 03_exponentially-weighted-averages
• 04_understanding-exponentially-weighted-averages
• 05_bias-correction-in-exponentially-weighted-averages
• 06_gradient-descent-with-momentum
• 07_rmsprop
• 08_adam-optimization-algorithm
• 09_learning-rate-decay
• 10_the-problem-of-local-optima

week 3: hyperparameter-tuning-batch-normalization-and-programming-frameworks

• 01_hyperparameter-tuning
  • 01_tuning-process
  • 02_using-an-appropriate-scale-to-pick-hyperparameters
  • 03_hyperparameters-tuning-in-practice-pandas-vs-caviar
• 02_batch-normalization
  • 01_normalizing-activations-in-a-network
  • 02_fitting-batch-norm-into-a-neural-network
  • 03_why-does-batch-norm-work
  • 04_batch-norm-at-test-time
• 03_multi-class-classification
  • 01_softmax-regression
  • 02_training-a-softmax-classifier
• 04_introduction-to-programming-frameworks
  • tensorflow

My personal programming assignments

week1: practical-aspects-of-deep-learning
week2: optimization-algorithms
week3: hyperparameter-tuning-batch-normalization-and-programming-frameworks