参考
- pytorch实现L2和L1正则化regularization的方法
https://blog.csdn.net/guyuealian/article/details/88426648
- 深度学习——优化器算法Optimizer详解(BGD、SGD、MBGD、Momentum、NAG、Adagrad、Adadelta、RMSprop、Adam)
https://www.cnblogs.com/guoyaohua/p/8542554.html
参考
https://blog.csdn.net/guyuealian/article/details/88426648
https://www.cnblogs.com/guoyaohua/p/8542554.html