Machine learning optimization algorithm
Author: Kailugaji - blog Park http://www.cnblogs.com/kailugaji/
1. gradient descent
2. The stochastic gradient descent method
3. Small batch gradient descent
4. References
[1] Qiuxi Peng, Neural Network Learning and depth [M]. 2019.
[2] [Machine Learning] gradient descent three forms BGD, SGD and MBGD