Machine learning optimization algorithm in three forms BGD [Machine Learning] gradient descent method, SGD and MBGD

Machine learning optimization algorithm

Author: Kailugaji - blog Park  http://www.cnblogs.com/kailugaji/

1. gradient descent

2. The stochastic gradient descent method

3. Small batch gradient descent

4. References

[1] Qiuxi Peng,  Neural Network Learning and depth [M]. 2019.

[2]  [Machine Learning] gradient descent three forms BGD, SGD and MBGD

Guess you like

Origin www.cnblogs.com/kailugaji/p/12030258.html