Gradient disappears and appears to solve the problem

1. Use the quadratic cost function gradient causes of the disappearance of

Quadratic cost function

2. cross-entropy cost function

What is the cross-entropy cost function

Cross entropy cost function
### gradient principle to solve the problem of disappearing
image.png

Gradient disappears solution .png
## 3. Summary
This is a summary of his first contact with the gradient disappears problem. The main problem is the disappearance of the gradient-induced secondary cost function, and then use the cross-entropy generation of add function to solve this problem, the principle of this process was a preliminary understanding.
For gradient other issues arising from the disappearance of problems and their solutions, we met during the subsequent summary.

Published 32 original articles · won praise 7 · views 7594

Guess you like

Origin blog.csdn.net/Isaacddx/article/details/85057011