Above we talked about the significance of the introduction of the activation function, a variety of activation function, let's take an example of an activating function sigmoid do, other similar. sigmoid function is expressed as follows:
It is a graph of a function:
See above function graph, it can be seen are the characteristics of a sigmoid function when the input value is from negative infinity to positive infinity, the output value between 0 and 1. . . . . . . . . . . . .
Reprinted from the original article: https://blog.csdn.net/qq_44594249/article/details/100561953