Learn note04--Deep Learning Introduce and Back-Propagating

Learn note04–Deep Learning Introduce and Back-Propagating

1. Deep Learning Introduce

• The Steps of Deep Learning
  Step1：Neural network
  Different connection leads to different network structures
  Fully connect Feedforward Network
  Deep = Many hidden layers
  Step2：Goodness of function
  Step3：Pick best function

2. Backpropagation

An efficient way to compute in neural network

• Grandient Descent
  To compute the gradients efficiently, we use backpropagation.
• Chain Rule
• Forward pass
• Backward pass