Regularization (not completed)

Regularization Strategy

1. The data enhancement

2. \ (L_1 \) and \ (L_2 \) regularization

3. Dropout

4. DropConnect

5. Early stopping

References:
[1] Rule of the norm (a) machine learning L0, L1 and L2 norm
[2] Rule of the norm (ii) machine learning core Norm Rules preferences
[3 ] paper: Regularization and Optimization strategies in Deep Convolutional
Neural Network [4]