Detailed version of integrated learning self-made PPT screenshot explanation

Refer to Zhou Zhihua's "Machine Learning" and Li Hang's " Statistical Learning Methods " 

Integrated learning self-made PPT, the first time to learn, mistakes, a lot of advice.

Decision tree method to determine V=2.5 threshold

Quick facts: Hoeffding 's inequality: Hoeffding 's inequality refers to the difference between the true probability of an event and the frequency observed in Bernoulli trials. Hoeffding Inequality

Minimize the relationship between the loss function and the maximum likelihood function (linear regression as an example)

Maximum likelihood and linear regression (minimizing the loss function relationship) - Dujuancao11's blog - CSDN blog - Minimize the loss function

If the loss function is minimized, the classification error rate will also be minimized .

This shows that the exponential loss function is a consistent replacement loss function for the original 0/1 loss function for classification tasks.

Summary of common loss functions

The difference between  normalization , normalization and regularization, the relationship between normalization, standardization and regularization - Programmer Sought