There is a problem with the solution of machine learning day8-SVM training error of 0

Does an SVM classifier with a training error of 0 necessarily exist?

In theory, there is a set of parameters image.png, and imagesuch that SVM training error is zero, but this is not necessarily a parameter SVM solution satisfies the conditions, when the actual training SVM model, will join a slack variable, it is also possible to ensure an SVM classifier obtained Is it satisfied that the training error is 0?
Therefore, we need to find a set of parameters so that the training error is 0 and the solution of the SVM model.
Solutions SVM model constraints are
image.pngnow we get a set of parameters that can, when image.png, the image.png; as image.pngwhen image.png.
Therefore, we also need to meet the conditions,
image.pngtherefore, for a formula, first make b = 0, then
image.pngtherefore,
image.png

here image.png. imageIf the value is very small, it is enough image.png. At this time, the solution condition of SVM is satisfied, and the model error is also 0 at this time.

Add slack variables, can the training error of SVM be 0?

In practice, the SMO algorithm is used to train a linear SVM model with slack variables, and the penalty factor is any unknown constant, and a model with a training error of 0 may not be obtained.
The objective function of the SVM model with slack variables contains these two items:
image.pngwhen C=0, image=0, the optimization goal is reached, and the training error is not necessarily zero at this time.


Guess you like

Origin blog.51cto.com/15069488/2578601