Simple and crude understanding and implementation of machine learning linear regression (III): mathematics: the derivative guide, common functions, derivative of four operations, matrix (vector) derivative

Linear Regression

learning target

• Ownership in the implementation process of linear regression
• Application LinearRegression or SGDRegressor achieve regression prediction
• We know the assessment criteria and formulas regression algorithm
• Overfitting know the causes and solutions underfitting
• We know principle ridge regression and linear regression differences
• Application Ridge achieve regression prediction
• Application joblib achieve saving and loading models

2.3 Mathematics: derivation

Derivative 1 common functions

2 four arithmetic derivative

3 Exercises

• 3.1 y = x^3-2x2+sinx,求f`(x)

• 3.2 y=ln(sinx), 求dy/dx

4 matrix (vector) derivative [learn]

Reference Links: https://en.wikipedia.org/wiki/Matrix_calculus#Scalar-by-vector_identities