A Detailed Look at the Difference Between Lasso and Ridge Regression
algofin.substack.com
We left the last article on linear regression by introducing 2 variations of the standard Ordinary Least Squares (OLS) method, Lasso and Ridge, that have a very subtle difference on paper to distinguish them. As a reminder, the difference is in the type of loss carried out by the penalty parameter, where in Ridge regression we employ an L2 loss which involves squaring the parameters, whilst Lasso employs the L1 loss, which just uses their absolute values.
A Detailed Look at the Difference Between Lasso and Ridge Regression
A Detailed Look at the Difference Between…
A Detailed Look at the Difference Between Lasso and Ridge Regression
We left the last article on linear regression by introducing 2 variations of the standard Ordinary Least Squares (OLS) method, Lasso and Ridge, that have a very subtle difference on paper to distinguish them. As a reminder, the difference is in the type of loss carried out by the penalty parameter, where in Ridge regression we employ an L2 loss which involves squaring the parameters, whilst Lasso employs the L1 loss, which just uses their absolute values.