4. What are the differences between L2 and L1 regularization? For a given linear decision (w,b), calculate the value of the L2 and L1 penalty 5. Describe majorization-minimization and gradient descent...

4. What are the differences between L2 and L1 regularization? For a given linear decision (w,b),

calculate the value of the L2 and L1 penalty

5. Describe majorization-minimization and gradient descent

6. Describe the proximal gradient descent method: what is the gradient step? What is the proximal

step? For a set Q={x : ||x||<=1} in="" 2d="" space,="" what="" is="" the="" result="" of="" proxq(y)="">

a) y=[0.5,0.2]; b) y=[2,0]