Figure 1.

Illustration of the ${\ell }_0$, ${\ell }_1$ and seven non-convex functions. All the non-convex penalty functions share two common properties: They are singular at origin, concave and monotonically decreasing on (−∞,0], and concave and monotonically increasing on [0,∞).