Fig 4. Comparison of the performance of feedforward architecture with that of LASSO.

For this example, we chose N = 1000 and M = 500. Linear measurement is used for LASSO. Feedforward architecture performs well when the signal is very sparse, while LASSO has lower reconstruction error as K increases, at the price of increasingly more iterations. On the other hand, if we constrain the number of iterations, LASSO still performs better when K is large, but significantly worse with very sparse signals.