Algorithm 4 RED-PG Algorithm

$$\begin{array}{cc}\hfill & \mathbf{Require}:\ell (\cdot ;\mathit{y}),\mathit{f}(\cdot ),\beta ,\lambda ,{\mathit{v}}_0,{\mathit{u}}_0,L>0,\text{and}K\hfill \\ \hfill & 1:\mathbf{for}k=1,2,\dots ,K\mathbf{do}\hfill \\ \hfill & 2:{\mathit{x}}_k={\text{arg min}}_{\mathit{x}}\left\{\ell \right(\mathit{x};\mathit{y})+\frac{\lambda L}{2}\Vert \mathit{x}-{\mathit{v}}_{k-1}{\Vert }^2\}\hfill \\ \hfill & 3:{\mathit{v}}_k=\frac{1}{L}\mathit{f}\left({\mathit{x}}_k\right)-\frac{1-L}{L}{\mathit{x}}_k\hfill \\ \hfill & 4:\mathbf{end}\mathbf{for}\hfill \\ \hfill & 5:\text{Return}{x}_K\hfill \end{array}$$