ON and OFF RF mosaics and their temporal kernels are predicted by efficient coding of natural videos. (A) Frames of natural videos plus input noise are linearly filtered with the spatial kernels and then passed through one-dimensional temporal convolutions followed by a nonlinearity, resulting firing rates for each of RGCs. (B) The same calculations shown along the time axis, visualizing the temporal convolutions. (C) Examples of initial and optimized spatial filters, temporal filters, and nonlinearities: (left) fast OFF kernel, (right) slow ON kernel. (D) Unconstrained spatial filters learned center-surround shapes, about half of which are ON RFs. (E) Temporal filters using the parameterization (6) converged to four distinct clusters.