Figure A4.

Mean difference in MI of subsequent layers ℓ and $𝓁+1$. Positive numbers indicate compliance with the DPI. MI was measured on the MNIST training using the EDGE MI estimator on a simple MLP [4].