Figure - PMC

Skip to main content

View full-text article in PMC

. Author manuscript; available in PMC: 2015 May 1.

Published in final edited form as: Artif Intell. 2014 Feb 24;210:78–122. doi: 10.1016/j.artint.2014.02.004

Figure 9.14 — Approximation of $E (O_{i}^{l} O_{j}^{h})$ by $W_{i}^{l} W_{i j}^{l h}$ and $W_{i}^{l} W_{j}^{h}$ for pairs of connected non-input neurons, with a directed connection from j to i in a MNIST classifier network, before and after training. Histograms are obtained by taking 100,000 pairs of connected neurons, uniformly at random, and aggregating the results over 10 random input vectors.