Fig 5. Sparsity of input layer of networks pruned to 93% sparsity.

Each box represents the number of connections remaining between a parameter in the input layer and the first hidden layer. For all 858 networks in this group, ${\dot{\theta }}_i$ was pruned entirely from the network.