Fig 1. Schematic representation of our MaxEnt interpretation method.

An unseen sequence x elicits penultimate unit activations (shaded dots in left figure) via non-linear operations of intermediate layers (illustrated as a horizontal stack of convolutional filters). The MaxEnt method for interpreting a given input sequence x₀ assigns probability to a new sequence x according to its similarity to x₀ in the space of penultimate activations. The irregular path connecting x₀ and x in sequence space illustrates the steps of MCMC.