Skip to main content
. Author manuscript; available in PMC: 2009 Feb 12.
Published in final edited form as: Neural Netw. 2006 Mar 9;19(5):535–546. doi: 10.1016/j.neunet.2005.11.002

Figure 4.

Figure 4

Relationship between entropy, conditional entropy and mutual information illustrated using a Venn diagram. The degree to which ‘surprise’ is reduced in Et conditional on Et−1 is measured by the mutual information.