Skip to main content
NCBI home page
Biophysical Journal logoLink to Biophysical Journal
. 1987 Jan;51(1):47–53. doi: 10.1016/S0006-3495(87)83310-6

"Unlearning" increases the storage capacity of content addressable memories.

D Kleinfeld, D B Pendergraft
PMCID: PMC1329862  PMID: 3801583

Abstract

The storage and retrieval of information in networks of biological neurons can be modeled by certain types of content addressable memories (CAMs). We demonstrate numerically that the amount of information that can be stored in such CAMs is substantially increased by an unlearning algorithm. Mechanisms for the increase in capacity are identified and illustrated in terms of an energy function that describes the convergence properties of the network.

Full text

PDF
47

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Amit DJ, Gutfreund H, Sompolinsky H. Spin-glass models of neural networks. Phys Rev A Gen Phys. 1985 Aug;32(2):1007–1018. doi: 10.1103/physreva.32.1007. [DOI] [PubMed] [Google Scholar]
  2. Amit DJ, Gutfreund H, Sompolinsky H. Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett. 1985 Sep 30;55(14):1530–1533. doi: 10.1103/PhysRevLett.55.1530. [DOI] [PubMed] [Google Scholar]
  3. Crick F., Mitchison G. The function of dream sleep. Nature. 1983 Jul 14;304(5922):111–114. doi: 10.1038/304111a0. [DOI] [PubMed] [Google Scholar]
  4. Hopfield J. J., Feinstein D. I., Palmer R. G. 'Unlearning' has a stabilizing effect in collective memories. Nature. 1983 Jul 14;304(5922):158–159. doi: 10.1038/304158a0. [DOI] [PubMed] [Google Scholar]
  5. Hopfield J. J. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554–2558. doi: 10.1073/pnas.79.8.2554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Hopfield J. J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci U S A. 1984 May;81(10):3088–3092. doi: 10.1073/pnas.81.10.3088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Hopfield J. J., Tank D. W. Computing with neural circuits: a model. Science. 1986 Aug 8;233(4764):625–633. doi: 10.1126/science.3755256. [DOI] [PubMed] [Google Scholar]
  8. Little W. A., Shaw G. L. A statistical theory of short and long term memory. Behav Biol. 1975 Jun;14(2):115–133. doi: 10.1016/s0091-6773(75)90122-4. [DOI] [PubMed] [Google Scholar]
  9. Peretto P. Collective properties of neural networks: a statistical physics approach. Biol Cybern. 1984;50(1):51–62. doi: 10.1007/BF00317939. [DOI] [PubMed] [Google Scholar]

Articles from Biophysical Journal are provided here courtesy of The Biophysical Society

RESOURCES