Skip to main content
NCBI home page
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
. 1996 Apr 16;93(8):3303–3307. doi: 10.1073/pnas.93.8.3303

Self-organized phase transitions in neural networks as a neural mechanism of information processing.

O Hoshino 1, Y Kashimori 1, T Kambara 1
PMCID: PMC39602  PMID: 8622933

Abstract

Transitions between dynamically stable activity patterns imposed on an associative neural network are shown to be induced by self-organized infinitesimal changes in synaptic connection strength and to be a kind of phase transition. A key event for the neural process of information processing in a population coding scheme is transition between the activity patterns encoding usual entities. We propose that the infinitesimal and short-term synaptic changes based on the Hebbian learning rule are the driving force for the transition. The phase transition between the following two dynamical stable states is studied in detail, the state where the firing pattern is changed temporally so as to itinerate among several patterns and the state where the firing pattern is fixed to one of several patterns. The phase transition from the pattern itinerant state to a pattern fixed state may be induced by the Hebbian learning process under a weak input relevant to the fixed pattern. The reverse transition may be induced by the Hebbian unlearning process without input. The former transition is considered as recognition of the input stimulus, while the latter is considered as clearing of the used input data to get ready for new input. To ensure that information processing based on the phase transition can be made by the infinitesimal and short-term synaptic changes, it is absolutely necessary that the network always stays near the critical state corresponding to the phase transition point.

Full text

PDF
3303

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Crick F., Mitchison G. The function of dream sleep. Nature. 1983 Jul 14;304(5922):111–114. doi: 10.1038/304111a0. [DOI] [PubMed] [Google Scholar]
  2. Freeman W. J., Baird B. Relation of olfactory EEG to behavior: spatial analysis. Behav Neurosci. 1987 Jun;101(3):393–408. doi: 10.1037//0735-7044.101.3.393. [DOI] [PubMed] [Google Scholar]
  3. Freeman W. J. Neural networks and chaos. J Theor Biol. 1994 Nov 7;171(1):13–18. doi: 10.1006/jtbi.1994.1207. [DOI] [PubMed] [Google Scholar]
  4. GUGLER E., von MURALT, BUETLER R. [Immunoelectro-phoretic analysis of human serum proteins]. Schweiz Med Wochenschr. 1959 Jul 4;89:703–710. [PubMed] [Google Scholar]
  5. Gilbert C. D., Wiesel T. N. Receptive field dynamics in adult primary visual cortex. Nature. 1992 Mar 12;356(6365):150–152. doi: 10.1038/356150a0. [DOI] [PubMed] [Google Scholar]
  6. Hopfield J. J., Feinstein D. I., Palmer R. G. 'Unlearning' has a stabilizing effect in collective memories. Nature. 1983 Jul 14;304(5922):158–159. doi: 10.1038/304158a0. [DOI] [PubMed] [Google Scholar]
  7. Hopfield J. J. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554–2558. doi: 10.1073/pnas.79.8.2554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Hopfield J. J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci U S A. 1984 May;81(10):3088–3092. doi: 10.1073/pnas.81.10.3088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Hopfield J. J. Olfactory computation and object perception. Proc Natl Acad Sci U S A. 1991 Aug 1;88(15):6462–6466. doi: 10.1073/pnas.88.15.6462. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Kapadia M. K., Gilbert C. D., Westheimer G. A quantitative measure for short-term cortical plasticity in human vision. J Neurosci. 1994 Jan;14(1):451–457. doi: 10.1523/JNEUROSCI.14-01-00451.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Sompolinsky H, Kanter I., I Temporal association in asymmetric neural networks. Phys Rev Lett. 1986 Dec 1;57(22):2861–2864. doi: 10.1103/PhysRevLett.57.2861. [DOI] [PubMed] [Google Scholar]
  12. Vaadia E., Bergman H., Abeles M. Neuronal activities related to higher brain functions--theoretical and experimental implications. IEEE Trans Biomed Eng. 1989 Jan;36(1):25–35. doi: 10.1109/10.16446. [DOI] [PubMed] [Google Scholar]
  13. Zohary E., Celebrini S., Britten K. H., Newsome W. T. Neuronal plasticity that underlies improvement in perceptual performance. Science. 1994 Mar 4;263(5151):1289–1292. doi: 10.1126/science.8122114. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES