Skip to main content
NCBI home page
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
. 1989 Mar;86(5):1712–1716. doi: 10.1073/pnas.86.5.1712

Noise in neural networks: thresholds, hysteresis, and neuromodulation of signal-to-noise.

J D Keeler 1, E E Pichler 1, J Ross 1
PMCID: PMC286771  PMID: 2564205

Abstract

We study a neural-network model including Gaussian noise, higher-order neuronal interactions, and neuromodulation. For a first-order network, there is a threshold in the noise level (phase transition) above which the network displays only disorganized behavior and critical slowing down near the noise threshold. The network can tolerate more noise if it has higher-order feedback interactions, which also lead to hysteresis and multistability in the network dynamics. The signal-to-noise ratio can be adjusted in a biological neural network by neuromodulators such as norepinephrine. Comparisons are made to experimental results and further investigations are suggested to test the effects of hysteresis and neuromodulation in pattern recognition and learning. We propose that norepinephrine may "quench" the neural patterns of activity to enhance the ability to learn details.

Full text

PDF
1712

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Amit DJ, Gutfreund H, Sompolinsky H. Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett. 1985 Sep 30;55(14):1530–1533. doi: 10.1103/PhysRevLett.55.1530. [DOI] [PubMed] [Google Scholar]
  2. BRUNER J. S., POTTER M. C. INTERFERENCE IN VISUAL RECOGNITION. Science. 1964 Apr 24;144(3617):424–425. doi: 10.1126/science.144.3617.424. [DOI] [PubMed] [Google Scholar]
  3. Daw N. W., Robertson T. W., Rader R. K., Videen T. O., Coscia C. J. Substantial reduction of cortical noradrenaline by lesions of adrenergic pathway does not prevent effects of monocular deprivation. J Neurosci. 1984 May;4(5):1354–1360. doi: 10.1523/JNEUROSCI.04-05-01354.1984. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Emerson R. C., Citron M. C., Vaughn W. J., Klein S. A. Nonlinear directionally selective subunits in complex cells of cat striate cortex. J Neurophysiol. 1987 Jul;58(1):33–65. doi: 10.1152/jn.1987.58.1.33. [DOI] [PubMed] [Google Scholar]
  5. Foote S. L., Bloom F. E., Aston-Jones G. Nucleus locus ceruleus: new evidence of anatomical and physiological specificity. Physiol Rev. 1983 Jul;63(3):844–914. doi: 10.1152/physrev.1983.63.3.844. [DOI] [PubMed] [Google Scholar]
  6. Gray C. M., Freeman W. J., Skinner J. E. Chemical dependencies of learning in the rabbit olfactory bulb: acquisition of the transient spatial pattern change depends on norepinephrine. Behav Neurosci. 1986 Aug;100(4):585–596. doi: 10.1037//0735-7044.100.4.585. [DOI] [PubMed] [Google Scholar]
  7. Hopfield J. J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad Sci U S A. 1984 May;81(10):3088–3092. doi: 10.1073/pnas.81.10.3088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Kasamatsu T., Pettigrew J. D. Depletion of brain catecholamines: failure of ocular dominance shift after monocular occlusion in kittens. Science. 1976 Oct 8;194(4261):206–209. doi: 10.1126/science.959850. [DOI] [PubMed] [Google Scholar]
  9. Kirkpatrick S., Gelatt C. D., Jr, Vecchi M. P. Optimization by simulated annealing. Science. 1983 May 13;220(4598):671–680. doi: 10.1126/science.220.4598.671. [DOI] [PubMed] [Google Scholar]
  10. Marr D. A theory of cerebellar cortex. J Physiol. 1969 Jun;202(2):437–470. doi: 10.1113/jphysiol.1969.sp008820. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Peretto P., Niez J. J. Long term memory storage capacity of multiconnected neural networks. Biol Cybern. 1986;54(1):53–63. doi: 10.1007/BF00337115. [DOI] [PubMed] [Google Scholar]
  12. Poggio T., Reichardt W. Visual control of orientation behaviour in the fly. Part II. Towards the underlying neural interactions. Q Rev Biophys. 1976 Aug;9(3):377–438. doi: 10.1017/s0033583500002535. [DOI] [PubMed] [Google Scholar]
  13. Sclabassi R. J., Krieger D. N., Berger T. W. A systems theoretic approach to the study of CNS function. Ann Biomed Eng. 1988;16(1):17–34. doi: 10.1007/BF02367378. [DOI] [PubMed] [Google Scholar]
  14. Stevens C. F. Inferences about membrane properties from electrical noise measurements. Biophys J. 1972 Aug;12(8):1028–1047. doi: 10.1016/S0006-3495(72)86141-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Waterhouse B. D., Woodward D. J. Interaction of norepinephrine with cerebrocortical activity evoked by stimulation of somatosensory afferent pathways in the rat. Exp Neurol. 1980 Jan;67(1):11–34. doi: 10.1016/0014-4886(80)90159-4. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES