Skip to main content
Cognitive Neurodynamics logoLink to Cognitive Neurodynamics
. 2006 Dec 7;1(1):3–14. doi: 10.1007/s11571-006-9001-x

Definitions of state variables and state space for brain-computer interface

Part 1. Multiple hierarchical levels of brain function

Walter J Freeman 1,
PMCID: PMC2288954  PMID: 19003492

Abstract

Neocortical state variables are defined and evaluated at three levels: microscopic using multiple spike activity (MSA), mesoscopic using local field potentials (LFP) and electrocorticograms (ECoG), and macroscopic using electroencephalograms (EEG) and brain imaging. Transactions between levels occur in all areas of cortex, upwardly by integration (abstraction, generalization) and downwardly by differentiation (speciation). The levels are joined by circular causality: microscopic activity upwardly creates mesoscopic order parameters, which downwardly constrain the microscopic activity that creates them. Integration dominates in sensory cortices. Microscopic activity evoked by receptor input in sensation induces emergence of mesoscopic activity in perception, followed by integration of perceptual activity into macroscopic activity in concept formation. The reverse process dominates in motor cortices, where the macroscopic activity embodying the concepts supports predictions of future states as goals. These macroscopic states are conceived to order mesoscopic activity in patterns that constitute plans for actions to achieve the goals. These planning patterns are conceived to provide frames in which the microscopic activity evolves in trajectories that adapted to the immediate environmental conditions detected by new stimuli. This circular sequence forms the action-perception cycle. Its upward limb is understood through correlation of sensory cortical activity with behavior. Now brain-machine interfaces (BMI) offer a means to understand the downward sequence through correlation of behavior with motor cortical activity, beginning with macroscopic goal states and concluding with recording of microscopic MSA trajectories that operate neuroprostheses. Part 1 develops a hypothesis that describes qualitatively the neurodynamics that supports the action-perception cycle and derivative reflex arc. Part 2 describes episodic, “cinematographic” spatial pattern formation and predicts some properties of the macroscopic and mesoscopic frames by which the embedded trajectories of the microscopic activity of cortical sensorimotor neurons might be organized and controlled.

Keywords: Beta activityβ, BCI, BMI, Electrocorticogram ECoG, Epsilon activity ε, Gamma activity γ, Intentional action, Local field potential LFP, Multiple spike activity MSA, Multiunit activity MUA, State variables, State transitions

Acknowledgment

I am grateful for permission from J. C. Sanchez, Department of Pediatrics, Division of Neurology, and P. C. Carney and J. C. Principe, Department of Electrical and Computer Engineering, University of Florida, Gainesville FL 32611 to use their figure illustrating intracranial recording.

Appendix 1. Wave-pulse statistical relations

A continuous record is digitized at 1 KHz simultaneously of a spike train of a single neurons and the ECoG at the cortical site of penetration (Freeman 1975/2004). The ECoG is filtered in the pass band of the desired oscillatory frequency, e.g., 20–80 Hz. The spike train is accumulated to give np ~10,000 pulses expressed as a series of 0’s and 1’s. The N values of ECoG values are normalized to zero mean and unit SD; an amplitude histogram is divided into 61 bins centered at 0 and ranging between ± 3 SD in steps of 0.1 SD. At each time step the question is asked, is there a pulse in any bin between T = 0 and T = ±Tr time steps (e.g., Tr = ±25 ms preceding and following T = 0 ms). A 1-D table of the pulse occurrences at each amplitude is accumulated at T = 0, p(v). The nv(v) values in each bin, nv, are divided by the total number of pairs to get the probability density for amplitude at T = 0:

graphic file with name M1.gif 1

The number of pulses in each bin, np (p,v) is divided by the total number of pairs to give the joint pulse-amplitude probability density at T = 0:

graphic file with name M2.gif 2

The pulse probability density is divided by the amplitude probability density to give the pulse probability conditional on amplitude at T = 0:

graphic file with name M3.gif 3

The algorithm is repeated at each time lag between −Tr and +Tr to get the pulse probability conditional on time and amplitude in 2-D, which is then normalized by dividing the function by the grand mean pulse probability, Po:

graphic file with name M4.gif 4

The function is normalized by dividing all values by the grand mean pulse probability, Po to get the normalized conditional pulse probability (NCPD):

graphic file with name M5.gif 5

The time dependence of the NCPD is found by averaging across the upper third of the range for v > 0, giving the pulse probability wave that is comparable to the autocorrelation of the filtered ECoG or LFP:

graphic file with name M6.gif 6

The sigmoid curve is the NCPD on amplitude is estimated by averaging over lag times at k values where the deviation of Pv(T) above zero is maximal:

graphic file with name M7.gif 7

The sigmoid curve is fitted to the data (Fig. 1A) in order to evaluate the upper asymptote, Qm, as given in the equation inset with the data. The asymptote varies in proportion to the degree of arousal, and it has differing mean values for differing populations in the olfactory and limbic systems. The forward gain of the population is given by the derivative of the sigmoid curve, dq/dv. Two examples are shown for Qm = 2 in behavioral rest and Qm = 5 in arousal (Freeman 2000) for comparison with the numerical derivative in Fig. 1A. The maximal gain, vmax = ln Qm from the second derivative set to 0, is displaced to the excitatory side. This asymmetry underlies the input-dependent nonlinearity of cortical dynamics, which is required for the destabilization in spontaneous breaking of symmetry by state transitions (Freeman and Vitiello 2006). From Freeman (1979; reprinted Ch. 10, 2000)

Footnotes

URL: http://sulcus.berkeley.edu

References

  1. Abbott A (2006) Neuroprosthetics: in search of a sixth sense. Nature 442:125–127 [DOI] [PubMed]
  2. Andersen RA, Musallam S, Pesaran B (2004) Selecting the signals for a brain-machine interface. Curr Opin Neurobiol 14(6):720–726 [DOI] [PubMed]
  3. Abeles M (1991) Corticonics: neural circuits of the cerebral cortex. Cambridge UP, New York
  4. Barabásí A-L (2002) Linked. The new science of networks. Perseus, Cambridge MA
  5. Barrie JM, Freeman WJ, Lenhart M (1996) Modulation by discriminative training of spatial patterns of gamma EEG amplitude and phase in neocortex of rabbits. J Neurophysiol 76:520–539 [DOI] [PubMed]
  6. Barrie JM, Holcman D, Freeman WJ. (1999) Statistical evaluation of clusters derived by nonlinear mapping of EEG spatial patterns. J Neurosci Meth 90:87–95 [DOI] [PubMed]
  7. Basar E (1998) Brain function and oscillations. 1. Principles and approaches. 2. Integrative brain function, neurophysiology and cognitive operations. Springer-Verlag, Berlin
  8. Blanche TJ, Spacek MA, Hetke JF, Swindale NV (2005) Polytrodes: high-density silicon electrode arrays for large-scale multiunit recording. J Neurophysiol 93(5):2987–3000 [DOI] [PubMed]
  9. Blankertz B, Mueller KR, Curio G, Vaughan TM, Schalk G, Wolpaw JR, Schloegl A, Neuper C, Pfurtscheller G, Hinterberger T, Schoeder M, Birbaumer M. (2004) The BCI Competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans Biomed Eng 51:1044–1051 [DOI] [PubMed]
  10. Bok ST (1959) Histonomy of the cerebral cortex. Elsevier, Amsterdam
  11. Braitenberg V, Schüz A (1998) Cortex: statistics and geometry of neuronal connectivity. 2nd ed. Springer-Verlag, Berlin
  12. Bressler SL, Freeman WJ (1980) Frequency analysis of olfactory system EEG in cat, rabbit and rat. Electroencephalogr clin Neurophysiol 50:19–24 [DOI] [PubMed]
  13. Bressler SL, Kelso JAS (2001) Cortical coordination dynamics and cognition. Trends Cogn Sci 5:2–36 [DOI] [PubMed]
  14. Carmena JM, Lebedev MA, Crist RE, O’Doherty JE, Santucci DM, Dimitrov DF, Patil PG, Henriquez CS, Nicolelis MAL (2003) Learning to control a brain–machine interface for reaching and grasping by primates. PLoS Biol 1:193–208 [DOI] [PMC free article] [PubMed]
  15. Carmena JM, Lebedev MA, Henriquez CA, Nicolelis MAL (2005) Stable ensemble performance with single-neuron variability during reaching movements in primates. J Neurosci 25(46):10712–10716 [DOI] [PMC free article] [PubMed]
  16. Chapin JK, Moxon KA, Markowitz RS, Nicolelis MAL (1999) Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nature Neurosci 2:664–670 [DOI] [PubMed]
  17. Cheng M, Gao X, Gao S, Xu D (2002) Design and implementation of a brain-computer interface with high transfer rates. IEEE Trans Biomed Eng 49(10):1181–1186 SSVEP [DOI] [PubMed]
  18. Cohen D, Nicolelis MAL (2004) Reduction of single-neuron firing uncertainty by cortical ensembles during motor skill learning. J Neurosci 24:3574–3582 [DOI] [PMC free article] [PubMed]
  19. DiGiovanna J, Sanchez JC, Principe JC (2006) Improved linear BMI systems via population averaging. Proc EMBS [DOI] [PubMed]
  20. Donoghue JP (2002) Connecting cortex to machines: recent advances in brain interfaces. Nat Neurosci Suppl 1085–1088 [DOI] [PubMed]
  21. Ferster CB, Skinner BF (1957) Schedules of reinforcement. NJPrentice-Hall, Englewood Cliffs
  22. Fingelkurts AnA, Fingelkurts AlA (2004) Making complexity simpler: multivariability and metastability in the brain. Int J Neurosci 114:843–862 [DOI] [PubMed]
  23. Freeman WJ (1975) Mass action in the nervous system. New York: Academic. E-format (2004): http://sulcus.berkeley.edu/MANSWWW/MANSWWW.html
  24. Freeman WJ (1979) Nonlinear gain mediating cortical stimulus-response relations. Biol Cybern 33:237–247 [DOI] [PubMed]
  25. Freeman WJ (2000) Neurodynamics: an exploration of mesoscopic brain dynamics. Springer, London
  26. Freeman WJ (2004a) Origin, structure, and role of background EEG activity. Part 1. Analytic amplitude. Clin Neurophysiol 115:2077–2088 [DOI] [PubMed]
  27. Freeman WJ (2004b) Origin, structure, and role of background EEG activity. Part 2. Analytic phase. Clin Neurophysiol 115:2089–2107 [DOI] [PubMed]
  28. Freeman WJ (2005a) Origin, structure, and role of background EEG activity. Part 3. Neural frame classification. Clin Neurophysiol 116(5):1118–1129 [DOI] [PubMed]
  29. Freeman WJ (2005) A field-theoretic approach to understanding scale-free neocortical dynamics. Biol Cybern 92/6:350–359 [DOI] [PubMed]
  30. Freeman WJ (2006) Origin, structure, and role of background EEG activity. Part 4. Neural frame simulation. Clin Neurophysiol 117:572–589 [DOI] [PubMed]
  31. Freeman WJ, Barrie JM (2000) Analysis of spatial patterns of phase in neocortical EEGs in rabbit. J Neurophysiol 84:1266–1278 [DOI] [PubMed]
  32. Freeman WJ, Burke BC (2003) A neurobiological theory of meaning in perception. Part 4. Multicortical patterns of amplitude modulation in gamma EEG. Int J Bifurc Chaos 13:2857–2866 [DOI]
  33. Freeman WJ, Grajski KA (1987) Relation of olfactory EEG to behavior: factor analysis. Behav Neurosci 101:766–777 [DOI] [PubMed]
  34. Freeman WJ, Rogers LJ (2003) A neurobiological theory of meaning in perception. Part 5. Multicortical patterns of phase modulation in gamma EEG. Int J Bifurc Chaos 13:2867–2887 [DOI]
  35. Freeman WJ, Rogers LJ, Holmes MD, Silbergeld DL (2000) Spatial spectral analysis of human electrocorticograms including the alpha and gamma bands. J Neurosci Meth 95:111–121 [DOI] [PubMed]
  36. Freeman WJ, Vitiello G (2006) Nonlinear brain dynamics as macroscopic manifestation of underlying many-body field dynamics. Phys Life Rev 3:93–118 [DOI]
  37. Gao X, Xu D, Cheng M, Gao S (2003) A BCI-based environmental controller for the motion-disabled. IEEE Trans Rehab Engin 11(2):137–140 [DOI] [PubMed]
  38. Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416–1419 [DOI] [PubMed]
  39. Gonzalez SL, Grave de Peralta R, Thut G, Millán J del R, Morier P, Landis T (2006) Very high frequency oscillations (VHFO) as a predictor of movement intentions. NeuroImage, Short Communication, 32:170–179 [DOI] [PubMed]
  40. Granit R, Kernell D, Shortess GK (1963) Quantitative aspects of repetitive firing of mammalian motoneurons caused by injected currents. J Physiol 168:453–472 [DOI] [PMC free article] [PubMed]
  41. Granit R, Renkin B (1961) Net depolarization and discharge rate of motoneurons, as measured by recurrent inhibition. J Physiol 158:461–475 [DOI] [PMC free article] [PubMed]
  42. Haken H (1983) Synergetics: an introduction. Springer-Verlag, Berlin
  43. Hinterberger T, Kubler A, Kaiser J, Neumann N, Birbaumer N (2003) A brain-computer interface (BCI) for the locked-in: comparison of different EEG classifications for the thought translation device. Clin Neurophysiol 114:416–425 [DOI] [PubMed]
  44. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP (2006) Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442:164–172 [DOI] [PubMed]
  45. Houk JC (2005) Agents of the mind. Biol Cybern 92:427–437 [DOI] [PubMed]
  46. Houk JC, Wise SP (1995) Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cerebral Cortex 5:95–110 [DOI] [PubMed]
  47. Kay LM, Freeman WJ (1998) Bidirectional processing in the olfactory-limbic axis during olfactory behavior. Behav Neurosci 112:541–553 [DOI] [PubMed]
  48. Kipke DR, Vetter RJ, Williams JC (2003) Silicon-substrate intracortical microelectrode arrays for long-term recording of neuronal spike activity in cerebral cortex. IEEE Trans Rehab Engin 11:151–155 [DOI] [PubMed]
  49. Kozma R, Freeman WJ (2001) Chaotic resonance: methods and applications for robust classification of noisy and variable patterns. Int J Bifurc Chaos 10:2307–2322
  50. Kozma R, Freeman WJ, Erdí P (2003) The KIV model – nonlinear spatiotemporal dynamics of the primordial vertebrate forebrain. Neurocomputing 52:819–826
  51. Kozma R, Puljic M, Balister P, Bollobas B, Freeman WJ (2004) Neuropercolation: a random cellular automata approach to spatiotemporal neurodynamics. Ch. in: Lecture notes in computer science: 141.225.40.170 springerlink.com. http://repositories.cdlib.org/postprints/1013
  52. Lashley KS (1942) The problem of cerebral organization in vision. In: Cattell J (ed) Biological symposia VII:301–322
  53. Lee D, Port NL, Kruse W, Georgopoulos AP (1998) Variability and correlated noise in the discharge of neurons in motor and parietal areas of the primate cortex. J Neurosci 18:1161–1170 [DOI] [PMC free article] [PubMed]
  54. Li X, Li G, Wang L, Freeman WJ (2006) A study on a bionic pattern classifier based on olfactory neural system. Int J Bifurc Chaos (in press)
  55. Liley DTJ, Wright JJ (1994) Intracortical connectivity of pyramidal and stellate cells: estimates of synaptic densities and coupling symmetry. Network 5:175–189
  56. Mehring C, Rickert J, Vaadia E, Cardoso de Oliveiera S, Aertsen A, Rotter S (2003) Inference of hand movements from local field potentials in monkey motor cortex. Nature Neurosci 6(12):1253–1254 [DOI] [PubMed]
  57. Merleau-Ponty M (1945/1962) Phenomenology of perception. (C Smith, Trans.). Humanities Press, New York
  58. Millay J (1999) Multidimensional mind: remote viewing in hyperspace. North Atlantic Books, Berkeley CA
  59. Miltner WHR, Barun C, Arnold M, Witte H, Taub E (1999) Coherence of gamma-band EEG activity as a basis for associative learning. Nature 397:434–436 [DOI] [PubMed]
  60. Müller MM, Bosch J, Elbert T, Kreiter A, Valdes Sosa M, Valdes Sosa P, Rockstroh B (1996) Visually induced gamma band responses in human EEG – a link to animal studies. Exper Brain Res 112:96–112 [DOI] [PubMed]
  61. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA (2004) Cognitive control signals for neural prosthetics. Science 305:258–262 [DOI] [PubMed]
  62. Nicolelis MAL (2001) Actions from thoughts. Nature 409:403–407 [DOI] [PubMed]
  63. Nicolelis MA (2003) Brain-machine interfaces to restore motor function and probe neural circuits. Nat Rev Neurosci 4(5):417–22 [DOI] [PubMed]
  64. Nunez PL, Srinivasan R, Westdorp AF, Wijesinghe RS, Tucker DM, Silberstein RB, Cadusch PJ (1997) EEG coherency I: statistics, reference electrode, volume conduction, Laplacians, cortical imaging and interpretation at multiple scales. Electroenceph clin Neurophysiol 103:499–515 [DOI] [PubMed]
  65. Ohl FW, Scheich H, Freeman WJ (2001) Change in pattern of ongoing cortical activity with auditory category learning. Nature 412:733–736 [DOI] [PubMed]
  66. Othmer S, Othmer SF, Kaiser DA (1999) EEG biofeedback: an emerging model for its global efficacy. Ch. 11 In: Evans JR, Abarbanel A (eds) Introduction to quantitative EEG and neurofeedback. Academic, New York, pp. 243–310
  67. Prigogine I (1980) From being to becoming: time and complexity in the physical sciences. W H Freeman, San Francisco
  68. Principe JC, Tavares VG, Harris JG, Freeman WJ (2001) Design and implementation of a biologically realistic olfactory cortex in analog VLSI. Proc IEEE 89:1030–1051 [DOI]
  69. Rodriguez E, George N, Lachaux J-P, Martinerie J, Renault B, Varela F (1999) Perception’s shadow: long-distance synchronization of human brain activity. Nature 397:430–433 [DOI] [PubMed]
  70. Sanchez JS, Carmena JM, Lebede MA, Nicolelis MAL, Harris JG, Principe JC (2004) Ascertaining the importance of neurons to develop better brain-computer interfaces. IEEE Trans Biomed Eng 51:943–953 [DOI] [PubMed]
  71. Sanchez JS, Carney PR, Principe JC (2006) Analysis of amplitude modulated control features for ECoG neuroprosthetics. IEEE Intern Conf Engin Biol Med (in press) [DOI] [PubMed]
  72. Schroeder M (1991) Fractals, chaos, power laws. WH Freeman, San Francisco
  73. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP (2002) Instant neural control of a movement signal. Nature 416:141–142 [DOI] [PubMed]
  74. Sholl DW (1956) The organization of the cerebral cortex. Wiley, New York
  75. Singer W, Gray CM (1995) Visual feature integration and the temporal correlation hypothesis. Ann Rev Neurosci 18:555–586 [DOI] [PubMed]
  76. Skarda CA, Freeman WJ (1987) How brains make chaos in order to make sense of the world. Behav Brain Sci 10:161–195
  77. Sperry RW (1950) Neural basis of the spontaneous optokinetic response. J Comp Physiol 43:482–489 [DOI] [PubMed]
  78. Stuart DG (2005) Integration of posture and movement: contributions from Sherrington, Hess and Bernstein. Human Movement Sci 24:621–643 [DOI] [PubMed]
  79. Swadlow HA (1994) Efferent neurons and suspected interneurons in motor cortex of the awake rabbit: axonal properties, sensory receptive fields and subthreshold synaptic inputs. J Neurophysiol 71:437–453 [DOI] [PubMed]
  80. Tallon-Baudry C, Bertrand O, Delpuech C, Pernier J (1996) Stimulus-specificity of phase-locked and non phase-locked 40-Hz visual responses in human. J Neurosci 16:4240–4249 [DOI] [PMC free article] [PubMed]
  81. Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J (1998) Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci 18:4244–4254 [DOI] [PMC free article] [PubMed]
  82. Taylor DM, Tillery SI, Schwartz AB (2002) Direct cortical control of 3D neuroprosthetic devices. Science 296:1829–1832 [DOI] [PubMed]
  83. Tsuda I (2001) Toward an interpretation of dynamics neural activity in terms of chaotic dynamical systems. Behav Brain Sci 24:793–847 [DOI] [PubMed]
  84. Von Holst E, Mittelstädt H (1950) Das Reafferenz Prinzip. Wechselwirkung zwischen Zentralnervensystem und Peripherie. Naturewissenschaften 37:464–476 [DOI]
  85. von Neumann J (1958) The computer and the brain. New Haven CT, Yale UP
  86. Wang Y, Sanchez JC, Principe JC, Mitzelfelt JD, Gunduz A (2006) Analysis of the correlation between local field potentials and neuronal firing rate in the motor cortex. Proc EMBS [DOI] [PubMed]
  87. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, Chapin JK, Kim J, Biggs SJ, Srinivasan MA, Nicolelis MAL (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408:361–365 [DOI] [PubMed]

Articles from Cognitive Neurodynamics are provided here courtesy of Springer Science+Business Media B.V.

RESOURCES