Modeling real-world systems plays a pivotal role in their analysis and contributes to a better understanding of their behavior and performance. Classification, optimization, control, and pattern recognition problems rely heavily on modeling techniques. Such models can be categorized into three classes: white-box, black-box, and gray-box (Nelles, 2001). White-box models are fully derived from first principles, i.e., physical, chemical, biological, economical, etc. laws. All equations and parameters are determined from theory. Black-box models are based solely on experimental data, and their structure and parameters are determined by experimental modeling. Building black-box models requires little or no prior knowledge of the system. Gray-box models represent a compromise or combination of white-box and black-box models (Nelles, 2001).
In the modeling of highly nonlinear and complex phenomena, we may not have a good understanding of the processes, and thus black-box models may be our best (or even our only) choice. Artificial neural networks (ANNs) are one of the most powerful and popular tools for black-box modeling and are designed and inspired by real biological neural networks.
There has been an increasing interest in analyzing neurophysiology from a nonlinear and chaotic systems viewpoint in recent years (Christini and Collins, 1995; Sarbadhikari and Chakrabarty, 2001; Korn and Faure, 2003; Hadaeghi et al., 2013; Jafari et al., 2013; Mattei, 2013). For example, although the famous Hodgkin and Huxley model (Hodgkin and Huxley, 1952) has been the basis of almost all of the proposed models for neural firing, the Rose-Hindmarsh model (Hindmarsh and Rose, 1984) is known to be a more refined model since it can show different firing patterns, especially chaotic bursts of action potential, which enable a proper matching between this model behavior and experimental data. Another example of the observation of chaotic behavior in the nervous system is the period-doubling route to chaos in flicker vision (Crevier and Meister, 1998), which is the focus of this letter.
Stimulation with periodic flashes of light is useful for distinguishing some disorders of the human visual system (Crevier and Meister, 1998). It has been shown by Crevier and Meister (1998) that during electroretinogram (ERG) recordings of the visual system, period-doubling can occur. It is well-known that period-doubling occurs in nonlinear dynamical systems, and it is often associated with the onset of chaos. In one study (Crevier and Meister, 1998) the retina of a salamander was stimulated with a periodic square-wave flashes, and the ERG was recorded. The flash frequency was changed between zero and 30 Hz, while the contrast was constant. In another record, the contrast was changed while the frequency was fixed at 16 Hz. All the ERG signals were filtered at 1–1000 Hz. Using a common approach to obtain a discrete time series from a continuous recorded signal, successive local maxima of the signal were extracted as a time series (Figure 1A). As shown in Figures 1B,C, both the parameters (flash frequency and contrast) have a great effect on the recorded ERG signals and cause bifurcations resulting in a period-doubling route to chaos.
However, it is difficult to understand the exact relations between the parameters and their effects. In other words, it is not easy to build a white-box model that can regenerate the signals and diagrams accurately. That may be because of the highly complex and nonlinear dynamics involved. We have used the ability of an ANN in learning highly nonlinear dynamics as a black-box model of this system. We used a four hidden layer feed-forward neural network with (7/4/8/5) neurons in the layers (Figure 1D) and nonlinear transfer functions hyperbolic tangent function that help the network learn the complex relationships between input and output. The activation function of the last layer of the network is linear transfer function. We used two parameters (contrast and frequency) and three time delays (xn−1, xn−2, and xn−3) as the inputs of the ANN to fit each data point of the time series (xn) as the output of the network.
As shown in Figures 1E,F, this model can generate bifurcation diagrams similar to those obtained from real data. As the result, we believe that ANNs are powerful tools for modeling highly nonlinear behavior in the nervous system. We plan to construct ANN models in future work including extension to more cases and details, extension of the ideas in Hadaeghi et al. (2013) to patients with bipolar disorder, and extension of the ideas in Jafari et al. (2013) to patients with attention deficit hyperactivity disorder (ADHD).
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors would like to thank Professor Markus Meister for allowing us to use his data.
References
- Christini D. J., Collins J. J. (1995). Controlling nonchaotic neuronal noise using chaos control techniques. Phys. Rev. Lett. 75, 2782–2785 10.1103/PhysRevLett.75.2782 [DOI] [PubMed] [Google Scholar]
- Crevier D. W., Meister M. (1998). Synchronous period-doubling in flicker vision of salamander and man. J. Neurophysiol. 79, 1869–1878 [DOI] [PubMed] [Google Scholar]
- Hadaeghi F., Hashemi Golpayegani M., Moradi K. (2013). Does “Crisis-Induced Intermittency” explain bipolar disorder dynamics? Front. Comput. Neurosci. 7:116 10.3389/fncom.2013.00116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hindmarsh J. L., Rose R. M. (1984). A model of neuronal bursting using three coupled first order differential equations. Proc. R. Soc. Lond. B Biol. Sci. 221, 87–102 10.1098/rspb.1984.0024 [DOI] [PubMed] [Google Scholar]
- Hodgkin A. L., Huxley A. F. (1952). A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117, 500–544 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jafari S., Baghdadi G., Hashemi Golpayegani S. M. R., Towhidkhah F., Gharibzadeh S. (2013). Is attention deficit hyperactivity disorder a kind of intermittent chaos? J. Neuropsychiatry Clin. Neurosci. 25, E02 10.1176/appi.neuropsych.12040079 [DOI] [PubMed] [Google Scholar]
- Korn H., Faure P. (2003). Is there chaos in the brain? II. Experimental evidence and related models. C.R. Biol. 326, 787–840 10.1016/j.crvi.2003.09.011 [DOI] [PubMed] [Google Scholar]
- Mattei T. A. (2013). Nonlinear (chaotic) dynamics and fractal analysis: new applications to the study of the microvascularity of gliomas. World Neurosurg. 79, 4–7 10.1016/j.wneu.2012.11.047 [DOI] [PubMed] [Google Scholar]
- Nelles O. (2001). Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models. Berlin, Heidelberg: Springer-Verlag; 10.1007/978-3-662-04323-3_1 [DOI] [Google Scholar]
- Sarbadhikari S. N., Chakrabarty K. (2001). Chaos in the brain: a short review alluding to epilepsy, depression, exercise and lateralization. Med. Eng. Phys. 23, 445–455 10.1016/S1350-4533(01)00075-3 [DOI] [PubMed] [Google Scholar]