Abstract
In this paper, the algebraic topological characteristics of brain networks composed of electroencephalogram(EEG) signals induced by different quality images were studied, and on that basis, a neurophysiological image quality assessment approach was proposed. Our approach acquired quality perception-related neural information via integrating the EEG collection with conventional image assessment procedures, and the physiologically meaningful brain responses to different distortion-level images were obtained by topological data analysis. According to the validation experiment results, statistically significant discrepancies of the algebraic topological characteristics of EEG data evoked by a clear image compared to that of an unclear image are observed in several frequency bands, especially in the beta band. Furthermore, the phase transition difference of brain network caused by JPEG compression is more significant, indicating that humans are more sensitive to JPEG compression other than Gaussian blur. In general, the algebraic topological characteristics of EEG signals evoked by distorted images were investigated in this paper, which contributes to the study of neurophysiological assessment of image quality.
Introduction
In the last decades, with the development of image quality assessment, scientists began to explore the neural mechanism of image quality perception. Neurophysiological approaches are treated as complementary methods to traditional psychophysical ones since quality assessment processes occur inside the media consumer’s brain [1–6]. In the wake of the development of the electroencephalogram (EEG) technique, neurophysiological assessment of image quality becomes more economical and portable [7–16]. Consequently, EEG was taken as an ideal signal to explore the neural responses to image stimuli with different qualities.
Hayashi et al. observed that the value of the power of α-EEG was higher in the image with higher quality [7]. Scholler et al. found that quality changes of images evoked an event-related potential called P3 positively correlated with the magnitude of the change [11]. Moreover, since P3 is not directly associated with sensory processing, Steady-State Visual Evoked Potentials (SSVEPs) based paradigm was investigated as a complementary approach by Mueller et al., and the result showed that the adjustment the amplitude of SSVEP had been significantly negatively correlated with Mean Opinion Scores (MOS) [12–14]. In order to elicit the specific EEG signal, a participant is presented a stimulus in the form of corresponding experimental paradigms. For instance, in Mueller’s research [14], the SSVEP signal in the occipital cortex was evoked by the flickering effect of the quality changes at a frame rate of 3 Hz. However, in order to approximate the actual process of human perception of images, images should be presented in a more friendly and natural way. Consequently, in the field of image quality assessment, the display configuration of an image is generally carried out in accordance with a conventional procedure [1, 17] where the evoked EEG signal scarcely has distinctive features. Therefore, when the image is presented according to the conventional image quality assessment paradigm, it is hard to understand the neuropsychological characteristics of quality judgment processes inside the brain sufficiently.
In order to deeply understand the brain’s response to image quality, images need to be presented in a natural way. However, as described above, it is hard to extract the neural characteristics corresponding to perceived quality during the conventional image display procedure. Fortunately, functional network analysis is promising to be a key to solve this dilemma [18–20]. Functional network analysis, which is constructed by quantifying correlations between time series of activity of brain regions, has been rapidly developed since the scientists share the opinion that brain function is determined by the interaction between different neurons and different regions [18, 19, 21, 22]. However, extensive analysis of graphs or networks suffers from a local versus a global problem [23]. Thus, algebraic topology was developed to address the problem. The tools of algebraic topology are uniquely equipped to provide quantitative information about both the local and global properties of a graph, which enables the analysis of the whole brain’s functional patterns without losing the local knowledge of the brain regions. Consequently, Topological Data Analysis (TDA) [24–29] provides a series of new topological and geometric tools to analyze EEG signals. The neural activity distribution emerging in different brain areas will entail different brain patterns, and we expect to find its expression in subtle yet highly significant differences in topological characteristics. Giusti et al. revealed intrinsic geometric structure in neural correlations by clique topology [30]. Using pairwise correlations of neurons in the hippocampus, they detect geometric organization intrinsically from the neural activity without appealing to external stimuli or receptive fields. In subsequent studies, Giusti et al. comprehensively discussed the feasibility of using higher-order algebraic topology tools to understand neural data and presented a basic theoretical framework for brain model computation using algebraic topology for the first time [31]. Furthermore, Santos et al. explored topological phase transitions in functional brain networks, and they considered that a topological invariant, the Euler characteristic, suffices to characterize the sequence of topological phase transitions in the complex network [32]. By applying it to the resting-state fMRI analysis in the Human Connectome Project [33], they show that topological phase transitions occur when the Euler entropy has a singularity, which remarkably coincides with the emergence of multidimensional topological holes in the brain network [34–37]. Meanwhile, Piangerelli et al. design a topological classifier for detecting the emergence of epileptic seizures, in which continuous homomorphic entropy is considered as the classification feature of the EEG signals [38]. According to the result, persistent homology not only provides efficient algorithms for calculating the Betti number of each complex in the families under consideration but also encodes the evolution of nested complex homology groups at different scales. Both the Euler characteristics [39] and the persistent homology [27, 40] are helped to understand the data better and keep stability concerning perturbations or the presence of noise in the EEG signals. Thus, they are likely to reveal the neurological perception procedure of image quality from different perspectives and complement each other to some extent. Consequently, the algebraic topological features of the EEG signal, namely Euler characteristics and the persistent homology, are selected in this paper to analyze the brain responses to images at different distortion levels.
In our study, twenty participants were considered in the conventional image quality assessment procedure, and EEG signals were collected synchronously during the test. The neurophysiological feature of image quality perception was investigated by exploiting Euler characteristics and persistent homology features of the EEG signal. On that basis, how the brain regions are involved in the assessment of perceived quality was interpreted by selecting Vietoris-Rips filtration. Finally, the relationship between algebraic topological features of EEG signal and image quality is further discussed in detail.
Methods
The framework of our proposed neurophysiological method for image quality perception analysis is shown in Fig 1. Collecting the EEG data synchronously by a special cap with electrodes when the subject watches an image with a specific distortion level (Step I). Calculating the distance matrix by correlation among electrodes (Step II) and constructing the Vietoris-Rips simplex (Step III). Analyzing the neurophysiological features in the brain stimulated by images across the qualities by TDA (Step IV).
Fig 1. Neurophysiological method for image quality perception analysis.
Step I: Collecting the EEG data. Step II: Calculating the distance matrix among electrodes. Step III: Constructing the Vietoris-Rips simplex. Step IV: Extracting the algebraic topology characteristics of brain network.
Stimuli
Forty source images were collected from a subset of the image database in [1], which were freely downloaded from Laboratory for Image & Video Engineering at The University of Texas at Austin. All images had the same mean luminance and were resized to a reasonable size for display on a screen resolution of 1440 × 1080. The LCD monitor is 23.8” (60.5cm). All images were distorted by two distortion types that could occur in real-world applications: Gaussian blur and JPEG compression. Furthermore, in order to maximize the difference, images in two kinds of extreme distortion levels are studied. In Gaussian blur, the standard deviation of the Gaussian kernel of the clear image is 1.5 and that of the unclear image is 16. In JPEG compression, the Q-value of the clear image is 70 and that of the unclear image is 8.
Procedure
In the image quality evaluation test, the subjects were asked to clarify the presented image’s clarity, i.e., clear or not clear. After a general introduction to the experiment and the preparation of the EEG cap, subjects started the test with EEG recording, which is shown in Fig 2. Each distortion type had two sessions, and in each session, subjects had to watch a series of 80 images divided into two classes, i.e., clear image and unclear image. Each trial began with a fixation slice that lasted 1 second, and then a clear or an unclear image appeared randomly for 5 seconds, and subjects needed to assess the quality of the image. A rest slice appeared followed to remind subjects that they could take a break for 1 second. Subsequently, the next trial started to run.
Fig 2. Image quality assessment process.
Each trial began with a fixed section lasting 1 second, followed by a randomly presented clear (HQ stands for High Quality while LQ stands for Low Quality) or unclear image lasting 5 seconds, and subjects were required to evaluate image quality. A rest screen was then shown to remind the subjects that they could rest for one second. Then the next experiment began.
Subjects and equipment
Data were collected from twenty healthy volunteers (9 males, 11 females; in the age group 19–27) with normal (or corrected to normal) vision, and the subjects had signed the informed consent form. All the subjects were asked to look at the images with a view angle of 20 degrees and rate how clear they were. Test equipment was Neuracle 64 System (Neuracle product; sensor array: 64-channel adult-sized head cap (M = 64 in Fig 2); EEG acquisition software: EEG Recorder; amplifier: NSW364; reference electrode: middle of Cz and Pz). The sample rate was 1000 Hz, and the filtering window was 0.3 to 100 Hz.
Ethical statement
This work (i) identifies the institutional and/or licensing committee that approved the experiments, including any relevant details; (ii) confirms that all experiments were performed in accordance with relevant named guidelines and regulations; and (iii) confirms that informed consent was obtained from all participants and/or their legal guardians. The study is approved by Northwestern Polytechnical University Hospital ETHICS Committee. The individual pictured in ‘Experiment Paradigm.mp4’ has provided written informed consent (as outlined in PLOS consent form) to publish their image alongside the manuscript.
Topological data analysis for EEG data
Topological data analysis for EEG data is shown in Fig 1 and the following are detailed:
EEG acquisition and preprocessing
EEG data are collected by EEG cap and downsampled to 250 Hz. In order to reduce the computation time of topological features, the change of TDA feature of the subjects at different time latencies after the image appeared is investigated first. By comparing the TDA feature of EEG data evoked by a clear verse an unclear image over different latencies after the image is displayed, the EEG of two seconds after displaying the image is selected for the topological data analysis in this paper. A set of filters obtains filtered EEG signals of different wavebands, namely, δ band (1∼3 Hz), θ band (4∼7 Hz), α band (8∼13 Hz), and β band (14∼30 Hz)
Distance matrix computation
The filtered signal from each electrode in the EEG cap and the distance between electrodes r and t is calculated by phase-locking value analysis [41, 42] in Euler characteristics analysis:
| (1) |
while in persistent homology analysis, the distance is calculated by standardized Euclidean distance [38]:
| (2) |
Here, j is the imaginary unit, and ϕr(n) is the n-th instantaneous phase of the channel r with the length of N while ϕt(n) is that of channel t. r|k stands for the y-component in (xk, yk) and vk is the sample standard deviation calculated among all y-components at position k in channel r. Similarly, t|k stands for the same case of channel t.
Simplicial complexes construction
Simplicial complexes are constructed by Vietoris-Rips filtration according to the distance matrix obtained in Step II. A topological structure to an otherwise disconnected set of points is established where a sequence of simplexes is created [23], which is shown in Fig 3. The Betti number of a generic topological space S is composed of β0 and β1 in this paper. β0 is the number of connected components in S while β1 is the number of holes in S. In fact, according to the findings in the previous study [32], for each Betti curve, it is hard to obtain significant features directly from the Betti curve. Fortunately, further extracting the feature of the Betti curve by Euler entropy or persistent homology entropy will hopefully reveal the perception differences of the subjects stimulated by images in different qualities.
Fig 3. Basic concepts of topological data analysis involved in this paper.
β0 is the number of connected components in S while β1 is the number of holes in S. With the increasing of ε, a k-dimensional hole appears in the simplicial complex.
Euler characteristics analysis
As shown in Fig 3, each network has an associated topological structure, its simplicial complex, constituted by its nodes (k = 0), edges (k = 1), triangles (k = 2), tetrahedrons (k = 3), and higher k-dimensional parts. The alternate sum of the numbers of k-dimensional simplexes determines the Euler characteristic χ. The Euler entropy Sχ of the associated brain network is obtained by the alternate sum of the numbers Clk of k-dimensional simplexes [32] from k = 0 to k = K, where K = 3 is selected as the highest order of simplexes in this paper:
| (3) |
Furthermore, a topological phase transition represents a major change in the network topology [23, 32, 34–37], occurring at negative peak with the value of . The phase transition point of Euler entropy occurs at the intersection of Betti curves, and each side of the transition point of Euler entropy represents different topological structures, which means a critical topological change occurs in the brain networks. For instance, before the first transition point, the number of connected components overcomes the number of loops or cycles, and after that point, the situation is reversed. Consequently, the phase transition is selected in this paper to analyze neurological characteristics during the image quality perception. [32].
Persistent homology analysis
Persistent homology is an algebraic object that counts the number of n-dimensional holes in a topological space, that is, Betti number. During the filtration, time at which a k-dimensional hole that appears in the simplicial complex is recorded as Tstart, and Tend is the time at the k-dimensional hole disappears. Accordingly, the k-dimensional Betti interval is defined by [Tstart, Tend], and the persistence barcode is the graphical representation of it [23, 43]. Persistent entropy provides a new entropy measure to extract the feature of topological space by persistence barcode [44–46], which is introduced to measure how “ordered” the structure of the filtering simplex complex is. In this paper, B = {(xi, yi)|i ∈ I} is set to the persistent barcode associated with the filtration of topological space S, where i is a set of indexes. Moreover Accordingly, the persistent entropy H of the filtered simplicial complex is calculated by:
| (4) |
where , and L = ∑i∈I (yi − xi). Moreover, H is rescaled and is treated as the persistent homology feature of EEG data in this paper.
| (5) |
where ℓmax is the maximum interval in the considered persistent barcode.
Result
Vietoris-Rips
Topological structures of EEG data evoked by different distortions images are constructed by Vietoris-Rips filtration, as shown in Fig 4. A topological structure to an otherwise disconnected set of points is established where a sequence of simplexes is created. In the filtration process, a functional brain network is built for each value of the correlation threshold ε ∈ [0, 1] by assigning an edge linking two brain regions if their normalized correlation level is larger than 1-ε. As ε is enhanced, new edges are gradually attached, thus changing the topology of the brain network, which becomes increasingly denser and harder to analyze. As a consequence, we use Euler characteristic and persistent homology to track these changes in the evolution of both surfaces and networks.
Fig 4. Illustration of the filtration process in a functional brain network where ε is from 0.3 to 1.
In addition, in order to explore the relationship between different brain regions and image quality perceptions, the EEG mapping result (Model:BEM, template:MNI, source located: MNE) is plotted complimentary in Fig 5, which is the average of the epochs at the same time point (t = 1.36s after image display) under the stimulus of clear and unclear images [47]. Generally speaking, more brain regions are involved when the participant perceives an unclear image compared to a clear one, especially in the frontal lobe. Moreover, the topological structure of EEG elicited by an unclear image is more complicated since the more higher-dimension simplexes are observed. As a consequence, we hypothesize that the blurred images make the task more difficult, leading to more mental activities. These results verify the effectiveness of our approach in describing the complex correlation between EEG signals and image quality perception, and our approach is closer to the actual biological response process.
Fig 5. EEG mapping and Vietoris-Rips simplex.
Red indicates high levels of neuronal activation in EEG mapping. In Vietoris-Rips simplex, the red line is the one-dimensional simplex, and the blue parts are the higher-dimensional simplex.
Euler characteristics
Since different frequencies of EEG imply different brain states, the EEG signals of different frequency bands were analyzed respectively [48]. Filtered EEG signals of different wavebands are obtained by a set of filters, namely, δ band (1∼3 Hz), θ band (4∼7 Hz), α band (8∼13 Hz), and β band (14∼30 Hz). As shown in Fig 6, filtered EEG signals of different wavebands are obtained by a set of filters. The topological structures of it are constructed by Vietoris-Rips filtration, where the phase-locking value (PLV) of EEG data is taking as the normalized correlation coefficient between electrodes. The differences of topological structures of EEG data evoked by different distortions images are consistent across different frequency bands. As mentioned above, the topological structure of EEG elicited by an unclear image is more complex. The Euler entropies of brain networks for different values of ε are calculated, and it is a remarkable fact that Euler entropy has a negative peak with the change of ε. Since the ε value corresponding to the negative peak of Euler entropy is different between the clear and unclear situation, we further calculate the ε value when the negative peak of Euler entropy appears, which is taken as a phase transition point in this work. We infer that the value of the control parameter ε at which the phase transition occurs is a fingerprint that can be used to differentiate it from others, which is promising to extract the feature of the brain network associated with image quality perception. According to the comparison in different frequency bands among all participants, the phase transition points of Euler entropy differ significantly in the alpha and beta band. Therefore, we focus on analyzing the alpha and beta bands of EEG signals.
Fig 6. Topological data analysis using Euler characteristics in functional brain networks.
The functional networks of EEG data with different frequencies were constructed by algebraic topology analysis. By calculating the variation curve of Euler entropy with parameter ε of the network, the corresponding phase transition points are obtained.
Both in Gaussian blur, as well as JPEG compression situations, Euler characteristics of brain network constructed by EEG signal in beta and alpha bands evoked by images in clear and unclear deterioration levels are shown in Fig 7. According to Fig 7, the phase transition point of Euler entropy in the brain network evoked by an unclear image is later than that of the clear image in the beta band. In contrast, the opposite is true in the alpha band, whether Gaussian blur or JPEG compression. Moreover, by comparing the different distortion types, it is evident that the phase transition difference of brain network caused by JPEG compression is pronounced (Paired Samples Test, p<0.05), which indicates that participants may be more sensitive to JPEG compression other than Gaussian blur.
Fig 7. Euler characteristic of brain network constructed by EEG signal in alpha and beta bands evoked by forty source images in clear and unclear deterioration levels.
The effect of Gaussian blur on Euler entropy is on the left, while that of JPEG compression is on the right.
Persistent homology analysis
As shown in Fig 8, similar to Euler characteristic analysis, EEG signal is also analyzed in different frequency bands. After filtration, the functional brain network of EEG in different bands was constructed, and the barcode of it is further calculated by javaplex toolbox [43] to obtain the persistent entropy.
Fig 8. Topological data analysis using persistent homology in functional brain networks.
Filtered EEG data by different frequency bands was analyzed by TDA. After filtration, the functional brain network was constructed, and the barcodes were calculated by it. According to the barcodes, the comparison of persistent entropy stimulated by clear and unclear images was shown in different bands.
Fig 9 shows the average value of persistent entropy of EEG signals evoked by forty source images in clear and unclear deterioration levels. Obviously, the separation of persistent entropy between two brain patterns under different distortions images is clearly depicted in Fig 9, where is plotted. According to Fig 9, the topological structure of EEG evoked by a clear image (solid blue line) has a higher persistent entropy than that of an unclear image (dash red line). It is evident from Fig 9 that there is a strong separation between the two populations, especially in beta and delta bands. Moreover, the persistent entropy of EEG data evoked by clear image and unclear image remains similar differences over the distortion types and sessions.
Fig 9. The average value of persistent entropy of EEG signals evoked by forty source images in clear and unclear deterioration levels among different frequency bands.
Gaussian blur is on the left, while JPEG compression is on the right. The y-axis is the persistent entropy , and the x-axis is the subject list sort by the PH of the situation from smallest to largest.
Furthermore, we perform a paired T-test on persistent entropy of two frequency bands, namely, beta band and delta band. According to the T-test, there are significant differences between the two distortion situations since the p<0.05 both in the beta band as well as delta band.
Discussion
In this paper, we investigate the neurophysiological processes of image quality perception exploiting EEG. More brain regions, especially in the frontal area, are involved when a subject perceives an unclear image compared to a clear image, which indicates that human perception of image quality might be related to the advanced cognitive processes to some extent. Furthermore, TDA is adopted to extract the physiologically meaningful feature of EEG evoked by different deterioration levels. According to Euler characteristics of brain network constructed by EEG signal, both in Gaussian blur and JPEG compression tests, the phase transition point of Euler entropy in the unclear situation in the beta band is later than that of the clear situation. In contrast, the opposite is true in the alpha band. According to the Gradient Magnitude Similarity Deviation (GMSD) analysis of forty images, the quality gap between GB is larger than JPEG(In GB blur, Clear: 0.9317, Unclear: 0.7380; in JPEG compression, Clear: 0.9413, Unclear: 0.8365;). However, the phase transition difference of brain network caused by JPEG compression is more significant, which indicates that human visual systems are more sensitive to additive noise (such as block-wise effect) compared to the loss of detailed information (such as edge information). Meanwhile, according to the persistent homology analysis, the persistent entropy of EEG data induced by clear images is significantly higher than that of unclear images in the beta and delta bands, which indicates that unclear images activate more orderly brain functional responses. Consequently, phase transition of the brain network is associated with image quality in the beta and alpha band while the persistent entropy is in the beta and delta band, which indicates that entropy analysis and persistent homology analysis are complementary to each other. Furthermore, since both Euler characteristics and persistent entropy in the beta band of EEG signal evoked by the image of different deterioration levels have significant changes, beta bands should be closely related to subjects’ perception procedure of image quality.
Moreover, since the statistically significant changes of different distortion levels were found both in Euler characteristics and persistent homology, the TDA analysis investigated in this paper provides a utility neurophysiological assessment of image quality. Here, we have provided some evidence for such applications by comparing topological features among the images with different qualities. Further studies on this issue will be left for future work.
Besides, since intense brain activities are observed in the frontal lobe, the frontal lobe’s function needs to be further explored. The frontal lobe is the physiological basis of the most elaborate psychological activities, responsible for planning, regulating, controlling people’s psychological activities, etc., playing an essential role in the advanced and purposive behavior of humans. It suggests that human perception of image quality might be related to the advanced cognitive processes to some extent. However, many other explanations can account for this pattern of recruitment. As a consequence, frontal recruitment needs to be further investigated in future work.
Compared to the neurophysiological analysis based on the evoked potential that needs a specific experiment paradigm, this work investigated the brain responses during the conventional image assessment test, which is more similar to the actual human perception of images, and the result ought to be more general.
Since this paper focuses on an extreme case of distortion, future studies may aim at more distortion level analysis. In addition, the correlation between brain response analysis and conventional behavioral methods such as MOS ought to further investigate to deeply understand the perception feature of the brain related to image quality.
Conclusion
In this paper, we proposed an approach for neurophysiological assessment of image quality from EEG using algebraic topology characteristics of the brain network. Our approach acquired quality perception-related neural information by integrating the EEG collection with conventional image assessment procedures and obtaining physiologically meaningful characteristics of brain responses to different distortion-levels images by topological data analysis. According to the validation experiment results, statistically significant discrepancies of EEG data evoked by a clear image compared to that of an unclear image are observed in several frequency bands, especially in the beta band. The phase transition point of Euler entropy in the unclear situation in the beta band is later than that of the clear situation, while the opposite is true in the alpha band. Meanwhile, the persistent entropy of EEG data induced by clear images is significantly higher than that of unclear images in the beta and delta bands. Since both Euler character and persistent entropy in the beta band of EEG signal evoked by the image of different deterioration levels have significant changes, beta bands should be closely related to subjects’ perception procedure of image quality. Furthermore, the phase transition difference of brain network caused by JPEG compression is more significant, indicating that humans are more sensitive to JPEG compression other than Gaussian blur. In general, the algebraic topological analysis of EEG signals evoked by distorted images is investigated in this paper, and the EEG features related to image quality are obtained, which provides a practical approach for the neurophysiological assessment of image quality.
Supporting information
(MP4)
Acknowledgments
The experiment leading to these results has been performed in Key Lab of Film and TV Media Technology of Zhejiang Province and Shaanxi Joint International Research Center on Integrated Technique of Brain-Computer for Unmanned System.
Data Availability
The data underlying the results presented in the study are available from https://datadryad.org/stash/share/Nv5oV1ssYvLJXZ7Yo69_qe4upD8oH6IUiUaa8YQg3FE. And the dataset has been assigned a unique digital object identifier (DOI): doi: 10.5061/dryad.bcc2fqzdj.
Funding Statement
a) The Funding List: Key Research and Development Program of Zhejiang Province under Grant No.2019C03138 and No.2019C01002. b) The funders provided the experiment material and equipment for our study. c) The Key Research and Development Program of Zhejiang Province (Grant No.2019C03138 and No.2019C01002) provided a salary for Chang Liu, Dingguo Yu, and Xiaoyu Ma.
References
- 1. Sheikh HR, Sabir MF, Bovik AC. A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society. 2006;15(11):3440–3451. doi: 10.1109/TIP.2006.881959 [DOI] [PubMed] [Google Scholar]
- 2.Ajaj T, Müller KR, Curio G, Wieg T, Bosse S. EEG-Based Assessment of Perceived Quality in Complex Natural Images. In: 2020 IEEE International Conference on Image Processing (ICIP). IEEE; 2020. p. 136–140.
- 3. Chan KY, Arndt S, Engelke U. A novel strategy for classifying perceived video quality using electroencephalography signals. Engineering Applications of Artificial Intelligence. 2020;92:103692. doi: 10.1016/j.engappai.2020.103692 [DOI] [Google Scholar]
- 4. Engelke U, Darcy DP, Mulliken GH, Bosse S, Martini MG, Arndt S, et al. Psychophysiology-based QoE assessment: A survey. IEEE Journal of Selected Topics in Signal Processing. 2016;11(1):6–21. doi: 10.1109/JSTSP.2016.2609843 [DOI] [Google Scholar]
- 5. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing. 2004;13(4):600–612. doi: 10.1109/TIP.2003.819861 [DOI] [PubMed] [Google Scholar]
- 6. Wang Z, Bovik AC. Modern image quality assessment. Synthesis Lectures on Image, Video, and Multimedia Processing. 2006;2(1):1–156. [Google Scholar]
- 7.Hayashi H, Shirai H, Kameda M, Kunifuji S, Miyahara M. Assessment of extra high quality images using both EEG and assessment words on high order sensations. In: Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics.’cybernetics evolving to systems, humans, organizations, and their complex interactions’ (cat. no.0; 2000.
- 8. Arndt S, Antons JN, Schleicher R, Mller S, Curio G. A Physiological Approach to Determine Video Quality. In: 2011 IEEE International Symposium on Multimedia; 2011. doi: 10.1109/ISM.2011.91 [DOI] [Google Scholar]
- 9. Arndt S, Antons JN, Schleicher R, Moller S, Curio G. Using Electroencephalography to Measure Perceived Video Quality. IEEE Journal of Selected Topics in Signal Processing. 2014;8(3):366–376. doi: 10.1109/JSTSP.2014.2313026 [DOI] [Google Scholar]
- 10.Kroupi E, Hanhart P, Lee JS, Rerabek M, Ebrahimi T. EEG correlates during video quality perception. In: 22nd European Signal Processing Conference (EUSIPCO); 2014.
- 11. Scholler S. Toward a Direct Measure of Video Quality Perception Using EEG. IEEE Transactions on Image Processing. 2012;21(5):2619–2629. doi: 10.1109/TIP.2012.2187672 [DOI] [PubMed] [Google Scholar]
- 12. Benjamin B, Laura A, Sven D, Stefan H, Matthias SK, Irene S, et al. The Berlin Brain-Computer Interface: Progress Beyond Communication and Control. Frontiers in Neuroscience. 2016;10:1–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Bosse S, Acqualagna L, Porbadnigk AK, Curio G, Müller KR, Blankertz B, et al. Neurophysiological assessment of perceived image quality using steady-state visual evoked potentials. In: Applications of Digital Image Processing XXXVIII; 2015. [DOI] [PubMed] [Google Scholar]
- 14. Bosse S, Acqualagna L, Samek W, Porbadnigk AK, Curio G, Blankertz B, et al. Assessing Perceived Image Quality Using Steady-State Visual Evoked Potentials and Spatio-Spectral Decomposition. IEEE Transactions on Circuits & Systems for Video Technology. 2017;8(28):1–13. [Google Scholar]
- 15. Kujala MV, Kauppi JP, Törnqvist H, Helle L, Vainio O, Kujala J, et al. Time-resolved classification of dog brain signals reveals early processing of faces, species and emotion. Scientific Reports. 2020;10(1):1–13. doi: 10.1038/s41598-020-76806-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Gómez C, Arbeláez P, Navarrete M, Alvarado-Rojas C, Le Van Quyen M, Valderrama M. Automatic seizure detection based on imaged-EEG signals through fully convolutional networks. Scientific reports. 2020;10(1):1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Union IT. Methodology for the subjective assessment of the quality of television pictures. ITU-R Recommendation BT 500-11. 2002;. [Google Scholar]
- 18. Bullmore E, Sporns O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nature reviews neuroscience. 2009;10(3):186–198. doi: 10.1038/nrn2575 [DOI] [PubMed] [Google Scholar]
- 19. Fornito A, Zalesky A, Bullmore E. Fundamentals of brain network analysis. Academic Press; 2016. [Google Scholar]
- 20. Li X, Mota B, Kondo T, Nasuto S, Hayashi Y. EEG dynamical network analysis method reveals the neural signature of visual-motor coordination. PLOS ONE. 2020;15(5):1–32. doi: 10.1371/journal.pone.0231767 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Telesford QK, Simpson SL, Burdette JH, Hayasaka S, Laurienti PJ. The brain as a complex system: using network science as a tool for understanding the brain. Brain connectivity. 2011;1(4):295–308. doi: 10.1089/brain.2011.0055 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Bressler SL, Menon V. Large-scale brain networks in cognition: emerging methods and principles. Trends in cognitive sciences. 2010;14(6):277–290. doi: 10.1016/j.tics.2010.04.004 [DOI] [PubMed] [Google Scholar]
- 23.Ghrist RW. Elementary applied topology. vol. 1. Createspace Seattle; 2014.
- 24. Altındiş F, Yılmaz B, Borisenok S, İçöz K. Parameter investigation of topological data analysis for EEG signals. Biomedical Signal Processing and Control. 2021;63:102196. doi: 10.1016/j.bspc.2020.102196 [DOI] [Google Scholar]
- 25. Carlsson G. Topology and data. Bulletin of the American Mathematical Society. 2009;46(2):255–308. doi: 10.1090/S0273-0979-09-01249-X [DOI] [Google Scholar]
- 26. Chan JM, Carlsson G, Rabadan R. Topology of viral evolution. Proceedings of the National Academy of Sciences. 2013;110(46):18566–18571. doi: 10.1073/pnas.1313480110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. De Silva V, Ghrist R. Coverage in sensor networks via persistent homology. Algebraic & Geometric Topology. 2007;7(1):339–358. doi: 10.2140/agt.2007.7.339 [DOI] [Google Scholar]
- 28. Perea JA, Harer J. Sliding windows and persistence: An application of topological methods to signal analysis. Foundations of Computational Mathematics. 2015;15(3):799–838. doi: 10.1007/s10208-014-9206-z [DOI] [Google Scholar]
- 29.Chung MK, Bubenik P, Kim PT. Persistence diagrams of cortical surface data. In: International Conference on Information Processing in Medical Imaging. Springer; 2009. p. 386–397. [DOI] [PubMed]
- 30. Giusti C, Pastalkova E, Curto C, Itskov V. Clique topology reveals intrinsic geometric structure in neural correlations. Proceedings of the National Academy of Sciences. 2015;112(44):13455–13460. doi: 10.1073/pnas.1506407112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Giusti C, Ghrist R, Bassett DS. Two’s company, three (or more) is a simplex. Journal of computational neuroscience. 2016;41(1):1–14. doi: 10.1007/s10827-016-0608-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Santos FA, Raposo EP, Coutinho-Filho MD, Copelli M, Stam CJ, Douw L. Topological phase transitions in functional brain networks. Physical Review E. 2019;100(3):032414. doi: 10.1103/PhysRevE.100.032414 [DOI] [PubMed] [Google Scholar]
- 33. Van Essen DC, Ugurbil K, Auerbach E, Barch D, Behrens T, Bucholz R, et al. The Human Connectome Project: a data acquisition perspective. Neuroimage. 2012;62(4):2222–2231. doi: 10.1016/j.neuroimage.2012.02.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Kosterlitz JM. Nobel lecture: topological defects and phase transitions. Reviews of Modern Physics. 2017;89(4):040501. doi: 10.1103/RevModPhys.89.040501 [DOI] [Google Scholar]
- 35. Santos F, Coutinho-Filho M. Topology, symmetry, phase transitions, and noncollinear spin structures. Physical Review E. 2009;80(3):031123. doi: 10.1103/PhysRevE.80.031123 [DOI] [PubMed] [Google Scholar]
- 36. Angelani L, Casetti L, Pettini M, Ruocco G, Zamponi F. Topological signature of first-order phase transitions in a mean-field model. Europhysics Letters. 2003;62(6):775–781. doi: 10.1209/epl/i2003-00439-9 [DOI] [Google Scholar]
- 37. Casetti L, Pettini M, Cohen E. Phase transitions and topology changes in configuration space. Journal of Statistical Physics. 2003;111(5-6):1091–1123. doi: 10.1023/A:1023044014341 [DOI] [Google Scholar]
- 38. Piangerelli M, Rucco M, Tesei L, Merelli E. Topological classifier for detecting the emergence of epileptic seizures. BMC research notes. 2018;11(1):392. doi: 10.1186/s13104-018-3482-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Okun B. Euler characteristic in percolation theory. Journal of Statistical Physics. 1990;59(1-2):523–527. doi: 10.1007/BF01015581 [DOI] [Google Scholar]
- 40. Lee H, Kang H, Chung MK, Kim BN, Lee DS. Persistent brain network homology from the perspective of dendrogram. IEEE transactions on medical imaging. 2012;31(12):2267–2277. doi: 10.1109/TMI.2012.2219590 [DOI] [PubMed] [Google Scholar]
- 41. He B, Astolfi L, Valdés-Sosa PA, Marinazzo D, Palva SO, Bénar CG, et al. Electrophysiological brain connectivity: theory and implementation. IEEE transactions on biomedical engineering. 2019;66(7):2115–2137. doi: 10.1109/TBME.2019.2913928 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Lachaux JP, Rodriguez E, Martinerie J, Varela FJ. Measuring phase synchrony in brain signals. Human brain mapping. 1999;8(4):194–208. doi: [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Tausz A, Vejdemo-Johansson M, Adams H. javaPlex: a research platform for persistent homology. Book of Abstracts Minisymposium on Publicly Available Geometric/Topological Software. 2012;7:1–41. [Google Scholar]
- 44. Chintakunta H, Gentimis T, Gonzalez-Diaz R, Jimenez MJ, Krim H. An entropy-based persistence barcode. Pattern Recognition. 2015;48(2):391–401. doi: 10.1016/j.patcog.2014.06.023 [DOI] [Google Scholar]
- 45. Merelli E, Rucco M, Sloot P, Tesei L. Topological characterization of complex systems: Using persistent entropy. Entropy. 2015;17(10):6872–6892. doi: 10.3390/e17106872 [DOI] [Google Scholar]
- 46. Rucco M, Castiglione F, Merelli E, Pettini M. Characterisation of the idiotypic immune network through persistent entropy. In: Proceedings of ECCS 2014. Springer; 2016. p. 117–128. [Google Scholar]
- 47. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of neuroscience methods. 2004;134(1):9–21. doi: 10.1016/j.jneumeth.2003.10.009 [DOI] [PubMed] [Google Scholar]
- 48. Henry JC. Electroencephalography: basic principles, clinical applications, and related fields. Neurology. 2006;67(11):2092–2092. doi: 10.1212/01.wnl.0000243257.85592.9a [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
(MP4)
Data Availability Statement
The data underlying the results presented in the study are available from https://datadryad.org/stash/share/Nv5oV1ssYvLJXZ7Yo69_qe4upD8oH6IUiUaa8YQg3FE. And the dataset has been assigned a unique digital object identifier (DOI): doi: 10.5061/dryad.bcc2fqzdj.









