Abstract
Brain–computer interfaces (BCIs) are a new technology that subverts traditional human–computer interaction, where the control signal source comes directly from the user’s brain. When a general BCI is used for practical applications, it is difficult for it to meet the needs of different individuals because of the differences among individual users in physiological and mental states, sensations, perceptions, imageries, cognitive thinking activities, and brain structures and functions. For this reason, it is necessary to customize personalized BCIs for specific users. So far, few studies have elaborated on the key scientific and technical issues involved in personalized BCIs. In this study, we will focus on personalized BCIs, give the definition of personalized BCIs, and detail their design, development, evaluation methods and applications. Finally, the challenges and future directions of personalized BCIs are discussed. It is expected that this study will provide some useful ideas for innovative studies and practical applications of personalized BCIs.
Keywords: personalized brain–computer interface (pBCI), specific BCI user, customized brain–computer interface (cBCI), general brain–computer interface (gBCI), brain–computer interface (BCI)
1. Introduction
Brain–computer interfaces (BCIs) are designed to bypass users’ nerves and muscles to realize direct interaction between their brain and external devices through their brain signals. BCIs have potential medical [1] and non-medical applications. So far, researchers have conducted many studies on BCIs [1,2], proposed a general BCI system [3], and expect it to have a wide range of applications.
BCIs were first proposed by the University of California, Los Angeles (UCLA) in the 1970s [4]. At that time, experiments were conducted on animals to establish a direct communication path between the external environment (or equipment) and the brain [5,6]. Among them, two groundbreaking studies [7,8,9] published in Nature in 2012 showed how the BCI system achieved neuro arm control and arm motion recovery after paralysis. In 2017, Ajiboye et al. confirmed the effectiveness of the intracortical BCI system in the rehabilitation of patients with limb disorders [10]. BCI is ultimately driven or controlled by brain signals induced by a specific user’s mental activities. Although the connection between external devices and the brain has been established, and the availability of BCI systems can be verified from both invasive and non-invasive aspects, a BCI is ultimately driven or controlled by specific users’ psychological activities and brain signals induced by them. [11]. It is difficult for a general BCI system to meet the needs of specific users, so it is necessary for researchers and developers to customize personalized BCI systems for individuals. In recent years, to respond to the need of personalized therapy, the research on personalized and family therapy programs has expanded rapidly [12]. Personalized BCIs have gradually become an important research direction.
Personalized BCIs have been designed and developed on the basis of general BCIs, and customized BCI systems for specific BCI users according to their characteristics. In 2009, Borman et al. proposed a feature selection method to effectively reduce the dimension of multi-channel feature space, and select the feature most suitable for a specific user from the feature space [13]. In 2011, Arvaneh et al. proposed a sparse common spatial pattern (SCSP) algorithm for brain signal channel selection to select channels for specific users [14]. In 2015, Weyand et al. found that there were significant differences between subjects in the stimulation caused by the same mental task and cognitive process, and proposed a user-centered scoring method for mental tasks [15]. In 2017, Mastakouri et al. applied transfer learning to personalized BCIs to customize the brain signal classification model for specific users [16]. In 2020, Qi W et al. proposed a multi-mode wearable system for continuous and real-time breathing pattern monitoring during daily activities [17].
The above research covers the personalized development of BCI technology, that is, customizing BCI systems to meet the needs of specific users. However, although some aspects of personalized BCIs have been explored by a few studies [11,14,18,19], compared with general BCIs, there are fewer studies on them and there is no standardized definition. Personalized BCIs also have many problems that need to be further investigated. First, the paradigm design of personalized BCI is a difficult point. How to evaluate user satisfactions with the selected paradigm is also a problem and especially how to customize a satisfactory brain signal acquisition scheme for a specific user. Second, to improve the decoding performance of personalized BCI, what problems need to be solved in the personalized processing of brain signals and neurofeedback? At present, few studies have elaborated on these two aspects. Finally, the key to proving whether a system is effective is whether it can meet the relevant evaluation criteria. At present, there is no comprehensive evaluation method for personalized BCI performance. Whether the personalized BCIs proposed by researchers can meet the needs of specific users remains to be discussed.
In order to solve the above problems, it is necessary to design perfect evaluation criteria for personalized BCIs, propose a standard definition of personalized BCIs, and try to meet the needs of specific users in the process of designing personalized BCI systems.
To this end, this study will first give a definition of personalized BCIs, and then discuss the research and development of personalized BCIs. It is worth mentioning that this study attempts to propose a personalized BCI evaluation standard based on the evaluation indicators of the general BCI. Finally, this study introduces and discusses the application, challenges, limitations, and prospects of personalized BCIs.
2. Personalized BCI
A personalized BCI is designed and developed for a specific user on the basis of the general BCI. For this reason, before describing personalized BCI, we will first introduce the general BCI for comparison.
2.1. General BCI
Figure 1 is the schematic diagram of the general BCI system, showing the main parts of a BCI system [20]. Most BCI systems rely on three typical BCI paradigms: Motor Imagery (MI), P300, and steady-state visual-evoked potentials (SSVEP). At the same time, in the process of brain signal acquisition, we can collect electroencephalogram (EEG), near infrared spectroscopy (NIRS), and other signals through non-invasive devices, or use invasive devices to collect electrocartography (ECoG) [21,22] and local field potential(LFP) [23] signals. The personalized processing of brain signals includes preprocessing, feature extraction and selection, and classification. The classical algorithms for brain signal preprocessing include Kalman filtering [24] and the Independent Component Correlation Algorithm [25]. There are also many feature extraction and selection algorithms, such as covariance matrix [26] and the tensor method [27]. At present, there is more research on the classification algorithm of brain signals, and the commonly used classification algorithms include support vector machines, nonlinear Bayesian classifiers, artificial neural networks [28], and combinations of multiple classifiers [29]. Finally, the neurofeedback in Figure 1 can include the device state, presented stimulus, control display state, device controller state, user state and reported error, and environment state [2].
The general BCI system framework is conducive to comparing different BCI studies, and its purpose is to provide an objective method to compare BCI technology with other BCI and non-BCI user interface technologies [2].
2.2. Personalized BCI
Although the above general BCI system framework attempts to provide BCI benchmark applications, owing to the large individual differences between BCI users (as shown in Figure 2b), it is necessary to customize personalized BCI systems for specific BCI users on the basis of the general BCI system framework, as shown in Figure 2a.
For a personalized BCI, it is necessary to design, develop, and evaluate the BCI system based on the general BCI and fully consider the individual differences among BCI users, such as individual unique requirements, capability characteristics, mental activities, and brain signal characteristics [30]. We need to improve user satisfaction with the system, enhance the user experience, and make the system practical. Designing a personalized BCI system includes a personalized BCI paradigm [15,18] for a specific BCI user, a specific brain signal acquisition scheme suitable for the user, and a personalized brain signal processing algorithm [19,31] (including a specific preprocessing model, personalized channel selection, personalized feature extraction and selection, and a personalized classifier model). In addition, a personalized BCI system also includes the design and display of devices and control interfaces suitable for users, personalized neurofeedback, and an intelligent environment for operation [30], as shown in Figure 2c.
The above ideas of personalized BCI are also inspired by personalized medicine. Personalized medicine is a medical model that provides a patient with a personalized treatment plan according to his or her genome information and relevant individual characteristics [32]. Meanwhile, a personalized BCI is a concept and method for designing, developing, and evaluating BCI systems. Figure 2b shows that the individual differences determined by biological heterogeneity make the needs of individual BCI users different (such as communication and control with the outside world, neural regulation, and brain state monitoring). Their capability characteristics (such as self-care ability, vision, hearing, and imagination) and state characteristics (physical or physiological conditions) will affect their mental activities (including motivation), while the differences in mental activities will lead to differences in brain signal characteristics. In turn, this will lead to differences in the training decoding models, with different decoding results leading to different neurofeedback. These differences will make it difficult for the general BCI to adapt to or meet the needs of different users, which requires us to customize the personalized BCI system for specific users, as shown in Figure 2a, to achieve the transformation from the general BCI to the personalized BCI.
In the following sections, we describe the design and development methods of personalized BCIs as well as their performance evaluation and reporting criteria, especially the application of personalized BCIs.
3. Personalized BCI Design, Research, and Development
For a specific BCI user, to achieve the transformation from the general BCI to a personalized BCI, the design of the components of the general BCI can be personalized, as shown in Table 1. Table 1 lists the personalized research conducted for specific parts of BCIs, including the whole personalized BCI algorithm. In addition, this section also describes the brain signal acquisition scheme, specific preprocessing model, personalized neural feedback, and intelligent environment for a specific user.
Table 1.
Reference | Specific Works for Personalized BCI | Personalized Component |
---|---|---|
Weyand et al., 2015 [15] | Proposes the use of personalized mental tasks; explores a user-centered approach Proposes user-selected weighted slope scores (WS-US) and user-selected pair-wise accuracy rankings (PWAR-US) |
Personalized BCI paradigm |
Yeo et al., 2018 [33] | Proposes the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) | |
Kuzovkin et al., 2019 [34] | Realizes visualization of mental state space for personalized BCI | |
Wang et al., 2021 [31] | A classifier-based approach for personalized channel selection in deep belief networks is proposed | Personalized channel selection |
Astigarraga et al., 2016 [19] | Presents a brain–computer interface for motion imaging based on a distributed algorithm for EEG channel selection | |
Arvaneh et al., 2011 [14] | Proposes a sparse common spatial pattern (SCSP) algorithm for brain signal channel selection | |
Ugarte et al., 2017 [35] | An algorithm model is proposed to select different types of brain signal processing methods for subjects by predicting their wishes | Personalized feature extraction and selection |
Bormane et al., 2009 [13] | A feature selection method is proposed to effectively reduce the dimension of multi-channel feature space | |
Wang et al.,2021 [31] | A personalized feature extraction method based on filter banks and elastic networks is proposed | |
Kalaganis et al., 2020 [36] | A data enhancement method for graph signals is proposed to improve the accuracy of personalized classification | Personalized classification model |
Mastakouri et al., 2017 [16] | Proposes a personalized model based on a transfer learning algorithm for the rehabilitation of patients with motion disorders | |
Bashashati et al., 2016 [37] | Uses a Bayesian-based optimization algorithm to adjust parameters | The whole personalized BCI algorithm |
Ugarte et al.,2017 [35] | An algorithm model is proposed to select different types of brain signal processing methods for subjects |
3.1. Personalized BCI Paradigm Design
Cognitive psychology takes mental representation as the basic unit of information processing, and the construction, storage, extraction, and manipulation of mental representation are called cognitive processes, which can be reflected by brain activities [15]. A BCI infers a user’s cognitive process or state by analyzing brain activity signals. Therefore, the design and development of a BCI system can draw on the achievements of cognitive psychology.
A BCI system is mainly composed of coding and decoding, in which BCI coding is a specific mental task designed or designated in advance for the user, through which the user performs these set mental tasks to encode or “write” the user’s intention into the signal generated by the brain central nervous activity [15,38,39], such as encoding into the electroencephalogram (EEG) signal or near-infrared spectroscopy (NIRS) signal. The user’s intention is characterized by EEG or NIRS features.
BCI coding is realized by the BCI paradigm, which is based on the mental tasks set by BCI coding. The hardware and software realize the direct interaction between the brain and external devices, forming a type of communication or control system. BCI paradigm design is an important part of BCI research and development. It determines what type of stimulus users will face and chooses the target stimulus or what kind of mental activities they will actively perform, thus determining the characteristics of induced neural signals [40,41]. For example, the motor imagery (MI) BCI paradigm defines a set of MI tasks that users are required to perform in order to manipulate MI-BCI, including the limbs involved in motion and the manner of motion. The synchronous MI-BCI paradigm requires hardware and software to visually present the paradigm to users to prompt them to execute the specified MI [18] at the designed time sequence. The asynchronous MI paradigm does not require prompting.
Different BCI paradigms have different efficacies and applicability. Individual BCI users can choose paradigms according to their own needs, and, at the same time, according to their own capabilities and state characteristics, they can consider their capability to perform the mental tasks assigned by BCI paradigms and combine their own preferences for mental tasks to choose their own personalized BCI paradigms.
An important aspect of a personalized BCI paradigm is personalized mental tasks, which are evaluated by task performance (the performance of users in the tasks, such as classification accuracy), task suitability (the suitability of tasks for users), and task ease of use (the difficulty users have performing tasks). When designing a personalized BCI paradigm, it is necessary to evaluate personalized mental tasks. So far, personalized BCI paradigm design has mainly used the following two methods. One is a design method based on the mental task score [11], where tasks are recommended for users by calculating their mental task scores, and then users can choose them according to their own conditions. The other is the BCI paradigm of self-regulation based on feedback; that is, users are placed in a closed loop system and use visual presentation and other means to let them self-regulate mental tasks and their execution methods through feedback mechanisms [18].
(1) Personalized BCI paradigm design based on mental task scoring
Weyand et al. proposed a user-centered mental task selection framework. When the framework is used to select personalized mental tasks for users, multiple groups of experiments are designed. In the first several groups of experiments, users are required to perform a variety of different alternative mental tasks, and each task is scored using the proposed framework. In the next several groups of experiments, users are required to select personalized mental tasks that are suitable for them according to the scores and their feelings. At present, there are user-selected weighted slope scores (WS-US), user-selected pair-wise accuracy rankings (PWAR-US), the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) [15], and other scoring methods. For the WS-US scoring method, one can take the near-infrared spectrum acquisition method as an example to sort the tasks according to the degree of hemodynamic activity during a variety of different mental tasks, where the user selects the mental tasks according to the sorting situation. For the PWAR US scoring method, one selects appropriate classification features and uses cross-validation to perform an iteration for all possible paired combinations of candidate mental tasks, and then PWAR US will rank these task pairs from high to low. The higher the ranking, the higher the classification accuracy [15]. For the RBANS scoring method, each participant is required to select a pair of tasks in the list according to the perceived task difficulty data in all iterations [33].
(2) Personalized BCI paradigm execution based on visual feedback
Different BCI users usually perform mental tasks specified in the BCI paradigm in different ways, and the same BCI user may also perform specific mental tasks in different ways. It is necessary to find a personalized mental task execution method suitable for users to induce brain signal features with good separability, so as to further improve the performance of the BCI system, such as classification accuracy.
In addition, one of the core tenets of a BCI system is an advanced machine learning algorithm, which classifies the user’s brain signal features into desired actions or instructions. This algorithm usually operates in high-dimensional brain signal feature space. When it cannot correctly identify the desired instructions from brain signals, the reason can be found by visual feedback of data [18]. At present, the technologies that support visual feedback mainly include self-organizing maps (SOM). A SOM has the function of dimension reduction. It can visualize the recorded neural signals online into tracks on a two-dimensional SOM and provide users with real-time feedback to help them adjust the way they perform mental tasks and change their mental state in time [34,42,43].
Kuzovkin et al. used the method of visual feedback to help users choose the most suitable mental paradigm [34]. Through appropriate simplification, they could directly visualize the mental activities of users. Users could evaluate and adjust their mental activities in real time during the interaction process to achieve “what you want is what you see or what you see is what you want.” Figure 3 shows the way to provide visual feedback on the user’s mental activities to the user so that they can adjust the way they perform mental tasks in a timely manner. In the beginning, because the user has no experience imagining left-hand or right-hand movements, their way of imagining these movements is often inappropriate. The difference between the left and right brain in the visual feedback sensory motor rhythm power topographic map is not significant, and the BCI machine learning algorithm has difficulty distinguishing it. To improve the classification performance of BCI, users must adjust their own mental activity mode. With their interactive adaptation with the visual feedback system, they gradually find the most suitable left-hand or right-hand motion imagination execution mode. At this time, the visual feedback sensory motor rhythm power map has significant differences between the left and right sides of the brain, which the BCI machine learning algorithm can accurately identify.
This visual feedback method promotes the “dialogue” between the user and the BCI machine learning algorithm and visually explains to the user why the current series of mental activities is difficult for the BCI system to recognize, which mental activities can be well recognized by the system, and which mental activity execution methods should be changed. By constantly adjusting their own mental activities, users can find appropriate execution methods for each mental task to continuously improve the output performance of the BCI.
3.2. Brain Signal Acquisition Scheme for a Specific User
Brain signal acquisition sensor technology is one of the bottlenecks in the practical application of BCI systems. At present, the quality of the brain signals collected is not high, and the user comfort is poor [44,45]. Therefore, it is the direction of future efforts to research and develop sensors that can collect brain signals to meet the application requirements and make users more comfortable. Lyu et al. argued that the user-centered design of a brain signal acquisition scheme should ensure the safety, comfort, aesthetics, and ease of use of sensor equipment [30].
At present, there are many brain signal acquisition methods [46], but not all of them are suitable for specific BCI users. Because different BCI users have different needs, capability characteristics, and status characteristics, they will have corresponding preferences for brain signal acquisition methods. For example, some BCI users may prefer to choose wearable EEG earphones, while some BCI users may only use implantable BCIs to collect ECoG [21,22] or Spikes/LFP signals [23].
3.3. Personalized Processing of Brain Signals
The processing module of brain signals includes channel selection, feature extraction, and pattern recognition. Because each individual’s thinking activities and brain physiological characteristics are different, the collected brain signals will also be different. Therefore, for personalized BCI systems, personalized signal processing is a very important element.
3.3.1. Specific Preprocessing Model
Brain signal preprocessing is the pre-link of subsequent feature extraction and selection and classification model construction. Its purpose is to eliminate artifacts and improve the signal-to-noise ratio. In a general BCI, a general artifact elimination model is used to improve the signal-to-noise ratio. However, the characteristics of artifacts such as electromyography and electro-oculogram caused by different BCI users are often different. It is necessary to introduce advanced machine learning algorithms to build an artifact elimination model for a specific BCI user, monitor the generated artifacts in real time, and eliminate them.
3.3.2. Personalized Channel Selection
In the experimental research of BCI systems, to obtain more data, multi-channel BCI systems are often used to collect brain signals. However, not every channel contributes to classification. Some channels even reduce the classification accuracy. Different channel combinations often have different classification performances. In addition, under the same BCI paradigm or mental task, there are differences in the activation of different users’ brain regions. Therefore, it is necessary to select brain regions or corresponding channel combinations for specific BCI users to optimize the BCI system performance. At present, people can use Granger causality [47], dynamic causal modeling [48], and other means to calculate the connections between neurons and causality of information transmission. For example, in the BCI paradigm of motion imagination, the distribution of event-related desynchronization/event-related synchronization (ERD/ERS) on the scalp among users is not the same, so it is necessary to carry out personalized channel selection for different BCI users of motion imagination.
At present, there are many personalized channel selection algorithms, whose selection criteria are often different, but the main purpose is to select the most suitable channel subset for the user. For example, the sparse common space pattern (SCSP) can remove irrelevant channels, customize channel subsets for the user to produce the best classification accuracy, or reserve the minimum number of channels without affecting the classification accuracy. This algorithm has been successfully used in motion image BCIs [14]. Select distribution estimation (EDA) can capture the correlation between channels, code these relationships according to statistical correlation, and then select the subset with the best performance for BCI users [19]. In addition, Wang et al. put forward a personalized channel selection method based on a deep belief network. This algorithm is based on the idea that the channel with greater contribution to the output of the neuron has greater weight in its corresponding dimension. Thus, several channels with higher weight in the first layer of the trained deep belief network (DBN) model are selected as the optimal channel combination [31].
3.3.3. Personalized Feature Extraction and Selection
To identify the mental state of BCI users with high accuracy, extracting and selecting brain signal features with good separability is the premise or basis of subsequent classification and is the core part of personalized brain signal processing. Because different users have different mental activities, abilities, and physiological conditions, the time–frequency characteristics of different users in the same channel are distributed differently under the same BCI paradigm or mental task, so personalized feature extraction and selection are required for specific users. For example, the time–frequency characteristics of ERD/ERS of different users are different for the same channel (such as C3 or C4) in the mental task of motion imagination.
At present, personalized feature extraction and selection can screen the best features for users through FBCSP, mutual information, genetic algorithms, and more. For example, Wang et al. proposed a personalized feature extraction method based on filter banks and elastic networks. First, Filter Bank Common Spatial Pattern (FBCSP) is used for feature extraction, and then the training data are used to build the elastic network logic regression model to select the best feature subset for each subject [31]. Borman et al. proposed a two-stage feature selection method that can effectively reduce the dimension of feature space. First, mutual information is used to filter out the smallest feature, and then a genetic algorithm is used in the filtered feature space to further reduce the dimension and obtain the best feature subset [13].
3.3.4. Personalized Classification Model
There are many classification models of general BCIs, but the general model may not be necessarily suitable for the BCI customized for specific users. It is necessary to select the classifier type suitable for user applications for a personalized BCI system. Discrete and continuous control tasks usually select the classifier whose output is a discrete value and the regression model whose output is a continuous signal, respectively, and then use the features selected in the previous section for training to obtain personalized classification models. In addition, owing to the nonstationarity of BCI users’ brain signals (brain signal characteristics change with time), the trained classification model needs to adapt to this nonstationarity, and online adaptive machine learning can be used to update the classification model parameters.
Some studies have used transfer learning to predict the personalized classification model of subjects, using the existing data of subjects to predict the personalized model for new subjects or updating the existing model for them. Mastakouri et al. trained a personalized model for a 26th subject based on the data of the first 25 subjects in transfer learning and then predicted other experiments of the subject from this model [16]. This personalized model of transfer learning training links the EEG rhythm with sports performance, enabling researchers to deal with the heterogeneity of sports performance of different subjects. Kalaganis et al. proposed a data enhancement method for graph signals. This method uses graph variant empirical mode decomposition to generate artificial EEG signals to improve the classification accuracy of personalized BCI [36].
Owing to the large difference among brain signals between individuals and the change of brain signal characteristics over time, the effect of transfer learning for BCI is limited. Although researchers have proposed some personalized classifier models, the work of Lopes Dias et al. [49] shows that, for some BCI users, the classification effect of the personalized classifier model is not significantly different from the general classifier model, or even lower than that of the general classifier model, which may be caused by the training of the personalized classification model.
3.3.5. Personalization Algorithm Design Based on the Overall BCI System
In addition to the personalized design of the BCI paradigm, brain signal acquisition scheme, preprocessing model, channel selection, feature extraction and selection, and classification model, it is also necessary to customize the BCI system for specific BCI users from the perspective of the whole BCI system and further optimize it.
Ugarte et al. proposed a weighted discriminator (WD) index [35] which reflects the preference of subjects for corresponding parameters (such as different signal acquisition and processing schemes), selects the most suitable scheme for subjects, and integrates it into their customized BCI system. Bashashati et al. proposed an optimization algorithm based on Bayes and applied it to the BCI of motion imagination [37]. According to the brain signal characteristics of each subject, the algorithm uses Bayes to optimize parameters such as channel, frequency band, and time period, and evaluate these parameters to provide a personalized BCI system. The above research is based on the entire BCI system to design personalized algorithms, and the research in this area needs to be further developed.
3.4. Personalized Neurofeedback
Neurofeedback (NF) is a biofeedback technology based on central nervous activity [50,51]. Neurofeedback is one of the key links of the BCI system. It forms a closed loop bi-directional BCI system, feeds back neural activity to users in real time through visual, auditory, or tactile feedback forms, and uses the principle of operant conditioned reflex to enable users to learn to independently enhance or inhibit neural activity. Endogenous regulation of brain activity is achieved through neural feedback training, as shown in Figure 1. Neurofeedback is one of the key links of the BCI system, which forms a closed-loop bidirectional BCI system, as shown in Figure 1. Through neurofeedback, the user’s brain activity characteristics, BCI decoding results, and results of communication or control with devices can be visually fed back to the user in visual, auditory, or tactile ways to adjust their mental activity mode, so as to adjust their brain signals, drive the BCI system, and improve its performance [2]. BCI operation usually requires effective interaction between two adaptive controllers (user and BCI adaptive algorithm), and neurofeedback plays a key role [1].
Because different BCI users have different capabilities, states, and ways to perform the same mental tasks, their brain signal characteristics are also different, and thus, the BCI decoding results and communication or control results are different, which ultimately leads to different contents of the feedback signals to users, and their self-regulation processes are also different. In addition, different BCI users have preferences for the form or interface of neurofeedback. Therefore, it is necessary to design personalized neural feedback for specific BCI users.
Personalized neurofeedback should not only adjust the neural activities of specific users but also improve the user’s sense of experience and satisfaction in the process of feedback [52,53]. However, the existing BCI neurofeedback is relatively brain-intensive, and users are easily tired mentally and physically, and even bored. To increase the effectiveness of neurofeedback, a specific feedback channel should be designed according to the characteristics of the user (such as health, hearing, or visual impairment) and let them conduct neurofeedback easily, rather than completing a tedious task.
3.5. Personalized Intelligent Environment
The BCI system operates in the environment, and its users interact with the environment. The performance of the system is closely related to the operating environment. At present, most BCI systems have been developed in well-controlled and structured laboratory environments. Such BCI systems are usually difficult to adapt to the daily life and working environment of users [30], Some studies have introduced shared control to improve the robustness of BCI systems [54]. In addition, the performance and efficacy of the current BCI systems are still very limited, so it is necessary to design an intelligent operating environment. For example, an intelligent environmental system can be built by technologies such as intelligent sensor networks and deep learning in the operating environment and integrated with the BCI system to further improve its performance of the BCI system.
According to the needs of specific BCI users (the efficacy provided by BCI is required to solve their problems) and their capabilities, and taking full account of their living or working environment (which may have some uniqueness), an intelligent environment suitable for the operation and operation of a specific BCI system (such as different BCI paradigms) can be built, considering user preferences for the intelligent environment. Designing such a personalized intelligent environment is conducive to enhancing the interaction performance between the BCI system and users and improving the user’s sense of experience and satisfaction [55,56].
4. Evaluation of Personalized BCI Performance
To compare the performance of different BCI systems, the criteria for reporting their performance are crucial [2], and personalized BCI is no exception (as shown in Figure 2c). In addition, the evaluation of personalized BCI performance methods also helps specific users to evaluate such BCIs to promote their improvement.
The personalized BCI is designed and developed on the basis of the general BCI (as shown in Figure 2a). Therefore, the performance of the personalized BCI also needs to be evaluated quantitatively or objectively according to the general BCI performance indicators. In addition, it needs to be evaluated from the perspective of specific BCI users through indicators such as satisfaction [30,54].
4.1. Performance Evaluation Methods for General BCI System
A general BCI system performance evaluation method is shown in Table 2, including multiple quantitative indicators from the perspective of researchers. As shown in Table 2, the most commonly used indicators are classification accuracy, the information transmission rate, and Cohen’s kappa. These three indicators reflect the accuracy, transmission rate, and consistency of BCI, which can be evaluated to a certain extent, while sensitivity, specificity, noise factor, F-measurement [2], and other indicators can be used as supplements to these indicators.
Table 2.
Index | Computing Method | Explanation |
---|---|---|
Classification positive accuracy | p is the correct classification rate; Ci,i is the ith element of the diagonal of the confusion matrix; N is the total number of trials | |
Information transmission rate | ITR is the amount of information transmitted in unit time, N is the target number, P is the accuracy rate, and T is the time required to output an instruction | |
Cohen’s kappa | Κ is the consistency indicator between nominal scales, Ci,: and C:,i are row i and column i of the confusion matrix, respectively, and N is the total number of trials | |
Sensitivity | Se is sensitivity, TP is true positive, TN is true negative | |
Specificity | Sp is specific, TP is true positive, TN is true negative | |
Noise factor | F is false positive, FP is false positive, TP is true positive | |
F-measurement | is a measure of classifier performance under different significance levels α, F is the false detection rate, Se is sensitivity | |
Failure rate [30] | is the failure rate, M is the number of failed BCI products during the working time, N is the total number of BCI products, and Δt is BCI working time | |
Mean time between failures [30] | MTBF is the mean time between failures; λ is the average failure rate | |
Fitts Throughput [57] | TP is throughput; ID is index of difficulty; MT is mean movement time | |
Receiver Operating Characteristic Curve(ROC) [57] | The abscissa of the curve is the false positive rate (FPR). N is the number of real negative samples, and FP is the number of positive samples predicted by the classifier among N negative samples. The ordinate is the true positive rate (TPR). P is the number of real positive samples, and TP is the number of positive samples predicted by the classifier among the P positive samples. | |
Area Under Curve (AUC) [57] | Calculated by mean and variance | Area under ROC curve, generally between 0.5 and 1 |
4.2. Evaluation Method of Personalized BCI Performance
As shown in Figure 4, the satisfaction evaluation of specific users regarding BCI sensors is extremely important, because the performance of BCI sensors will seriously affect user acceptance of BCIs [30,54], The workload evaluation of a specific user controlling the BCI will also affect the user’s acceptance of BCI [30]. In addition, Figure 4 also includes a user-specific visual analog scale [2,58] and an evaluation of a specific user’s overall satisfaction with BCI [30,54]. The latter can use Quest 2.0 and its extension form of user satisfaction with auxiliary technology [56,58,59]. In particular, interview/follow-up evaluation with specific users is necessary and important, in which four issues need to be considered when BCI technology is converted into practical application [1].
5. Personalized BCI Application
Whether it is the personalization of an experimental paradigm, brain signal processing, or neural feedback, the ultimate goal is to build a BCI system platform and put it into practice. In this section, we will discuss the applications of personalized BCIs in the rehabilitation of motor dysfunction, psychiatric treatment and rehabilitation, emotion recognition, and other fields. Table 3 lists the main personalized BCI applications so far, and this section will review the contents in the table.
Table 3.
Reference | Applications | Direction |
---|---|---|
Abiri et al. 2017 [60] | Designed a social robot based on gesture control. | Auxiliary Control |
Uma et al. 2017 [43] | Developed a personalized GUI application that collaborated with the EEG device, accessed the user’s needs, | |
Coscia M et al. 2019 [61] | adjusted and improved the duration and intensity of brain/neural exoskeleton (B/NE)training according to the patient’s individual ability. | |
Vinoj et al., 2019 [62] | Developed a brain-controlled lower limb exoskeleton, and customized it according to the degree of disability to assist users with lower limb disorders in rehabilitation training. | |
Bronte-Stewart et al., 2020 [63] | A personalized dual threshold control strategy was proposed to drive closed-loop subthalamic nucleus deep brain stimulation (STN-DBS). | Parkinson’s |
Kübler et al., 2017 [64] | A neuromental algorithm was developed to assign different neural feedback training modules to different stroke patients. | Cerebral apoplexy |
Mane et al., 2019 [65] | Used biometric markers to predict patients’ expected responses to existing interventions and provide patients with high expectations. | |
Parastarfeizabadi et al., 2017 [66] | Adaptive adjustment of stimulus parameters. | Rehabilitation of mental disorders |
Campanella.,2013 [67] | ERPs and machine learning can help predict the disease progression and treatment results of specific subjects. | |
He et al., 2020 [68] | Personalized tasks through emotional reflex control and automatically modified the human–computer interaction process. | Emotional recognition |
Daly et al., 2017 [69] | Developed a high-performance emotional state detection system. |
5.1. Application of Personalized BCI in Auxiliary Control
At present, BCIs are most widely used in auxiliary control, such as communication and control, and in motion replacement.
-
(1)
Communication and control
The basic principles of BCI communication and control are similar, both of which realize the output of external instructions/symbols by identifying specific patterns of brain signals. Through BCIs, users with severe disabilities can communicate with others and control the external device. Abiri et al. designed a social robot based on gesture control [60]. By combining this with the neural feedback mechanism, they customized the decoding model for users to control the gestures of the social robot. Uma et al. developed a personalized GUI application that collaborated with the EEG device to access the user’s neesd [43]. Abiri et al. confirmed that in cursor control, there is a positive correlation between individual visualization ability and the controllability level of the cursor, which can provide research directions for personalized cursor control [70].
-
(2)
Motion replacement
Annalisa Colucci et al. mentioned in the literature published in 2022 [71] that the brain/neural exoskeleton (B/NE) will play a key role in improving the effectiveness of personalized treatment strategies. Coscia M et al. [61] adjusted and improved the control parameters of B/NE training according to the patient’s individual ability by monitoring the physiological biomarkers that predict mental exhaustion, such as heart rate variability, galvanic skin response, or respiratory rate. In addition, Vinoj et al. developed a brand-controlled lower limb exoskeleton that can be customized according to the degree of disability [62].
5.2. Application of Individualized BCI in the Rehabilitation of Neurological Diseases
The following takes the treatment and rehabilitation of Parkinson’s disease (PD) and stroke as examples to discuss the application of personalized BCIs in the rehabilitation of motor and cognitive dysfunction.
-
(1)
Treatment and rehabilitation of Parkinson’s disease
At present, there is no way to completely cure PD [72], and personalized BCIs are expected to improve the symptoms of Parkinson’s disease patients. Bronte-Stewart et al. proposed a personalized dual threshold control strategy using the bidirectional deep brain–computer interface (dBCI) and applied the strategy to neural or motor input to drive closed-loop subthalamic nucleus deep brain stimulation (STN-DBS) for the treatment of PD [63]. This is a personalized BCI. Different from traditional BCI, it seamlessly adjusts the parameters of nerve stimulation according to the activity status and medication cycle of specific users. The purpose is to provide specific Parkinson’s patients with the parameters of the best treatment and rehabilitation effects. This study demonstrated the feasibility and effectiveness of closed-loop DBS for PD for the first time.
-
(2)
Rehabilitation after stroke
Strokes lead to cognitive disorders or/and motor disorders in patients [73]. For the rehabilitation of these disorders, personalized BCIs mainly use BCI-based neurofeedback training and transcranial electrical stimulation (TES) to intervene.
-
(a)
Rehabilitation of cognitive impairment
A study found that increasing the energy of a specific EEG frequency band can improve cognitive performance. Kübler et al. used this discovery to design a neural feedback training module based on BCI to enhance the cognitive function of stroke patients and proposed a neuropsychology algorithm. According to the neuropsychology test results, different suitable neurofeedback training modules can be customized or allocated for specific stroke patients [64].
-
(b)
Rehabilitation of dyskinesia
Mane et al. used transcranial direct current stimulation coupled with BCI (TDCS-BCI) to intervene in the upper limb motor disorder of stroke patients. They found that the brain symmetry index and power ratio index (PRI) were the best predictors of TDCS-BCI intervention, and these predictors were helpful for identifying the biomarkers of different patients [65]. The biometric markers of specific patients can be used to predict their expected response to existing interventions, and the interventions with the highest expected benefits can be recommended to patients to achieve personalized rehabilitation programs. Compared with the traditional BCI, this personalized BCI application solves the adaptability of the general scheme to different patients and provides each patient with a rehabilitation scheme that is suitable for them and has higher expected benefits.
5.3. Application of Individualized BCI in the Rehabilitation of Mental Disorders
Output-type BCI, which mainly outputs instructions from the brain, mainly realizes communication and control with the outside world. Compared with this type of BCI, there is another type of BCI that mainly uses external devices or machines to bypass the nerve or muscle system to directly input electricity to the brain (such as deep brain stimulation (DBS)), transcranial direct/alternating current stimulation (tDCS/tACS) [74,75,76], magnetism (such as transcranial magnetic stimulation (TMS)), sound (such as transcranial ultrasonic stimulation (TUS)), and light stimulation or neurofeedback (input BCI) to regulate central nervous activity. Such a BCI can be used for physical intervention in mental disorders to promote rehabilitation.
One of the main factors of the regulatory effect of input BCIs on mental disorders is the optimization of the optimal neuromodulation or stimulation parameters for a specific patient, that is, personalized stimulation parameter settings. Fellous et al. used advanced machine learning algorithms to identify brain states and optimized stimulus parameters using neural features. They introduced explainable artificial intelligence (XAI) to identify specific biometric markers (such as event related potentials (ERPs) [76,77,78,79]) to detect abnormal neural activity [80]. For example, delayed and/or reduced ERP amplitudes can be observed in alcohol-addicted patients and animal models [78,79,81,82]. When abnormal neural activity is detected, the stimulation to the brain is turned on, the stimulation parameters are adjusted adaptively, and the stimulation is turned off immediately after the normalization of brain activity [66]. ERPs and machine learning can support the diagnosis of mental symptoms and predict the disease progression and treatment results of specific subjects so as to achieve personalized treatment and rehabilitation [67,83].
5.4. Application of Individualized BCI in the Rehabilitation of Mental Disorders
Emotion regulation is very important for an individual’s physical and mental health, and emotion recognition is the basis of emotion regulation. The emotions of different individuals will change with time and environment [84]. Therefore, BCI needs to be customized for specific individuals to identify emotions.
Affective BCI (aBCI) monitors emotional states by measuring neurophysiological signals, helps users actively customize mental tasks, and improves the performance of human–computer interactions [68]. For example, in one study individuals used emotional changes to control a game. When they realize that their emotional state will affect the game parameters, they will actively change their emotions according to their preferences, adjust their mental tasks through the results of the game manipulation and emotional feedback, and achieve personalized aBCI-based game manipulation [85].
In addition, Daly et al. developed an emotional state detection system for brain–computer music interfaces (BCMI) [69]. Among them, BCMI induces users’ emotions through music to help them regulate their emotions [37]. Daly et al. trained the classifier for each subject (the music stimulus used in the experiment was created by the affective algorithm composition (AAC) system [86,87]). The experimental results showed that, compared with the ordinary BCIM (p < 0.05), the personalized BCMI system could more accurately detect the subjects’ emotions (p < 0.01).
5.5. BCI-Related Research Considering Specific Users
MI, P300, and SSVEP are three typical BCI paradigms. Owing to the large differences in the needs, capabilities, and brain signal characteristics of specific BCI users, it is a current and future research direction to customize the above BCIs for specific users on the basis of general BCIs.
In an MI-BCI study, Delisle Rodriguez and others automatically located the band with the highest power during the movement imagination of specific subjects through the sparsity constraint and total power used for time–frequency representation to improve classification accuracy [88]. Furthermore, Wu et al. proposed a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm. The algorithm can customize filter banks for specific subjects to identify multiple MI tasks [89]. In addition, Kumar et al. optimized time domain filters for specific subjects [90], and Gaur et al. used the Pearson correlation coefficient to select channels for specific subjects [91].
In a P300 BCI study, Sellers et al. optimized the P300 BCI system for specific users by customizing parameters such as matrix size and inter stimulus interval (ISI) [92]. Erdogan et al. analyzed the response of specific users to the spelling paradigm and determined the most appropriate P300 detection band for them [93]. In recent years, Wang et al. used a multi-scale convolutional neural network (MS-CNN) to train a general decoding model and then adjusted the general model by using part of the data of specific subjects through transfer learning to obtain a customized decoding model [94]. In addition, Li et al. proposed a TrAdaBoost algorithm based on cross-validation and an adaptive threshold (CV-T-TAB). By selecting and combining existing classifiers of multiple subjects who perform well on new subjects, the amount of data required for training is reduced, and the classifier performance of specific subjects with a small amount of data is effectively improved [95].
In SSVEP research, Ravi et al. customized channel subsets for specific users to reduce the impact of changes in stimulus spacing on SSVEP decoding performance [96]. Meanwhile, Rejer et al. used wavelet transforms (WT) to determine the optimal flicker frequency for a specific user to achieve customization of SSVEP-BCI [97]. In addition, Mehdizavareh et al. used the training data of other subjects to optimize the super-parameters of the canonical correlation analysis (CCA) model for specific subjects [98]. Peters introduced a method to adaptively select the test length of a specific user, which can improve the information transmission rate and the accuracy of letter selection [99]. The above research has achieved personalized design for specific subjects or users in some aspects of SSVEP-BCI.
6. Challenges and Prospects of Personalized BCI
6.1. Challenges Faced by Personalized BCI
The challenges faced by personalized BCIs not only come from the limitations of general BCIs, but also have further problems to be solved. The following section will describe the problems that need to be solved when customizing BCI for specific users from the perspective of the transformation from general BCI to personalized BCI, as well as BCI paradigm, sensors, brain signal analysis, neurofeedback and evaluation methods.
-
(1)
How to personalize the general BCI to suit specific users
In the research on personalized BCI, how to deal with the relationship between personalized BCI and the general BCI, that is, how to make personalized designs for specific users based on the general BCI to satisfy them, is a challenge that needs to be overcome to move BCI into practical applications, and is an important direction of future BCI research.
-
(2)
Which BCI paradigm suits or satisfies a specific user
Although the current personalized BCI research allows specific users to freely choose existing paradigms [11] and automatically adjust the established paradigm through neural feedback [18], the existing paradigms (such as the MI paradigm, P300 paradigm, and SSVEP paradigm) have inherent defects. For example, Chuan-Chih Hsu et al. proposed that low-frequency SSVEP would lead to the risk of photosensitive epilepsy [100]. The P300 experiment took too long, and MI had high requirements of user imagination. The existing paradigms have difficulty meeting the needs of specific users. Another challenge and important direction of personalized BCI research is how to improve the existing BCI paradigm for specific users or how to customize a new BCI paradigm for them and incorporate user evaluation indicators into the paradigm design.
-
(3)
Which brain signal acquisition sensor is suitable for satisfying a specific BCI user
The limitation of brain signal acquisition sensor technology is the bottleneck hindering the practical application of BCI systems. The current non-invasive BCI sensor user comfort (such as wet electrodes needing gel or normal saline to reduce the impedance and dry electrodes needing a certain pressure to keep it close to the scalp) and ease of use are poor (placing or wearing the electrode usually requires assistance from others). The safety of invasive BCI sensors also has problems (such as trauma caused by ECoG recordings and intracortical recordings). These factors mean the user satisfaction of BCI systems is low. Yu and Qi conducted a consumer survey in 2018 [101] to select the best wearable non-invasive EEG BCI. The three main characteristics of selecting appropriate earphones are as follows: safety 84.26%, effect accuracy 59.34%, and comfort 58.3%. This proves that one of the challenges facing personalized BCI is designing sensors that can satisfy specific users on the premise of safety and collecting effective brain signals.
-
(4)
Which brain signal characteristics of a specific user are suitable for driving a BCI
When the general BCI model trained by the brain signal data of many subjects or users is used for a specific user, it is usually difficult to ensure that its performance meets the requirements, because the brain signals vary greatly between individuals and within an individual over time. Under the specific BCI paradigm, how to meet the needs of specific users and customize feature subsets and classification models to better drive BCIs requires further research. For example, Qi in 2021 proposed a multilayer Recurrent Neural Network (RNN) consisting of a Long Short-Term Memory (LSTM) module and a dropout layer [102]. It effectively improved the classification performance of brain signals and showed strong anti-interference ability.
-
(5)
What kind of neural feedback can improve BCI performance and satisfy specific users
Neurofeedback in BCI refers to the brain activity information of a specific user or the communication and control results obtained from it, so as to help users adjust their mental activity strategies and improve the performance of controlling the BCI. It is also important for future personalized BCI research to investigate how to customize the neural feedback scheme for a specific user (including the characteristics of brain signals to be fed back, the direction of regulation, and the presentation mode of feedback) to avoid boring content and forms of neural feedback and provide neural feedback with motivation, immersion, and user satisfaction. For example, D. Borton et al. proposed that the specific needs of patients can be met through closed-loop neural feedback, adjustment of parameters and the introduction of different neural regulation features, and the opportunity to alter the dynamic state of neural networks can be provided [103].
-
(6)
How to evaluate the performance of BCI customized for specific users
Although there are some criteria for evaluating or reporting BCI performance [57], mainly from the technical perspective, BCI is directly controlled by a specific user’s brain signals to improve the user’s work efficiency and quality of life. Therefore, it is also necessary to combine user-centered BCI evaluation methods to develop a BCI that the user is satisfied with. Although this paper tries to provide an evaluation method of personalized BCI, it still needs to be further improved and verified.
6.2. Limitations of Personalized BCI
Although a personalized BCI has many advantages and ways to be improved, it has its own limitations due to it needing to be customized for specific users.
First of all, there is the problem of funds. Specific users may not be able to accept the soaring production costs of customized personalized BCIs. At the same time, the research and development of personalized BCI also needs funding. It is difficult to obtain financial support for personalized research and development only for specific users. Secondly, the research time of BCI systems is long, which makes it difficult for specific users to use personalized BCIs quickly. In the long customization process, the needs of users will gradually change, which makes it unable to really meet the needs of specific users. Finally, some users do not have the conditions to use BCIs or have poor abilities to use BCI [104], so it is difficult to customize personalized BCIs for these users.
6.3. Future of Personalized BCI
After years of development, BCIs have become general systems that have potential applications in medical and non-medical fields and which have been verified by many studies. At present, there is still a big gap between BCI research and practical applications. The research on personalized BCIs is mainly concentrated in the field of medical rehabilitation, focusing on enabling patients to obtain the most suitable treatment parameters. In the future, it is expected to achieve the one person, one program paradigm, and combine BCIs with other methods, not only to adjust the paradigm and treatment parameters, but also to enable patients to obtain a complete set of their own treatment programs from treatment to rehabilitation. Personalized BCIs can also have their own applications in other fields, such as life, games, military, and transportation. In the field of life, personalized BCIs may develop into multi-mode wearable devices and provide users with the most suitable services according to long-term and continuous brain signals (such as monitoring their physiological status at any time and customizing treatment plans for them to a certain extent). This application may greatly facilitate the life of the disabled or the elderly. In the field of transportation, personalized BCIs can be combined with automatic driving technology to customize the route and driving style for users through their characteristics. In the military field, personalized BCIs can customize combat plans for soldiers through their individual characteristics (for example, adjust their shooting distance and intensity for soldiers through special guns).
At present, the research on personalized BCIs is developing in two directions. On the one hand, we can trace the signal to specific neurons and explore the physiological differences of different users through the personality connection between nerves. On the other hand, we can customize personalized sensors for users to achieve personalized recognition of user intentions. Personalized BCIs will be one of the important ways for general BCIs to become practical. They will customize BCIs for specific users on the basis of general BCIs to meet user needs and improve satisfaction. The concept and method of personalized BCIs can promote the transformation of the BCI industry.
7. Conclusions
This study first attempted to give a definition of personalized BCIs, and describes the design and development of personalized BCIs, including the personalized BCI paradigm, channel selection, feature extraction and selection, classification model and neurofeedback. Then, we combined the general BCI system performance evaluation method with the evaluation method from the user’s perspective, and discussed the evaluation method of personalized BCI. Thirdly, we introduced the application research of personalized BCIs, including neuropsychiatric rehabilitation and emotion recognition, and finally discussed the challenges and prospects of personalized BCI. Due to the individual differences between different users of BCI, the design and development of personalized BCIs will be very important development directions in the future. How to meet the needs of specific users, improve the key technologies in personalized system design, and establish a sound evaluation system will be the key directions in future research.
Abbreviations
Term | Abbreviations |
Brain-computer Interface | BCI |
Personalized brain-computer interface | pBCI |
Customized brain-computer interface | cBCI |
General brain-computer interface | gBCI |
User-selected weighted slope scores | WS-US |
User-selected pair-wise accuracy rankings | PWAR–US |
Repeatable Battery for the Assessment of Neuropsychological Status | RBANS |
Sparse common spatial pattern | SCSP |
Electroencephalogram | EEG |
Near infrared spectroscopy | NIRS |
Motor imagery | MI |
Self-organizing map | SOM |
Electrocorticography | ECoG |
Local field potential | LFP |
Event-related desynchronization | ERD |
Event related synchronization | ERS |
Select distribution estimation | EDA |
Deep Belief Network | DBN |
Filter Bank Common Spatial Pattern | FBCSP |
Weighted discriminator | WD |
Neurofeedback | NF |
Receiver operating characteristic curve | ROC |
Area Under Curve | AUC |
Deep brain computer interface | DBCI |
Subthalamic nucleus–deep brain stimulation | STN-DBS |
Parkinson disease | PD |
BCI transcranial Direct Current Stimulation coupled BCI | TDCS-BCI |
Power ratio index | PRI |
Deep brain stimulation | DBS |
Transcranial direct/alternating current stimulation | tDCS/tACS |
Transcranial Magnetic Stimulation | TMS |
Transcranial ultrasound stimulation | TUS |
Explainable Artifificial Intelligence | XAI |
Event-related Potentials | ERPs |
Affective BCI | aBCI |
Brain-computer music interfaces | BCMI |
Affective algorithm composition | AAC |
Steady-state visual evoked potentials | SSVEP |
Discriminative and multi-scale filter bank tangent space mapping | DMFBTSM |
Inter stimulus interval | ISI |
Multiscale-CNN | MS-CNN |
TrAdaBoost based on cross-validation and an adaptive threshold | CV-T-TAB |
Canonical correlation analysis | CCA |
Wavelet Transform | WT |
Brain/neural exoskeleton | B/NE |
Author Contributions
Conceptualization, Y.F. and Y.M.; writing—original draft preparation, Y.M.; writing—review and editing, Y.F., A.G., W.N., P.D. and F.W. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This study was supported by the National Natural Science Foundation of China (82172058, 81771926, 61763022, 81470084, 61463024, 62006246).
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Ramsey N.F., Millán J.D.R. Brain-Computer Interfaces. Elsevier; Amsterdam, The Netherlands: 2020. [Google Scholar]
- 2.Allison B.Z., Dunne S., Leeb R., Millán J.D.R., Nijholt A. Towards Practical Brain-Computer Interfaces: Bridging the Gap from Research to Real-World Applications. Springer; Berlin/Heidelberg, Germany: 2012. [Google Scholar]
- 3.Mason S.G., Birch G.E. A general framework for brain-computer interface design. IEEE Trans. Neural Syst. Rehabil. Eng. 2003;11:70–85. doi: 10.1109/TNSRE.2003.810426. [DOI] [PubMed] [Google Scholar]
- 4.Kawala-Sterniuk A., Browarska N., Al-Bakri A., Pelc M., Zygarlicki J., Sidikova M., Martinek R., Gorzelanczyk E.J. Summary of over Fifty Years with Brain-Computer Interfaces—A Review. Brain Sci. 2021;11:43. doi: 10.3390/brainsci11010043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kübler A. The history of BCI: From a vision for the future to real support for personhood in people with locked-in syndrome. Neuroethics. 2019;13:163–180. doi: 10.1007/s12152-019-09409-4. [DOI] [Google Scholar]
- 6.Bamdad M., Zarshenas H., Auais M.A. Application of BCI systems in neurorehabilitation: A scoping review. Disabil. Rehabilitation Assist. Technol. 2015;10:355–364. doi: 10.3109/17483107.2014.961569. [DOI] [PubMed] [Google Scholar]
- 7.Kingwell K. Neurally controlled robotic arm enables tetraplegic patient to drink coffee of her own volition. Nat. Rev. Neurol. 2012;8:353. doi: 10.1038/nrneurol.2012.101. [DOI] [PubMed] [Google Scholar]
- 8.Ethier C., Oby E.R., Bauman M.J., Miller L.E. Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature. 2012;485:368–371. doi: 10.1038/nature10987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Hochberg L.R., Bacher D., Jarosiewicz B., Masse N.Y., Simeral J.D., Vogel J., Haddadin S., Liu J., Cash S.S., Van Der Smagt P., et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature. 2012;485:372–375. doi: 10.1038/nature11076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ajiboye A.B., Willett F.R., Young D.R., Memberg W.D., Murphy B.A., Miller J.P., Walter B.L., Sweet J., Hoyen H.A., Keith M.W., et al. Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: A proof-of-concept demonstration. Lancet. 2017;389:1821–1830. doi: 10.1016/S0140-6736(17)30601-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Weyand S., Schudlo L., Takehara-Nishiuchi K., Chau T. Usability and performance-informed selection of personalized mental tasks for an online near-infrared spectroscopy brain-computer interface. Neurophotonics. 2015;2:025001. doi: 10.1117/1.NPh.2.2.025001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.McConnell A., Moioli R., Brasil F., Vallejo M., Corne D., Vargas P., Stokes A. Robotic devices and brain-machine interfaces for hand rehabilitation post-stroke. J. Rehabil. Med. 2017;49:449–460. doi: 10.2340/16501977-2229. [DOI] [PubMed] [Google Scholar]
- 13.Bormane D.S., Patil S.T., Ingole D.T., Mahajan A. High performance EEG analysis for brain interface; Proceedings of the 13th International Conference on Biomedical Engineering; Singapore. 3–6 December 2008; pp. 69–72. [Google Scholar]
- 14.Arvaneh M., Guan C., Ang K.K., Quek C. Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI. IEEE Trans. Biomed. Eng. 2011;58:1865–1873. doi: 10.1109/TBME.2011.2131142. [DOI] [PubMed] [Google Scholar]
- 15.Weyand S., Takehara-Nishiuchi K., Chau T. Exploring Methodological Frameworks for A Mental Task-Based Near-Infrared Spectroscopy Brain-Computer Interface. J. Neurosci. Methods. 2015;254:36–45. doi: 10.1016/j.jneumeth.2015.07.007. [DOI] [PubMed] [Google Scholar]
- 16.Mastakouri A.A., Weichwald S., Özdenizci O., Meyer T., Schölkopf B., Grosse-Wentrup M. Personalized brain-computer interface models for motor rehabilitation; Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC); Banff, AB, Canada. 5–8 October 2017; pp. 3024–3029. [Google Scholar]
- 17.Qi W., Aliverti A. A Multimodal Wearable System for Continuous and Real-Time Breathing Pattern Monitoring During Daily Activity. IEEE J. Biomed. Health Inform. 2019;24:2199–2207. doi: 10.1109/JBHI.2019.2963048. [DOI] [PubMed] [Google Scholar]
- 18.Lotte F., Congedo M., Lécuyer A., Lamarche F., Arnaldi B. A review of classification algorithms for EEG-based brain–computer interfaces. J. Neural Eng. 2007;4:R1. doi: 10.1088/1741-2560/4/2/R01. [DOI] [PubMed] [Google Scholar]
- 19.Astigarraga A., Arruti A., Muguerza J., Santana R., Martin J.I., Sierra B. User adapted motor-imaginary brain-computer interface by means of EEG channel selection based on estimation of distributed algorithms. Math. Probl. Eng. 2016;2016:1435321. doi: 10.1155/2016/1435321. [DOI] [Google Scholar]
- 20.Yun-Fa F., Yue-Chao W., Hong-Yi L., Bao-Lei X., Yong-Cheng L. Direct brain-controlled robot interface technology. Acta Autom. Sin. 2012;38:1229–1246. [Google Scholar]
- 21.Aswinseshadri K. Evaluation of feature selection in Brain Computer Interface; Proceedings of the 2nd International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB); Chennai, India. 27–28 February 2016; pp. 93–97. [Google Scholar]
- 22.Li Y., Koike Y., Sugiyama M. A Framework of Adaptive Brain Computer Interfaces; Proceedings of the International Conference on Biomedical Engineering & Informatics; Tianjin, China. 17–19 October 2009. [Google Scholar]
- 23.Stieglitz T., Rubehn B., Henle C., Kisban S., Herwik S., Ruther P., Schuettler M. Brain–computer interfaces: An overview of the hardware to record neural signals from the cortex. Prog. Brain Res. 2009;175:297–315. doi: 10.1016/s0079-6123(09)17521-0. [DOI] [PubMed] [Google Scholar]
- 24.Dangi S., Gowda S., Heliot R., Carmena J.M. Adaptive Kalman filtering for closed-loop Brain-Machine Interface systems; Proceedings of the 5th International IEEE/EMBS Conference on Neural Engineering; Cancun, Mexico. 27 April–1 May 2011; pp. 609–612. [DOI] [Google Scholar]
- 25.Rejer I., Górski P. Independent Component Analysis for EEG data preprocessing-algorithms comparison; Proceedings of the IFIP International Conference on Computer Information Systems and Industrial Management; Krakow, Poland. 25–27 September 2013; pp. 108–119. [Google Scholar]
- 26.Shin H., Chung W. Brain computer interface approach using sensor covariance matrix with forced whitening; Proceedings of the 2017 5th International Winter Conference on Brain-Computer Interface (BCI); Gangwon, Korea. 9–11 January 2017; pp. 66–68. [Google Scholar]
- 27.Sun H., Zhang L., Li J., Zhao Q. Advances in Cognitive Neurodynamics (II) Springer; Dordrecht, The Netherlands: 2011. EEG Based Brain-Computer Interface System for Remote Vehicle Controlling; pp. 695–699. [Google Scholar]
- 28.Chen X., Li C., Liu A., McKeown M.J., Qian R., Wang Z.J. Toward Open-World Electroencephalogram Decoding Via Deep Learning: A comprehensive survey. IEEE Signal Process. Mag. 2022;39:117–134. doi: 10.1109/MSP.2021.3134629. [DOI] [Google Scholar]
- 29.Naseer N., Hong K.-S. fNIRS-based brain-computer interfaces: A review. Front. Hum. Neurosci. 2015;9:3. doi: 10.3389/fnhum.2015.00003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lyu X., Ding P., Li S., Dong Y., Su L., Zhao L., Gong A., Fu Y. Human factors engineering of BCI: An evaluation for satisfaction of BCI based on motor imagery. Cogn. Neurodyn. 2022 doi: 10.1007/s11571-022-09808-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Wang J.G., Shao H.M., Yao Y., Liu J.L., Ma S.W. A Personalized Feature Extraction and Classification Method for Motor Imagery Recognition. Mob. Netw. Appl. 2021;26:1359–1371. doi: 10.1007/s11036-021-01754-0. [DOI] [Google Scholar]
- 32.Hamburg M.A., Collins F.S. The path to personalized medicine. New Engl. J. Med. 2010;363:301–304. doi: 10.1056/NEJMp1006304. [DOI] [PubMed] [Google Scholar]
- 33.Yeo S.N., Lee T.S., Sng W.T., Heo M.Q., Bautista D., Cheung Y.B., Zhang H.H., Wang C., Chin Z.Y., Feng L., et al. Effectiveness of a Personalized Brain-Computer Interface System for Cognitive Training in Healthy Elderly: A Randomized Controlled Trial. J. Alzheimer’s Dis. 2018;66:127–138. doi: 10.3233/JAD-180450. [DOI] [PubMed] [Google Scholar]
- 34.Kuzovkin I., Tretyakov K., Uusberg A., Vicente R. Mental state space visualization for interactive modeling of personalized BCI control strategies. J. Neural Eng. 2020;17:016059. doi: 10.1088/1741-2552/ab6d0b. [DOI] [PubMed] [Google Scholar]
- 35.Rodríguez-Ugarte M., Iáñez E., Ortíz M., Azorín J.M. Personalized offline and pseudo-online BCI models to detect pedaling intent. Front. Neuroinformatic. 2017;11:45. doi: 10.3389/fninf.2017.00045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kalaganis F.P., Laskaris N.A., Chatzilari E., Nikolopoulos S., Kompatsiaris I. A Data Augmentation Scheme for Geometric Deep Learning in Personalized Brain–Computer Interfaces. IEEE Access. 2020;8:162218–162229. doi: 10.1109/ACCESS.2020.3021580. [DOI] [Google Scholar]
- 37.Bashashati H., Ward R.K., Bashashati A. User-customized brain computer interfaces using Bayesian optimiza-tion. J. Neural Eng. 2016;13:026001. doi: 10.1088/1741-2560/13/2/026001. [DOI] [PubMed] [Google Scholar]
- 38.Jia C., Gao X., Hong B., Gao S. Frequency and Phase Mixed Coding in SSVEP-Based Brain—Computer Interface. IEEE Trans. Biomed. Eng. 2010;58:200–206. doi: 10.1109/tbme.2010.2068571. [DOI] [PubMed] [Google Scholar]
- 39.Tanji Y., Nakanishi M., Suefusa K., Tanaka T. Waveform-Based Multi-Stimulus Coding for Brain-Computer Interfaces Based on Steady-State Visual Evoked Potentials; Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); Calgary, AB, Canada. 15–20 April 2018; pp. 821–825. [DOI] [Google Scholar]
- 40.Abiri R., Borhani S., Sellers E.W., Jiang Y., Zhao X. A comprehensive review of EEG-based brain–computer interface paradigms. J. Neural Eng. 2018;16:011001. doi: 10.1088/1741-2552/aaf12e. [DOI] [PubMed] [Google Scholar]
- 41.Rezeika A., Benda M., Stawicki P., Gembler F., Saboor A., Volosyak I. Brain–Computer Interface Spellers: A Review. Brain Sci. 2018;8:57. doi: 10.3390/brainsci8040057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kaski S., Joutsiniemi S.L. Monitoring EEG signal with the self-organizing map; Proceedings of the International Conference on Artificial Neural Networks; San Francisco, CA, USA. 28 March–1 April 1993; pp. 974–977. [Google Scholar]
- 43.Uma M., Sheela T. Analysis of Collaborative Brain Computer Interface (BCI) based Personalized GUI for Differently Abled. Intell. Autom. Soft Comput. 2018;24:747–757. doi: 10.1080/10798587.2017.1332804. [DOI] [Google Scholar]
- 44.Wu X., Zheng L., Jiang L., Huang X., Liu Y., Xing L., Xing X., Wang Y., Pei W., Yang X., et al. A Dry Electrode Cap and Its Application in a Steady-State Visual Evoked Potential-Based Brain–Computer Interface. Electronics. 2019;8:1080. doi: 10.3390/electronics8101080. [DOI] [Google Scholar]
- 45.Volosyak I., Valbuena D., Malechka T., Peuscher J., Gräser A. Brain–computer interface using water-based elec-trodes. J. Neural Eng. 2010;7:066007. doi: 10.1088/1741-2560/7/6/066007. [DOI] [PubMed] [Google Scholar]
- 46.Wu S.-L., Liao L.-D., Liou C.-H., Chen S.-A., Ko L.-W., Chen B.-W., Wang P.-S., Chen S.-F., Lin C.-T. Design of the multi-channel electroencephalography-based brain-computer interface with novel dry sensors. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2012;2012:1793–1797. doi: 10.1109/embc.2012.6346298. [DOI] [PubMed] [Google Scholar]
- 47.Nicolaou N., Georgiou J. Special Session on Brain-computer Interfaces and Brain Stimulation for Neurorehabilitation. Volume 2. SCITEPRESS; Setúbal, Portugal: 2013. Monitoring Depth of Hypnosis under Propofol General Anaesthesia-Granger Causality and Hidden Markov Models; pp. 256–261. [Google Scholar]
- 48.Lee M., Yoon J.-G., Lee S.-W. Predicting Motor Imagery Performance from Resting-State EEG Using Dynamic Causal Modeling. Front. Hum. Neurosci. 2020;14:321. doi: 10.3389/fnhum.2020.00321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Lopes-Dias C., Sburlea A.I., Müller-Putz G.R. A generic error-related potential classifier offers a comparable performance to a personalized classifier; Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC); Montreal, QC, Canada. 20–24 July 2020; pp. 2995–2998. [DOI] [PubMed] [Google Scholar]
- 50.Abarbanel A. Gates, states, rhythms, and resonances: The scientific basis of neurofeedback training. J. Neurother. 1995;1:15–38. doi: 10.1300/J184v01n02_02. [DOI] [Google Scholar]
- 51.Omejc N., Rojc B., Battaglini P.P., Marusic U. Review of the therapeutic neurofeedback method using electroencephalography: EEG Neurofeedback. Bosn. J. Basic Med. Sci. 2019;19:213. doi: 10.17305/bjbms.2018.3785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Martin S., Armstrong E., Thomson E., Vargiu E., Solà M., Dauwalder S., Miralles F., Daly Lynn J. A qualitative study adopting a user-centered approach to design and validate a brain computer interface for cognitive rehabilitation for people with brain injury. Assist. Technol. 2018;30:233–241. doi: 10.1080/10400435.2017.1317675. [DOI] [PubMed] [Google Scholar]
- 53.Liberati G., Pizzimenti A., Simione L., Riccio A., Schettini F., Inghilleri M., Mattia D., Cincotti F. Developing brain-computer interfaces from a user-centered perspective: Assessing the needs of persons with amyotrophic lateral sclerosis, caregivers, and professionals. Appl. Ergon. 2015;50:139–146. doi: 10.1016/j.apergo.2015.03.012. [DOI] [PubMed] [Google Scholar]
- 54.Lu X., Ding P., Li S., Gong A., Zhao L., Qian Q., Su L., Fu Y. Human factors engineering of brain-computer interface and its applications: Human-centered brain-computer interface design and evaluation methodology. J. Biomed. Eng. 2021;38:210–223. doi: 10.7507/1001-5515.202101093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Chan S., Chan A. The validity and applicability of the Chinese version of the quebec user evaluation of satisfaction with assistive technology for people with spinal cord injury. Assist. Technol. 2006;18:25–33. doi: 10.1080/10400435.2006.10131904. [DOI] [PubMed] [Google Scholar]
- 56.Colucci M., Tofani M., Trioschi D., Guarino D., Berardi A., Galeoto G. Reliability and validity of the Italian version of Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 (QUEST-IT 2.0) with users of mobility assistive device. Disabil. Rehabil. Assist. Technol. 2019;16:251–254. doi: 10.1080/17483107.2019.1668975. [DOI] [PubMed] [Google Scholar]
- 57.Arjona C., Pentácolo J., Gareis I., Atum Y., Gentiletti G., Acevedo R., Rufiner H.L. Evaluation of LDA Ensembles Classifiers for Brain Computer Interface. J. Physics: Conf. Ser. 2011;332:012025. doi: 10.1088/1742-6596/332/1/012025. [DOI] [Google Scholar]
- 58.Kübler A., Holz E.M., Riccio A., Zickler C., Kaufmann T., Kleih S.C., Staiger-Sälzer P., Desideri L., Hoogerwerf E.J., Mattia D. The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications. PLoS ONE. 2014;9:e112392. doi: 10.1371/journal.pone.0112392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Zickler C., Riccio A., Leotta F., Hillian-Tress S., Halder S., Holz E., Staiger-Sälzer P., Hoogerwerf E.-J., Desideri L., Mattia D., et al. A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software. Clin. EEG Neurosci. 2011;42:236–244. doi: 10.1177/155005941104200409. [DOI] [PubMed] [Google Scholar]
- 60.Abiri R., Zhao X., Heise G., Jiang Y., Abiri F. Brain computer interface for gesture control of a social robot: An offline study; Proceedings of the 2017 Iranian Conference on Electrical Engineering (ICEE); Tehran, Iran. 2–4 May 2017; pp. 113–117. [Google Scholar]
- 61.Coscia M., Wessel M.J., Chaudary U., Millan J.D.R., Micera S., Guggisberg A., Vuadens P., Donoghue J., Birbaumer N., Hummel F.C. Neurotechnology-aided interventions for upper limb motor rehabilitation in severe chronic stroke. Brain. 2019;142:2182–2197. doi: 10.1093/brain/awz181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Vinoj P.G., Jacob S., Menon V.G., Rajesh S., Khosravi M.R. Brain-Controlled Adaptive Lower Limb Exoskeleton for Rehabilitation of Post-Stroke Paralyzed. IEEE Access. 2019;7:132628–132648. doi: 10.1109/ACCESS.2019.2921375. [DOI] [Google Scholar]
- 63.Bronte-Stewart H.M., Petrucci M.N., O’Day J.J., Afzal M.F., Parker J.E., Kehnemouyi Y.M., Wilkins K.B., Orthlieb G.C., Hoffman S.L. Perspective: Evolution of control variables and policies for closed-loop deep brain stimulation for Parkinson’s disease using bidirectional deep-brain-computer interfaces. Front. Hum. Neurosci. 2020;14:353. doi: 10.3389/fnhum.2020.00353. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Kübler A., Kleih S., Mattia D. Brain Computer Interfaces for Cognitive Rehabilitation After Stroke. Springer; Berlin/Heidelberg, Germany: 2017. [Google Scholar]
- 65.Mane R., Chew E., Phua K.S., Ang K.K., Robinson N., Vinod A.P., Guan C. Prognostic and monitory EEG-biomarkers for BCI upper-limb stroke rehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng. 2019;27:1654–1664. doi: 10.1109/TNSRE.2019.2924742. [DOI] [PubMed] [Google Scholar]
- 66.Parastarfeizabadi M., Kouzani A.Z. Advances in closed-loop deep brain stimulation devices. J. Neuroeng. Rehabilitation. 2017;14:79. doi: 10.1186/s12984-017-0295-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Campanella S. Why it is time to develop the use of cognitive event-related potentials in the treatment of psychiatric diseases. Neuropsychiatr. Dis. Treat. 2013;9:1835–1845. doi: 10.2147/NDT.S53687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.He Z., Li Z., Yang F., Wang L., Li J., Zhou C., Pan J. Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces. Brain Sci. 2020;10:687. doi: 10.3390/brainsci10100687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Daly I., Williams D., Malik A., Weaver J., Kirke A., Hwang F., Miranda E., Nasuto S.J. Personalised, multi-modal, affective state detection for hybrid brain-computer music interfacing. IEEE Trans. Affect. Comput. 2018;11:111–124. doi: 10.1109/TAFFC.2018.2801811. [DOI] [Google Scholar]
- 70.Abiri R., Borhani S., Kilmarx J., Esterwood C., Jiang Y., Zhao X. A Usability Study of Low-Cost Wireless Brain-Computer Interface for Cursor Control Using Online Linear Model. IEEE Trans. Human-Machine Syst. 2020;50:287–297. doi: 10.1109/THMS.2020.2983848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Colucci A., Vermehren M., Cavallo A., Angerhöfer C., Peekhaus N., Zollo L., Kim W.-S., Paik N.-J., Soekadar S.R. Brain–Computer Interface-Controlled Exoskeletons in Clinical Neurorehabilitation: Ready or Not? Neurorehabilit. Neural Repair. 2022;36:747–756. doi: 10.1177/15459683221138751. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Cuomo G., Maglianella V., Ghooshchy S.G., Zoccolotti P., Martelli M., Paolucci S., Morone G., Iosa M. Motor imagery and gait control in Parkinson’s disease: Techniques and new perspectives in neurorehabilitation. Expert Rev. Neurother. 2021;22:43–51. doi: 10.1080/14737175.2022.2018301. [DOI] [PubMed] [Google Scholar]
- 73.Paggiaro A., Birbaumer N., Cavinato M., Turco C., Formaggio E., Del Felice A., Masiero S., Piccione F. Magnetoencephalography in Stroke Recovery and Rehabilitation. Front. Neurol. 2016;7:35. doi: 10.3389/fneur.2016.00035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Habelt B., Wirth C., Afanasenkau D., Mihaylova L., Winter C., Arvaneh M., Minev I.R., Bernhardt N. A multimodal neuroprosthetic interface to record, modulate and classify electrophysiological correlates of cognitive function. bioRxiv. 2021:bioRxiv 2021.07.29.454271. doi: 10.3389/fbioe.2021.770274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Boggio P.S., Rigonatti S.P., Ribeiro R.B., Myczkowski M.L., Nitsche M.A., Pascual-Leone A., Fregni F. A randomized, double-blind clinical trial on the efficacy of cortical direct current stimulation for the treatment of major depression. Int. J. Neuropsychopharmacol. 2008;11:249–254. doi: 10.1017/S1461145707007833. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Gomes J., Trevizol A., Ducos D., Gadelha A., Ortiz B., Fonseca A., Akiba H., Azevedo C., Guimaraes L., Shiozawa P., et al. Effects of transcranial direct current stimulation on working memory and negative symptoms in schizophrenia: A phase II randomized sham-controlled trial. Schizophr. Res. Cogn. 2018;12:20–28. doi: 10.1016/j.scog.2018.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Knight R.T., Staines W.R., Swick D., Chao L.L. Prefrontal cortex regulates inhibition and excitation in distributed neural networks. Acta Psychol. 1999;101:159–178. doi: 10.1016/S0001-6918(99)00004-9. [DOI] [PubMed] [Google Scholar]
- 78.Ehlers C.L., Desikan A., Wills D.N. Event-related potential responses to the acute and chronic effects of alcohol in adolescent and adult Wistar rats. Alcohol. Clin. Exp. Res. 2014;38:749–759. doi: 10.1111/acer.12299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Marco J., Fuentemilla L., Grau C. Auditory sensory gating deficit in abstinent chronic alcoholics. Neurosci. Lett. 2005;375:174–177. doi: 10.1016/j.neulet.2004.11.017. [DOI] [PubMed] [Google Scholar]
- 80.Fellous J.-M., Sapiro G., Rossi A., Mayberg H., Ferrante M. Explainable Artificial Intelligence for Neuroscience: Behavioral Neurostimulation. Front. Neurosci. 2019;13:1346. doi: 10.3389/fnins.2019.01346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Ehlers C. ERP responses to ethanol and diazepam administration in squirrel monkeys. Alcohol. 1988;5:315–320. doi: 10.1016/0741-8329(88)90072-9. [DOI] [PubMed] [Google Scholar]
- 82.Cohen H.L., Ji J., Chorlian D.B., Begleiter H., Porjesz B. Alcohol-related ERP Changes Recorded from Different Modalities: A Topographic Analysis. Alcohol. Clin. Exp. Res. 2002;26:303–317. doi: 10.1111/j.1530-0277.2002.tb02539.x. [DOI] [PubMed] [Google Scholar]
- 83.Thieme A., Belgrave D., Doherty G. Machine Learning in Mental Health. ACM Trans. Comput. Interact. 2020;27:1–53. doi: 10.1145/3398069. [DOI] [Google Scholar]
- 84.Yan W., Liu X., Shan B., Zhang X., Pu Y. Research on the Emotions Based on Brain-Computer Technology: A Bibliometric Analysis and Research Agenda. Front. Psychol. 2021;12:4995. doi: 10.3389/fpsyg.2021.771591. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Gilleade K., Dix A., Allanson J. Affective videogames and modes of affective gaming: Assist me, challenge me, emote me; Proceedings of the International Conference on Changing Views; Vancouver, BC, Canada. 16–20 June 2005. [Google Scholar]
- 86.Daly I., Malik A., Weaver J., Hwang F., Nasuto S.J., Williams D., Kirke A., Miranda E. Identifying music-induced emotions from EEG for use in brain-computer music interfacing; Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII); Xi’an, China. 21–24 September 2015; pp. 923–929. [Google Scholar]
- 87.Williams D., Kirke A., Miranda E.R., Roesch E., Daly I., Nasuto S. Investigating affect in algorithmic composition systems. Psychol. Music. 2014;43:831–854. doi: 10.1177/0305735614543282. [DOI] [Google Scholar]
- 88.Delisle-Rodriguez D., Cardoso V., Gurve D., Loterio F., Romero-Laiseca M.A., Krishnan S., Bastos-Filho T. System based on subject-specific bands to recognize pedaling motor imagery: Towards a BCI for lower-limb rehabilitation. J. Neural Eng. 2019;16:056005. doi: 10.1088/1741-2552/ab08c8. [DOI] [PubMed] [Google Scholar]
- 89.Wu F., Gong A., Li H., Zhao L., Zhang W., Fu Y. A new subject-specific discriminative and multi-scale filter bank tangent space mapping method for recognition of multiclass motor imagery. Front. Hum. Neurosci. 2021;15:595723. doi: 10.3389/fnhum.2021.595723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Kumar S., Sharma A., Tsunoda T. Subject-specific-frequency-band for motor imagery eeg signal recognition based on common spatial spectral pattern; Proceedings of the Pacific Rim International Conference on Artificial Intelligence, Cuvu; Yanuka Island, Fiji. 26–30 August 2019; pp. 712–722. [Google Scholar]
- 91.Gaur P., McCreadie K., Pachori R.B., Wang H., Prasad G. An automatic subject specific channel selection method for enhancing motor imagery classification in EEG-BCI using correlation. Biomed. Signal Process. Control. 2021;68:102574. doi: 10.1016/j.bspc.2021.102574. [DOI] [Google Scholar]
- 92.Sellers E.W., Krusienski D.J., McFarland D.J., Vaughan T.M., Wolpaw J.R. A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance. Biol. Psychol. 2006;73:242–252. doi: 10.1016/j.biopsycho.2006.04.007. [DOI] [PubMed] [Google Scholar]
- 93.Erdogan B., Gencer N.G. Application of wiener deconvolution model in p300 spelling paradigm; Proceedings of the 2009 14th National Biomedical Engineering Meeting; Izmir, Turkey. 20–22 May 2009; pp. 1–4. [Google Scholar]
- 94.Wang H., Pei Z., Xu L., Xu T., Bezerianos A., Sun Y., Li J. Performance enhancement of P300 detection by multiscale-CNN. IEEE Trans. Instrum. Meas. 2021;70:1–12. doi: 10.1109/TIM.2021.3067943. [DOI] [Google Scholar]
- 95.Li M., Lin F., Xu G. A TrAdaBoost Method for Detecting Multiple Subjects’ N200 and P300 Potentials Based on Cross-Validation and an Adaptive Threshold. Int. J. Neural Syst. 2020;30:2050009. doi: 10.1142/S0129065720500094. [DOI] [PubMed] [Google Scholar]
- 96.Ravi A., Pearce S., Zhang X., Jiang N. User-specific channel selection method to improve SSVEP BCI decoding robustness against variable inter-stimulus distance; Proceedings of the 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER); San Francisco, CA, USA. 20–23 March 2019; pp. 283–286. [Google Scholar]
- 97.Rejer I. Wavelet transform in detection of the subject specific frequencies for SSVEP-based BCI; Proceedings of the International Multi-Conference on Advanced Computer Systems; Miedzyzdroje, Poland. 19–21 October 2016; pp. 146–155. [Google Scholar]
- 98.Mehdizavareh M.H., Hemati S., Soltanian-Zadeh H. Enhancing performance of subject-specific models via subject-independent information for SSVEP-based BCIs. PLoS ONE. 2020;15:e0226048. doi: 10.1371/journal.pone.0226048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Peters B., Higger M., Quivira F., Bedrick S., Dudy S., Eddy B., Kinsella M., Memmott T., Wiedrick J., Fried-Oken M., et al. Effects of simulated visual acuity and ocular motility impairments on SSVEP brain-computer interface performance: An experiment with Shuffle Speller. Brain-Comput. Interfaces. 2018;5:58–72. doi: 10.1080/2326263X.2018.1504662. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Hsu C.-C., Yeh C.-L., Lee W.-K., Hsu H.-T., Shyu K.-K., Li L.P.-H., Wu T.-Y., Lee P.-L. Extraction of high-frequency SSVEP for BCI control using iterative filtering based empirical mode decomposition. Biomed. Signal Process. Control. 2020;61:102022. doi: 10.1016/j.bspc.2020.102022. [DOI] [Google Scholar]
- 101.Yu X., Qi W. A user study of wearable EEG headset products for emotion analysis; Proceedings of the 2018 International Conference on Algorithms, Computing and Artificial Intelligence; Sanya, China. 21 December 2018; pp. 1–7. [Google Scholar]
- 102.Qi W., Ovur S.E., Li Z., Marzullo A., Song R. Multi-sensor guided hand gesture recognition for a teleoperated robot using a recurrent neural network. IEEE Robot. Autom. Lett. 2021;6:6039–6045. doi: 10.1109/LRA.2021.3089999. [DOI] [Google Scholar]
- 103.Borton D., Micera S., Millán J.D.R., Courtine G. Personalized neuroprosthetics. Sci. Transl. Med. 2013;5:210rv2. doi: 10.1126/scitranslmed.3005968. [DOI] [PubMed] [Google Scholar]
- 104.Chi X., Wan C., Wang C., Zhang Y., Chen X., Cui H. A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential. IEEE Trans. Neural Syst. Rehabil. Eng. 2022;30:1525–1535. doi: 10.1109/TNSRE.2022.3179971. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.