Abstract
People attach greater importance to the physical health of teenagers because adolescence is a critical period for the healthy development of the human body. With the progress of biosensing technologies and artificial intelligence, it is feasible to apply wearable devices to continuously record teenagers’ physiological signals and make analyses based on modern advanced methods. To solve the challenge that traditional methods of monitoring teenagers’ physical fitness lack accurate computational models and in-depth data analyses, we propose a novel evaluation model for predicting the physical fitness of teenagers. First, we collected 1024 teenagers’ PPGs under the guidance of the proposed three-stage running paradigm. Next, we applied the median filter and wavelet transform to denoise the original signals and obtain HR and SpO2. Then, we used the Pearson correlation coefficient method to finalize the feature set, based on the extracted nine physical features. Finally, we built a 1D-CNN with LSTM model to classify teenagers’ physical fitness condition into four levels: excellent, good, medium, and poor, with an accuracy of 98.27% for boys’ physical fitness prediction, and 99.26% for girls’ physical fitness prediction. The experimental results provide evidence supporting the feasibility of predicting teenagers’ physical fitness levels by their running PPG recordings.
Keywords: teenager physical fitness monitoring, wearable bracelets, noninvasive biosensors, wireless biosensors, Photoplethysmography (PPG), Pearson correlation coefficient (PCC), deep learning, Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM)
1. Introduction
People are attaching greater importance to personal health monitoring, especially in the context of the global COVID-19 pandemic background [1]. With the development of modern technologies, Artificial Intelligence (AI) is widely implemented in Healthcare 4.0 for producing early and accurate results [2]. The Internet of Things (IoT) is working as a catalyst to enhance the power of AI applications in human healthcare [3,4,5]. Increasing attention is being paid to the physical fitness of teenagers because adolescence is a crucial period of physical and health development, from the aspect of the whole life cycle [6]. The physical fitness condition of teenagers correlates not only to the happiness of their families, but also the future of the country and the nation. Researchers in the field of healthcare, psychology, and education should make a great effort to study teenagers’ physical fitness to give them a healthier and brighter future.
Referring to ‘The Second National Physical Fitness Monitoring Report’ published by the State Sports General Administration of China, the physical fitness condition of Chinese teenagers has been declining continuously since 1985 [7]. Nowadays, teenagers are spending more time on their smartphones and computers and are less likely to go out for exercise, leading to a decline in their physical health [8,9,10]. In addition to strengthening teenagers’ physical exercise, from the aspect of the teenagers themselves, governments and researchers should study the mechanisms for physical fitness evaluation to get the physical health of teenagers under control. For example, the ‘National Students’ Physical Health Standard’, published in 2014, requires all schools in China to carry out regular physical fitness tests for students of all grades, from primary school to college. Regular monitoring can indeed contribute to a better understanding of adolescent health, but it is not convenient enough.
With the rapid development of biosensors and biosensing technologies, people have more convenient and flexible means to monitor health conditions, for example, wireless and noninvasive signal collecting biosensors, such as bracelets and brain rings [11,12,13,14,15]. Smart wearable wireless biosensors, based on IoT framework, make it feasible to collect continuous physiological recordings in neural scenarios, such as sports, games, and classrooms [16,17,18,19,20]. Li Xiaoqing proposes an IoT platform for smart maternal healthcare services with wearable devices and cloud computing, and the key technologies, which can mitigate the workload of medical staff, increase work efficiency, facilitate pregnant women going to doctors, and improve the quality of obstetrical treatment [21]. Marian Ion creates a wearable flexible pressure sensor that could be integrated into a clinically approved blood pressure monitoring device for healthcare purposes [22]. In Takafumi’s research, they monitored health and diagnosed disease in the early stage with the help of a wrist flexible heart pulse sensor, integrated with a soft pump and a pneumatic balloon membrane [23]. We can apply wearable devices like smart bracelets to continuously record teenagers’ physiological signals and analyze their physical fitness condition with the aid of modern advanced methods.
There is a trend whereby the methodology of data mining transforms gradually from simple statistical means and conventional machine learning methods to deep learning algorithms. Ling Chen applied the Statistical Program for Social Sciences (SPSS) to study teenager physical health-promoting strategies in 2014 [24]. Crouter’s team applied conventional receiver operating characteristic (ROC) curves and regression analyses in 2015 to develop prediction equations for energy expenditure, to develop and validate methods for analyzing wrist accelerometer data in youth [25]. While, in recent years, the deep learning method has been much more popular with researchers for its powerful data analysis skills. According to Bolhasani reviews, deep learning is the most popular topic having a wide range of applications, such as computer vision, natural language processing, disease prediction, drug discovery, bioinformatics, biomedicine, etc. [26]. Of these applications, healthcare and medical science-related applications are dramatically on the rise. In Dang’s research, they developed an end-to-end framework which is based on physical features embedded in raw data and a 1D-CNN-LSTM model for smart structural health monitoring purposes [27]. Focusing on obesity problems in adolescents, Lee Sungchul’s team used feedforward deep learning models and CNN models to distinguish walking movements between nonobese and obese groups, at a rate of 90.5% [28]. The deep learning method can analyze the huge and complicated physical health data of teenagers more efficiently and quickly. However, at present, research on the analyses of the physical health of ordinary teenagers is still relatively lacking.
Taken together, researchers have made great efforts in the field of health monitoring of teenagers, and research methods are transforming gradually from traditional artificial statistics to computer sciences. However, experts and scholars have focused more on the healthcare of patients than on the physical development of normal adolescents. Although deep learning algorithms are growing rapidly, there are few health monitoring models for the average teenager. In order to monitor the physical health fitness condition of normal teenagers and help their teachers, families, and themselves know better about adolescents’ health, in the present research, we collected one thousand and twenty-four fourteen-year-old middle school students’ photoplethysmography signals under the guidance of our proposed three-stage running experiment paradigm. Then we applied the median filter and wavelet transform to denoise the original signals to make signals available to obtain heart rate and blood oxygen saturation. We used the Pearson correlation coefficient method to finalize the feature set based on our extracted nine physical features. Finally, we built a 1D-CNN with LSTM model to classify teenagers’ physical fitness condition into four levels: excellent, good, medium, and poor.
We organized the remainder of the paper as follows. Section 2 introduces materials and methods, including the framework system (Section 2.1), the experimental paradigm (Section 2.2), and participants’ composition (Section 2.3). We also introduce the methods of preprocessing the original physiological signals (Section 2.4), extracting key features (Section 2.5), and constructing evaluation models (Section 2.6). The finalized feature set (Section 3.1 and Section 3.2) and the evaluation metrics used to measure the performance of the proposed model (Section 3.3) are given in Section 3. Section 4 discusses the advantages and disadvantages of the proposed framework and presents the main contributions of the work. Finally, Section 5 concludes the paper.
2. Materials and Methods
2.1. System Framework
2.1.1. Self-Designed Smart Bracelet System
Our self-designed smart bracelet system is applied to achieve a bulk transmission of PPG recordings from the smart bracelets to the personal computer (PC), as displayed in Figure 1. The embedded sensors in the smart bracelets we designed collect PPG voltage value recordings 25 times per second. The effective operation of the whole system is shown below.
-
(1)
Enable wireless connection. Bracelets keep on, and connect with, the Bluetooth-WiFi router via embedded Bluetooth modules wirelessly. Personal computers connect with the router through WiFi to ensure that the bracelets, the router, and the PC are all in the same WiFi environment.
-
(2)
Data upload cloud. PPGs can be bulk transmitted automatically to the cloud database via Bluetooth.
-
(3)
Gain data. If the PC sends a request to the cloud database to obtain the data stored there, we receive original signals collected by all used bracelets locally.
In this research, we first collected teenagers’ PPG recordings with the aid of smart bracelets and then applied the self-designed system to transmit the PPGs to computers for further analyses.
2.1.2. Framework of the Proposed Evaluation System
To classify teenagers’ physical fitness condition into four levels, categorized as excellent, good, medium, and poor, we analyzed their physiological recordings, and we developed the framework of teenager physical fitness evaluation system shown in Figure 2. Firstly, we recorded 1024 fourteen-year-old middle school students’ PPGs under the guidance of the designed experimental paradigm. Secondly, we applied an MF-WT method to preprocess the original PPGs to ensure that the signals were clean enough for further analyses. Then, we calculated HR and SpO2 from the preprocessed signals and extracted nine available features. We applied PCC to finalize the feature set. Finally, a 1D-CNN with LSTM evaluation model was developed to classify the teenagers’ physical fitness condition into four levels.
2.2. Experimental Paradigm
The principles of the experimental paradigm to collect effective PPGs can be summarized into the following three considerations:
-
(1)
The whole process should be based on the ‘National Students’ Physical Health Standard’ and the regular health test standard for teenage students, so that we can score students’ physical fitness condition with the aid of official principles, which will be used to guide us in labelling the running PPG features. Taking into account differences in muscle mass, respiratory development, and exercise duration between boys and girls during adolescence, the official documents state that boys run 1000 m, and girls run 800 m, so that the physical test can better monitor every person’s physical fitness. In this research, we evaluated boys’ and girls’ fitness conditions separately.
-
(2)
Our participants were all middle school students aged 14, so it required the testing procedures to be convenient and easy, so as to avoid students being unable to wear our smart bracelets comfortably, and to ensure that we could collect available PPGs.
-
(3)
The whole procedure ought to be scientific and complete so that we can extract as many vital physiological features as possible from the original signals.
According to the three aspects above, we designed the following experimental paradigm. Volunteers wore smart bracelets and did three-minute warm-up exercises before the official run. Then they were divided into two groups based on their gender, and the boys ran 1000 m while the girls ran 800 m, respectively. One experiment allowed attendance of ten students maximum. After running, students needed to have a rest to let their rapid breathing and heartbeats slow down until they recovered to normal fitness condition. The flowchart of the experimental paradigm is shown in Figure 3.
2.3. Volunteer Participants
One thousand and twenty-four middle school students (576 boys and 448 girls) volunteered to participate in the teenager fitness evaluation experiment. We required all students to have adequate sleep the night before the experiment and to be in good health. This research was conducted under China’s law, and all volunteers were informed that the biosensing recordings collected would only be used for the scientific study and would not be used for other purposes. We conducted the experiment with the subjects’ consent. The collected data was processed by means of anonymity, which guaranteed that the participants’ privacy would not be divulged.
2.4. Signal Preprocessing
Photoplethysmography (PPG) was first proposed in 1938 by Hertzman [29]. It is a non-invasive method to detect change of blood volume in living tissues, which requires the help of photoelectric means [29]. During movement, PPGs are highly susceptible to light in the environment, electromyography noise [30], and baseline drift [31]. The last two factors seriously interfere with the accuracy of heartbeat and blood pressure monitoring, which are both involved in the original PPGs collected during the experiment.
Baseline drift occurs because of noise with a frequency below 1 Hz caused by respiration and the relative friction between the human skin surface and the PPG sensor. The PPG signal with baseline drift is the superposition of the characteristic waveform and baseline drift signal. The baseline drift signal can be eliminated by appropriate filtering [32]. The median filter (MF) is a nonlinear digital filter technology, which can be applied to eliminate noise in images or other signals [33]. The design idea of MF is to check the sampling in the input signal and judge whether it represents the signal, which can be realized with the aid of the observation window composed of odd samples. The values in the observation window are sorted, and the median in the middle of the observation window is output. Then, the earliest value is discarded, a new sample obtained, and the above calculation process repeated.
Electromyography noise generates because of muscle tremors, which is also the main reason for motion artifacts [34]. Although the action time of muscle tremors is short, it can lead to wide frequency distribution similar to white noise in the frequency domain, which will affect the reliability of PPGs. Wavelet transform (WT) is a new transform analysis method, which can analyze the localization of time or space frequency, and gradually refine the signal or function through expansion and translation operation [35]. WT can achieve time subdivision at high frequency and frequency subdivision at low frequency, and can automatically adapt to the requirements of time-frequency signal analysis. WT protects useful signal spikes and abrupt signals. It is suitable for denoising the transient signal, as well as restraining the interference of high-frequency noise. The fundamental definition formula is as follows:
(1) |
α means scale and controls the scaling of the wavelet function, τ means translation and controls the migration of the wavelet function. Ψ (t) is the mother wavelet function.
2.5. Feature Engineering
Heart rate (HR) and blood oxygen saturation (SpO2) are two vital indexes extracted from preprocessed PPGs. The value of HR of healthy people is between 60 to 100, and the percentage of SpO2 is generally more than 94% [36]. The two indexes are applied to judge many vital functions of the human body. HR is one of the most important factors for monitoring the status of human hearts. As for SpO2, if the blood oxygen content of the human body is insufficient, it easily causes many complications, such as headaches. Real-time monitoring of HR and SpO2 helps people better know their health condition.
2.5.1. Feature Estimation
Direct current (DC) signals generate if no large-scale movement is in the human body because the light absorption of bones, muscles, and veins is unchanged. While alternating current (AC) signals are produced because light absorption naturally changes because of blood flow in the arteries. We applied Fast Fourier Transformation (FFT) to obtain HR from the original PPGs. We obtained the signal with a prominent amplitude near 1 Hz on the frequency spectrum. If the frequency is recorded as f, HR can be calculated as:
HR = f ∗ 60 (bpm). | (2) |
When we apply the photoplethysmography method to obtain SpO2, the skin of the human wrist is the transparent container containing hemoglobin. Both the red light with wavelength of 660 nm and the near-infrared light with wavelength of 940 nm are the incident light sources. We can measure light conduction intensity through the tissue bed to calculate SpO2. It provides a continuous non-invasive blood oxygen measuring instrument for the clinic. SpO2 and the relative light intensity of 660 nm and 940 nm on the photodetector have a linear relationship if the oxygen content in the blood changes. The calculation formula is:
(3) |
a and b are calibration constants:110 and 25, AC660 and DC660 mean the alternating and direct current generated in the human wrist tissue bed under red light with wavelength of 660 nm, AC940 and DC940 represent alternating and direct current generated under near-infrared light with wavelength of 940 nm.
2.5.2. Feature Extraction
To extract as many features which may relate to the physical fitness levels of teenagers as possible, we defined an initial feature set, including resting heart rate, heart rate descent rate, heart rate increase rate, maximum heart rate, heart rate reserve, mean blood oxygen saturation, standard deviation of blood oxygen saturation, instant heart rate, and time duration. The definitions are shown as follows:
-
(1)
Resting heart rate (HRrest) [37] refers to the number of heartbeats every minute when people are resting or in a peaceful state.
-
(2)
Heart rate increase rate (HRincrease) [38] refers to the rate of increase of the heart rate. Concerning that, our bracelets can collect energy consumption (EC) simultaneously while recording HR. We calculate the incremental quantity of the HR in the first 20 s of the running period divided by the incremental quantity of EC over the same time period as the HRincrease.
-
(3)
Maximum heart rate (HRmax) [39] refers to the maximum value of the HR at the maximum load intensity. We can use HRmax to monitor teenagers’ exercise intensity.
-
(4)
Heart rate reserve (HRreserve) [40] refers to the difference between HRmax and HRrest. The higher the value of HRreserve is, the better the cardiopulmonary function is.
-
(5)
Mean blood oxygen saturation (SpO2mean), SpO2 shows significant changes for neither the average person nor professional athletes under normal conditions, but it will apparently decrease when there is a quantity load of exercise. To extract as many adequate features as possible, which may be correlated with the teenagers’ physical fitness levels, we add SpO2mean into our initial feature set.
-
(6)
Standard deviation of blood oxygen saturation (SpO2SD) [41], SpO2SD shows little variation. However, we also add this feature into the original set to verify whether it makes sense to monitor teenagers’ physical fitness condition.
-
(7)
Time duration (TD) refers to the minus value between the time of finishing running (Tend)and the time of starting running (Tstart). According to the regular health test standard for teenage students, TD decides the results of the running process. The shorter TD is, the better the score is. Referring to TD, we can distribute the teenagers’ fitness levels into four degrees: excellent, good, medium, and poor.
-
(8)
Instant heart rate (HRinstant) [42] refers to the immediate HR after exercise. Zhou’s research finds that HRinstant has a strong negative correlation with cardiopulmonary functions, which shows that HRinstant may have a strong correspondence with predicting teenagers’ fitness levels.
-
(9)
Heart rate descent rate (HRdescent) [43] refers to the rate of recovery of heart rate after exercise, especially the minute immediately after exercise. The faster the HR drops, the better the cardiopulmonary function may be.
The definition formulae of the extracted features are shown in Table 1.
Table 1.
Measurement Period | Feature | Formulae | |
---|---|---|---|
3-min warm-up exercise | Resting heart rate (HRrest) | (4) | |
Running | Heart rate increase rate (HRincrease) | (5) | |
Maximum heart rate (HRmax) | (6) | ||
Heart rate reserve (HRreserve) | (7) | ||
Mean blood oxygen saturation (SpO2mean) | (8) | ||
Standard deviation of blood oxygen saturation (SpO2SD) | (9) | ||
Time duration (TD) | (10) | ||
Recovery | Heart rate descent rate (HRdecent) | (11) | |
Instant heart rate (HRinstant) | (12) |
2.5.3. Feature Selection
We extracted nine features that may correlate with levels of teenagers’ physical fitness. However, we made a first-round selection among these features to make sure that the selected features were key features, really contributing to evaluating physical fitness levels. The principles used to choose key features were as follows:
-
(1)
They had a strong correlation with physical fitness levels. For example, we found SpO2mean and SpO2SD do not have apparent changes, so we are not sure whether these two features can evaluate teenagers’ fitness condition. It was necessary to take some measures to remove useless features.
-
(2)
They did not have redundancy information between each other. Take SpO2mean and SpO2SD for example, they are both extracted from SpO2, so there may be redundancy information between them. We needed to find a way to remove the redundant features to make the selected dataset as clean as possible.
Based on the two principles above, we needed to analyze the correlation among extracted features to finalize the feature set. The final purpose of our research was to classify the teenagers’ physical fitness levels based on the PPGs, so it was necessary that we considered the correlated relationship between the feature and the fitness level when we made correlation analyses.
In the field of natural science, the Pearson correlation coefficient (PCC) is widely applied to measure correlation between two variables, and its value ranges from −1 to 1 [44]. It evolved from a similar, but slightly different, idea put forward by Francis Galton, in the 1880s.
PCC between two variables is defined as the quotient of covariance and standard deviation:
(13) |
The above formula defines the overall correlation coefficient, which is usually represented by . and to represent the standard deviation of two variables, respectively. Cov(X,Y) represents the covariance of two variables.
PCC can also be obtained by estimating the covariance and standard deviation of the sample, which is commonly represented by r:
(14) |
The value of PCC varies from −1 to 1. Value ‘1’ means that X and Y can be well described by linear equation. All data points fall on a straight line, and Y increases with the increase of X. Value ‘−1’ means that all data points fall on a straight line, while Y decreases with increase of X. Value ‘0’ means that the two variables have no relationship. Table 2 shows the relationship between the absolute value of PCC and correlation degrees.
Table 2.
PCC | 0.8~1.0 | 0.6~0.8 | 0.6~0.4 | 0.2~0.4 | 0.0~0.2 |
Relationship | Very strong | Strong | Moderate | Weak | Irrelevant |
2.6. A Deep Learning Method: 1D-CNN with LSTM
Professor Lecun first proposed the LeNet model based on Convolutional Neural Network (CNN) to solve the visual task of handwritten numeral recognition in 1998. In recent years, researchers have applied CNN and other CNN-based variant models to image processing, object detection, signal processing, and so on [45]. Considering the multi-dimensions of the features, and the computing and dimension reduction processing ability of deep learning algorithms, we applied 1D-CNN to build the evaluation model. A fundamental CNN is mainly composed of input layer, convolution layer, pooling layer, full connection layer, and activation layer. The function of each layer is briefly described as follows.
-
(1)
The input layer is a layer for the network to receive input samples. Its shape is consistent with that of the input samples. It serves to receive and transmit data for the network behind this layer.
-
(2)
The function of the convolution layer is to obtain features of input data through convolution operation, extract multiple features by using convolution kernels of different scales, and increase the number of effective features. The number of convolution kernels can change the depth of the input matrix. The convolution operation is such that the convolution kernel traverses the input matrix and convolutes with the elements at the corresponding position in the input matrix. A new output matrix starts from the operation result.
-
(3)
The pooling layer reduces the length and width of the matrix, which can reduce the size of the matrix, as well as the number of network parameters. The pooling layer usually discards the part with less information and retains its vital information, which not only speeds up calculation efficiency, but also ensures accuracy.
-
(4)
The full connection layer is a hierarchy that connects all nodes between previous features and final output.
-
(5)
The Softmax layer maps the input to real numbers between 0 and 1 and then normalizes these real numbers to ensure that the sum is 1; that is, to ensure the probability of mapping the input to the corresponding category. Through the transformation of the Softmax layer, the output of the previous layer is transformed into the probability that the samples belong to each class, so that the network can complete the multi-classification task.
Long Short-Term Memory (LSTM) was first proposed by Hochreiter and Schmidhuber in 1997 [46]. The original design intention was to solve the problem of long-term dependence in neural networks and make remembering long-term information the default behavior of neural networks, rather than requiring much effort to learn [47]. LSTM controls discarding or adding information through a ‘gate’ to realize the function of forgetting or remembering. A ‘gate’ is a structure that allows information to pass selectively, which is composed of a sigmoid function and a dot multiplication operation. The output value of the sigmoid function is between 0 and 1. ‘0’ represents complete discarding, while ‘1’ represents complete passing. An LSTM unit has three such gates: forget gate, input gate, and output gate.
Recurrent neural network (RNN) is suitable for processing time-series data, like one-channel physiological recordings. However, the original RNN has the problem of gradient disappearance, or gradient explosion. LSTM and layered RNN are all solutions to this problem. The essence of LSTM is to introduce the concept of cell state. Unlike RNN, which only considers the recent state, the cell state of LSTM will determine which states should be left and which should be forgotten [47]. Basic RNN can deal with some short-term dependence, but it cannot deal with long-term dependence, while LSTM has this capability.
Considering that the physiological characteristics we screen out are one-dimensional time-allowed sequences, we propose a 1D-CNN with an LSTM evaluation model to achieve the classified task. In the proposed model, the Conv1D layer refers to one-dimensional convolution calculation, which is usually used to process one-dimensional data, such as physiological signals. ReLU (Rectified Linear Unit), also known as modified linear unit, is an activation function that refers to the nonlinear functions represented by slope function and its variants. Batch normalization is a method to unify the scattered data, and also to optimize the neural network. The dropout layer prevents overfitting and improves the generalization ability of the model. The dense layer can aggregate network information for classification or other purposes.
3. Experiment Results
3.1. Signal Preprocessing Results
We applied MF and WT to preprocess the original PPGs to ensure the signals were clean enough for feature estimation. Figure 4 is an example of simulated physiological recordings with the preprocessing methods. The preprocessed signals with non-baseline draft and little noise welcomed further analysis.
3.2. Feature Engineering Results
Values and correlated degrees of the Pearson correlation coefficient between teenagers’ physiological features and their physical fitness levels are displayed in Table 3 and Table 4. The values of PCC among physiological features are shown in Figure 5, in which image (a) on the left is for boys, and image (b) on the right is for girls.
Table 3.
Feature | HRrest | HRincrease | HRmax | HRreserve | SpO2mean | SpO2SD | TD | HRdescent | HRinstant | |
---|---|---|---|---|---|---|---|---|---|---|
PCC | Boy | 0.392 | 0.598 | 0.440 | 0.113 | −0.136 | −0.493 | 0.370 | 0.492 | 0.625 |
Girl | 0.826 | 0.676 | 0.699 | −0.119 | 0.082 | −0.529 | 0.299 | 0.450 | 0.830 |
Table 4.
Correlation | Very Strong (PCC: 0.8~1.0) |
Strong (PCC: 0.6~0.8) |
Moderate (PCC: 0.4~0.6) |
Weak (PCC: 0.2~0.4) |
Irrelevant (PCC: 0.0~0.2) |
|
---|---|---|---|---|---|---|
Gender | Boy | None | HRinstant | HRmax | HRrest | HRreserve |
SpO2SD | ||||||
HRdescent | TD | SpO2mean | ||||
HRincrease | ||||||
Girl | HRrest | HRincrease | SpO2SD | TD | HRreserve | |
HRinstant | HRmax | HRdescent | SpO2mean |
As regards boys’ features, there is no very strong correlation between physiological features and fitness levels. But HRincrease (PCC = 0.598), HRmax (PCC = 0.440), SpO2SD (PCC = −0.493), HRdescent (PCC = 0.492), and HRinstant (PCC = 0.625) show a moderate or strong correlation. We added those features to our selected feature set. HRrest and TD’s PCC is between 0.2 and 0.4, representing a weak relationship between them and fitness levels. From image (a) in Figure 5, we find that HRrest has a strong correlation with SpO2SD (PCC = −0.72). SpO2SD is already in the selected feature set, so we eliminated HRrest. TD was the only scoring criteria for scoring students’ running in middle schools, although the PCC between TD and fitness levels is 0.370, we chose to persist with TD. HRreserve (PCC = 0.113) and SpO2mean (PCC = −0.136) have an irrelevant correlation to fitness levels, so we removed them directly.
As regards girls’ features, HRrest (PCC = 0.826) and HRinstant (PCC = 0.830) have a very strong correlation with fitness levels. We added these two features in the final feature set. We removed HRreserve and SpO2mean directly because their values are −0.119 and 0.082, respectively. The PCC between TD and girls’ physical fitness levels is 0.299, lower than 0.4, but for the same reason as regards the boys, we kept TD in the final selected feature set. The PCC between HRmax and girls’ physical fitness levels is 0.699, representing a strong correlation, but HRmax has a strong relationship with HRrest (PCC = 0.76) and HRinstant (PCC = 0.69) referring to image (b) in Figure 5. We considered that there was redundant information among HRmax, HRrest, and HRinstant, so we removed HRmax from the final feature set. SpO2SD (PCC = −0.529) and HRdescent (PCC = 0.450) show a moderate relationship, but HRdescent shows a weak correlation with other features. We cannot delete HRinstant casually. SpO2SD has a strong correlation with HRrest (PCC = −0.77) and HRinstant (PCC = −0.64), which were already chosen in the final set, so we removed SpO2SD.
Table 5 shows the final selected feature sets for boys and girls. We chose six features for the boys’ feature set and 5 features for the girls’ feature set. The final selected feature set will be used to develop our teenager physical fitness evaluation model.
Table 5.
Feature | HRrest | HRincrease | HRmax | HRreserve | SpO2mean | SpO2SD | TD | HRdescent | HRinstant | |
---|---|---|---|---|---|---|---|---|---|---|
Gender | Boy | × | √ | √ | × | × | √ | √ | √ | √ |
Girl | √ | √ | × | × | × | × | √ | √ | √ |
3.3. Evaluation Model Performance
We applied the proposed 1D-CNN with LSTM model to evaluate teenagers’ physical fitness condition. When developing the proposed model, we divided the data set in a ratio of seven to three and reduced the learning rate to the original 0.5 every 100 epochs. After several rounds of frame adjustment, we constructed the final framework described in Table 6 because of its best performance.
Table 6.
Model Framework for Boys | Model Framework for Girls | ||||
---|---|---|---|---|---|
Layer Type | Output Shape | Parameters | Layer Type | Output Shape | Parameters |
Conv1D | (None, 4, 64) | 192 | Conv1D | (None, 4, 64) | 192 |
ReLU | (None, 4, 64) | 0 | ReLU | (None, 4, 64) | 0 |
Conv1D | (None, 2, 64) | 12352 | Conv1D | (None, 2, 64) | 12352 |
Conv1D | (None, 1, 64) | 4160 | Conv1D | (None, 1, 64) | 4160 |
Batch normalization | (None, 1, 64) | 256 | Batch normalization | (None, 1, 64) | 256 |
Dropout | (None, 1, 64) | 0 | Dropout | (None, 1, 64) | 0 |
Conv1D | (None, 1, 32) | 2080 | Conv1D | (None, 1, 64) | 4160 |
Conv1D | (None, 1, 32) | 1056 | Conv1D | (None, 1, 64) | 4160 |
Batch normalization | (None, 1, 32) | 128 | Batch normalization | (None, 1, 64) | 256 |
LSTM | (None, 1, 32) | 8320 | LSTM | (None, 1, 64) | 33024 |
LSTM | (None, 32) | 8320 | LSTM | (None, 32) | 12416 |
Dense | (None, 4) | 132 | Dropout | (None, 32) | 0 |
Dense | (None, 4) | 132 |
To better measure the performance of the model, we recorded accuracy for the whole model, as well as precision, recall, and f1-score for every class with different epochs (epoch = 250, 300, and 350). Table 7 and Figure 6 record the evaluation indexes for teenagers’ physical fitness levels. We found that when the training epoch is 300, accuracy reaches the highest, the values of boys’ and girls’ physical fitness evaluation accuracy are 98.27% and 99.26%, respectively. From the detailed evaluation indexes for every class, we found two edge classifications (excellent and poor) get 100% accuracy for every epoch, for both boys and girls. While the accuracy for classifications of two intermediate parts (good and medium, especially medium) hardly achieve 100% prediction accuracy.
Table 7.
Gender | Epoch | Accuracy | Classes | Evaluation Indexes | ||
---|---|---|---|---|---|---|
Precision | Recall | F1-Score | ||||
Boy | 250 | 0.9769 | Excellent | 1.00 | 1.00 | 1.00 |
Good | 0.99 | 0.98 | 0.98 | |||
Medium | 0.84 | 0.94 | 0.89 | |||
Poor | 1.00 | 1.00 | 1.00 | |||
300 | 0.9827 1 | Excellent | 1.00 | 1.00 | 1.00 | |
Good | 0.99 | 0.98 | 0.99 | |||
Medium | 0.89 | 0.94 | 0.91 | |||
Poor | 1.00 | 1.00 | 1.00 | |||
350 | 0.9769 | Excellent | 1.00 | 1.00 | 1.00 | |
Good | 0.99 | 0.98 | 0.98 | |||
Medium | 0.84 | 0.94 | 0.89 | |||
Poor | 1.00 | 1.00 | 1.00 | |||
Girl | 250 | 0.9852 | Excellent | 1.00 | 1.00 | 1.00 |
Good | 0.95 | 1.00 | 0.97 | |||
Medium | 1.00 | 0.93 | 0.96 | |||
Poor | 1.00 | 1.00 | 1.00 | |||
300 | 0.9926 2 | Excellent | 1.00 | 1.00 | 1.00 | |
Good | 0.98 | 1.00 | 0.99 | |||
Medium | 1.00 | 0.98 | 0.98 | |||
Poor | 1.00 | 1.00 | 1.00 | |||
350 | 0.9778 | Excellent | 1.00 | 1.00 | 1.00 | |
Good | 0.95 | 1.00 | 0.97 | |||
Medium | 1.00 | 0.93 | 0.96 | |||
Poor | 1.00 | 1.00 | 1.00 |
1,2 The best accuracy for gender.
We recorded the changes of accuracy and loss during different epoch training for both boys and girls in Figure 7 and Figure 8. Decreasing loss value proves that it is converging, and increasing accuracy value proves that its accuracy is improving.
From Figure 9 and Figure 10, we can more clearly find that accuracy in classifying two intermediate parts (good and medium, especially medium) hardly achieves 100% prediction accuracy. The accuracy rates of excellent and poor are pretty high. We consider the middle two levels: good and medium, to be excessive, and hard to classify, while excellent and poor are more widely separated and easily distinguishable.
4. Discussions
In the present research, we explored predictability of the running PPGs for the physical fitness levels of teenagers. The wrist-recorded PPGs were found to be an effective indicator of teenagers’ physical fitness condition, with better results for predicting excellent and poor levels. Intermediate health levels are a bit harder to assess. The experiment results indicate that people can monitor physical fitness condition of adolescents by analyzing their physiological recordings with modern artificial intelligence methods.
Through mathematical calculation, MF-WT denoising, and PCC value analyses, we finalized the physiological feature set for boys and girls, respectively. Considering the one-dimensional nature, and time correlation, of physiological signals, computing ability, and dimension reduction processing ability of deep learning, we applied 1D-CNN with LSTM to achieve the classified task and got 98.27% (for boys) and 99.26% (for girls) as the final prediction results. Notably, whereas, ideally, it is expected to collect physiological recordings from all items of the student physical fitness test, on the guidance of official documents published by the government, for the prediction of health condition, our data were measured merely by a typical running test. Although cardiopulmonary function can be detected through long-distance running, and running is easier to monitor than sports such as those requiring sitting forward flexion, we admit that if combined with more physical tests, the results can be more accurate. Furthermore, the accuracy of the evaluation model, based on the current method, has reached the commercial level, but if the signals collected from other sports are added in the future, the accuracy will not be known.
In summary, the contributions of this paper are summarized as follows:
-
(1)
We have pioneered the exploration of the relationship between physiological recordings of teenagers with their physical fitness levels and proposed that some key features could be effectively used to predict fitness levels.
-
(2)
We have proposed an assessment model based on an optimized 1D-CNN with LSTM to predict the outcome of the running physical test. The proposed model could also be used for other predictive tasks based on biosensing recordings.
-
(3)
The experimental results provide evidence supporting the feasibility of predicting teenagers’ physical fitness levels by their biosensing recordings.
5. Conclusions
In this research, we have proposed a 1D-CNN with LSTM based evaluation model to assess the physical fitness condition of teenagers with the aid of our self-designed wearable smart bracelet system. Under the guidance of the designed experimental paradigm, we collected one thousand and twenty-four fourteen-year-old middle school students’ PPGs and applied median filter and wavelet transform to make the original physiological recordings clean enough for further mathematical calculating of heart rate (HR) and blood oxygen saturation (SpO2). Then we calculated nine features based on HR and SpO2 extracted in different experimental procedures and used the Pearson correlation coefficient method to finalize the feature set. Finally, we constructed a deep learning model, 1D-CNN with LSTM, to classify teenagers’ physical fitness condition into four levels: excellent, good, medium, and poor, with an accuracy of 98.27% for boys, and 99.26% for girls.
Our research demonstrates the possibility and feasibility of applying deep learning methods to analyze teenagers’ physical fitness based on PPG recordings, and fills the gap of health monitoring for ordinary teenagers. Extending our knowledge on the healthcare of teenagers may contribute to improving routine physical assessments and arousing widespread concern in society. With the rapid progress of biosensing technologies and artificial intelligence, health monitoring for teenagers’ physical fitness will achieve faster development based on existing methods.
Acknowledgments
The authors are grateful to Lan Yang, Di Lu, and Tianyou Xu for their generous support of data collection. We are grateful to Kangying Hu for his support in editing and visualizing this manuscript. We wish to thank all the volunteer teenagers for providing us with their bio-sensing recordings.
Author Contributions
Conceptualization, J.G. and B.W.; methodology, J.G. and B.W.; software, S.Z. and B.W.; validation, A.S. and W.H.; formal analysis, S.Z. and B.W.; investigation, J.G. and B.W.; resources, J.G., B.W. and A.S.; data curation, J.G., B.W. and S.Z.; writing—original draft preparation, J.G., B.W. and S.Z.; writing—review and editing, B.W., A.S. and W.H.; visualization, W.H.; supervision, W.H. and A.S.; project administration, J.G.; funding acquisition, J.G. All authors have read and agreed to the published version of the manuscript.
Funding
This research is sponsored by the National Natural Science Foundation of China (No.61977006), ‘Educational Big Data R&D and its Application’—Major Big Data Engineering Project of National Development and Reform Commission 2017, and Beijing Advanced Innovation Center for Future Education (BJAICFE2016IR-004).
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The datasets within this research are available from the corresponding author on reasonable request.
Conflicts of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Yip J.Y.-C. Healthcare resource allocation in the COVID-19 pandemic: Ethical considerations from the perspective of distributive justice within public health. Public Health Pract. 2021;2:100111. doi: 10.1016/j.puhip.2021.100111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kishor A., Chakraborty C. Artificial Intelligence and Internet of Things Based Healthcare 4.0 Monitoring System. Wirel. Pers. Commun. 2021:1–17. doi: 10.1007/s11277-021-08708-5. [DOI] [Google Scholar]
- 3.Meenu G., Gopal C., Victor H.C.D.A. Smart Healthcare Monitoring Using IoT with 5G: Challenges, Directions, and Future Predictions. CRC Press; Boca Raton, FL, USA: 2021. [Google Scholar]
- 4.Hassan H.K., Abed J.K., Waheb M.A. The IoT for Healthcare Applications. IOP Conf. Ser. Mater. Sci. Eng. 2021;1105:012075. doi: 10.1088/1757-899X/1105/1/012075. [DOI] [Google Scholar]
- 5.Singh D., Kumar B., Singh S., Chand S. A Secure IoT-Based Mutual Authentication for Healthcare Applications in Wireless Sensor Networks Using ECC. Int. J. Healthc. Inf. Syst. Inform. 2021;16:21–48. doi: 10.4018/IJHISI.20210401.oa2. [DOI] [Google Scholar]
- 6.Grace M., Woods-Townsend K., Griffiths J., Godfrey K., Hanson M., Galloway I., Azaola M.C., Harman K., Byrne J., Inskip H. Developing teenagers’ views on their health and the health of their future children. Health Educ. 2012;112:543–559. doi: 10.1108/09654281211275890. [DOI] [Google Scholar]
- 7.General Administration of Sport of China . The Second National Physical Fitness Monitoring Report. People’s Physical Culture Publishing House; Beijing, China: 2007. [Google Scholar]
- 8.Adorjan M., Ricciardelli R. Smartphone and social media addiction: Exploring the perceptions and experiences of Canadian teenagers. Can. Rev. Sociol. Can. Sociol. 2021;58:45–64. doi: 10.1111/cars.12319. [DOI] [PubMed] [Google Scholar]
- 9.Cho H.-S. A study on the solution for the internet, smartphone, and internet game addiction of teenagers. Korean J. Youth Stud. 2019;26:291–310. doi: 10.21509/KJYS.2019.10.26.10.291. [DOI] [Google Scholar]
- 10.Chou H.-L., Chou C. A quantitative analysis of factors related to Taiwan teenagers’ smartphone addiction tendency using a random sample of parent-child dyads. Comput. Hum. Behav. 2019;99:335–344. doi: 10.1016/j.chb.2019.05.032. [DOI] [Google Scholar]
- 11.Moon S.M., Kim J.W. Privacy-Preserving Method to Collect Health Data from Smartband. J. Korea Soc. Comput. Inf. 2020;25:113–121. [Google Scholar]
- 12.Beggiato M., Hartwich F., Krems J. Using Smartbands, Pupillometry and Body Motion to Detect Discomfort in Automated Driving. Front. Hum. Neurosci. 2018;12:338. doi: 10.3389/fnhum.2018.00338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hunkin H., King D.L., Zajac I.T. Evaluating the feasibility of a consumer-grade wearable EEG headband to aid assessment of state and trait mindfulness. J. Clin. Psychol. 2021;77:2559–2575. doi: 10.1002/jclp.23189. [DOI] [PubMed] [Google Scholar]
- 14.Casciola A., Carlucci S., Kent B., Punch A., Muszynski M., Zhou D., Kazemi A., Mirian M., Valerio J., McKeown M., et al. A Deep Learning Strategy for Automatic Sleep Staging Based on Two-Channel EEG Headband Data. Sensors. 2021;21:3316. doi: 10.3390/s21103316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wang F.-K., Tang M.-C., Su S.-C., Horng T.-S. Wrist Pulse Rate Monitor Using Self-Injection-Locked Radar Technology. Biosensors. 2016;6:54. doi: 10.3390/bios6040054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Liu X., Zhao C., Zheng B., Guo Q., Duan X., Wulamu A., Zhang D. Wearable Devices for Gait Analysis in Intelligent Healthcare. Front. Comput. Sci. 2021;3:42. doi: 10.3389/fcomp.2021.661676. [DOI] [Google Scholar]
- 17.Teixeira E., Fonseca H., Diniz-Sousa F., Veras L., Boppre G., Oliveira J., Pinto D., Alves A., Barbosa A., Mendes R., et al. Wearable Devices for Physical Activity and Healthcare Monitoring in Elderly People: A Critical Review. Geriatrics. 2021;6:38. doi: 10.3390/geriatrics6020038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Mahajan A., Pottie G., Kaiser W. Transformation in Healthcare by Wearable Devices for Diagnostics and Guidance of Treatment. ACM Trans. Comput. Health. 2020;1:1–12. doi: 10.1145/3361561. [DOI] [Google Scholar]
- 19.Nukala B.T., Nakano T., Rodriguez A., Tsay J., Lopez J., Nguyen T.Q., Zupancic S., Lie D.Y.C. Real-Time Classification of Patients with Balance Disorders vs. Normal Subjects Using a Low-Cost Small Wireless Wearable Gait Sensor. Biosensors. 2016;6:58. doi: 10.3390/bios6040058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Steinberg C., Philippon F., Sanchez M., Fortier-Poisson P., O’Hara G., Molin F., Sarrazin J.-F., Nault I., Blier L., Roy K., et al. A Novel Wearable Device for Continuous Ambulatory ECG Recording: Proof of Concept and Assessment of Signal Quality. Biosensors. 2019;9:17. doi: 10.3390/bios9010017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Li X., Lu Y., Fu X., Qi Y. Building the Internet of Things platform for smart maternal healthcare services with wearable devices and cloud computing. Futur. Gener. Comput. Syst. 2021;118:282–296. doi: 10.1016/j.future.2021.01.016. [DOI] [Google Scholar]
- 22.Ion M., Dinulescu S., Firtat B., Savin M., Ionescu O., Moldovan C. Design and Fabrication of a New Wearable Pressure Sensor for Blood Pressure Monitoring. Sensors. 2021;21:2075. doi: 10.3390/s21062075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Yamaguchi T., Yamamoto D., Arie T., Akita S., Takei K. Wrist flexible heart pulse sensor integrated with a soft pump and a pneumatic balloon membrane. RSC Adv. 2020;10:17353–17358. doi: 10.1039/D0RA02316G. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ling C., Wenbo Z., Chao Y., Feng S. SPSS variance analysis-based teenager physical health promoting strategy research. BioTechnology Indian J. 2014;10:1156–1161. [Google Scholar]
- 25.Crouter S.E., Flynn J.I., Bassett D.R., Jr. Estimating Physical Activity in Youth Using a Wrist Accelerometer. Med. Sci. Sports Exerc. 2015;47:944–951. doi: 10.1249/MSS.0000000000000502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bolhasani H., Mohseni M., Rahmani A.M. Deep learning applications for IoT in health care: A systematic review. Inform. Med. Unlocked. 2021;23:100550. doi: 10.1016/j.imu.2021.100550. [DOI] [Google Scholar]
- 27.Dang H.V., Tran-Ngoc H., Nguyen T.V., Bui-Tien T., De Roeck G., Nguyen H.X. Data-Driven Structural Health Monitoring Using Feature Fusion and Hybrid Deep Learning. IEEE Trans. Autom. Sci. Eng. 2021;18:2087–2103. doi: 10.1109/TASE.2020.3034401. [DOI] [Google Scholar]
- 28.Lee S., Hwang E., Kim Y., Demir F., Lee H., Mosher J.J., Jang E., Lim K. Mobile Health App for Adolescents: Motion Sensor Data and Deep Learning Technique to Examine the Relationship between Obesity and Walking Patterns. Appl. Sci. 2022;12:850. doi: 10.3390/app12020850. [DOI] [Google Scholar]
- 29.Hertzman A.B. The blood supply of various skin areas as estimated by the photoelectric plethysmograph. Am. J. Physiol. 1938;124:328–340. doi: 10.1152/ajplegacy.1938.124.2.328. [DOI] [Google Scholar]
- 30.Fei W., Xiao-Yan Q. Removal of Motion Noise from Surface-electromyography Signal Using Wavelet Adaptive Filter; Proceedings of the 2016 3rd International Conference on Materials Engineering, Manufacturing Technology and Control; Taiyuan, China. 27–28 February 2016; pp. 1294–1298. [Google Scholar]
- 31.Ruan D., A Fessler J., Balter J.M., Keall P. Real-time profiling of respiratory motion: Baseline drift, frequency variation and fundamental pattern change. Phys. Med. Biol. 2009;54:4777–4792. doi: 10.1088/0031-9155/54/15/009. [DOI] [PubMed] [Google Scholar]
- 32.Qaisar S.M. Baseline wander and power-line interference elimination of ECG signals using efficient signal-piloted filtering. Health Technol. Lett. 2020;7:114–118. doi: 10.1049/htl.2019.0116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Miljković N., Popović N., Djordjević O., Konstantinović L., Šekara T.B. ECG artifact cancellation in surface EMG signals by fractional order calculus application. Comput. Methods Programs Biomed. 2017;140:259–264. doi: 10.1016/j.cmpb.2016.12.017. [DOI] [PubMed] [Google Scholar]
- 34.Alkhidir T., Sluzek A., Yapici M.K. Simple method for adaptive filtering of motion artifacts in E-textile wearable ECG sensors; Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society; Milan, Italy. 25–29 August 2015; [DOI] [PubMed] [Google Scholar]
- 35.Shensa M.J. The discrete wavelet transform: Wedding the a trous and Mallat algorithms. IEEE Trans. Signal Processing Publ. IEEE Signal Processing Soc. 1992;40:2464–2482. doi: 10.1109/78.157290. [DOI] [Google Scholar]
- 36.Kossmann C.E. The Normal Electrocardiogram. Circulation. 1953;8:920–936. doi: 10.1161/01.CIR.8.6.920. [DOI] [PubMed] [Google Scholar]
- 37.Cooney M.T., Vartiainen E., Laakitainen T., Juolevi A., Dudina A., Graham I.M. Elevated resting heart rate is an independent risk factor for cardiovascular disease in healthy men and women. Am. Heart J. 2010;159:612–619.e3. doi: 10.1016/j.ahj.2009.12.029. [DOI] [PubMed] [Google Scholar]
- 38.Jagim A.R., Koch-Gallup N., Camic C.L., Kroening L., Nolte C., Schroeder C., Gran L., Erickson J.L. The accuracy of fitness watches for the measurement of heart rate and energy expenditure during moderate intensity exercise. J. Sports Med. Phys. Fit. 2021;61:205–211. doi: 10.23736/S0022-4707.20.11151-4. [DOI] [PubMed] [Google Scholar]
- 39.Berglund I.J., Sørås S.E., Relling B.E., Lundgren K.M., Kiel I.A., Moholdt T. The relationship between maximum heart rate in a cardiorespiratory fitness test and in a maximum heart rate test. J. Sci. Med. Sport. 2019;22:607–610. doi: 10.1016/j.jsams.2018.11.018. [DOI] [PubMed] [Google Scholar]
- 40.Swain D.P., Leutholtz B.C., King M.E., Haas L.A., Branch J.D. Relationship between% heart rate reserve and %VO2 reserve in treadmill exercise. Med. Sci. Sports Exerc. 1998;30:318–321. doi: 10.1097/00005768-199802000-00022. [DOI] [PubMed] [Google Scholar]
- 41.Mengelkoch L.J., Martin D., Lawler J. A Review of the Principles of Pulse Oximetry and Accuracy of Pulse Oximeter Estimates During Exercise. Phys. Ther. 1994;74:40–49. doi: 10.1093/ptj/74.1.40. [DOI] [PubMed] [Google Scholar]
- 42.Williamson J.W., Nóbrega A.C., Winchester P.K., Zim S., Mitchell J.H. Instantaneous heart rate increase with dynamic exercise: Central command and muscle-heart reflex contributions. J. Appl. Physiol. 1995;78:1273–1279. doi: 10.1152/jappl.1995.78.4.1273. [DOI] [PubMed] [Google Scholar]
- 43.Cole C.R., Foody J.M., Blackstone E.H., Lauer M.S. Heart rate recovery after submaximal exercise testing as a predictor of mortality in a cardiovascularly healthy cohort. Ann. Intern. Med. 2000;132:552–555. doi: 10.7326/0003-4819-132-7-200004040-00007. [DOI] [PubMed] [Google Scholar]
- 44.Xia Z., Song Y., Ma J., Zhou L., Dong Z. Research on the Pearson correlation coefficient evaluation method of analog signal in the process of unit peak load regulation; Proceedings of the 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI); Yangzhou, China. 20–22 October 2017; pp. 554–559. [Google Scholar]
- 45.Luz S., Mario M.O., Gustavo R.G., Enas A., Arunkumar N. Using Deep Convolutional Neural Network for Emotion De-tection on a Physiological Signals Dataset (AMIGOS) IEEE Access. 2019;7:57–67. [Google Scholar]
- 46.Hochreiter S., Schmidhuber J. Long short-term memory. Neural Comput. 1997;9:1735–1780. doi: 10.1162/neco.1997.9.8.1735. [DOI] [PubMed] [Google Scholar]
- 47.Awais M., Raza M., Singh N., Bashir K., Manzoor U., Islam S.U., Rodrigues J.J.P.C. LSTM-Based Emotion Detection Using Physiological Signals: IoT Framework for Healthcare and Distance Learning in COVID-19. IEEE Internet Things J. 2020;8:16863–16871. doi: 10.1109/JIOT.2020.3044031. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets within this research are available from the corresponding author on reasonable request.