Abstract
Goal: The SARS-CoV-2 viral infection could cause severe acute respiratory syndrome, disturbing the regular breathing and leading to continuous coughing. Automatic respiration monitoring systems could provide the necessary metrics and warnings for timely intervention, especially for those with mild symptoms. Current respiration detection systems are expensive and too obtrusive for any large-scale deployment. Thus, a low-cost pervasive ambient sensor is proposed. Methods: We will posit a barometer on the working desk and develop a novel signal processing algorithm with a sparsity-based filter to remove the similar-frequency noise. Three modes (coughing, breathing and others) will be conducted to detect coughing and estimate different respiration rates. Results: The proposed system achieved 97.33% accuracy of cough detection and 98.98% specificity of respiration rate estimation. Conclusions: This system could be used as an effective screening tool for detecting subjects suffering from COVID-19 symptoms and enable large scale monitoring of patients diagnosed with or recovering.
Keywords: Ambient sensor, cough detection, COVID-19 pandemic, healthcare, respiration
I. Introduction
Coronavirus disease 2019 (COVID-19) has emerged as a pandemic and it has affected over 210 countries. More than 42 million people are infected globally, and the number of cases is increasing rapidly. The demand for healthcare systems worldwide has risen abruptly and caused significant disruptions to the delivery of care. Abnormal respiration is one of the most obvious symptoms of SARS-CoV-2 viral infection. COVID-19 symptoms are fever (83%–99%), dry cough (59.4%–82%) and respiratory distress (∼55%) [1]. Abnormal respiration rate is also one of the indications of the severity of a COVID-19 patient's condition and it is often used as an index to support clinical decisions for timely interventions at the inchoate stage of the infection. Respiration involves a complex biological interaction between the central nervous system, respiratory-related motor neurons, and respiration muscles [2]. Based on these interactions, various techniques have been developed for respiratory rate detection. However, accurate, continuous, and pervasive respiratory rate measurement is challenging and still under investigation, especially for direct measurement. Ding and Liu et al. [3], [4] have recently reviewed the current wearable sensing and telehealth technologies, and in general, the respiratory rate (RR) is captured in the following three ways:
A. Respiratory Airflow Detection
Respiratory airflow could induce variation in pressure, temperature, humidity and acoustic in the vicinity of subjects [5]. One of the standard clinical devices for respiration monitoring is the Spirometer, based on a pneumotachograph measuring the volume of air inhaled and exhaled by a patient in each breath and the time it takes for each breath [6]. Joseph M et al. [7] introduced a nasal prong method connected to a pressure transducer to measure nasal flow in sleep apnea and hypopnea patients. Capnography is another clinic respiration measurement that detects the End-Tidal Carbon Dioxide levels for hypoventilation [8], integrating with a face mask to measure the concentration in the exhaled air [9]. However, it is expensive and could cause difficulty in breathing. Das et al. [10] proposed a monitoring system based on BTC (Negative Temperature Coefficient) type thermistor and the thermistor placed in the nasal or oral position, detecting air temperature fluctuations during inhalation and exhalation. Thermal imaging [11] captured by infrared cameras is a non-contact method to estimate the RR from thermal images through detecting the air temperature variations near the limited nose or mouth area. Humidity gradient can also be used to detect respiration. Kano et al. [12] embedded a nanoparticle thin film on a flexible substrate onto a sensor chip, detecting the humidity variations and measuring a subject's respiration rate. Cheng et al. [13] proposed a polymer film sensor using 1D nanowires to measure the water molecules' absorption for estimating the RR. The performance of thermal and humidity gradient sensing greatly depends on the environment. Acoustic sensing methods could achieve high accuracy in RR detection by capturing the acoustic signal induced by breathing where sensors are positioned at the nasal and tracheal locations or ear canal [14], [15]. However, imaging and acoustic sensing could lead to privacy concerns.
B. Abdominal Volume Changes and Body Movements
Sensing respiratory-related physical activities such as abdominal or chest movements is another common approach. Bates et al. [16] demonstrated a tri-axial accelerometer-based method for detecting the breathing motions. Zhang et al. [17] proposed a waist-worn device based on a triboelectric nanogenerator (TENG) for sensing breathing, as the breathing process is carried out by contraction and relaxation of the diaphragm and which causes the subtle variation of the abdominal circumference. Different modes of respiration, such as abdominal and thoracic respiration, and various daily activities (standing, lying and sitting), were assessed by the TENG sensor system. Another stretchable and wearable technology based on an inkjet-printed strain gauge sensor was developed in [18]. Huang et al. [19] proposed a non-invasive respiratory monitoring system by integrating an array of load sensors in the e-textile bed sheet to detect pressure variance in the breathing cycle. However, the power supply and the sensors' life cycles are limited, and other body movements will induce significant noise and severely affect the detection results.
C. Physiological Signals
Respiratory signals, can be extracted from cardiovascular measurements, such as the electrocardiogram (ECG) and the photoplethysmography (PPG) signals. O'Brien et al. [20] showed that the respiratory signal could be extracted from a single lead ECG sensor signal. The resulting respiratory signal has a correlation coefficient of around 0.75, with measurements from inductance plethysmography. RR measurement from a single lead ECG shows better results than methods based on the mean electrical axis while it can classify epochs of disordered respiration during sleeping with 82% accuracy. Meredith et al. [21] reviewed PPG methods for RR monitoring. PPG based methods are shown to be more robust and reliable in RR measurement compare to ECG based methods. However, both ECG and PPG would require the patient to wear the sensor, and user compliance would be a major issue for large scale deployment, and the sensors are prone to motion artifacts.
This paper proposes an ambient sensing system for respiration monitoring. This system is based on a single barometric sensor positioned in a working or living environment. In particular, the miniaturized sensor can be placed on the desk and capture the user's respiration and coughing pervasively. The system was conducted based on the hypothesis that respiration airflow will cause subtle air pressure variation in close proximity, and highly sensitive barometric sensors can detect such small changes. This small sensor can be built as low-cost devices for large scale deployment and potentially be used to monitor patients suffering from COVID-19 symptoms as a screening tool for detecting early signs of infection.
II. Materials and Methods
A. The Ambient System Setup
The ambient sensor system was designed based on a single barometric sensor (DPS310, Infineon, German). The barometric sensor has a pressure precision of ± 0.002hPa and an operation range of 300--1200 hPa. The sensor prototype measures 3 cm × 2 cm. It was controlled by the microcontroller (XMC2Go, Infineon, German) and it is designed on the desk (Fig. 1). The working desk is located in an indoor environment, such as the living room or the personal office, with slow and constant airflow. The barometric sensor is connected to a personal computer, but it can be extended to the wireless sensor.
B. Algorithm Design
Despite the barometric sensor's high sensitivity, the barometric signal is very noisy, and it requires a robust signal processing algorithm to extract the respiration information. A lightweight decision tree algorithm is designed and developed with the aim of enabling on-node processing, and the flowchart of the algorithm is illustrated in Fig. 2. Three modes are designed in this system: coughing, breathing and others (randomly talking or hold breathing).
1). Valid Signal and Coughing Detection Stage
The first stage of the decision tree algorithm is to distinguish ‘breathing’ from ‘others’ (Fig. 3. Part I). The barometric sensor has the sensing precision of ± 0.002hPa (0.2Pa), a reference to the noise level . If the data amplitude is lower than the noise level, this data sequence will be classified as the ‘others’. Then the system will continue to collect the next data stream. Once this collected signal is over the noise level, a high-pass filter will be applied to raw data input. The coughing signal has a similar frequency to the noise and a similar amplitude to the breathing signal. A coughing threshold was selected empirically based on the different coughing test patterns (Fig. 3. Part II).
The second stage of the algorithm detects coughing from the ‘breathing’ mode. If the high pass filtered signal level is larger than the coughing level threshold , the system will be switched to the ‘coughing’ mode and counting the frequency and incidence of coughing. If high pass filtered data is lower than the coughing level, the system status will remain in the ‘breathing’ mode. Once the accumulated breathing time is equal to or larger than the 60s, the signals will then be processed to detect breathing and coughing.
2). Respiration Rate Monitoring Stage
The data output from the bandpass Butterworth filtered signal may show different amplitude because of the different breathing strengths each time. In the first step, a data normalization scaling into a standard form [ −1, 1] is introduced to enhance the detection of breathing (Fig. 3. Part III. C1 and Part IV. C2). First derivative is used in the second step to extract the peak and valley points of the signals caused by the inhalation and exhalation process for estimating breathing rates.
Although the bandpass filterer can reduce the low and high-frequency noise, there still a small amplitude noise with a similar frequency to the signal (Fig. 3. Part III. D1 and Part IV. D2). This kind of noise has a lower amplitude than the standard signal amplitude and is located near the zero-crossing area. In the third step, a double direction ‘bandstop’ threshold [ ] can reduce the zero-crossing noise. This ‘bandstop’ threshold will remove all the features between a designed low threshold and a high threshold .
The signal processing is mainly divided into the low-frequency group (Fig. 3. Part III) and the high-frequency group (Fig. 3. Part IV). Bandstop filter can effectively remove the subtle noise near the zero-crossing point of the high-frequency groups (Fig. 3. Part IV. E2) but cannot reduce the local noise with a relatively large amplitude close to the signal points in the low-frequency groups (Fig. 3. Part III. E1). A low-frequency breathing pattern may contain high-frequency noise, which is close to a high-frequency signal band. Thus, an additional low pass filter is applied to the lower frequency groups. Considering breathing signals may vary with different subjects, it is essential to set the correlated Butterworth filter to classify different breathing patterns of this situation.
This research proposes a novel sparsity-based method to set the Butterworth filter, which can classify different breathing patterns. Step four of the algorithm is to determine the average sparsity value calculation. A local sparsity value is defined as the distance between the two closest valleys (Fig. 4. A, B and C). The total sparsity of a respiratory pattern is the sum of all its local sparsity values detected. Average sparsity should indicate the general breathing distribution without any outliers (Fig. 4. A and B). Still, it does not indicate the general breathing frequency. The average sparsity can be calculated in Eq. 1.
For any sparsity points, if it meets the relations:, it will be detected as an outlier point. Fig. 4. D. has shown the sparsity distribution for different situations. Then the algorithm uses the average sparsity to set up different Butterworth filters (Fig. 3. Part III. E1, F1 and Part IV. E2. F2). For the situation in Fig. 3. Part III. E1, which has a relatively large sparsity value containing much local noise at high-frequency bands, the signal will be processed with an additional low-pass filter. For the situations in Fig. 3. Part IV. E2, where the signal has a relatively low sparsity value, will be processed by an additional high-pass filter. Thus, based on the sparsity of the signal, a different filter is used.
The cutoff threshold is empirically selected for additional sparsity-based Butterworth filter (low-pass and high-pass filter). It will generate different values depending on different sparsity values generated in the last stage and it is shown as Eq. 2 and 3.
where , are system parameters (set empirically), is the average sparsity.
Algorithm: Sparsity Based Filter.
Input: Respiration pattern matrix
Output: Sparsity filtered based respiration pattern matrix
-
1:
while i < n do
-
2:
;
-
3:
-
4:
for j in range(len()-1) do
-
5:
;
-
6:
-
7:
-
8:
-
9:
if:
-
10:
; i+=1;
-
11:
else:
-
12:
; i+=1;
-
13:
return
The pseudocode in supplementary material shows the details of the algorithm for the sparsity-based filter. Although the local noise has been shrunk significantly in step five, small local noise still exists. Step six reduces the duplicated points such as peak-peak and valley-valley induced after thresholding (Fig. 3. Part III. F1). The final step is the respiration rate estimation.
C. Spatial Sensitivity Study
The relative distance of sensors and users is an essential evaluation of the respiration monitoring system. Thus, an extensive study of analyzing the spatial sensitivity of the sensor is conducted in this research. For a relative spatial location [x, y, z] generated by the respiration signal, the signal energy can be extracted from a series of signal data. The valid energy can be obtained by integrating the average noise threshold level between a sliding window with a respiration frequency shown in Eq. 4. If the respiration energy is larger than the valid level, it can be determined as a valid sensor location. If not, this will be determined as an invalid location.
Based on the preliminary data (processing result from the bandpass filter), we investigated the sensor's effective sensing range on detecting the respiration rate (16 times/mins). We set up the working space with the relative horizontal offset of X from −10 cm to 10 cm (tangential to the user's orientation), Y from 0-25 cm (along to the user's direction) vertical offset from 25 cm to 35 cm. The nasal location is (0, 0, Z), while Z is chosen by 25cm, 30 cm, 35 cm.
D. Experimental Protocol
A respiration monitoring protocol (Table I) is designed with the respiration rate monitoring part (E1-E3) and the cough detection part (E4-E6). In our research, 10 healthy subjects were recruited with consent (Table I). Each subject was required to follow the six groups (E1-E6) of our protocol to simulate different respiration patterns.
TABLE I. Experimental Protocol and Study Participants Characteristics.
Respiration protocols | Trials | |
---|---|---|
E1 | Low Respiration Rate (1-11) | 88 |
E2 | Normal Respiration Rate (12-16) | 40 |
E3 | Fast Respiration Rate (17-20) | 32 |
E4 | Respiration Rate (Random) | 100 |
E5 | Coughing | 100 |
E6 | Others (talking or hold breathing) | 100 |
Characteristics | Testing set | |
No. Subjects | 10 | |
Age (years)a | 24 ± 2 | |
Sex (No.) | M (6), F (4) | |
Height (cm)a | 172 ± 9 | |
Weight (kg)a | 65 ± 12 |
aData are expressed as mean ± std, dev.
III. Results
The cough detection data set contains 100 coughing patterns, 100 breathing patterns, and 100 other patterns from 10 subjects. The precision of coughing detection is 96%, recall is 99%, f1-score is 97% and support is 97 (events). The general detection accuracy is 97.33% (Confusion Matrix is shown in supplementary materials). For coughing detection, a few methods were used to captured the peak and valley points. The comparison results are shown in Fig. 5. The results show that the minimal number of peak and valley points has better accuracy than other methods before the sparsity-based filter. The sparsity-based filter has greatly improved the whole system performance and significantly enhanced robustness in different situations. The minimal number of the peak and valley points shows the best results with a general specificity of 98.98 % and the error proportion of E1 is 29.41%, E2 is 47.06% and E3 is 23.53%. In the sensitivity study, the sensor signal strength with an X offset of 25 cm, Y offset of 20 cm, Z offset of 30 cm is shown in Fig. 6. The signal strength was strong from 0-15 offset but became unstable when the distance is more than 20 cm.
IV. Discussion
This system shows that the barometers can detect breathing and cough reliably in a working desk environment even if there are other people in the same room, as long as the others are at least 35 cm away from the sensor. A comparison of different respiration sensing systems is conducted in terms of specificity, system sensitivity, payload convenience, equipment expense, and privacy (Supplementary Material). Our system outperforms other systems with a specificity of 98.98% respiration rate monitoring. One potential limitation of the proposed system is that it is based on a relatively constant environment without any window or door opening/closing events during the monitoring process, as those events may cause a sudden increase/decrease of the room air pressure and thus affect the sensing accuracy. Arm movements may also affect the airflow diffusion temporarily if it moves over the sensors. Besides, the body's movements and orientations may result in different sensing areas; thus, a more robust system could be built with multi-barometer sensing arrays on the desk or integrated as badges or buttons to be worn on the chest. A patient study should be conducted to validate the proposed. With the development of the advanced barometric sensors, the device could be extended to quantify respiration in sleep, leading to other applications, such as sleep apnea detection, etc.
V. Conclusion
This paper proposes using a barometric sensor as an ambient sensor for respiration rate estimation and coughing detection. From the experiments, we have shown the sensitivity of the sensor in capturing the subtle airflow variation caused by breathing and coughing in a desk working scenario. A lightweight signal processing algorithm is designed and proposed for detecting breathing and coughing. In addition, a sparsity-based filter is proposed for reducing the local high-frequency noise without attenuating or rejecting the coughing or high-frequency breathing signals. The experimental results of cough detection and respiration monitoring show the robustness and accuracy of the proposed method. The low cost and miniaturized sensor can be deployed as a pre-scanning tool for detecting people with COVID-19 symptoms and analyze the severity of the infection.
VI. Supplementary Material
The supplementary materials (S. M) include the respiration signal strength distribution with the barometric sensor at different spatial locations (S. M: Fig. 1-5), confusion matrix for coughing detection (S. M: Fig. 6), the pseudocode of duplicate points reduction (S. M: Table. 1), a performance comparison of current respiration monitoring systems (S. M: Table. 2).
Acknowledgment
The authors acknowledge the significant technical support from the Hamlyn Centre of Imperial College London.
Funding Statement
This work was supported in part by a Newton Fund Institutional Links Grant 330760239 under the Newton-Thailand Research Fund (TRF) partnership, and in part by the UK Department of Business, Energy and Industrial Strategy (BEIS) and TRF and delivered by the British Council.
Contributor Information
Xiaoshuai Chen, Email: cxiaoshuai19@imperial.ac.uk.
Shuo Jiang, Email: jiang_shuo@163.com.
Zeyu Li, Email: zeyu.li@duke.edu.
Benny Lo, Email: benny.lo@imperial.ac.uk.
References
- [1].Li Y. C., Bai W. Z., and Hashikawa T., “The neuroinvasive potential of SARS-CoV2 may play a role in the respiratory failure of COVID-19 patients,” J. Med. Virol., vol. 92, no. 6, pp. 552–555, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2].Sowho M., Amatoury J., Kirkness J. P., and Patil S. P., “Sleep and respiratory physiology in adults,” Clin. Chest Med., vol. 35, no. 3, pp. 469–481, 2014. [DOI] [PubMed] [Google Scholar]
- [3].Ding X.-R. et al. , “Wearable sensing and telehealth technology with potential applications in the coronavirus pandemic,” IEEE Rev. Biomed. Eng., to be published, doi: 10.1109/RBME.2020.2992838. [DOI] [PubMed]
- [4].Liu H., Allen J., Zheng D., and Chen F., “Recent development of respiratory rate measurement technologies,” Physiol. Meas., vol. 40, no. 7, 2019, Art. no. 07TR01. [DOI] [PubMed] [Google Scholar]
- [5].AL-Khalidi F. Q., Saatchi R., Burke D., Elphick H., and Tan S., “Respiration rate monitoring methods: A review,” Pediatr. Pulmonol., vol. 46, no. 6, pp. 523–529, 2011. [DOI] [PubMed] [Google Scholar]
- [6].Miller M. R. et al. , “Standardisation of spirometry,” Eur. Respir. J., vol. 26, no. 2, pp. 319–338, 2005. [DOI] [PubMed] [Google Scholar]
- [7].Montserrat J. M., Farré R., Ballester E., Felez M. A., Pastó M., and Navajas D., “Evaluation of nasal prongs for estimating nasal flow,” Amer. J. Respir. Crit. Care Med., vol. 155, no. 1, pp. 211–215, 1997. [DOI] [PubMed] [Google Scholar]
- [8].Kim S.-M. et al. , “Capnography for assessing nocturnal hypoventilation and predicting compliance with subsequent noninvasive ventilation in patients with ALS,” PLoS One, vol. 6, no. 3, 2011, Art. no. e17893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].Bergese S. D. et al. , “Multicenter study validating accuracy of a continuous respiratory rate measurement derived from pulse oximetry: A comparison with capnography,” Anesth. Analg., vol. 124, no. 4, 2017, Art. no. 1153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [10].Das T., Guha S., Banerjee N., and Basak P., “Development of thermistor based low cost high sensitive respiration rate measurement system using audio software with audio input,” in Proc. IEEE 3rd Int. Conf. Biosignals, Images Instrum., 2017, pp. 1–3. [Google Scholar]
- [11].Chen D.-Y. and Lai J.-C., “HHT-based remote respiratory rate estimation in thermal images,” in Proc. 18th IEEE/ACIS Int. Conf. Softw. Eng., Artif. Intell., Netw. Parallel/Distrib. Comput., 2017, pp. 263–268. [Google Scholar]
- [12].Kano S., Dobashi Y., and Fujii M., “Silica nanoparticle-based portable respiration sensor for analysis of respiration rate, pattern, and phase during exercise,” IEEE Sensors Lett., vol. 2, no. 1, Mar. 2018, Art. no. 2000104. [Google Scholar]
- [13].Zhou C., Zhang X., Tang N., Fang Y., Zhang H., and Duan X., “Rapid response flexible humidity sensor for respiration monitoring using nano-confined strategy,” Nanotechnology, vol. 31, no. 12, 2020, Art. no. 125302. [DOI] [PubMed] [Google Scholar]
- [14].Liu C., Xiong J., Cai L., Feng L., Chen X., and Fang D., “Beyond respiration: Contactless sleep sound-activity recognition using RF signals,” Proc. ACM Interactive, Mobile, Wearable Ubiquitous Technol., vol. 3, no. 3, pp. 1–22, 2019. [Google Scholar]
- [15].Abbasi-Kesbi R., Valipour A., and Imani K., “Cardiorespiratory system monitoring using a developed acoustic sensor,” Healthcare Technol. Lett., vol. 5, no. 1, pp. 7–12, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [16].Bates A., Ling M. J., Mann J., and Arvind D. K., “Respiratory rate and flow waveform estimation from tri-axial accelerometer data,” in Proc. IEEE Int. Conf. Body Sensor Netw., 2010, pp. 144–150. [Google Scholar]
- [17].Zhang H. et al. , “Waist-wearable wireless respiration sensor based on triboelectric effect,” Nano Energy, vol. 59, pp. 75–83, 2019. [Google Scholar]
- [18].Al-Halhouli A., Qitouqa H., Alashqar A., and Abu-Khalaf J., “Inkjet printing for the fabrication of flexible/stretchable wearable electronic devices and sensors,” Sensor Rev., vol. 38, no. 4, 2018, doi: 10.1108/SR-07-2017-0126. [DOI] [Google Scholar]
- [19].Huang M.-C. et al. , “Inconspicuous on-bed respiratory rate monitoring,” in Proc. 6th Int. Conf. Pervasive Technologies Related Assistive Environments, 2013, pp. 1–8. [Google Scholar]
- [20].O'Brien C. and Heneghan C., “A comparison of algorithms for estimation of a respiratory signal from the surface electrocardiogram,” Comput. Biol. Med., vol. 37, no. 3, pp. 305–314, 2007. [DOI] [PubMed] [Google Scholar]
- [21].Meredith D. J., Clifton D., Charlton P., Brooks J., Pugh C., and Tarassenko L., “Photoplethysmographic derivation of respiratory rate: A review of relevant physiology,” J. Med. Eng. Technol., vol. 36, no. 1, pp. 1–7, 2012. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.