Abstract
In 2019, a new virus, SARS-CoV-2, responsible for the COVID-19 disease, was discovered. Asymptomatic and mildly symptomatic patients were forced to quarantine and closely monitor their symptoms and vital signs, most of the time at home. This paper describes e-CoVig, a novel mHealth application, developed as an alternative to the current monitoring paradigm, where the patients are followed up by direct phone contact. The e-CoVig provides a set of functionalities for remote reporting of symptoms, vital signs, and other clinical information to the health services taking care of these patients. The application is designed to register and transmit the heart rate, blood oxygen saturation (), body temperature, respiration, and cough. The system features a mobile application, a web/cloud platform, and a low-cost specific device to acquire the temperature and . The architecture of the system is flexible and can be configured for different operation conditions. Current commercial devices, such as oximeters and thermometers, can also be used and read using the optical character recognition (OCR) functionality of the system. The data acquired at the mobile application are sent automatically to the web/cloud application and made available in real-time to the medical staff, enabling the follow-up of several users simultaneously without the need for time consuming phone call interactions. The system was already tested for its feasibility and a preliminary deployment was performed on a nursing home showing promising results.
Keywords: COVID-19, mHealth, telemedicine, pulse oximetry, temperature
1. Introduction
A viral pneumonia outbreak reported in December 2019, in Wuhan, China [1,2], was caused by a new virus SARS-CoV-2 (severe acute respiratory syndrome—coronavirus 2), a member of the coronavirus family. First identified in the 1960s, this group of viruses has between 60–140 nm and 30k+ bases and is found mostly in bats, birds, and reptiles. It is the 7th lineage of the Coronavirus family [3], thought to have crossed the species barrier, and causes a human respiratory disease named COVID-19.
SARS-CoV-2 changed the world. This highly contagious pathogen spread worldwide in months and healthcare facilities were quickly overwhelmed with the burden of patients. To tackle this pandemic, three methods are being set in place: vaccination, pharmacologic therapy, and the so-called non-pharmacologic intervention (NPI), which includes lockdown, social distancing, mask-wearing, testing, and tracing. An important NPI component is the increase the symptoms tracking and vital signs monitoring capabilities, in particular for mild or asymptomatic patients at home or in isolated accommodations. Providing the tools for easy visualization and management of the collected data is also important, which would allow for a closer monitoring of these patients and a quicker clinical response if necessary.
e-CoVig is a novel highly adaptable mHealth system developed for the remote monitoring of symptoms in COVID-19 patients, which uses the mobile phone as a primary sensing device. Our approach is designed to enable rapid deployment at affordable costs and followed a “human-friendly” design approach. This system is indicated for patients diagnosed with this disease and subjects undergoing quarantine, aiding in the screening of COVID-19. The main contributions of our work are the cloud-connected mobile application for remote symptomatology monitoring, the specialized wearable device that can be deployed at scale, and a feasibility study that precedes a full scale real-world evaluation. The remainder of the work is organized as follows: Section 2 establishes the background to the problem; Section 3 describes the state-of-the-art in mHealth applications; Section 4 details the implementation of our e-CoVig approach; Section 5 summarizes the feasibility evaluation results; finally, Section 6 provides a discussion and outline of the main findings.
2. Background
In humans, four active CoV lineages generally account for 15-30% of common colds in children and adults (229E, NL63, OC43, and HKU1) [4]. Three other particularly aggressive forms cause respiratory disorders; designated as severe acute respiratory syndrome (SARS) and middle east respiratory syndrome (MERS), the variants are known as SARS-CoV (active between 2002–2004), MERS-CoV (active since 2012), and SARS-CoV-2 (active since 2019).
SARS-CoV-2 causes the COVID-19 disease, which ranges from mild influenza-like syndrome to a life-threatening respiratory infection. Compared with the previous pandemics (influenza-derived), COVID-19 is the first from the coronavirus family, which means that the world was much less prepared to manage it [5,6,7]. COVID-19 initially lacked specific pharmacological therapy or vaccines, and the physio-pathological process was unknown.
SARS-CoV-2 is inhaled, affecting the upper respiratory system with fever, smell perturbations, sneezing, and headaches [8]. Based on the available information [9,10], SARS-CoV-2 causes an exacerbated thrombo-inflammatory process with initial pulmonary involvement (although it quickly affects other organs), which results in hypoxemia, often without the subjects noticing [11], leading to a deficient relation between ventilation and perfusion. In the worst case, patients may need either non-invasive or invasive ventilation to enable lung oxygenation support. As much as 15–20% of the people hospitalized with COVID-19 require a ventilator, while more than 70% of patients who enter intensive care need one [12,13].
The most frequent symptoms are fever, tiredness, dry cough, myalgia, dyspnea, loss of smell, gustatory dysfunction, rhinorrhea, asthenia, and sore throat [5,14,15,16]. “Silent” hypoxemia (i.e., unperceived lack of oxygen), and persistent high fever, are among the main early physical signs. Hospital admission criteria include persistent high fever (>38 °C) for the past 48 h, increased respiratory rate (≥24 CPM), and decreased oxygen saturation (≤94%).
These parameters can be monitored preventively at home. Such monitoring can consist of a frequent recording of body temperature, oxygen saturation, respiration, photoplethysmography (PPG), heart rate (HR), audio for cough characterization, and also self-report questionnaires or other relevant clinical data for the characterization of the pathology, e.g., to assess smell or gustatory dysfunction.
Mobile health (mHealth) pertains to the use of mobile devices, such as smartphones, tablets, and related personal use devices to deliver healthcare services [17,18]. As highlighted by Gonzalez et al. [17], mHealth systems typically comprise a: (1) sensor unit; (2) mobile unit; (3) remote unit. The same authors concluded that although mHealth is a topic of growing interest, there is a lack of integrated solutions, which would enhance multiple open challenges in existing approaches. COVID-19 demanded a quick and specialized response, involving symptom tracking as well as physiological sensing.
Although several mHealth systems exist, we present a novel approach for at-home support and self-reporting of the outcomes using the smartphone as the primary data collection interface. Special emphasis has been given to usability, providing a “human-friendly” end-to-end solution for automated COVID-19 patient tracking (Figure 1).
3. State-of-the-Art
As of May 2020, more than 200 COVID-19 related applications were found on the App Store and Google Play Store [19]. These applications present various features, the most frequent being [19,20]: (a) General information about the coronavirus pandemic; (b) news; (c) recording of symptoms; (d) contact tracing apps. The main features of our approach are the patient diary, the smartphone-based physiological sensing, and the specialized device. An example of a comparable approach is the “K-note” app [21]. Developed in Japan, this application was adapted for use in the coronavirus outbreak; its main features are recording individual patient data and symptoms, and sending them via email to appropriate health professionals in a CSV file. Between March and May, the application was installed by more than 20,280 users and 400 facilities and organizations across Japan.
Other applications and platforms were developed to address the COVID-19 pandemic. In Portugal, the web-platform Trace COVID-19 was developed by the National Health System for symptom tracking and managing patients. In this platform, healthcare professionals can register specific information of infection cases, conduct contact tracing, surveillance, and clinical follow-up of patients with suspected or confirmed COVID-19. However, the information must be gathered and inserted manually into the platform by healthcare professionals, increasing the overall workload. In the United Kingdom, a health science company called ZOE, together with London King’s College launched the COVID Symptom Study app [22], which aims to gather information about COVID-19 to better understand the disease and its evolution. Users that install this application provide information regarding their symptoms daily. All this information is gathered and processed using software algorithms to improve the understanding of COVID-19 symptoms, how fast the virus is spreading in different areas, identify risk areas in the country, and better understand symptoms linked to health conditions. It is important to note that this application is not intended to be a diagnostic tool.
A major difference of previous work to our work is the goal of developing a smartphone-based platform for symptoms and vital signs monitoring, where referred individuals report their symptoms and regularly measure their vital signs, while health professionals monitor the registered information “on the other side”. Therefore, our application implements phone-based methods for signal acquisition using the smartphone built-in sensors, such as the camera or microphone. To evaluate vital signs that require specialized sensors (e.g., body temperature), a low cost wearable was developed. There are other clinical devices that measure blood oxygenation, heart rate, and body temperature, such as the JERRY-II+(AA) compact pulse oximeter, or the OXIrate hand-held pulse oximeter; however, these devices are typically expensive and difficult to integrate into other platforms. In Portugal, a group of students and researchers at Nova School of Science & Technology developed a simple device that uses a BITalino device coupled with pulse oximetry and temperature sensors to measure these vital signs (Project HomeSafe), however, the cost of such station is still high. Our novel specialized low-cost wearable is open-source, easily upgradable, and unlike the previously mentioned alternatives, uses an IR thermometer, reducing the overall acquisition time; furthermore, all the sensors are integrated in a single device. Despite the latest advances in telemedicine and mHealth, existing systems are still hindered by high deployment costs, proprietary protocols, closed hardware and software, intrusive form factors, and/or long learning curves. We offer an open-source solution that can be easily upgraded and integrated into other systems. The cloud platform also offers an easy way to visualize data in a user-friendly website.
4. Proposed Approach
This section describes the main components of the proposed flexible system. It is made up of three main blocks, designed to function as a whole, but each block can also work separately and independently.
4.1. Overall Architecture
The e-CoVig system is a low-cost mHealth solution, coupling a cloud-based e-Health platform for the collection, management, and visualization of physiological and clinical data to a ubiquitous system for acquiring symptomatic measures, using the mobile phone as the primary interface. It seeks to automate the process of follow-up and monitoring of a large number of patients. Monitored parameters include dense recording of temperature, oxygen saturation (), photoplethysmography (PPG), heart rate (HR), audio (for the characterization of the cough and respiration), as well as self-report questionnaires with COVID-19 symptomatology or other relevant clinical data for the characterization of the pathology.
Physiological measurements, namely , HR, and temperature are collected using a low-cost and easy-to-use specialized device. The BrainAnswer data visualization and monitoring platform (BrainAnswer—Neuroscience in your hands. https://brainanswer.pt/, accessed on 20 March 2021) is used as cloud-base storage, analytics engine, and patient and healthcare professional dashboards portal. e-CoVig is intended to facilitate the automated interaction between the user and the national healthcare systems, contributing to reduce the risk of contamination and densifying the monitoring process over time, by increasing the number of symptomatic measures. The system can also be extended to other units in the public, private, or social sector. Figure 2 presents the detailed architecture of the system.
4.2. Session Management and Authentication
Individuals undergoing e-CoVig monitoring are assigned a unique QR code that can be used across the different components of the system (i.e., mobile and web apps). The mobile app is installed either by the patient, informal carer, or healthcare professional and serves as the primary data collection interface.
When the user opens the application for the first time, the app opens the Login Screen (Figure 3a), where it is possible to sign in to the application with login credentials email/phone number, and password, or by scanning the previously generated personal QR code (Figure 3b). After successfully signing in, the user unlocks the application features (Figure 3c).
The QR code is particularly useful to simplify the login process for patients less proficient in smartphone use. It also enables batch processing of multiple patients in internment or in institutions, e.g., elderly homes, correctional facilities, and others in which it may be of added value to monitor groups of patients sequentially.
All the data collected with the mobile app are stored locally and synchronized with the BrainAnswer cloud back-end whenever an Internet connection is available. BrainAnswer also provides a web-app with a user-friendly analytics dashboard, through which healthcare professionals can review the status of the population that they are following, receive alerts for patients in which abnormal parameters are detected (e.g., hypoxia, high fever), and review the collected qualitative and quantitative data.
4.3. Mobile App
The mobile application is the preferred component of the system for the acquisition and transmission of the data for the subjects being monitored. Physiological and clinical data are acquired and sent to the cloud platform through this smartphone-based platform, where the healthcare personnel can follow the symptoms’ evolution and general health of the subjects. Its main functionalities are as follows:
Electronic Diary (e-Diary)
Symptoms are periodically assessed using an in-app patient electronic diary; self-reporting questionnaires enable the recording of other relevant clinical data to support the pathology characterization. These questionnaires divide symptoms into two categories: moderate and severe. In the moderate section, patients can report symptoms such as mild fever, cough, headaches, muscle pain, weakness, loss of smell or taste, and sore throat. In the severe section, the symptoms monitored are high fever (>38 °C), shortness of breath, peripheral cyanosis, chest pain, loss of consciousness, bloody cough, and vomiting or diarrhea. Taking into account that COVID-19 can have a heavy toll on patients’ overall well-being, the questionnaire includes questions regarding anxiety, quality of sleep, focusing state, and overall feeling.
The patient symptoms diary is implemented using forms (Figure 4a), which can be dynamically and remotely modified through the BrainAnswer cloud platform by health professionals (Figure 2), to better suit each patients’ needs and provide a simple way to gather information regarding the patient and his symptoms.
Quantitative assessment of physiological parameters can be performed momentarily or near-continuously with the specialized device (when applicable). The mobile app also issues reminders and enables the patients to access historical data. Physiological measurements can be performed through multiple methods, as described next.
Optical Character Recognition (OCR)
Using the camera, the mobile application is capable of performing optical character recognition (OCR) on pictures taken to a digital display. This technique allows the patient to automatically retrieve text from household devices that might be available using the camera feed. In our system, this feature is used to retrieve the temperature value from thermometers (Figure 4c), or the blood oxygenation value from pulse oximeters (POxs). This feature can be extended to acquire the blood pressure values from a blood pressure monitor.
Respiration and Cough Recording
Using the microphone on the smartphone, it is possible to record the patients’ respiration or coughing and instantly share it with the health professional. This feature allows for a characterization of the breathing sounds and an assessment of the cough, which is typically hard to describe by the patient itself. The duration of the recording can be adjusted on the web platform to better suit the patient’s needs.
Camera-based Photoplethysmography (cbPPG)
The application implements a camera-based photoplethysmography (cbPPG) feature, by using the device camera and flash [23,24,25,26,27]. This works on the principle that the blood absorbs irradiated light more than tissues [28,29,30] and, consequently, the blood flow affects the amount of light reflected. By measuring the reflected light, the difference in blood flow volume caused by the cardiovascular dynamics can be detected, Figure 4b.
BITalino Integration
For patients with enhanced risk or who have already been diagnosed, it is important to measure temperature and , which are not easily obtained accurately using a standard smartphone. To overcome this problem, our application can record such data from BITalino, a commercial device that has been specifically designed to deal with the requirements of multi-modal physiological data acquisition [31]. This also allows the acquisition of other sensors that can be interfaced with a BITalino device, such as electrocardiography (ECG) signals, which can provide valuable cardiovascular information.
e-CoVig Device
Due to the cabled connections of the sensors in the BITalino device and its cost compared to standard digital thermometers and POxs, we developed a specialized low-cost device (see Section 4.4). It has all the sensors integrated into an ergonomic form factor, wireless connectivity, and is equipped with specific sensors of interest in the remote monitoring of COVID-19. The device is assigned to the patient, allowing the recording of body temperature, heart rate, and . The application is capable of communicating with the developed device and retrieving the measurements from the onboard sensors (Figure 4d).
4.4. Specialized Device
A specialized device was built using the low-cost and low-power system ESP32 microcontroller (Espressif Systems, Shanghai, China) coupled with specialized sensors (Figure 5). The ESP32 is based on a single-core 32-bit microprocessor running at 160 MHz, 520 KiB of static RAM, integrating Wi-Fi and Bluetooth (classic and BLE). It can be powered using a small LiPo battery.
The device, specialized in and temperature acquisition, uses the following sensors:
Maxim Integrated MAX30101 (Maxim Integrated, San Jose, CA, USA) high-sensitivity pulse oximeter and heart-rate sensor for wearable health, coupled with the MAX32664 biometric sensor hub (Maxim Integrated, San Jose, CA, USA). Once a finger covers the MAX30101 sensor, light-dependent PPG signals are captured and filtered. These signals are passed to the MAX32664 sensor hub, which uses the available information to compute the blood oxygenation and heart rate. The computed values are transmitted to the ESP32 using I2C serial communication protocol.
Melexis MLX90614 digital non-contact infrared thermometer (Melexis, Ieper, Belgium). The sensor measures the surface temperature of any object is pointing to; temperature can be measured by pointing the sensor to a relevant body part, e.g., forehead skin or inner ear (tympanic temperature). The ESP32 queries the temperature sensor using I2C. The thermometer measures the object (surface) temperature, however, the forehead skin temperature does not correspond directly to the subject’s core body temperature. Common IR thermometers convert the object temperature into body temperature. It was assumed that this transformation follows a linear regression. Object and body pair temperature measurements were taken with an F102 IR thermometer to obtain a linear equation that translates forehead object temperature measurements into body temperature estimations. The results are displayed in Figure 6.
The device is constantly gathering these three measurements (, heart rate, and temperature) and, once a Bluetooth connection is established, the values are sent via Bluetooth Serial in a JSON format to the smartphone, as shown below:
The Confidence variable represents the confidence of the sensor, Status reflects the status of the sensor (0: Success, 1: Not Ready, 2: Object Detected, 3: Finger Detected), and the remaining are self-explanatory. A 3D-printed case was designed to encapsulate the developed device.
The measurement of body temperature at the forehead may lack precision, especially since it is more susceptible to acquisition conditions variability, e.g., the distance from the sensor to the skin greatly impacts the measured temperature. A more accurate and reliable approach would be measuring the tympanic temperature using the IR thermometer, which is a better representation of the subject’s body temperature, therefore, not requiring a linear transformation. The device takes periodic measures of temperature evenly spaced by 0.5 s and, to avoid small fluctuations, a moving average filter of width 3 is applied.
4.5. Workflow
Although our approach can be applied to other use cases, it has been designed for mild or asymptomatic patients at home or in isolated accommodations. It aims to provide an easy and automated method to register symptoms and vital signs and share them with the appropriate healthcare professional.
In case of COVID-19 suspicion, the patient contacts or is referenced by the healthcare professional, which then creates an e-CoVig account. After receiving the credentials or personal QR code, the patient completes his/her profile on the BrainAnswer platform, where the remote monitoring procedure is explained. The patient then installs the application on the smartphone (e-CoVig—available on Google Play. https://play.google.com/store/apps/details?id=com.ecovig.app, accessed on 20 March 2021).
In more severe cases, but still, of home quarantine, an e-CoVig device is either delivered at the healthcare facility or mailed to the patient’s address. Within the smartphone application, the patient has a specific measurement protocol that he should follow. Instructions on how to use the device and platform are provided to the patient using the device by the responsible healthcare professional to assure good conditions for the acquisition of vital signs. Video instructions for self-guided operation are also provided (https://brainanswer.pt/website/project/ecovig/video-ecovig.mp4, accessed on 20 March 2021).
The application can store all the collected information locally (Figure 7a), enabling the patient to review the history data (e.g., Figure 7b). It can also send the information to the cloud-based BrainAnswer platform, through which it can be shared with health professionals. The BrainAnswer platform also integrates algorithms for feature extraction and risk assessment of the monitored subjects, following the guidelines set forth by the COVID-19 management task force in Portugal.
Reminders can also be defined (Figure 7c) so that the patient never forgets to measure his vital signs and share them with healthcare professionals. These reminders can be defined by the patients and healthcare professionals previously, or remotely according to the patient’s medical needs.
On the BrainAnswer platform side, a healthcare professional is responsible for the follow-up of a given patient (or a group of patients). The professional can visualize on his dashboard the information submitted by the various patients. If they suspect that some patient is at greater risk, it is possible to remotely set a stricter acquisition regime for the patient or to contact him via the contacts provided during registration. This way, a single health professional could manage a larger number of patients, decreasing the gathering of people in health centers, and making more efficient the work of medical helplines.
5. Results
This section presents the experiments that were done to validate the system especially addressing the acquisition of physiological data.
5.1. Participants, Procedure, and Statistics
We designed a cross-sectional study to ascertain the reproducibility and accuracy of the measurements of , heart rate, and temperature with the e-CoVig device. A priori sample size was estimated with the G*Power software, version 3.1.9.6 (Universität Kiel, Germany) [32,33], for a medium-size effect, a power of 0.80, and an error probability of 0.05, resulting in a minimum sample of 27 participants to achieve the criteria. Accordingly, thirty volunteers were recruited, by convenience, among the students and staff of Coimbra’s Polytechnic Institute to participate in the study. The main characteristics of the population are summarized in Table 1.
Table 1.
Mean | Standard Deviation | |
Age (years) | ||
Height (m) | ||
Weight (Kg) | ||
Temperature (°C) | ||
N | % | |
Gender (female) | 22 | |
Smoking habits (yes) | 1 | |
Sedentary (yes) | 14 | |
Arterial hypertension (yes) | 0 | |
Dyslipidaemia (yes) | 2 | |
Diabetes (yes) | 0 | |
Other clinical conditions (yes) | 0 | |
Medication (yes) | 2 |
Written informed consent from each participant was obtained, and all data were treated confidentially and anonymously. The Ethical Commission of the Polytechnic Institute of Coimbra approved the study.
All evaluations were performed in the morning, in a laboratory with appropriate conditions and controlled humidity, temperature, light, and sound, with the participant comfortably seated and after a 10 min resting period. Relevant demographic and clinical data were initially collected. For each physiological parameter (, heart rate, and temporal and tympanic temperature), four consecutive measurements were taken with an interval of 2 min between measurements, alternating the e-CoVig device (two measurements) with a standard clinically validated device (two measurements).
The reference devices used for comparison were the MX430 Philips Intellivue Patient Monitor (Royal Phillips, Amsterdam, Netherlands) for and heart rate, the Microlife NC150 non-contact thermometer (Microlife AG Swiss Corporation, Widnau, Switzerland) for the forehead (temporal) temperature, and the Omron GT 510 oto-thermometer (Omron Corporation, Kyoto, Japan) for the ear (tympanic) temperature. The mean value for each pair of measurements obtained with the reference and the e-CoVig device was used for comparison, assessing the degree of agreement between methods. The individual measurements obtained with the e-Covig device were further used for assessing reproducibility.
The data were computerized and processed with R (version 4.0.3). Simple descriptive statistics were applied for demographic and clinical characterization. Data are presented as mean ± standard deviation (SD) for continuous variables, and as frequency (%) for categorical variables. Comparisons between independent groups were performed with Student’s t-test, and for repeated measures with Student’s paired t-test. The bivariate correlation analysis was performed with Pearson’s R and regression analysis. The criterion for statistical significance used was a p-value ≤ 0.05 to a 95% confidence interval.
5.2. Reproducibility Results
To study the reproducibility of the e-CoVig device, a repeated-measurements comparison was performed, for which results are summarized in Table 2. As demonstrated, no significant differences were observed for heart rate, oxygen saturation, and temporal and tympanic temperatures. The lower p-value of the temperature measures can be explained by the small range of measured values and the precision of the IR sensor used in the specialized e-CoVig device, which is 0.5 °C in this temperature range.
Table 2.
1st Measurement | 2nd Measurement | Mean Difference | p-Value | |
---|---|---|---|---|
Heart rate (BPM) | ||||
(%) | ||||
Temporal temperature (°C) | ||||
Tympanic temperature (°C) |
Figure 8 depicts the regression plots for the repeated-measurements with the e-CoVig device, highlighting the significant correlation between measurements buttressed by significant correlation terms for all the physiological variables studied.
5.3. Agreement Results
Regarding the comparison between the measurements made with the e-CoVig and the standard clinically validated devices, Table 3 summarizes the pairwise analysis. The mean difference obtained for the e-CoVig tympanic temperature measurement is greater than the temporal temperature (−1.04 ± 0.26 vs. 0.34 ± 0.34, respectively, p < 0.001), which can be explained by the fact that the temporal measurements correspond to an estimation of the core temperature from the temperature measured on the forehead skin, while the tympanic temperature is a better representation of the core temperature, not requiring a previous calibration. It is noteworthy that the standard deviation was smaller for the tympanic measurements, indicating that this method of acquisition is less susceptible to variability caused by the acquisition procedure.
Table 3.
Standard Device | e-CoVig Device | Mean Difference | p-Value | |
---|---|---|---|---|
Heart rate (BPM) | ||||
(%) | ||||
Temporal temperature (°C) | <0.001 | |||
Tympanic temperature (°C) | <0.001 |
A very strong positive and linear correlation was found between the e-CoVig and the standard devices regarding the measurements of heart rate (R = 0.991, p < 0.001) and oxygen saturation (R = 0.964, p < 0.001). No significant association was found regarding the measurements of temporal (R = 0.322, p = 0.083) and tympanic (r = 0.212, p = 0.260) temperatures, as depicted in Figure 9. These results are expected, given that the range of temperature measurements is very narrow, less than 1 °C for the tympanic reference temperature, and the IR thermometer has a precision of 0.5 °C within this range. Small variations of the distance between the sensor and the body could have also affected these results. It is speculated that the lower p-value of the Pearson’s coefficient for the temporal measurements is due to the wider range of measured temperatures when compared with the tympanic ones (SD: 0.33 vs. 0.18 °C).
6. Discussion
The COVID-19 pandemic forced several thousands of people to be confined to their homes. In case of suspicion or confirmation of infection, it is important to monitor the symptoms and vital signs of the subject. Our approach facilitates this monitoring, by providing a mobile-cloud platform that allows patients to record their symptoms, and a specialized device to measure and record physiological signals.
The mobile platform uses a cloud back-end provided by BrainAnswer, resulting in greater flexibility and modularity of the monitoring procedures. The cloud platform also works as a web portal, which medical professionals can use to visualize and manage their patients’ medical data. The mobile and web platforms were used at Santa Casa da Misericórdia’s Nursing Home of Castelo Branco for monitoring the residents, showing good preliminary results. The platforms were handled by instructed healthcare professionals of this establishment and were a valuable tool to digitize the patients’ data. A total of 30 residents participated and 865 acquisitions were performed during one month of use. The main feature used was the self-reports, which allowed the nursing home to easily store medical information and later visualize it in an organized way. The previous method for storing these data was using paper records, therefore, the e-CoVig platform facilitates the effortless transition to digital records. Promising results were achieved, as there was good adherence, lack of resistance, and nurses reported that using e-CoVig made it easier to store data and share it with other healthcare professionals between shifts.
The smartphone-based methods for recording vital signals, either by using OCR or cbPPG, provide a more objective method of recording important medical data, without requiring the acquisition of extra devices. This enables widespread deployment at a large scale. The cbPPG may also be used for estimating the respiration rate, the stress level, and even the blood oxygenation [24,25,27], which can help detect and prevent cases of silent hypoxia [11].
The developed specialized device presented good results overall, and is integrated with the mobile application, thus enabling the measurement of body temperature, heart rate, and . These three vital signals are very important to monitor in COVID-19 patients. The pulse oximeter sensor showed identical results to a standard clinical pulse oximeter. The IR thermometer on the device can be used to measure the tympanic and temporal temperatures, the latter requiring a linear transformation for estimation of the body temperature. The temporal temperature results presented a mean difference of 0.34 °C and standard deviation of 0.34 °C, which is within the precision of the thermometer in this range, (i.e., 0.5 °C). These results could be improved even further if a sensor more accurate in the body temperature range is used (e.g., the MLX90614ESF-DCC, -DCH, or -DCI.
It is important to note that measuring the body temperature on the forehead comes with some limitations; in a recent article in IEEE Spectrum, Erik Beall described them [34], highlighting the main limitation of the temporal temperature, which is the fact that it estimates the body temperature from the skin temperature in the forehead. This measurement may lack precision and, even though it can give a rough estimation of the body core temperature, an acquisition site more representative of the internal temperature is desirable (e.g., the tympanic temperature as suggested in our approach).
Regarding the tympanic temperature measurements, the results presented a lower standard deviation of differences, while showing a larger mean difference, which could be corrected by adding an offset to the estimation. When measuring the tympanic temperature, a probe cap could be used to standardize the acquisition method, reducing acquisition variability and improving the results. It is important to acknowledge that the p-values of the temperature measurements did not present significant values, which may be caused by the limited range of measured temperatures since all the subjects had body temperature values within the normal range. Nevertheless, this is a fundamental first step to ensure that it is worthwhile enrolling real patients in the experimental evaluation. Testing the IR temperature sensor on feverish subjects would provide a wider range of temperatures, further refining the results. Future work should also include the implementation of feedback channels between the medical professional and the patient, so patients can feel safely monitored.
Beside the specialized device, the BITalino device was also integrated into the e-CoVig application, allowing the acquisition of additional physiological signals using this established device; this makes it possible for the device to read ECG (e.g.), enabling the use of e-CoVig not only for monitoring COVID-19 patients, but also cardiac and other chronic patients.
The next step is a full evaluation of the system in a real-world setting. e-CoVig will be deployed for long-term monitoring at least two medical wards where COVID-19 and non-COVID-19 patients are present. In these wards, patients are already monitored using standard clinical equipment, and followed by practitioners who investigate patient symptoms. Concurrent data acquisition using e-CoVig and standard medical practices will enable the validation of the , heart rate, and temperature measurements. It will also establish the base for the development of patient outcomes prediction and modeling, allowing for early intervention from healthcare practitioners.
Overall, e-CoVig showed very good results both in the laboratory and real-world settings. The suggested remote-monitoring paradigm could allow the monitoring of a larger number of patients, without greatly increasing the work overhead for medical professionals and is ready for deployment. This tool can be used for individual monitoring, in the case of subjects under home quarantine, or for collective monitoring, as it is being used to follow-up the residents in a nursing home.
Acknowledgments
The authors would like to thank all the volunteers that have accepted to participate in the study, and to all the institutions that made this work possible.
Author Contributions
Conceptualization, resources, and funding acquisition, H.P.d.S., J.S., J.V., L.B.R. and T.P.; software, A.R., L.M. and R.C.; hardware F.M., A.R., H.P.d.S. and J.S.; validation, J.V., T.P., F.F. and L.B.R.; methodology, formal analysis, investigation, data curation, and writing—review and editing, all authors; writing—original draft preparation, A.R. and H.P.d.S.; project administration, H.P.d.S., J.S. and J.V. All authors have read and agreed to the published version of the manuscript.
Funding
This work was funded by Fundação para a Ciência e Tecnologia (FCT) under the grants e-CoVig—Project 255_596880547, and LARSyS—Project UIDB/50009/2020, by FCT/MCTES through national funds and, when applicable, co-funded EU funds under the grant NICE-HOME—Project UIDB/50008/2020, and by the IT—Instituto de Telecomunicações under grant BI/No. 13—19 May 2020 “AIMHealth”, which is gratefully acknowledged.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethical Commission of the Polytechnic Institute of Coimbra (87_CEIPC/2020, approved on 30 May 2020).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available upon reasonable request made to the corresponding author. The data are not publicly available due to privacy restrictions.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study, in the collection, analyses, or interpretation of data, in the writing of the manuscript, or in the decision to publish the results.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.ProMED Promed Post—ProMED-Mail. [(accessed on 14 August 2020)]; Available online: https://promedmail.org/promed-post/?id=6864153%20#COVID19.
- 2.World Health Organization Pneumonia of Unknown Cause—China. [(accessed on 14 August 2020)]; Available online: https://www.who.int/csr/don/05-january-2020-pneumonia-of-unkown-cause-china/en/
- 3.European Centre for Disease Prevention and Control Latest Evidence on COVID-19. [(accessed on 16 August 2020)]; Available online: https://www.ecdc.europa.eu/en/covid-19/latest-evidence.
- 4.Lim Y.X., Ng Y.L., Tam J.P., Liu D.X. Human Coronaviruses: A Review of Virus–Host Interactions. Diseases. 2016;4:26. doi: 10.3390/diseases4030026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Joseph T., Moslehi M. International Pulmonologist’s Consensus on COVID-19. Amrita Institute of Medical Sciences; Kochi, Kerala, India: 2020. [Google Scholar]
- 6.Times T.N.Y. How Bad Will the Coronavirus Outbreak Get? Here Are 6 Key Factors. [(accessed on 16 August 2020)]; Available online: https://www.nytimes.com/interactive/2020/world/asia/china-coronavirus-contain.html.
- 7.Times T.N.Y. Telemedicine Arrives in the U.K.: ‘10 Years of Change in One Week’. [(accessed on 16 August 2020)]; Available online: https://www.nytimes.com/2020/04/04/world/europe/telemedicine-uk-coronavirus.html.
- 8.Pullen M., Skipper C., Hullsiek K., Bangdiwala A., Pastick K., Okafor E., Lofgren S., Rajasingham R., Engen N., Galdys A., et al. Symptoms of COVID-19 Outpatients in the United States. Open Forum Infect. Dis. 2020 doi: 10.1093/ofid/ofaa271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Polidoro R.B., Hagan R.S., de Santis Santiago R., Schmidt N.W. Overview: Systemic Inflammatory Response Derived From Lung Injury Caused by SARS-CoV-2 Infection Explains Severe Outcomes in COVID-19. Front. Immunol. 2020;11 doi: 10.3389/fimmu.2020.01626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Gandhi R.T., Lynch J.B., del Rio C. Mild or Moderate Covid-19. N. Engl. J. Med. 2020;383:1757–1766. doi: 10.1056/NEJMcp2009249. [DOI] [PubMed] [Google Scholar]
- 11.Torjesen I. COVID-19: Patients to use pulse oximetry at home to spot deterioration. BMJ. 2020:m4151. doi: 10.1136/bmj.m4151. [DOI] [Google Scholar]
- 12.CNN The World Is Scrambling to Buy Ventilators in the COVID-19 Pandemic. One Country Has Only Four of Them—For 12 Million People. [(accessed on 10 February 2021)]; Available online: https://edition.cnn.com/2020/04/18/africa/covid-19-ventilator-shortage-intl-scli/index.html.
- 13.Ñamendys-Silva S. Respiratory support for patients with COVID-19 infection. Lancet. 2020;8:E18. doi: 10.1016/S2213-2600(20)30110-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Guan W., Ni Z., Hu Y., Liang W., Ou C., He J., Liu L., Shan H., Lei C., Hui D.S., et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N. Engl. J. Med. 2020;382:1708–1720. doi: 10.1056/NEJMoa2002032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Lechien J.R., Chiesa-Estomba C.M., Place S., Laethem Y.V., Cabaraux P., Mat Q., Huet K., Plzak J., Horoi M., Hans S., et al. Clinical and epidemiological characteristics of 1420 European patients with mild-to-moderate coronavirus disease 2019. J. Intern. Med. 2020;288:335–344. doi: 10.1111/joim.13089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.O’Keefe J.B., Tong E.J., O’Keefe G.A.D., Tong D.C. Predictors of disease duration and symptom course of outpatients with acute covid-19: A retrospective cohort study. medRxiv. 2020 doi: 10.1101/2020.06.05.20123471. [DOI] [Google Scholar]
- 17.Gonzalez E., Peña R., Avila A., Vargas-Rosales C., Munoz-Rodriguez D. A Systematic Review on Recent Advances in mHealth Systems: Deployment Architecture for Emergency Response. J. Healthc. Eng. 2017;2017:1–13. doi: 10.1155/2017/9186270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Silva B., Rodrigues J., de la Torre Díez I., López-Coronado M., Saleem K. Mobile-health: A review of current state in 2015. J. Biomed. Inform. 2015;56:265–272. doi: 10.1016/j.jbi.2015.06.003. [DOI] [PubMed] [Google Scholar]
- 19.Ming L., Untong N., Aliudin N.A., Osili N., Kifli N., Tan C.S., Goh K., Ng P., Al-Worafi Y., Lee K., et al. Mobile Health Apps on COVID-19 Launched in the Early Days of the Pandemic: Content Analysis and Review. JMIR mHealth uHealth. 2020;8:e19796. doi: 10.2196/19796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Collado-Borrell R., Escudero-Vilaplana V., Villanueva-Bueno C., Herranz A., Sanjurjo-Saez M. Features and Functionalities of Smartphone Apps Related to COVID-19: Systematic Search in App Stores and Content Analysis. J. Med Internet Res. 2020;22:e20334. doi: 10.2196/20334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Yamamoto K., Takahashi T., Urasaki M., Nagayasu Y., Shimamoto T., Tateyama Y., Matsuzaki K., Kobayashi D., Kubo S., Mito S., et al. Health Observation App for COVID-19 Symptom Tracking Integrated With Personal Health Records: Proof of Concept and Practical Use Study. JMIR mHealth uHealth. 2020;8:e19902. doi: 10.2196/19902. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sudre C.H., Lee K.A., Lochlainn M.N., Varsavsky T., Murray B., Graham M.S., Menni C., Modat M., Bowyer R.C.E., Nguyen L.H., et al. Symptom clusters in COVID-19: A potential clinical prediction tool from the COVID Symptom Study app. Sci. Adv. 2021;7 doi: 10.1126/sciadv.abd4177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Jonathan E., Leahy M. Investigating a smartphone imaging unit for photoplethysmography. Physiol. Meas. 2010;31:N79–N83. doi: 10.1088/0967-3334/31/11/N01. [DOI] [PubMed] [Google Scholar]
- 24.Scully C., Lee J., Meyer J., Gorbach A., Granquist-Fraser D., Mendelson Y., Chon K. Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone. IEEE Trans. Biomed. Eng. 2011;59:303–306. doi: 10.1109/TBME.2011.2163157. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kanva A., Sharma C., Deb S. Determination of SpO2 and heart-rate using smartphone camera; Proceedings of the 2014 International Conference on Control, Instrumentation, Energy and Communication (CIEC); Calcutta, India. 31 January–2 February 2014; pp. 237–241. [DOI] [Google Scholar]
- 26.Yan B., Chan C., Li C., To O., Lai W., Tse G., Poh Y., Poh M.Z. Resting and Postexercise Heart Rate Detection From Fingertip and Facial Photoplethysmography Using a Smartphone Camera: A Validation Study. JMIR Mhealth Uhealth. 2017;5:e33. doi: 10.2196/mhealth.7275. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Ding X., Nassehi D., Larson E.C. Measuring Oxygen Saturation With Smartphone Cameras Using Convolutional Neural Networks. IEEE J. Biomed. Health Inform. 2018;23:2603–2610. doi: 10.1109/JBHI.2018.2887209. [DOI] [PubMed] [Google Scholar]
- 28.Mendelson Y. Pulse oximetry: Theory and applications for noninvasive monitoring. Clin. Chem. 1992;38:1601–1607. doi: 10.1093/clinchem/38.9.1601. [DOI] [PubMed] [Google Scholar]
- 29.Allen J. Photoplethysmography and it application in clinical physiological measurement. Physiol. Meas. 2007;28:R1–R39. doi: 10.1088/0967-3334/28/3/R01. [DOI] [PubMed] [Google Scholar]
- 30.Alian A.A., Shelley K.H. Monitoring Technologies in Acute Care Environments. Springer; New York, NY, USA: 2014. Photoplethysmography: Analysis of the Pulse Oximeter Waveform; pp. 165–178. [DOI] [Google Scholar]
- 31.Silva H.P., Fred A., Martins R. Biosignals for Everyone. IEEE Pervasive Comput. 2014;13:64–71. doi: 10.1109/MPRV.2014.61. [DOI] [Google Scholar]
- 32.Faul F., Erdfelder E., Lang A.G., Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
- 33.Faul F., Erdfelder E., Buchner A., Lang A.G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods. 2009;41:1149–1160. doi: 10.3758/BRM.41.4.1149. [DOI] [PubMed] [Google Scholar]
- 34.Beall E.B. Infrared Fever Detectors Used for COVID-19 Aren’t As Accurate As You Think. [(accessed on 7 February 2021)];2020 Available online: https://spectrum.ieee.org/news-from-around-ieee/the-institute/ieee-member-news/infrared-fever-detectors-used-for-covid19-arent-as-accurate-as-you-think.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data presented in this study are available upon reasonable request made to the corresponding author. The data are not publicly available due to privacy restrictions.