Skip to main content
BMC Medical Informatics and Decision Making logoLink to BMC Medical Informatics and Decision Making
. 2020 Aug 14;20:192. doi: 10.1186/s12911-020-01210-1

WEARCON: wearable home monitoring in children with asthma reveals a strong association with hospital based assessment of asthma control

M R van der Kamp 1,2,3,, E C Klaver 1, B J Thio 1,4, J M M Driessen 5,6, F H C de Jongh 7,8, M Tabak 2,3, J van der Palen 4,9, H J Hermens 2,3
PMCID: PMC7427745  PMID: 32795352

Abstract

Background

Asthma is one of the most common chronic diseases in childhood. Regular follow-up of physiological parameters in the home setting, in relation to asthma symptoms, can provide complementary quantitative insights into the dynamics of the asthma status. Despite considerable interest in asthma home-monitoring in children, there is a paucity of scientific evidence, especially on multi-parameter monitoring approaches. Therefore, the aim of this study is to investigate whether asthma control can be accurately assessed in the home situation by combining parameters from respiratory physiology sensors.

Methods

Sixty asthmatic and thirty non-asthmatic children were enrolled in the observational WEARCON-study. Asthma control was assessed according to GINA guidelines by the paediatrician. All children were also evaluated during a 2-week home-monitoring period with wearable devices; a physical activity tracker, a handheld spirometer, smart inhalers, and an ambulatory electrocardiography device to monitor heart and respiratory rate. Multiple logistic regression analysis was used to determine which diagnostic measures were associated with asthma control.

Results

24 of the 27 uncontrolled asthmatic children and 29 of the 32 controlled asthmatic children could be accurately identified with this model. The final model showed that a larger variation in pre-exercise lung function (OR = 1.34 95%-CI 1.07–1.68), an earlier wake-up-time (OR = 1.05 95%-CI 1.01–1.10), more reliever use (OR = 1.11 95%-CI 1.03–1.19) and a longer respiratory rate recovery time (OR = 1.12 95%-CI 1.05–1.20) were significant contributors to the probability of having uncontrolled asthma.

Conclusions

Home-monitoring of physiological parameters correlates with paediatrician assessed asthma control. The constructed multivariate model identifies 88.9% of all uncontrolled asthmatic children, indicating a high potential for monitoring of asthma control. This may allow healthcare professionals to assess asthma control at home.

Trial registration

Netherlands Trail Register, NL6087. Registered 14 February 2017.

Keywords: Asthma control, Ambulatory monitoring, eHealth, Physiology sensors, Wearable electronic devices, Paediatrics, Telemedicine, Multivariate analysis, spirometry, Inhaler use

Background

Asthma is one of the most common chronic diseases in childhood and has a major impact on the quality of life [1, 2]. Paediatric asthma is characterized by chronic airway inflammation and bronchial hyperresponsiveness to triggers such as allergens, exercise and viral infections. Symptoms include shortness of breath, wheeze and cough hampering sleep, play and sports [3]. National and international respiratory associations recognize the scale and impact of this chronic lung disease [4, 5].

The Dutch lung alliance states that regular follow-up of asthma control is needed to prevent disease deterioration and boost quality of life [4]. However, scheduled outpatient-clinic evaluations at infrequent intervals do not always follow the fluctuating course of paediatric asthma symptoms. Moreover, this follow-up normally requires extensive evaluation in a hospital setting to accurately assess the asthma status of a child according to the guidelines of the Global Initiative for Asthma (GINA) (i.e. the assessment of asthma symptom control, monitoring risk factors (lung function, airway hyperresponsiveness and exacerbations) and assessing treatment factors (adherence/inhalation technique)) [5]. Ambulant monitoring provides opportunities to objectively follow-up physiological parameters by longitudinal measurements in daily life, outside regular visits, and may provide healthcare professionals with complementary insights into the dynamics of the asthma status.

Asthma control questionnaires are used to assist in monitoring symptom severity in the home-situation [68]. These questionnaires offer an easy low-cost option to follow-up symptom control on a regular basis. However, they are also prone to symptom misperception, individual interpretation of the questions, and recall bias [9, 10]. Moreover, children quickly adapt their behaviour to pathophysiological decline in asthma control and consequently report no or subtle symptoms, while the decline might be serious [11, 12]. Monitoring the questionnaire scores alone has yet not been able to improve symptom management or impact daily life [13]. This stresses the urge for additional complementary objective methods to monitor children with asthma at home, providing real-time assessment of symptoms and physiological modulation [14].

The most frequently investigated home-monitoring device dates back from the pre-technology-era and is the peak expiratory flow meter [15]. Kotses et al. [16] concluded that peak flow only gives a small increment in effectiveness beyond that afforded by symptom monitoring. In the last decade, literature also reveals increasing efforts in monitoring medication adherence at home to steer asthma management [17]. Other home-monitoring studies involved measurements of physical activity [18, 19], inflammation markers [20], respiratory distress [21], or coughing and wheezing [22]. All individual parameters showed potential in monitoring asthma but were individually not strongly related to control of asthma in a broad paediatric population.

Despite considerable interest in asthma home-monitoring in children, there is a paucity of scientific evidence, especially on multi-parameter monitoring approaches [13, 23]. We hypothesize that a holistic home-monitoring approach, combining the outcomes of multiple wearable devices signalling respiratory physiology, can provide quantitative relevant information on paediatric asthma control. Therefore, the objective of the WEARCON study is to investigate whether asthma control can be accurately assessed in the home-situation with a combination of measurements from respiratory physiology sensors.

Methods

Study design

The WEARCON study had a prospective observational design. After informed consent, children and parents received all study devices, instruction materials, and were instructed at their home. Children were monitored for 2 weeks at home with wearable devices, followed by an outpatient-clinic visit to assess asthma control (Fig. 1). This study was approved by the medical ethics committee and was registered in the Netherlands trial register (trial no. NL6087). Oral and written consent to participate were obtained from the parents or legal guardians of the children. Children of 12 years or older also provided oral and written consent.

Fig. 1.

Fig. 1

Schematic overview of the study design. Legend: Schematic overview of the study design; describing the process of recruitment, enrolment, home-monitoring, and grouping based on the outpatient-clinic evaluation

Subjects

Sixty children with paediatrician-diagnosed asthma and thirty non-asthmatic children between 4 and 14 years, were recruited using consecutive sampling.

Asthmatic children (n = 60)

The asthmatic children were recruited at the outpatient clinic of the paediatric department of Medisch Spectrum Twente, Enschede, The Netherlands (referral centre for paediatric asthma). Children with paediatrician-diagnosed asthma, who had exercise induced symptoms and were scheduled for an exercise bronchoprovocation test (BPT) between February 2017 and June 2018, were approached to participate in the study. Children with comorbid chronic diseases, children with an inability to understand or speak Dutch, children with electrical stimulation devices (i.e. pacemaker), children with psychomotor retardation, or children for whom it was not possible to wear all wearable devices, i.e. due to severe skin diseases or amputation, were not eligible to participate.

Asthma control was assessed in every child by the same paediatric pulmonologist according to the GINA recommendations of assessment of asthma control [5]. Many children with poorly controlled asthma avoid strenuous exercise or mispercept symptoms, so their asthma may appear to be well controlled [5]. Therefore, the BPT was used in addition to the GINA recommendations to assess asthma control. Uncontrolled asthma was defined as 1) having an uncontrolled level of asthma symptom control as defined by GINA (three or more of the following conditions in the past 4 weeks; > 2 episodes of daytime symptoms weekly, > 2 uses of reliever medication weekly, nocturnal symptoms and activity limitation) OR 2) having a positive BPT (> 12% decrease in FEV1) [5]. The exercise BPT was performed in a climate chamber with dry, cold air (10 degrees Celsius) following the American Thoracic Society protocol [24]. Children aged 8–14 years old performed the BPT on a treadmill for 6 min with submaximal exercise load (steady-state heart rate of 85% of the maximal heart rate (220 – age)) and their nose clipped. The inclination of the treadmill was 10%. Children aged 4–7 years old performed the exercise on a jumping castle for 6 min as described by van Leeuwen et al. [25].

Non-asthmatic children (n = 30)

The non-asthmatic controls were recruited with information flyers at schools in the region. The non-asthmatic children received the same medical evaluation to confirm that they did not have asthma. The same exclusion criteria applied for the non-asthmatic group. Children with a prior diagnosis of asthma, prescribed asthma medication or self-reported asthmatic symptoms, were ineligible.

Subject characteristics

Demographic characteristics were retrieved from the electronic patient record. The (C)-ACT score was obtained after each week of monitoring. Lung function (FEV1% predicted) and the maximal post-exercise fall in FEV1 were obtained during the BPT.

(Wearable) monitoring devices

Figure 2 shows the four commercially available devices used in the WEARCON study. Our choice of devices was based on the trade-off between 1) the best quality devices (so that the most relevant data could be extracted for this study) and 2) the non-obtrusiveness of the devices (so that it would be feasible for children to be able to use the device for 2 weeks). Physical activity was assessed using the Actigraph WGT3X-BT wireless activity tracker (Actigraph inc. Pensacola, FL). Lung function measurements were performed with the hand-held Spirobank advanced II (MIR inc. Roma, Italy). Medication adherence and reliever medication use were electronically tracked with the two Cohero Health smart inhalers. (Cohero inc. New York, NY). Electrocardiography (ECG) was measured using the Emotion Faros 180° (Bittium. Oulu, Findland). Wearables did not show interpretable data to the subjects to prevent any influence and data was stored anonymously.

Fig. 2.

Fig. 2

The smart monitoring devices. Legend: Smart devices from top-left to bottom-right: MIR spirobank II advanced, Actigraph wGT3X-BT, Cohero Health smart inhalers, eMotion Faros 180

Data acquisition, preprocessing and analysis

Continuously measured signals had to be at least 75% complete to be eligible for pre-processing and analysis.

Physical activity & sleep

The subjects wore the activity tracker for fourteen consecutive days in representative school weeks, without (bank) holidays, reflecting the subjects’ average habitual activities [26]. The subjects were instructed to attach the tracker at the wrist and remove it only before activities involving water (such as showering or swimming). Physical activity outcome measures yielded the number of minutes spent at each of four activity levels (sedentary, light, moderate and vigorous activity), the average duration (bout length) and the distribution of activities from at least moderate intensity, expressed in the scale parameter of the Weibull distribution [27]. Sleep parameters were derived from the activity tracker with the Cole-Kripke sleep algorithm [28]. This algorithm provided the average sleep time, wake-up-time (defined in minutes after midnight), sleep efficiency, awake minutes and time per awakening. Furthermore, the sleep restlessness 1 h before wake-up was defined as the average vector magnitude activity counts in the hour the children wake-up. All activity and sleep parameters were averaged per day over the 2 weeks of home-measurement.

Spirometry measurements at home

Children were instructed to perform spirometry whenever they exercised (before and 3–6 min after) and during symptoms (before reliever use). Spirometer flow-volume loops were classified accordingly based on self-reported events (pre-exercise, post-exercise, symptom). Incorrectly blown spirometer measurements were excluded, according to the ATS/ERS criteria for standardisation lung function testing [29]. Spirometry outcome measures were the average pre-exercise forced expiratory volume in 1 s (FEV1), pre-exercise forced expiratory flow between 25 and 75% of exhalation (FEF25–75), pre-exercise peak expiratory flow (PEF), the percentage change in FEV1 after exercise and during symptoms and the variation in pre-exercise lung function, defined as the absolute difference between the highest and lowest predicted pre-exercise FEV1.

Smart inhaler

The date and time of inhalation were acquired from the Cohero Health server. Controller adherence was calculated by dividing the amount of controller medication taken by the amount of medication prescribed (%). Reliever usage was summed for the period of 2 week monitoring.

Heart rate and respiratory rate

Continuous raw ECG data was acquired for 2 days and two nights, with at least one vigorous activity within the period (sports, gym class). Subjects were instructed to attach the eMotion Faros device according to the 3-wire lead placement (mid-clavicular under both claviculae and on left abdomen within the rib cage frame). The device was removed before activities involving water.

The raw ECG was pre-processed to retrieve heart rate (HR) and respiratory rate (RR) using ECG-derived respiration, which is known to provide an robust RR estimate [30]. Artefact and baseline correction was applied using a FIR filter with a Kaiser window using cut-off frequencies of 0.45 and 39 Hz [31]. The RS amplitude was determined by subtracting the S-amplitude from the R-amplitude of the same QRS complex. The respiratory curve based on the RS-amplitude was established by using cubic spline interpolation to construct a respiratory signal with 50 Hz [32]. This algorithm was validated against flow measurement on a separate set of subjects during different daily tasks, showing strong positive correlations (r = 0.69) and a sensitivity of 91.5% and positive predictive value of 0.998 on assessing single breathing cycles [33].

ECG outcome parameters were the average daytime HR and RR, night-time HR and RR (in beats or breath per minute) and the HR and RR recovery time, defined as the time (seconds) needed to recover to baseline after physical exertion.

Statistical analysis

Descriptive statistics were used to examine all continuous outcome measures and were expressed in means + − standard deviation (SD) for normally distributed variables and with median + − interquartile range (IQR) for non-normal distributed variables. Univariate analyses were performed with SPSS statistics (IBM Corp. Released 2013, Version 22.0). The differences in the categorical variables across the different asthma groups were tested with a chi-square test. Homogeneity of variances was verified in all continuous outcome parameters with the Levene’s test. The Shapiro-Wilk test was used to determine whether the variables were normally distributed among all three groups. The differences across the asthma groups in the variables that did not have a normal distribution were tested with the Kruskal-Wallis test followed by multiple comparisons of Games-Howell. The difference of normally distributed variables across the asthma groups were tested with Analysis of Variance (ANOVA) followed by Tukey HSD test for the post-hoc comparisons of the three groups. P-values less than 0.05 were considered as significant.

Prior to the multivariate analysis missing data was handled using the multiple imputation regression method. Missing data patterns were analysed for monotonicity. In case of monotonicity the monotone method was used; in case of random patterns the Markov Chain Monte Carlo method was used. Constraints were added to the variables to prevent unrealistic imputations (e.g. negative lung function values). Five imputed datasets were created and pooled according to the bar procedure [34]. Multivariate analysis was performed using a binary logistic regression analysis with asthma control as dependent variable, with the controlled asthma group as reference group, as the intended use of the model is to assist in the monitoring of children who are already diagnosed with asthma. All home monitoring parameters (see Table 2) were considered for inclusion in this final multivariate model. Independent variables with a multi-collinearity of more than 0.8 were not both used in the same model. The model was not adjusted for other potential predictors, such as age, gender, allergies etc., to prevent overfitting of the model and to specifically focus the model on the best combination of home-monitoring parameters. Stepwise forward likelihood ratio selection was used as enter method of variables with an entry probability of 0.10 and removal probability of 0.20. The model was optimized using the Nagelkerke pseudo R-squared, so that the model which explained the most of the variation (R2 closest to 1.0) was chosen. The resulting binary logistic regression was used to determine relevant diagnostic validity measures, such as sensitivity, specificity and positive and negative predictive value.

Table 2.

Univariate analysis of home-monitoring parameters in the domains; (a) Spirometry, (b) activity, (c) sleep, (d) medication use, (e) heart rate and respiratory rate. Data are shown as mean ± SD or median (IQR)

a) Spirometry Uncontrolled Controlled Non-asthmatic

P-value

(ANOVA / Kruskal-Wallis)

Pre-exercise FEV1 (% predicted) 82.2 ± 16.0 86.1 ± 8.9 98.0 ± 9.5 a,b < 0.01 *
Pre-exercise FEF25–75 (% predicted) 66.9 ± 20.9 75.3 ± 17.7 90.0 ± 20.5 a,b < 0.01 *
Pre-exercise PEF (% predicted) 77.4 ± 22.2 81.7 ± 14.4 98.1 ± 18.2 a,b < 0.01 *
Variation pre-exercise FEV1 (% predicted) 18.0 ± 10.3 9.4 ± 5.4 b 7.6 ± 4.3 b < 0.01 *
FEV1 change after exercise (%) − 11.5 ± 11.9 −0.6 ± 7.6 b −1.6 ± 3.7 b < 0.01 *
FEV1 change during symptoms (%) −30.2 ± 21.4 −6.1 ± 8.1 b < 0.01 *
b) Activity Uncontrolled Controlled Non-asthmatic

P-value

(ANOVA / Kruskal-Wallis)

Sedentary activity (min/day) 568 ± 97 566 ± 90 573 ± 89 0.97 *
Light activity (min/day) 270 ± 50 274 ± 51 270 ± 47 0.92 *
Moderate activity (min/day) 97 ± 35 88 ± 33 92 ± 30 0.65 *
Vigorous activity (min/day) 7.4 ± 8.5 6.0 ± 7.9 9.4 ± 9.2 0.95 *
Activity length (seconds) 22.7 ± 2.3 21.9 ± 2.4 22.5 ± 2.3 0.39 *
Scale parameter (a.u.) 12.9 ± 1.9 12.2 ± 1.9 12.7 ± 1.8 0.33 *
c) Sleep Uncontrolled Controlled Non-asthmatic

P-value

(ANOVA / Kruskal-Wallis)

Wake-up-time (h:min) 6:28 (6:17–6:59) 7:18 (7:00–7:34) b 7:01 (6:45–7:20) < 0.01 ^
Awake minutes per night (min) 59.9 ± 19.9 51.6 ± 16.5 53.1 ± 17.5 0.19 *
Time per awakening (min) 2.66 ± 0.82 2.40 ± 0.87 2.36 ± 0.53 b 0.06 *
Sleep efficiency (%) 89.0 ± 3.8 91.2 ± 5.0 90.4 ± 3.0 0.23 *
Total sleep time per night (min) 496 ± 62 514 ± 81 498 ± 54 0.60 *
Sleep restlessness before wake-up (counts) 3.37 (2.56–4.87) 2.79 (1.91–4.12) 2.76 (2.48–3.18) b 0.07 ^
d) Medication use Uncontrolled Controlled Non-asthmatic

P-value

(ANOVA / Kruskal-Wallis)

Reliever use (n.o.u.) 16.5 (1–34) 3 (0–5) b 0.04 ^
Reliever use after activity (n.o.u.) 0.5 (0–5.5) 0 (0–0) b < 0.01 ^
Reliever use before activity (n.o.u.) 0 (0–5) 0 (0–0) b < 0.01 ^
Controller adherence (% of prescribed) 81.1 ± 30.9 92.7 ± 19.1 0.24 *
e) Heart rate & respiratory rate Uncontrolled Controlled Non-asthmatic

P-value

(ANOVA / Kruskal-Wallis)

Daytime heartrate (beats/min) 101 ± 17 97 ± 16 102 ± 10 0.08 *
Daytime respiratory rate (breaths/min) 19.7 ± 2.9 18.5 ± 2.2 19.3 ± 2.0 0.16 *
Nighttime heartrate (beats/min) 79 ± 16 72 ± 14 71 ± 9 0.36 *
Nighttime respiratory rate (breaths/min) 17.5 ± 2.6 15.6 ± 1.6 b 15.2 ± 2.2 b < 0.01 *
Heart rate recovery time (seconds) 54.4 (36.2–111.5) 27.5 (22.0–51.5) b 29.0 (20.2–35.1) b < 0.01 ^
Respiratory rate recovery time (seconds) 60.7 (35.8–101.3) 23.1 (15.7–30.5) b 16.2 (11.1–20.3) b < 0.01 ^

Abbreviations: FEV1 Forced expiratory volume in 1 s, FEF25–75 Forced expiratory flow between 25 and 75% of the expiratory volume, PEF Peak expiratory flow, n.o.u. Number of use, min Minute, h Hour, a.u. Arbitrary unit

aP < =0.05 compared to controlled asthma

bP < =0.05 compared to uncontrolled asthma

*Normally distributed (ANOVA)

^ Not normally distributed and/or inhomogeneity of variances (Kruskal-Wallis)

Sample size

WEARCON studied whether asthma control could be accurately assessed using a multiple binary logistic regression model. Agresti and Peduzzi suggested ten cases per event per group [35, 36]. This indicated that for a three parameter multiple regression model 60 (30/30) asthmatic children were needed, assuming an equal distribution between the children with controlled and uncontrolled asthma [37]. Thirty non-asthmatic children were included as well to put all asthma home-monitoring parameters in perspective relative to normal values and opens the opportunity to explore the diagnostic value of these parameters for asthma in general.

Results

The participation rate of all eligible children for this study was 83.3% (90/108). From these 90 subjects, one was excluded due to insufficient home-monitoring data and a no-show to the outpatient-clinic evaluation. Overall data completeness was 88.5%. On average, children performed nine spirometry measurements over the course of 2 weeks. 73,9% of these attempts were satisfactory according to the ATS/ERS criteria for standardisation lung function testing. The wear time of the activity tracker was 91,7% (±SD 9,9%) during daytime. The sleep data was complete for 94,4% of the nights.

Asthma control classification

Of the remaining 89 children, thirty-two were placed in the “controlled asthma group”, twenty-seven in the “uncontrolled asthma group” and thirty children were included as non-asthmatic subjects. From the twenty-seven uncontrolled asthmatics, thirteen were classified uncontrolled based on the results of the BPT, three on the GINA criteria and eleven on both the GINA and BPT results. Table 1 shows an overview of the subject characteristics of all children. Significant baseline differences in the presence of allergy and maximal FEV1 fall at the BPT were found between the children with controlled asthma compared to the children with uncontrolled asthma.

Table 1.

Subject characteristics. Data are shown as mean ± SD, %, or median (IQR)

Uncontrolled asthma (n = 27) Controlled asthma (n = 32) Non-asthmatics (n = 30) P-value
(ANOVA / Kruskal-Wallis / Chi-square)
Age (y) 8.2 ± 2.8 9.5 ± 2.6 9.3 ± 2.9 0.19 *
Gender (% male) 77% 84% 53% a 0.02 +
Weight (kg) 31.4 ± 10.6 37.9 ± 14.2 32.9 ± 11.5 0.11 *
Length (cm) 133 ± 17 140 ± 17 138 ± 18 0.30 *
BMI z-score 0.43 ± 0.94 0.85 ± 1.17 −0.02 ± 1.13 a < 0.01 *
ICS use (%) 70% 66% 0% c,d < 0.01 +
LABA use (%) 11.1% 6.7% 0% c,d 0.19 +
Inhalation allergy (%) 90% 61% b 13% c,d < 0.01 +
Baseline FEV1 (% pred) 90.6% ± 12.7% 92.9% ± 9.8% 95.7% ± 9.7% 0.21 *
Fall in FEV1 at ECT (%) 27.9% (17.3–32.8%) 6.0% (3.8–9.8%) d 3.1% (0.6–5.1%) d < 0.01 ^
C-ACT scores 22.0 (17–25) 22.5 (20–25.5) 27.0 (27–27) c,d < 0.01 ^

Abbreviations: BMI Body mass index, ICS Inhaled corticosteroids, LABA Long acting beta-antagonists, FEV1 Forced expiratory volume in 1 s, ECT Exercise challenge test, C-ACT Childhood asthma control test

aP ≤ 0.05 compared to controlled asthma

bP ≤ 0.05 compared to uncontrolled asthma

cP < 0.01 compared to controlled asthma

dP < 0.01 compared to uncontrolled asthma

*Normally distributed (ANOVA)

^ Not normally distributed and/or inhomogeneity of variances (Kruskal-Wallis)

+ Binary variables > Chi-square

Univariate analysis

Table 2 shows the univariate analysis of the home-measured parameters in each study group. The spirometry parameters (Table 2.a) showed that both the children with controlled and uncontrolled asthma had significantly lower home-measured pre-exercise lung function values (FEV1, FEF25–75 and PEF) compared the non-asthmatic controls. The children with uncontrolled asthma showed a significant larger variation in pre-exercise FEV1 and a larger FEV1 decrease after exercise and during symptoms compared to the controlled asthma group. No activity parameters showed any significant differences between the controlled, uncontrolled and non-asthmatic group (Table 2.b). Regarding sleep (Table 2.c), no significant differences were found in total sleep time and sleep efficiency. However, children with uncontrolled asthma woke-up earlier compared to children with controlled asthma. The uncontrolled asthma group furthermore showed on average a longer duration per awakening and more sleep restlessness in the hour before wake-up compared to the non-asthmatic children. Reliever use was significantly higher in the uncontrolled asthma group compared to the controlled asthma group (Table 2.d). The mean respiratory rate during night was higher in the uncontrolled asthma group compared to both the controlled and non-asthmatic group. The recovery time of both the heart rate and respiratory rate after exercise were higher in the uncontrolled asthma as well (Table 2.e).

Multivariate analysis

11.5% Of missing data values were imputed using the Markov Chain Monte Carlo method, as missing patterns were random without monotonicity. Stepwise entering of the home-monitoring parameters for controlled and uncontrolled asthmatic children resulted in a multiple logistic regression model (N = 59) with R2 = 0.82. The final model (Table 3) showed that a larger variation in pre-exercise lung function (OR = 1.34 95%-CI 1.07–1.68), an earlier wake-up-time (OR = 1.05 95%-CI 1.01–1.10), more reliever use (OR = 1.11 95%-CI 1.03–1.19) and a longer respiratory rate recovery time (OR = 1.12 95%-CI 1.05–1.20) were associated with higher odds of being in the uncontrolled asthma group, compared to the controlled asthma group. Figure 3, display the distribution of the four significant contributors (pre-exercise lung function variation, wake-up-time, reliever use and respiratory rate recovery time) to the multivariate binary logistic regression model after Markov Chain Monte Carlo imputation. Table 4, shows the classification matrix of the model. Twenty-four of the twenty-seven uncontrolled asthmatic children (88.9% sensitivity) and 29 of the 32 controlled asthmatic children (90.6% specificity) can be accurately classified with the model. The associated positive and negative predicted values for uncontrolled and controlled asthma are 88.9 and 90.6%, respectively.

Table 3.

The model characteristics of the binary logistic regression model

Covariates Coefficient p-value Odds ratio 95% confidence interval
Lower Upper
Variation pre-exercise FEV1 0.292 0.012 1.339 1.067 1.680
Wake-up-time −0.053 0.012 0.948 0.910 0.988
Reliever use 0.100 0.006 1.105 1.029 1.187
Respiratory rate recovery time 0.113 0.001 1.120 1.046 1.198

Fig. 3.

Fig. 3

Distribution of the monitoring parameters. Legend: The boxplots (median, IQR and extreme values) display the distribution of the four significant contributors (pre-exercise lung function variation, wake-up-time, reliever use and respiratory rate recovery) to the multivariate binary logistic regression model after Markov Chain Monte Carlo imputation. The asterisks indicate significance with p < 0.05, the diamonds indicate significance with p < 0.01

Table 4.

Classification matrix of the multivariate model: Paediatrician assessed control of asthma versus model based prediction of asthma control with multivariate binary logistic regression model

Paediatrician based asthma control
Uncontrolled Controlled
Model based asthma control Uncontrolled 24 3
Controlled 3 29

Discussion

This study showed that data acquired from home-monitoring devices is strongly associated with the control of asthma, as assessed in the outpatient-clinic during an extensive evaluation including a bronchoprovocation test. The variation in lung function, the wake-up-time, the reliever usage and the recovery time of the respiratory rate after exercise did significantly distinguish between controlled and uncontrolled asthma in univariate analysis. Most striking is that the combination of these parameters can accurately identify 88.9% of all uncontrolled asthmatic children, suggesting a high potential of a holistic monitoring approach to assess paediatric asthma control at home.

To our knowledge, no studies are available using a multi-dimensional wearable monitoring approach in children with asthma to objectively assess asthma control, making WEARCON unique through its innovative approach of using state of the art technology. Honkoop et al. [38] published their study protocol about the prediction of exacerbations and deterioration in asthma control in adults using mHealth. Their approach resembles the WEARCON protocol in measuring spirometry, respiratory rate, physical activity and medication adherence.

Univariate analysis showed a significant difference in the variation in FEV1, which implies that uncontrolled asthmatic children show a wider range of pre-exercise FEV1 (mean 18.0%). Results of Brouwer et al. [39] are in line with our results. They found a mean FEV1 variation of 5.7% and suggested a disease cut-off of 11.8%. In their follow up research in 2010 Brouwer et al. [40] concluded that the contribution of FEV1 variation in diagnosing asthma in children is limited. Their study however aimed to differentiate asthmatic from non-asthmatic children, which may explain the different findings as controlled and uncontrolled asthmatic children were merged in one group.

The uncontrolled asthmatic children woke up earlier compared to the controlled asthmatic children. This is compatible with the circadian rhythms of asthma mediators such as cortisol and histamine [41]. Although previous studies found that children with uncontrolled asthma wake-up more often during night [42, 43], the wake-up-time was not previously found to be altered in children with uncontrolled asthma. Van Maanen et al. [44] found no differences in sleep parameters between children with frequent asthma symptoms and children without symptoms in the PIAMA birth cohort study, but no electronic sleep monitoring was used and they questioned whether their asthma questions on nocturnal asthma were sensitive enough to find an effect.

The GINA asthma strategy states that children with high use of short-acting bronchodilators are at risk for uncontrolled asthma [5]. The results of the WEARCON study correspond with that statement as the odds ratio indicates that every additional inhalation over a two-week period increases the risk of uncontrolled asthma with 10.5%. This emphasizes the importance of assessing inhaler use objectively with smart inhaler technology. Moreover, the reliever use data shows a high variability among children within the two asthma groups. We do believe that the classification of asthma control based on the amount of reliever use should therefore be made with caution, and in combination with other objective parameters, as poor symptom perception may influence the reliever use behavior.

The respiratory rate recovery time after exercise was on average almost twice as long (40 s) in children with uncontrolled asthma compared to children with controlled asthma. This seems small, but hampers children’s typical frequent short bust of intense activity [45]. No other studies investigated this parameter in asthmatic children. Post-exercise recovery in adolescents and adults is mediated by change in the RR and in the tidal volume. However, in children the RR recovery is the main contributor [46]. In children with uncontrolled asthma, the recovery of respiratory rate after exercise may be increased as bronchoconstriction compromises ventilation. Therefore, we expect the RR recovery to be a reproducible measure, just depending on the bronchoconstriction severity and possibly the cardio respiratory fitness. This is important to explore in a validity and reproducibility study.

Several single parameters could significantly distinguish between controlled and uncontrolled asthma in univariate analysis, which may reveal a suggestion for the individual patient whether his/her asthma is controlled or not. However, as Fig. 3 reveals, there is quite some overlap between the controlled and uncontrolled group, so the parameters in isolation may not provide sufficient accuracy, as previously found in literature [1822]. This also holds true for the clinical practice as clinicians will not let them guide based on a single question/answer during a patient visit. Clinicians are trained to combine all the factors to come up with the right diagnosis. The multivariate model resembles this viewpoint and based on the results of this study do provide a more accurate classification of asthma control compared to the GINA questions alone.

A limitation of this study is that the non-asthmatic group was not matched to the asthma groups for gender. Prevalence of asthma is higher in boys than girls [1]. This corresponds with the baseline characteristics of the asthma groups in this study. However, our non-asthmatic group is 50/50 divided, possibly confounding univariate comparison between the asthmatic groups and the non-asthmatic children for several home-monitoring parameters (e.g. the amount of vigorous activities [47]). Nevertheless, the multivariate model was not affected by this limitation as the model was solely build on the data of the asthmatic children.

Although the results of this study emphasize the potential relevance of home-monitoring, further studies should validate the model of the WEARCON study. The model has been built on a training dataset of 60 asthmatic children, but has to be validated with a validation dataset of home-monitoring data in asthmatic children to determine the exact effect size.

The implication of the observations in our study is that a tool to reliably monitor asthma control at home seems attainable. Moreover, children were adherent to the home-measurements for the study period of 2 weeks. Children and parents embraced home-monitoring as was shown in the high participation rate and high adherency. However, for long-term asthma care the home-monitoring tool should be lean, non-obtrusive and proportional to the severity of the disease to maximize usability, engagement and minimize the burden to the child [48]. Such a tool could be a stepping stone to better follow the fluctuations of the asthma status and timely anticipate on signalled changes in asthma control. This could improve the current clinical evaluation of asthma control, which is intermittent and subjective. Proper randomized controlled trials and longitudinal studies will be needed to establish the efficacy of home-monitoring on asthma control when implemented in the paediatric asthma care.

Conclusion

This study shows a correlation between data of home-monitoring devices and hospital-based assessment of asthma control. These results add to the rapidly expanding research field of home-monitoring of chronic respiratory diseases and provide a stepping stone to investigate paediatric asthma monitoring outside the hospital.

Acknowledgements

Not applicable.

Abbreviations

(c-)ACT

(childhood) Asthma Control Test

ANOVA

Analysis of variance

ATS

American Thoracic Society

BPT

Broncho provocation test

CI

Confidence interval

ECG

Electrocardiography

ERS

European Respiratory Society

FEF2575

Forced Experatory Flow between 25 and 75% of expiratory volume

FEV1

Forced Expiratory Volume in 1 s

GINA

Global initiative for asthma

HR

Heart rate

IQR

Interquartile range

OR

Odds ratio

PEF

Peak Expiratory Flow

RR

Respiratory rate

SD

Standard deviation

WEARCON

Wearable home-monitoring of asthma control

Authors’ contributions

MvdK designed and performed the study, processed the study data, performed the analysis and wrote the draft-manuscript. EK performed the study and processed the experimental data. BT conceived the presented idea, directed the project in the hospital and contributed substantially to the final manuscript. JD performed the in hospital evaluations of the experiments and contributed to the interpretation of the results. FdJ designed the experiments and contributed to the interpretation of the results. MT contributed substantially to the final manuscript. JvdP co-designed the study and assisted in the statistical analyses of the data. HH designed the study and supervised the project. All authors discussed the results, commented on the manuscript and approved the final manuscript.

Authors’ information

MvdK is a Technical Physician and PHD student with expertise in eHealth pediatric asthma care (both from research and clinical point of view). He acts as a bridge between the technological knowledge about ambulatory monitoring (MT&HH from university of Twente & Roessingh Research and Development) and the clinical knowledge about pediatric asthma (EK, BT, JvdP, FdJ & JD from Medisch Spectrum Twente and OCON sports).

Funding

This study was funded by an unrestricted grant from the Stichting Pediatrisch Onderzoek Enschede (SPOE). The funder had no role in the design of the study or the collection, analysis and interpretation of the data.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available, as the datasets contain secondary outcome parameters which will be used for follow up research in Medisch Spectrum Twente, but the datasets are available from the corresponding author on reasonable request.

Ethics approval and consent to participate

This study was approved by the medical ethics committee Twente (ref. nr. P16–27) and was registered in the Netherlands trial register (trial no. NL6087). Oral and written consent to participate were obtained from the parents or legal guardians of the children and from the child itself if he/she was 12 years or older.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Wijga AH, Kerkhof M, Gehring U, de Jongste JC, Postma DS, Aalberse RC, et al. Cohort profile: The Prevention and Incidence of Asthma and Mite Allergy (PIAMA) birth cohort. Int J Epidemiol. 2014;43(2):527–535. doi: 10.1093/ije/dys231. [DOI] [PubMed] [Google Scholar]
  • 2.Merikallio VJ, Mustalahti K, Remes ST, Valovirta EJ, Kaila M. Comparison of quality of life between asthmatic and healthy school children. Pediatr Allergy Immunol. 2005;16(4):332–340. doi: 10.1111/j.1399-3038.2005.00286.x. [DOI] [PubMed] [Google Scholar]
  • 3.Desager KN, Nelen V, Weyler JJJ, de Backer WA. Sleep disturbance and daytime symptoms in wheezing school-aged children. J Sleep Res. 2005;14(1):77–82. doi: 10.1111/j.1365-2869.2004.00432.x. [DOI] [PubMed] [Google Scholar]
  • 4.Long Alliantie Nederland . Zorgstandaard astma Kinderen & Jongeren. 2012. pp. 1–119. [Google Scholar]
  • 5.Global Initiative for Asthma . Global Strategy for Asthma Management and Prevention. 2019. [Google Scholar]
  • 6.Liu AH, Zeiger R, Sorkness C, Mahr T, Ostrom N, Burgess S, et al. Development and cross-sectional validation of the Childhood Asthma Control Test. J Allergy Clin Immunol. 2007;119(4):817–825. doi: 10.1016/j.jaci.2006.12.662. [DOI] [PubMed] [Google Scholar]
  • 7.Juniper EF, Gruffydd-Jones K, Ward S, Svensson K. Asthma Control Questionnaire in children: validation, measurement properties, interpretation. Eur Respir J. 2010;36(6):1410–1416. doi: 10.1183/09031936.00117509. [DOI] [PubMed] [Google Scholar]
  • 8.Brand PLP, Makela MJ, Szefler SJ, Frischer T, Price D. Monitoring asthma in childhood: symptoms, exacerbations and quality of life. Eur Respir Rev. 2015;24(136):187–193. doi: 10.1183/16000617.00003614. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Carroll WD, Wildhaber J, PLP B. Parent misperception of control in childhood/adolescent asthma: the Room to Breathe survey. Eur Respir J. 2012;39(1):90–96. doi: 10.1183/09031936.00048911. [DOI] [PubMed] [Google Scholar]
  • 10.Madhuban AA, Driessen JM, Brusse-Keizer MG, van Aalderen WM, de Jongh FH, Thio BJ. Association of the asthma control questionnaire with exercise-induced bronchoconstriction. J Asthma. 2011;48(3):275–278. doi: 10.3109/02770903.2011.555035. [DOI] [PubMed] [Google Scholar]
  • 11.McQuaid EL, Kopel SJ, Nassau JH. Behavioral adjustment in children with asthma:a meta-analysis. Dev Behav Pediatr. 2001;22(6):430–439. doi: 10.1097/00004703-200112000-00011. [DOI] [PubMed] [Google Scholar]
  • 12.Lammers N, van Hoesel MHT, Kamphuis M, Brusse-Keizer M, van der Palen J, Visser R, et al. Assessing Exercise-Induced Bronchoconstriction in Children; The Need for Testing. Front Pediatr. 2019;7:157. doi: 10.3389/fped.2019.00157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pijnenburg MW, Baraldi E, Brand PLP, Carlsen KH, Eber E, Frischer T, et al. Monitoring asthma in childhood. Eur Respir Rev. 2015;24(136):178–186. doi: 10.1183/09031936.00088814. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Dinakar C, Chipps BE, Matsui EC, Abramson SL, Irani AM, Kim JS, et al. Clinical tools to assess asthma control in children. Pediatrics. 2017;139(1):e20163438. doi: 10.1542/peds.2016-3438. [DOI] [PubMed] [Google Scholar]
  • 15.Kupczyk M, Haque S, Sterk PJ, Nizankowska-Mogilnicka E, Papi A, Bel EH, et al. Detection of exacerbations in asthma based on electronic diary data: results from the 1-year prospective BIOAIR study. Thorax. 2013;68(7):611–618. doi: 10.1136/thoraxjnl-2012-201815. [DOI] [PubMed] [Google Scholar]
  • 16.Kotses H, Harver A, Humphries CT. Home monitoring in asthma self-management. J Asthma. 2006;43(9):649–655. doi: 10.1080/02770900600701309. [DOI] [PubMed] [Google Scholar]
  • 17.Morton RW, Elphick HE, Rigby AS, Daw WJ, King DA, Smith LJ, et al. STAAR: a randomised controlled trial of electronic adherence monitoring with reminder alarms and feedback to improve clinical outcomes for children with asthma. Thorax. 2017;72(4):347–354. doi: 10.1136/thoraxjnl-2015-208171. [DOI] [PubMed] [Google Scholar]
  • 18.Vahlkvist S, Inman MD, Pedersen S. Effect of asthma treatment on fitness, daily activity and body composition in children with asthma. Allergy. 2010;65(10):1464–1471. doi: 10.1111/j.1398-9995.2010.02406.x. [DOI] [PubMed] [Google Scholar]
  • 19.van der Kamp M, Thio B, Tabak M, Hermens H, Driessen J, van der Palen J. Does exercise-induced bronchoconstriction affect physical activity patterns in asthmatic children? J Child Heal Care. 2019:136749351988125 [cited 2019 Oct 23] Available from: http://journals.sagepub.com/doi/10.1177/1367493519881257. [DOI] [PubMed]
  • 20.Manna A, Caffarelli C, Varini M, Povesi Dascola C, Montella S, Maglione M, et al. Clinical application of exhaled nitric oxide measurement in pediatric lung diseases. Ital J Pediatr. 2012;38:74. doi: 10.1186/1824-7288-38-74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Maarsingh EJ, van Eykern LA, Sprikkelman AB, van Aalderen WM. Histamine induced airway response in pre-school children assessed by a non-invasive EMG technique. Respir Med. 2004;98(4):363–372. doi: 10.1016/j.rmed.2003.10.014. [DOI] [PubMed] [Google Scholar]
  • 22.Enseki M, Nukaga M, Tadaki H, Tabata H, Hirai K, Kato M, et al. A breath sound analysis in children with cough variant asthma. Allergol Int. 2019;68(1):33–38. doi: 10.1016/j.alit.2018.05.003. [DOI] [PubMed] [Google Scholar]
  • 23.Huffaker MF, Carchia M, Harris BU, Kethman WC, Murphy TE, Sakarovitch CCD, et al. Passive nocturnal physiologic monitoring enables early detection of exacerbations in children with asthma a proof-of-concept study. Am J Respir Crit Care Med. 2018;198(3):320–328. doi: 10.1164/rccm.201712-2606OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Crapo R, Casaburi R, Coates AL, Enright PL, Hankinson JL, Irvin CG, et al. Guidelines for Methacholine and exercise challenge testing - 1999. Am J Respir Crit Care Med. 2000;161(1):309–329. doi: 10.1164/ajrccm.161.1.ats11-99. [DOI] [PubMed] [Google Scholar]
  • 25.Van Leeuwen JC, Driessen JMM, De Jongh FHC, Anderson SD, Thio BJ. Measuring breakthrough exercise-induced bronchoconstriction in young asthmatic children using a jumping castle. J Allergy Clin Immunol. 2013;131(5):1427–1429. doi: 10.1016/j.jaci.2012.10.014. [DOI] [PubMed] [Google Scholar]
  • 26.Trost SG, Fees BS, Haar SJ, Murray AD, Crowe LK. Identification and validity of accelerometer cut-points for toddlers. Obesity. 2012;20(11):2317–2319. doi: 10.1038/oby.2011.364. [DOI] [PubMed] [Google Scholar]
  • 27.Lehman EH. Shapes, moments and estimators of the Weibull distribution. IEEE Trans Reliab. 1963;R-12(3):32–38. [Google Scholar]
  • 28.Cole RJ, Kripke DF, Gruen W, Mullaney DJ, Gillin JC. Automatic sleep/wake identification from wrist activity. Sleep. 1992;15(5):461–469. doi: 10.1093/sleep/15.5.461. [DOI] [PubMed] [Google Scholar]
  • 29.Miller MR, Hankinson J, Brusasco V, Burgos F, Casaburi R, Coates A, et al. Standardisation of spirometry. Eur Respir J. 2005;26(2):319–338. doi: 10.1183/09031936.05.00034805. [DOI] [PubMed] [Google Scholar]
  • 30.FQ AL-K, Saatchi R, Burke D, Elphick H, Tan S. Respiration rate monitoring methods: A review. Pediatr Pulmonol. 2011;46(6):523–529. doi: 10.1002/ppul.21416. [DOI] [PubMed] [Google Scholar]
  • 31.Buendía-Fuentes F, Arnau-Vives MA, Arnau-Vives A, Jiménez-Jiménez Y, Rueda-Soriano J, Zorio-Grima E, et al. High-Bandpass Filters in Electrocardiography: Source of Error in the Interpretation of the ST Segment. ISRN Cardiol. 2012;2012:1–10. doi: 10.5402/2012/706217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.BIOPAC systems Inc. Respiration recording | BIOPAC. [cited 2017 Jul 25]. Available from: https://www.biopac.com/knowledge-base/respiration-recording/.
  • 33.Kamp MR, Thio BJ, de Jongh FHC, Driessen JMM. American Thoracic Society International Conference Meetings Abstracts American Thoracic Society International Conference Meetings Abstracts. American Thoracic Society. 2019. Monitoring of the respiratory rate recovery time in children with asthma; p. A7179. [Google Scholar]
  • 34.Baranzini D. The “Bar procedure”: SPSS single dataframe aggregating SPSS multiply imputed split files. 2018. [Google Scholar]
  • 35.Agresti A. An introduction to categorical data analysis [Internet] 2. Hoboken: Wiley; 2007. Logistic Regression; pp. 99–136. [Google Scholar]
  • 36.Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR, Concato J, et al. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–1379. doi: 10.1016/s0895-4356(96)00236-3. [DOI] [PubMed] [Google Scholar]
  • 37.CDC . AsthmaStats: Uncontrolled Asthma among Children, 2012–2014 | CDC National Asthma Control Program. 2019. [Google Scholar]
  • 38.Honkoop PJ, Simpson A, Bonini M, Snoeck-Stroband JB, Meah S, Fan Chung K, et al. MyAirCoach: the use of home-monitoring and mHealth systems to predict deterioration in asthma control and the occurrence of asthma exacerbations; study protocol of an observational study. BMJ Open. 2017;7(1):e013935. doi: 10.1136/bmjopen-2016-013935. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Brouwer AFJ, Roorda RJ, Duiverman EJ, PLP B. Reference values for peak flow and FEV1 variation in healthy schoolchildren using home spirometry. Eur Respir J. 2008;32(5):1262–1268. doi: 10.1183/09031936.00148107. [DOI] [PubMed] [Google Scholar]
  • 40.Brouwer AFJ, Visser CAN, Duiverman EJ, Roorda RJ, Brand PLP. Is home spirometry useful in diagnosing asthma in children with nonspecific respiratory symptoms? Pediatr Pulmonol. 2010;45(4):326–332. doi: 10.1002/ppul.21183. [DOI] [PubMed] [Google Scholar]
  • 41.Barnes P, FitzGerald G, Brown M, Dollery C. Nocturnal asthma and changes in circulating epinephrine, histamine and cortisol. N Engl J Med. 1980;303(5):263–267. doi: 10.1056/NEJM198007313030506. [DOI] [PubMed] [Google Scholar]
  • 42.Dean BB, Calimlim BC, Sacco P, Aguilar D, Maykut R, Tinkelman D. Uncontrolled Asthma Among Children: Impairment in Social Functioning and Sleep. J Asthma. 2010;47(5):539–544. doi: 10.3109/02770900903580868. [DOI] [PubMed] [Google Scholar]
  • 43.Bateman ED, Hurd SS, Barnes PJ, Bousquet J, Drazen JM, FitzGerald M, et al. Global strategy for asthma management and prevention: GINA executive summary. Eur Respir J. 2008;31(1):143–178. doi: 10.1183/09031936.00138707. [DOI] [PubMed] [Google Scholar]
  • 44.van Maanen A, Wijga AH, Gehring U, Postma DS, Smit HA, Oort FJ, et al. Sleep in children with asthma: results of the PIAMA study. Eur Respir J. 2013;41(4):832–837. doi: 10.1183/09031936.00019412. [DOI] [PubMed] [Google Scholar]
  • 45.McManus AM, Chu EYW, Yu CCW, Hu Y. How Children Move: Activity pattern characteristics in lean and obese Chinese children. J Obes. 2011;2011:1–6. doi: 10.1155/2011/679328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Plowman S, Smith D. Exercise physiology for health, fitness, and performance: Lippincott Williams & Wilkins; 2007. Available from: https://books.google.nl/books?id=fYiqixSbhEAC.
  • 47.Nader PR, National Institute of Child Health and Human Development Study of Early Child Care and Youth Development Network Frequency and intensity of activity of third-grade children in physical education. Arch Pediatr Adolesc Med. 2003;157(2):185–190. doi: 10.1001/archpedi.157.2.185. [DOI] [PubMed] [Google Scholar]
  • 48.Svedberg P, Arvidsson S, Larsson I, Carlsson IM, Nygren JM. Barriers and enablers affecting successful implementation of the electronic health service SISOM: Multicenter study of child participation in pediatric care. J Med Internet Res. 2019;21(11):e14271. doi: 10.2196/14271. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets generated and analysed during the current study are not publicly available, as the datasets contain secondary outcome parameters which will be used for follow up research in Medisch Spectrum Twente, but the datasets are available from the corresponding author on reasonable request.


Articles from BMC Medical Informatics and Decision Making are provided here courtesy of BMC

RESOURCES