Efficacy of the Smartphone-Based Glucose Management Application Stratified by User Satisfaction

Abstract

Background

We aimed to assess the efficacy of the smartphone-based health application for glucose control and patient satisfaction with the mobile network system used for glucose self-monitoring.

Methods

Thirty-five patients were provided with a smartphone device, and self-measured blood glucose data were automatically transferred to the medical staff through the smartphone application over the course of 12 weeks. The smartphone user group was divided into two subgroups (more satisfied group vs. less satisfied group) based on the results of questionnaire surveys regarding satisfaction, comfort, convenience, and functionality, as well as their willingness to use the smartphone application in the future. The control group was set up via a review of electronic medical records by group matching in terms of age, sex, doctor in charge, and glycated hemoglobin (HbA1c).

Results

Both the smartphone group and the control group showed a tendency towards a decrease in the HbA1c level after 3 months (7.7%±0.7% to 7.5%±0.7%, P=0.077). In the more satisfied group (n=27), the HbA1c level decreased from 7.7%±0.8% to 7.3%±0.6% (P=0.001), whereas in the less satisfied group (n=8), the HbA1c result increased from 7.7%±0.4% to 8.1%±0.5% (P=0.062), showing values much worse than that of the no-smartphone control group (from 7.7%±0.5% to 7.7%±0.7%, P=0.093).

Conclusion

In addition to medical feedback, device and network-related patient satisfaction play a crucial role in blood glucose management. Therefore, for the smartphone app-based blood glucose monitoring to be effective, it is essential to provide the patient with a well-functioning high quality tool capable of increasing patient satisfaction and willingness to use.

INTRODUCTION

Recently, public healthcare expenditures have been increasing exponentially due to a plethora of chronic diseases such as diabetes and the aging of the population [1,2,3]. Despite the continuing development of pharmaceuticals and therapeutic measures, this tendency appears to be increasing with time. Thus, we are at point where a new type of chronic disease management system should be established. It is against this backdrop that the Ubiquitous-Healthcare (U-Healthcare) has come into existence. The recently commercialized U-Healthcare makes health management possible without temporal and geographical limits by facilitating doctor-patient communication over the internet or via cellular phones [4,5]. This technology is mainly available for patients with chronic diseases, particularly for diabetes mellitus [6,7,8,9,10,11,12,13,14].

A cellular phone is a suitable device that can be programmed for glucose monitoring without a hospital visit. In addition, it can also be used for receiving diabetes-related educational content. The majority of the previous cellular phone-based research for diabetes management used short message service (SMS) or telephone counseling. This process mainly involves telecommunication with active participation of the medical staff including medical feedback that is based on the blood glucose levels recorded by the patients. Numerous studies have already shown the multiple advantages of telecommunication for patient management and blood-glucose monitoring [15,16,17,18,19,20].

The requirements for information technology-based blood glucose monitoring are the following: a device for sensing health data, a network for communication, and medical feedback to patients. With the popularization of smart phones, many health applications have been released for these devices. However, most of the applications for chronic disease management have solely focused on self-management without interactive feedback. In contrast, clinical trials thus far have solely focused on medical feedback, thereby largely neglecting aspects pertaining to the convenience of the device or network. Consequently, in this study, we aimed to assess the effectiveness of smartphone applications for blood glucose monitoring and interactive communication between patients and the medical team.

METHODS

Study population and design

This study targeted outpatients with type 2 diabetes mellitus who visited Seoul St. Mary's Hospital from October to November 2012. For the intervention group, the inclusion criteria were men or women aged 20 to 70 years who had type 2 diabetes mellitus for more than 1 year. The baseline glycated hemoglobin (HbA1c) had to be between 7.0% and 10.0%. Patients who had serious concomitant internal diseases, such as heart failure, liver diseases, and kidney disease with a creatinine level >1.5 mg/dL or serious diabetes complications were excluded. Patients who were dependent on an insulin pump, already enrolled in other clinical trials, or otherwise considered unsuitable by the researchers were also excluded from the study.

Forty-two patients expressed their interest in participating in the study, and 38 signed the informed consent form approved by the Investigation Review Board of Seoul St. Mary Hospital. Three patients refused for reasons such as change in cell phone number. Thus, 35 patients were selected to participate in the intervention group.

At the first and the final visit, height, body-weight, waist and hip circumference, and blood pressure were measured. Blood samples were also collected for HbA1c measurement and lipid profile assessment (total cholesterol [TC], triglyceride [TG], low density lipoprotein cholesterol [LDL-C], and high density lipoprotein cholesterol [HDL-C]). The collected data were transferred to the Galaxy S-II Smartphone (Samsung Electronics, Suwon, Korea), CareSens-LINK blood glucose monitor (i-SENS, Wonju, Korea), and S(M)BPM-1 blood pressure monitor (Samsung Electronics) at the first visit. The blood glucose and blood pressure were self-measured by the patients and the recorded data were automatically transferred to the medical staff through the smartphone application (henceforth app) 'Mobile Smartcare, version 1.0.7' (Samsung Electronics). The smartphone users checked their blood glucose level and recorded the data in the smartphone application. The data were then automatically transferred to the hospital. The medical staff analyzed the data and sent recommendations and feedback tailored to the patient an average of once per week (Fig. 1). If the blood glucose level remained high, a warning message and recommendations for exercise and diet were sent to the user. If the user had hypoglycemia (<60 mg/dL) or did not record any blood glucose measurements, the medical team called the user to change the insulin dose or recommend an early visit to the hospital.

Fig. 1.

Screen view by patients on Smartphone application. (A) My laboratory data, (B) message Box from medical team, (C) health information, (D) the official announcement, (E) my target glycated hemoglobin range, blood glucose level, and blood pressure, and (F) hospital reservation guide.

After 3 months, at the second outpatient visit, the same laboratory tests and anthropometric tests were conducted to evaluate the effects of blood glucose monitoring and interactive communication. A questionnaire survey on the smartphone app was also performed at the follow-up visit. The questionnaire made by the Catholic medical team consisted of items pertaining to satisfaction, comfort, convenience, and functionality, as well as the willingness to use the app in the future and recommend to other patients.

The control group in this study was set up via electronic medical records (EMRs) review. The criteria for the control group were patients who visited the hospital with the same diagnosed disease during the same period as the intervention group. Patients matched to the intervention group in terms of age, sex, doctor in charge, and HbA1c were screened and randomly selected through EMR review. All patients were provided with the written informed consents to participate, and the study was approved by the Ethics Committee and the Review Board of Korea Institution for Social and Health Affairs.

Statistical analysis

The baseline characteristics of the two groups were compared using an unpaired t-test for continuous variables and the Mantel-Haenszel chi-square test for categorical variables. To improve the normality, we performed log-transformation for variables with a skewed distribution. We also conducted an analysis of the within-group mean change from baseline to the end of the trial using a paired t-test. Nonparametric tests were performed for subgroup analysis based on compliance. The signed-rank test was used to assess the differences in the variables between baselines and follow-up in the high and low compliance groups and the Kruskal-Wallis test was used to test differences among the three groups (high and low compliance groups, and control). Data were analyzed using a standard package (SAS version 9.1; SAS Institute, Cary, NC, USA).

RESULTS

Of the 38 patients who participated in the study, three patients dropped out due to personal reasons, and 35 patients continued until the end of the 12 week study period.

Baseline characteristics

The baseline characteristics are shown in Table 1. The mean age in the intervention group was 51.8±10.3 years, while in the control group the mean age was 53.8±9.0 years. The mean body mass index (BMI) in the intervention group was 25.0±3.3 kg/m², and the mean duration of diabetes was 11.8±7.3 years. There were no significant differences between the two groups with respect to sex, BMI, glucose control methods and laboratory data, including HbA1c and cholesterol levels.

Table 1.

Clinical characteristics and baseline laboratory data of the Smartphone group and control groups

Values are presented as mean±standard deviation or number (%).

BMI, body mass index; SBP, systolic blood pressure; DBP, diastolic blood pressure; HbA1c, glycated hemoglobin; HMG-CoA, 3-hydroxy-3-methylglutaryl-CoA; TC, total cholesterol; TG, triglyceride; HDL-C, high density lipoprotein cholesterol; LDL-C, low density lipoprotein cholesterol.

^aBased on Mantel-Haenszel chi-square test.

Effect on blood glucose level

In the smartphone group, the mean HbA1c decreased after 3 months from the baseline level of 7.7%±0.7% to 7.5%±0.7% (P=0.077). In the control group there was no change from baseline (7.7%±0.5% to 7.7%±0.7%) over the same period thus showing no intergroup difference after 3 months. Both the smartphone group and control group had no difference in the baseline TC, TG, HDL-C, and LDL-C levels after 3 months thus showing no significant intergroup differences (Table 2).

Table 2.

Laboratory follow-up data of subjects

Values are presented as mean±standard deviation. Interaction between group and time about all variables were not significant.

BMI, body mass index; SBP, systolic blood pressure; DBP, diastolic blood pressure; HbA1c, glycated hemoglobin; TC, total cholesterol; TG, triglyceride; HDL-C, high density lipoprotein cholesterol; LDL-C, low density lipoprotein cholesterol.

Analysis of the questionnaire survey

Of the 35 users, two patients expressed unchanged or increased satisfaction and expectations when compared to the pre-use survey. The remaining eight patients expressed less satisfaction accompanied with complaints. Thirty-six complaints were received during the study period. The majority of these complaints were due to data transfer errors (15/36 cases, 41.7%). Other causes of complaints were mismatch between measured data and uploaded data (6/36 cases, 16.7%), network errors (5/36 cases, 13.9%), and difficulties in using the device (3/36 cases, 8.3%), which led to a decrease in satisfaction (Table 3).

Table 3.

Detailed list of complaints from the Smartphone application user

Values are presented as number (%).

Subgroup analysis by compliance

The smartphone user group was divided into two subgroups based on the results of the on the surveys conducted at baseline and after 3 months. The more satisfied group consisted of 27 patients, and the less satisfied group consisted of eight patients. There were no significant difference in age, sex, diabetes mellitus duration, blood pressure, or BMI between the more satisfied group and less satisfied group.

The change in HbA1c level from baseline to the 3-month follow-up was significantly different once satisfaction was taken into consideration (P for interaction=0.0004). The HbA1c in the more satisfied group decreased significantly from 7.7%±0.8% to 7.3%±0.6% (P<0.001), whereas in the less satisfied group, the HbA1c remained essentially the same (7.7%±0.4% to 8.1%±0.5%, P=0.062) and was actually worse than the control group. TC, TG, HDL-C, and LDL-C levels were not significantly different from the baseline levels (Table 4).

Table 4.

Laboratory follow-up data by satisfaction of patients

Values are presented as mean±standard deviation or number (%).

DM, diabetes mellitus; BMI, body mass index; SBP, systolic blood pressure; DBP, diastolic blood pressure; HbA1c, glycated hemoglobin; TC, total cholesterol; TG, triglyceride; HDL-C, high density lipoprotein cholesterol; LDL-C, low density lipoprotein cholesterol.

^aStatistical significance was noticed (P<0.05) for the more satisfied group vs. the less satisfied group at 3 months later.

DISCUSSION

Of the three major prerequisites for IT-based health management systems, device utility (Sensors), network (Transfer), and medical feedback, existing studies have exclusively focused on medical feedback. The blood glucose monitoring system mostly revolves around active involvement of the medical staff, i.e., medical feedback. A previous study involving the use of SMS for 12 weeks demonstrated a decrease in HbA1c level by 1.01% [15], and another study on type 1 diabetes showed that the application of a cellular phone-based blood glucose monitoring system resulted in a 0.5% decrease of HbA1c levels [16]. Likewise, a number of other similar studies have shown successful reduction in the HbA1c levels [17,18,19]. These study results provide evidence regarding the feasibility of cellular phones as an important tool for blood glucose monitoring. However, it is not easy to commercialize a medical feedback-enabled smartphone, as it involves human-resource (HR) costs for the medical team that provides the medical feedback. This is directly associated with the rise of healthcare costs, thereby limiting commercialization because of low cost-effectiveness. In other words, commercialization must be preceded by economic feasibility. Several ongoing studies focus on economic analyses to investigate the possibilities of reducing medical feedback-related HR costs [19,20]. Cho et al. [20] reported a satisfactory result of a 50% reduction in medical staff by means of a simple algorithm. Methods such as a clinical decision support system and artificial intelligence that can achieve high effectiveness with low HR should be explored [20,21].

As mentioned above, the studies conducted thus far have not focused on sensor (device utility) and network transfer, which are the mediators for blood glucose monitoring. Meanwhile, this study has shown that, in addition to medical feedback, patient satisfaction with the device or network is important for blood-glucose management.

In our study, the HbA1c in the more satisfied group significantly decreased from 7.7%±0.8% to 7.3%±0.6% (P<0.001). There were no significant changes in TC, TG, HDL-C, and LDL-C. Because the study was performed over 3 months, it is unlikely that a significant change in lipid values would occur. Dissatisfaction with the use of the smartphone-based blood glucose monitoring system led to an increase in the HbA1c from 7.7%±0.4% to 8.1%±0.5% (P=0.062). The results of this study show the high positive effect on the blood glucose level in the more satisfied group after the use of smartphone compared to the less satisfied group. A notable point, however, is the negative impact on blood glucose level in the less satisfied group when compared to the no-smartphone control group. This appears to be associated with the users' dissatisfaction when an app is difficult to apply or when encountering frequent device breakdowns that affect compliance. This is immediately related to poorly controlled blood glucose. It is obvious that, in addition to medical feedback, device, and network-related patient satisfaction play a crucial role in blood glucose management. Therefore, for the smartphone app-based blood glucose monitoring to be effective, it is essential to provide the patient with a well-functioning high quality tool capable of increasing patient satisfaction and willingness to use the device. A smartphone is an upgraded type of device and network compared to the traditional cellular phone. It is simple, convenient, comfortable to carry, and appropriate for communication with the medical team. A patient who voluntarily downloads the diabetes-related app may be considered to have an interest in their blood glucose management. Nevertheless, if frequent breakdowns and other shortcomings decrease their satisfaction, then they are likely to fail in their blood glucose management. In other words, the results may be worse than if the smartphone app was not used.

Consequently, to increase user satisfaction and involve medical feedback, it is necessary to implement the steps from mobile application development to medical team involvement [22,23]. It is crucial to develop a tool that clearly reflects medical requirements and improvements. Additionally, secondary aspects, such as convenience, low cost, simple- and fun-to-use functions, and orderly design, should be considered to attract active user participation. Further, it is important to continuously upgrade the application based on user feedback. Moreover, the role of medical staff is important for the successful implementation of the fast-developing sensor and transfer app in the medical sector. It is the role of a medical team to select adequate devices, apply them, and earnestly analyze their effectiveness and economic feasibility.

This study has a few limitations. 1) First, this was not a randomized clinical trial. Nevertheless, the control group was randomly assigned by targeting patients who visited the hospital during the same period. 2) Our result is difficult to generalize because this was a small population and a short-term pilot study. 3) Therefore, additional future studies should be conducted with a larger population and longer duration. Although several blood glucose monitoring applications are available, this study used only one application; therefore, the strengths and weakness of other applications were not assessed. Given the varying functions unique to each application, the study results are likely to differ depending on the app used.

Despite these limitations, there are a few notable achievements of this study. First, a practical analysis was performed on a program attempting to combine the rapidly developing IT technology with medical needs. Second, the goal of this study was focused on the efficacy of a health management system depending on user satisfaction, which will contribute to further development of a user-friendly system. This study revealed that device utility and network can indirectly influence blood glucose management. This study may be an example of the progress in developing apps for chronic disease management in general, not only for diabetes.

The rapid development in health technology will continue, and such techniques will obviously be used more intensely in medicine. A large-scale trial investigating the possibility, efficacy, and economic feasibility is necessary to enable the effective grafting of IT to medical needs. Additionally, future efforts will have to focus on constructing a system that is capable of helping patients practically.