Abstract
Background
Overweight and obesity rates among the general population of the Netherlands keep increasing. Combined lifestyle interventions (CLIs) focused on physical activity, nutrition, sleep, and stress management can be effective in reducing weight and improving health behaviors. Currently available CLIs for weight loss (CLI-WLs) in the Netherlands consist of face-to-face and community-based sessions, which face scalability challenges. A digitally enabled CLI-WL with digital and human components may provide a solution for this challenge; however, the feasibility of such an intervention has not yet been assessed in the Netherlands.
Objective
The aim of this study was two-fold: (1) to determine how weight and other secondary cardiometabolic outcomes (lipids and blood pressure) change over time in a Dutch population with overweight or obesity and cardiometabolic risk participating in a pilot digitally enabled CLI-WL and (2) to collect feedback from participants to guide the further development of future iterations of the intervention.
Methods
Participants followed a 16-week digitally enabled lifestyle coaching program rooted in the Fogg Behavior Model, focused on nutrition, physical activity, and other health behaviors, from January 2020 to December 2021. Participants could access the digital app to register and track health behaviors, weight, and anthropometrics data at any time. We retrospectively analyzed changes in weight, blood pressure, and lipids for remeasured users. Surveys and semistructured interviews were conducted to assess critical positive and improvement points reported by participants and health care professionals.
Results
Of the 420 participants evaluated at baseline, 53 participated in the pilot. Of these, 37 (70%) were classified as overweight and 16 (30%) had obesity. Mean weight loss of 4.2% occurred at a median of 10 months postintervention. The subpopulation with obesity (n=16) showed a 5.6% weight loss on average. Total cholesterol decreased by 10.2% and low-density lipoprotein cholesterol decreased by 12.9% on average. Systolic and diastolic blood pressure decreased by 3.5% and 7.5%, respectively. Participants identified the possibility of setting clear action plans to work toward and the multiple weekly touch points with coaches as two of the most positive and distinctive components of the digitally enabled intervention. Surveys and interviews demonstrated that the digital implementation of a CLI-WL is feasible and well-received by both participants and health care professionals.
Conclusions
Albeit preliminary, these findings suggest that a behavioral lifestyle program with a digital component can achieve greater weight loss than reported for currently available offline CLI-WLs. Thus, a digitally enabled CLI-WL is feasible and may be a scalable alternative to offline CLI-WL programs. Evidence from future studies in a Dutch population may help elucidate the mechanisms behind the effectiveness of a digitally enabled CLI-WL.
Keywords: lifestyle intervention, prevention, obesity, overweight, weight loss, digital health, intervention, weight, pilot, digital, data, Fogg Behavior Model
Introduction
Background
The morbidity and mortality burden associated with obesity, diabetes, and cardiovascular disease (CVD) continues to increase globally [1]. The prevalence of diabetes and CVD has nearly doubled since 1990 to over 536 and 520 million cases worldwide, respectively [1,2]. Obesity, as a major risk factor for CVD and diabetes, is also associated with a decrease in life expectancy between 5 and 20 years, depending on the severity of the condition and comorbid disorders [3]. In addition, overweight-related diseases are expected to give rise to treatment costs equivalent to 8.4% of health spending in Organization for Economic Cooperation and Development countries [4].
A substantial portion of the risk of diabetes, CVD, and obesity is attributable to modifiable lifestyle factors such as an unhealthy diet, lack of physical activity, and smoking, which subsequently lead to metabolic imbalances and overweight or obesity [1-3]. Overweight and obesity are often the direct result of a disturbed energy balance, generated through a combination of the above-mentioned factors as well as excessive dietary energy consumption [5,6]. Despite being common knowledge, the principles of living a healthy lifestyle are insufficiently followed by the general population. Indeed, recent data show that over 50% of the Dutch population do not meet daily activity guidelines and that many elements of an individual’s environment are often obesogenic [7,8]. In addition, other health behavioral aspects such as deficient sleep and poor stress management also increase the risk of developing excess weight [9-11]. It is therefore unsurprising that overweight and obesity rates among the general population of the Netherlands keep increasing: in 2021, almost 50% of Dutch adults were living with overweight and 13% were living with obesity [12].
Therefore, successful approaches to preventing and treating overweight/obesity, CVD, and associated risk factors ought to tackle at least the four essential lifestyle components of nutrition, activity, sleep, and stress management, along with smoking and alcohol consumption when possible [13-15]. Preferably, this is done in a personalized way, since different individuals will be exposed to different triggers and face different challenges that lead to excess weight or failure to lose weight [16,17]. Combined lifestyle interventions (CLIs), especially those targeting weight loss (CLI-WLs), provide a potential solution for people who are overweight or obese to initiate and maintain healthier lifestyle behaviors [18]. Since 2019, some CLI-WL programs have been covered by basic insurance in the Netherlands for individuals meeting prespecified criteria such as obesity in case of a BMI≥30 or overweight and increased risk of comorbidities, including diabetes and CVD [19]. Dutch CLI-WL programs are 2-year programs delivered at varying intensities throughout this period, which consist of guidance mostly on physical activity and nutrition [18]. These programs consist of both individual and group sessions to educate participants, allowing them to share experiences and provide support [18]. The program is typically carried out completely offline by lifestyle coaches, physiotherapists, and dietitians accredited to deliver CLI-WL to patients referred by general practitioners [18]. Internationally, interventions similar to the Dutch CLI-WL have been shown to be effective in terms of weight reduction and health improvements, even when compared with standard care or pharmacological treatment [20]. However, reports on the effectiveness of Dutch CLI-WL programs since their inclusion in the basic insurance package have been inconsistent, with the effects of the interventions either falling short of expectations or not structurally translating to sustained weight loss in the medium to long term [21-23]. Previous studies have shown that the biggest barrier experienced by participants is the challenge of implementing and following lifestyle changes in a sustainable way [23,24].
A growing number of digital programs that can support individuals and providers in addressing health risks and conditions are being developed and made available to the public [25]. These so-called digital therapeutic solutions stem from an emerging field at the cross-section between health care and technology. Similar to pharmacological therapies or hardware medical devices, these therapeutics are evidence-based software products for the prevention, management, and treatment of health conditions. Several studies suggest that interventions including digital elements such as remote data monitoring and the possibility to digitally communicate with providers are associated with higher engagement from participants and subsequently with better health outcomes [26,27]. The incorporation of these digital elements—which are considered critical components of successful behavior change programs—can therefore help overcome the cited barriers to engagement in face-to-face programs such as accessibility, transportation, and scheduling [24,25,28]. In fact, digital therapeutic solutions, ranging from digital weight loss programs based on intensive dietary coaching to tracking and gamification apps, have been shown to induce weight loss to varying degrees, surpassing what offline interventions achieve [29,30]. Therefore, deploying a digitally enabled CLI-WL could broaden access to prevention and care, while delivering superior or at least comparable outcomes to those reported for currently available, completely offline CLI-WL programs in the Netherlands. Due to the novelty of digitally enabled CLI-WL programs in the Netherlands, there is a research gap that we seek to bridge with this research.
Objectives
The objective of this pilot study was to provide a real-world contribution to the discussion surrounding the feasibility of digitally enabled CLI-WL programs in the Netherlands. In this study, we assessed the changes in weight and concomitant cardiometabolic risk factors of a cohort of Dutch adults with overweight or obesity and cardiometabolic risk who participated in the pilot of a digitally enabled CLI-WL. In addition, we also conducted surveys and semistructured interviews to assess the critical positive and improvement points reported by participants and health coaches to further guide the development of future iterations of the intervention.
Methods
Study Sample
As of December 2021, 420 users were enrolled in the Ancora Health Lifestyle program through employer health programs or as a direct-to-consumer option. A study on a subset of this cohort was published previously in JMIR Cardio [31]. Body weight, blood pressure, and lipids (total and low-density lipoprotein [LDL] cholesterol) were measured at baseline. Participants who were classified as obese (BMI≥30) or overweight (BMI≥25) with one or more cardiometabolic risk factors were asked to participate in a 16-week digitally enabled CLI consisting of digital and human components. The cardiometabolic risk factors considered were a diastolic blood pressure≥80 mmHg or systolic blood pressure≥130 mmHg, dyslipidemia (LDL cholesterol≥3.0 mmol/L, total cholesterol≥5.1 mmol/L, high-density lipoprotein cholesterol<1 mmol/L, or triglycerides≥1.8 mmol/L), or prediabetes (hemoglobin A1c≥5.7% or fasting glucose≥5.6 mmol/L). An overview of the study flow is given in Figure 1.
Figure 1.
Overview of the study flow, including sample size at each stage. CLI-WL: combined lifestyle intervention targeting weight loss.
Combined Lifestyle Intervention
After baseline measurements, users were provided access to a web-based digital app where they could register and track health behaviors, weight, and anthropometrics data at any time. This app is a certified Class I medical device that generates evidence-based lifestyle recommendations spanning across nutrition, physical activity, sleep improvement, stress reduction, and tracking behaviors (such as logging weight) that are tailored to the individual’s prevailing risk profile. Other preliminary evidence of the health benefits of lifestyle interventions delivered to a subset of this cohort with the Ancora Health platform for health goals other than weight loss (eg, lipids, blood pressure, and nutrient imbalances) has been published previously [32-34].
The intervention was initiated with a 30-minute intake consultation conducted by video call. The intake consultation provided counseling on health risks, recommendation of targeted lifestyle medicine actions, and a “handshake” to undertake these actions for the following period. During the intervention, coaching was delivered digitally through one-on-one chat-based contact with optional audio/video calls alongside this format. Coaching was delivered by a health care professional with a background in either lifestyle coaching, nutrition, physiotherapy, or psychology, depending on the prevailing behavioral coaching required. This coaching was complemented by weekly progress reports. This approach builds on the Fogg Behavioral Model (FBM) [35]. The FBM posits that behavior change occurs when users are prompted to perform target behaviors that they are sufficiently motivated and sufficiently able to perform, with a trade-off between the level of motivation and level of ability. In this intervention, the FBM was implemented proactively through digital coaching: coaches used motivational interviewing techniques to manage/positively influence participants’ motivation levels and adjusted the difficulty of target behaviors on an ongoing basis in line with the participants’ motivation and/or skill level. Moreover, coaches helped users with tips/tricks and strategies to overcome any barriers encountered.
Measurements at Intake, During the Program, and After the Program
Upon enrollment to the program, participants underwent a baseline assessment where a comprehensive lifestyle questionnaire, a blood biochemistry panel, and physical measurements were collected using the InBody model 570 for body composition and the InBody BIOBP750 cuff for blood pressure. After the baseline assessment, users could access the digital web app to register and track their health behaviors and modify weight data at any time during the intervention. At follow-up after the intervention, which participants could voluntarily enroll for, the subset of blood biochemistry parameters found to be abnormal at baseline and the lifestyle questionnaire and physical measurements were reassessed. Weight and other cardiometabolic risk factors were remeasured at the health center for participants who were able to return for a remeasurement. Participants not able to return were asked to self-report their weight after receiving instructions from their lifestyle coaches (namely to measure it in the morning, before eating) (Figure 1). For self-reporting participants, other markers were not remeasured. According to the definition used in the criteria for participation in a CLI-WL in the Netherlands, we classified BMI values between 25 and 30 as “overweight” and values greater than or equal to 30 as “obese.” Changes from baseline in weight, blood pressure, and lipid markers were calculated by subtracting the end values from the first reported values, and the percent change was calculated by dividing the observed change by the baseline value.
After the entire cohort completed their intervention, the first author conducted semistructured interviews with 17 participants and 6 of the coaches delivering the intervention, either physically or via audio/video in Dutch or English. Semistructured interviews allow for greater flexibility for both the interviewer and participant than traditional, structured interviewing, while simultaneously providing greater direction in the interview process than completely unstructured interviews. The user research framework reported in this study was based on guidelines published by the Medical Research Council for process evaluations [36] and the Conceptual Framework for Implementation Research [37,38]. The focus of the interviews was acceptability and accessibility, two critical process indicators in the adoption of digital interventions. While there is no consensus definition of acceptability, it can be broadly defined as “people’s affective attitudes toward a new digital health intervention,” “usage intentions or actual usage,” and “satisfaction after having engaged with the intervention” [39]. Since most available acceptability measures in pilot or feasibility studies of digital health interventions lack a theoretically or empirically established cutoff, it has been suggested that 1 to 5 ratings and accompanying free-text responses may provide a sufficiently precise measure of acceptability [40].
The interview guide had questions for the coaches and participants focused on their experience coaching or partaking in the intervention, and on what they thought were the most important positive and improvement points for the quality of the intervention.
Statistical Analysis
Descriptive statistics were calculated to characterize the population at baseline in terms of demographics and clinical parameters. Paired remeasurement versus baseline changes in weight, blood pressure, and cholesterol in participants who were remeasured after a median of 10 months were assessed with the Student t test or Wilcoxon signed-rank test depending whether or not the data were normally distributed. All categorical variables are reported as percentages and continuous variables are reported as mean and SD. The χ2 test and analysis of variance were used to evaluate differences in categorical and continuous variables, respectively, at the cohort level. We considered P<.05 to indicate a statistically significant difference between cohorts and in pre- and postintervention measurements. All data analyses were performed using R software v4.0.3. Themes and coach/participant opinions were registered following an inductive process after the main findings of the interviews conducted by the first author were discussed in a multidisciplinary setting with the coaches, with no preexisting framework or theoretical constructs used to classify data [41,42].
Ethics Approval
The study was declared exempt from institutional review board approval through a waiver issued by the Medical Ethical Committee of the University Medical Centre Groningen (waiver number METC#2021/488).
Results
Baseline Characteristics
Baseline characteristics of the total study sample are shown in Table 1. We found that 208 of the 420 participants (49.5%) were classified as either obese or overweight with one or more cardiometabolic risk factors. Of these, 53 participants enrolled in the pilot study. These individuals were older, had higher lipid levels and blood pressure, as well as higher weight and BMI compared to the rest of the cohort (Table 1).
Table 1.
Baseline characteristics of the total study sample and the participants who enrolled in the pilot study.
| Characteristics | Entire cohort (N=420) | Participants of the pilot study (n=53) | P valuea | ||||
| Demographics | |||||||
|
|
Age (years), mean (SD) | 44.6 (11.1) | 48.2 (9.0) | .007 | |||
|
|
Female sex, n (%) | 227 (54.0) | 29 (54.7) | .99 | |||
| Anthropometrics, mean (SD) | |||||||
|
|
Weight (kg) | 77.5 (14.4) | 87.2 (11.2) | <.001 | |||
|
|
BMI (kg/m²) | 25.0 (4.6) | 29.1 (3.4) | <.001 | |||
| Blood pressure (mmHg), mean (SD) | |||||||
|
|
Systolic | 131 (17) | 146 (15) | <.001 | |||
|
|
Diastolic | 81 (12) | 93 (11) | <.001 | |||
| Lipids ( mmol/L), mean (SD) | |||||||
|
|
Total cholesterol | 5.1 (1.1) | 6.4 (1.0) | <.001 | |||
|
|
Low-density lipoprotein cholesterol | 3.1 (0.9) | 4.3 (0.9) | <.001 | |||
aUnpaired t test between the entire cohort and the pilot group.
Baseline Values and Changes in Weight and Cardiometabolic Risk Factors
We analyzed weight data for the entire group of 53 participants in the pilot and for the two subsets of participants with overweight and obesity separately (Table 2). In the entire group, the average weight loss achieved was 3.7 kilograms, which equates to an average of 4.2% body weight loss (P<.001). In total, 25 individuals (47%) achieved a reduction of at least 5% body weight. In the 37 participants with overweight, the mean weight loss was 2.9 kilograms (3.5% change). For the 16 participants with obesity, weight loss was higher at –5.4 kilograms and –5.6% body weight with a mean baseline weight of 97.3 kilograms (P<.001; Table 2).
Table 2.
Changes in weight after the combined lifestyle intervention for weight loss.
| Group | Preintervention weight (kg), mean (SD) | Postintervention weight (kg), mean (SD) | Absolute (relative) weight change, kg (%) | P value |
| Entire cohort (N=53) | 87.2 (11.2) | 83.5 (12.0) | –3.7 (–4.2) | <.001 |
| Participants classified as overweight (n=37) | 82.8 (8.3) | 79.9 (10.4) | –2.9 (–3.5) | <.001 |
| Participants classified as obese (n=16) | 97.3 (10.5) | 91.9 (11.3) | –5.4 (–5.6) | <.001 |
We also analyzed the changes in cardiometabolic risk factors in participants whose weight was remeasured on location and had abnormal lipid or blood pressure levels at baseline (Table 3). In these participants, total cholesterol, LDL cholesterol, systolic blood pressure, and diastolic blood pressure significantly decreased. In participants with obesity, changes in total and LDL cholesterol as well as in systolic and diastolic blood pressure were not significant, which was attributed to the very small sample size. In participants with overweight, total cholesterol, LDL cholesterol, and diastolic blood pressure were significantly decreased, whereas there was no significant decrease in systolic blood pressure.
Table 3.
Changes in lipid profile and blood pressure after the combined lifestyle intervention in individuals with abnormal baseline values.
| Variable | Preintervention, mean (SD) | Postintervention, mean (SD) | Absolute (relative) change, kg (%) | P value | |
| Total cholesterol (mmol/L) | |||||
|
|
Entire remeasured group (N=20) | 6.38 (1.00) | 5.73 (0.92) | –0.65 (–10.2) | .02a |
|
|
Participants with overweight (n=18) | 6.46 (1.01) | 5.71 (0.97) | –0.75 (–11.6) | .01a |
|
|
Participants with obesity (n=2) | 5.75 (0.74) | 5.88 (0) | 0.13 (2.3) | >.99a |
| LDLb cholesterol (mmol/L) | |||||
|
|
Entire remeasured group (N=24) | 4.34 (0.86) | 3.78 (0.88) | –0.56 (–12.9) | .007 |
|
|
Participants with overweight (n=20) | 4.46 (0.86) | 3.89 (0.85) | –0.57 (–12.8) | .02 |
|
|
Participants with obesity (n=4) | 3.71 (0.56) | 3.18 (0.88) | –0.53 (–14.3) | .17 |
| Systolic blood pressure (mmHg) | |||||
|
|
Entire remeasured group (N=22) | 146 (15) | 141 (16) | –5 (–3.5) | .04a |
|
|
Participants with overweight (n=18) | 148 (16) | 143 (16) | –5 (–3.4) | .12a |
|
|
Participants with obesity (n=4) | 139 (6) | 131 (14) | –9 (–6.5) | .14 |
| Diastolic blood pressure (mmHg) | |||||
|
|
Entire remeasured group (N=26) | 93 (11) | 86 (12) | –7 (–7.5) | .003a |
|
|
Participants with overweight (n=19) | 94 (11) | 86 (12) | –8 (–8.5%) | .003 |
|
|
Participants with obesity (n=7) | 90 (10) | 85 (12) | –5 (–5.6%) | .18a |
aBased on the Wilcoxon signed-rank test owing to baseline data not following the normal distribution.
bLDL: low-density lipoprotein.
None of the participants who were remeasured on location, based on information provided in the medical and lifestyle questionnaire at baseline and follow-up, had initiated blood pressure– or cholesterol-lowering medication during the lifestyle intervention.
Quantitative and Qualitative Participant Feedback
The subjective, qualitative feedback collected through surveys (n=37) and semistructured interviews (n=17) from pilot participants is presented in Textbox 1.
Summarized feedback collected from pilot participants through surveys and semistructured interviews regarding the acceptability and accessibility of the program.
Positive points
Coaches were friendly, engaged, and approachable for guidance
Proactive check-ins
Good, personal advice; coaches helped find solutions to overcome barriers
Program was (positively) challenging
Effectively motivated for behavioral change
Provided support in making effective lifestyle changes
Improvement points
Expand the features in the app (tracking, connectivity, reminders, personalized content)
More coaching conversations instead of chat messages
The quantitative results of the participant survey that was filled out at the end of the intervention period are presented in Table 4. The highest scoring items were linked to the feeling of involvement in the program (item 1, score 4.5/5), the interaction with the coaches (item 9, 4.6/5), and the knowledge displayed by the coaches (item 10, 4.4/5). Importantly, participants also overwhelmingly expressed the wish to continue working toward their health goals after the intervention (item 4, 4.7/5). The items that scored the lowest were linked to the need for one-on-one coaching and the importance of coaching in achieving the proposed health goals (items 7 and 8, 3.7/5 and 3.8/5, respectively).
Table 4.
Quantitative results of the participant survey (N=37).
| Item | Scorea |
| I felt involved in the program right from the start | 4.5 |
| I found the stepwise approach to behavioral change in the program easy to follow | 4.1 |
| I was motivated to work toward my health goals | 4.4 |
| I would like to continue working toward my health goals | 4.7 |
| I feel my health and well-being have improved since I participated in the Ancora program | 3.9 |
| I found the content of the program relevant and engaging | 4.0 |
| Human coaching was important for me to overcome my health challenges | 3.7 |
| Human coaching was important for me to achieve my health missions | 3.8 |
| I found my coach(es) friendly and empathic | 4.6 |
| I found my coach(es) knowledgeable | 4.4 |
a Scoring runs from 1 (“disagree completely”) to 5 (“agree completely”), with 3 being “neutral.”
The subjective feedback provided during semistructured interviews by the coaches (N=6) is presented in Textbox 2. In general, interviewees valued several aspects as the most positive and differentiating factors of the digitally enabled CLI-WL. These included the possibility of setting clear action plans (goals) for participants to work toward; the promotion of healthy eating, exercise, and other lifestyle habits as opposed to enforcing strict diets; and the speedy, problem solving–oriented interactions across the multiple weekly touch points. Both improvement points were related to the intervention curriculum, with health care professionals suggesting improvements in the food-tracking capabilities of the app as well as an expansion of the coaching resources.
Summary of the feedback regarding subjective intervention parameters “acceptability and accessibility” provided by coaches (N=6).
Positive points
Possibility to set clear goals for the intervention period based on a holistic assessment of the participant’s health
Integrative approach that promotes healthy eating and exercise as opposed to strict diets, including specific elements such as strength-training advice, stress management, and good sleep habits
Multiple touch points weekly between the Health Engagement team to enable rapid problem resolution and positive experience sharing
Multidisciplinary expertise for knowledge transfer
Protocolized digital coaching
One-on-one coaching with real-life examples
Improvement points
More insight into the participants’ daily lifestyle patterns during the intervention period
Expand the database of coaching resources (ie, materials coaches have available to support participants)
Discussion
Principal Results
In this study of 53 participants using the pilot version of a digitally enabled CLI-WL, we observed a mean weight loss of 3.7 kilograms (or 4.2% body weight reduction), with weight loss of more than 5 kilograms (or 5.6% body weight reduction) in individuals with obesity compared to baseline values at a median of 10 months after 16 weeks of online coaching. Both total cholesterol as well as LDL cholesterol decreased by over 10%, and systolic and diastolic blood pressure decreased by 5 and 7 mmHg, respectively. Our process evaluation analysis through surveys and interviews showed that digital implementation of a CLI-WL in the Netherlands is feasible and well-received by both participants and coaches.
Comparison With Prior Work
Evidence for the efficacy and safety of digital (or digitally enabled) and blended CLI-WL and the reduction of cardiometabolic and cardiovascular risk has been building up over the last 5 to 10 years [43,44]. As stated previously, some of the world’s most widely adopted commercial digital therapeutic programs for weight loss have reported achieving reductions in weight varying from 2.0% to 6.8% [30,31,45]. In addition, recent reviews showed that primarily mobile digital interventions targeting overweight and obese populations with high cardiovascular risk can be at least as effective as offline programs in terms of meaningful change of lifestyle and weight loss [22]. Several offline CLI-WL programs were shown to be effective to varying degrees in the Netherlands. Across three of the four interventions available in Dutch health care, weight loss achieved at 1 year varied between 2.9 kilograms and 2.2 kilograms [22,23,46]. Only one of these interventions reported follow-up data at 2 years, where participants lost an average of only 1.5 kilograms [47]. Another study reported an average weight loss of 2.5 kilograms at 18 months [23]. While we currently do not have such long-term data, a digitally enabled intervention that was similar to this CLI-WL (with a total duration of 12 months, including a maintenance phase), delivered in a real-world context, achieved long-term weight reductions of 7.2% and 7.6% in participants with overweight and obesity, respectively [48].
While none of the currently available CLI-WLs provided data on improvement in concomitant cardiometabolic risk factors, it is worthwhile to contextualize the changes achieved in blood pressure and lipids in this pilot study. Evidence for beneficial effects of healthful lifestyle modifications on blood pressure is solid, with several studies suggesting that lifestyle adaptation is preferable to pharmacological treatment in early stages of the disease [49]. Keeping in mind the observational nature of the results reported in this study, these do surpass the results of other recently evaluated digital therapeutic tools, which yielded reductions between 2.4 and 4.3 mmHg in mean blood pressure in randomized trials [50,51]. Similarly, the effect of lifestyle programs on cholesterol levels is well-established, with reductions varying from 7% to 9% to 20% for interventions of different intensity and complexity [52]. Interestingly, for web-based interventions, meta-analyses have shown total and LDL cholesterol improvements of approximately 0.15 mmol/L [53]. When compared to the results achieved previously in another cohort of individuals who participated in an Ancora Health digital lifestyle intervention, this group of individuals with overweight and obesity showed higher baseline lipid and blood pressure values and equal or greater reductions after the program [32,33].
In light of this evidence, it is worth discussing potential reasons why this blended CLI-WL achieved better results compared to those of previous studies. In a study evaluating the features of digitally enabled weight management programs, success was linked to the ability to promote behavioral change [54]. This finding is unsurprising, but what is interesting is that the study further broke down this ability to drive behavioral change to 20 features that were essential to the program. This set of features included specific goal-setting for weight, diet, caloric balance, and physical activity, as well as educational focus on various skills such as regulating eating patterns, time management, and nutritional label reading. In addition, this program also included the development of more general skills such as learning to exercise at certain target heart rates, problem solving, stress reduction, and psychological advice on how to cope with negative thinking and social cues [54]. Interestingly, these features include some of the most positive feedback points gathered during our participant survey, such as the appreciation for the stepwise approach to behavioral change in the program, the program content being relevant and engaging, and the digital support provided by the human coaching for overcoming challenges. In the qualitative assessment, participants further mentioned highly valuing the possibility to set clear goals for the intervention and that the coaching included elements that go beyond those of regular weight loss programs, such as advice on strength training, stress management, and sleep habits.
Other studies have focused on the potential advantages of digitally enabled interventions, such as the ability for participants to access educational information more easily and at their own discretion [44,55]. Unlike offline interventions driven primarily by one health care provider with a specific focus, digitally enabled programs can easily provide information covering a range of topics required to lead a balanced lifestyle across all relevant lifestyle domains. This seems to be especially powerful when apps also provide users with tools to help them track changes in weight and BMI. For instance, in-app actions such as self-monitoring of weight and the consistency of such health behavior tracking, as well as app engagement as measured by log-ins, predicted weight loss even in older populations [44,55]. These elements again come back in the qualitative feedback from participants highlighted in Textbox 2, who highly valued the multidisciplinary nature of the content and of the coaching, and suggested that even more attention should be paid to data collected about participants’ daily lifestyle patterns. In another study comparing a mobile app–based weight loss program with a traditional offline weight loss program, success in the weight loss intervention was linked to the digitalization of components common to the traditional program [56], including providing online food diaries rather than paper diaries or when the same curriculum delivered by the dietitian in person was delivered digitally. One such app-based program featured regular contact moments with a dietitian via either text messages or video calls, while allowing them to record their food, activity, and weight, as well as providing access to educational materials and a group chat [57].
Future Perspectives for Digital CLIs in The Netherlands
In the face of increasing rates of obesity, CVD, and (pre)diabetes, it is clear that there is a need for CLI-WLs to be deployed at scale in the Netherlands. However, current market penetration of these insurance-reimbursed programs is extremely low [58]. As the pathogenesis of obesity and (pre)diabetes is multifactorial, the etiology and environmental triggers vary among individuals; moreover, socioeconomic circumstances and barriers to lifestyle change also vary at an individual level. Yet, insurance-reimbursed CLI-WL programs currently offered in the Dutch market lack a data-driven approach to translating user profiles to personalized care pathways, with coaches bearing the burden of translating one-size-fits-all guidelines to a user’s context through their consultations. As suggested by the health care professionals interviewed in this study, supporting the delivery of CLI-WL programs with eHealth solutions such as those described in this research could help tailor the intervention to individual characteristics and needs, as well as tackle the practical issues of lack of time and capacity faced by care providers.
In fact, the Dutch National Institute for Public Health and the Environment (Rijksinstituut voor Volksgezondheid en Milieu [RIVM]) defines several important, evidence-based factors for the successful deployment of a (combined) lifestyle intervention program [59]. Interestingly, although these recommendations have been designed for offline programs, some of them are much more easily achievable with digitally enabled interventions. For instance, the RIVM recommends that participants of a CLI-WL who fail to achieve significant weight loss in the first month should receive increased support, since early weight loss is an important predictor of long-term success. Through its digital capabilities, the CLI-WL described herein allows for weekly monitoring of progress and enables coaches to review data and progress remotely. In addition, coaches are also able to contact the participant proactively to understand and address barriers in the absence of progress. Importantly, one full-time coach can effectively coach more than 100 participants across multiple regions while upholding the recommendation of 15 to 20 minutes of coaching time weekly. This allows for greater reach than possible with offline lifestyle interventions, which are often episodic, delivered at low frequency, and limited to participants within close proximity to the health coach. Importantly, a recent Dutch study showed that the Dutch population is generally sufficiently technology-literate, even across socioeconomic strata, and welcoming of digital technologies, which encourages the deployment of these interventions [60]. Lastly, the RIVM underscores the need for participants to develop self-efficacy skills to sustain behavioral change over the long term. This is in line with previous studies demonstrating that interventions applying theoretical frameworks or models for behavioral change—some of which were technology-based—were more effective at increasing adherence to healthy lifestyle habits than standard advice [61,62]. This program represents the first instance in which the FBM was used as part of a CLI-WL. The positive health outcomes and subjective feedback from users and health care professionals suggest that this approach holds promise and ought to be further explored for future iterations.
Strengths and Limitations
This study has several limitations. The first is the observational nature of the study. The second limitation is the small sample size of the remeasured population. Third, participants were not followed up for the duration of a standard CLI-WL (2 years); rather, these preliminary outcomes were reported after a median of 10 months after the 16-week intervention. As such, the results of the 16-week program should be compared with caution to those of other CLI-WLs that maintained participants engaged for the entirety of the 2-year period. Fourth, participants who could not return to the health center for a remeasurement were asked to self-report their weight after 10 months. As for all self-reported outcome measures, and despite careful instructions provided by the coach, measurement errors cannot be excluded. We are currently evaluating several possibilities to overcome this, such as the delivery of a personalized program box with a connected scale and wearable device. Lastly, the goal of CLI-WLs is to provide sustained positive health outcomes after 2 years (which is also the duration of the insured intervention in public health programs). Therefore, our 10-month results show that the weight loss can be sustained for a medium-long period of time, but we do not yet have data of 2-year follow-up for these participants. More research will also be conducted to evaluate the impact of interventional elements on engagement and health outcomes, such as to identify which elements are most effective for a digitally enabled CLI-WL.
Conversely, one strength of the study is that medication information was gathered at baseline and follow-up. This allows us to verify that weight loss and the improvements reported in lipids and blood pressure did not come from cholesterol- or blood pressure–lowering medications. In addition, by gathering detailed feedback from a majority of participants, we were able to identify critical points for improvement, which contributed to the further maturing of the intervention and informed the development of the mobile app designed to support it. Lastly, this is the first study to report on a real-world application of a digitally enabled intervention targeting health behavior change to promote weight loss in a cohort of Dutch adults with overweight and cardiometabolic risk factors.
Conclusions
In conclusion, a digitally enabled CLI showed sustained weight loss in individuals with overweight and obesity at the 10-month follow-up. Albeit preliminary, these findings suggest that a behavioral lifestyle program with a digital component deployed for this intervention can achieve greater weight loss than previously reported for currently available offline CLI-WLs in the Netherlands. Whereas larger-scale observational studies and randomized trials of other digital interventions have been conducted and shown evidence of effectiveness for digitally enabled CLI-WL in other countries, this study is a demonstration that such an approach can also be effective in the Netherlands. This is an important first step, as the feasibility of these programs remains a hot topic in public health discussions. Based on the qualitative feedback collected from pilot participants and health care professionals, this first version of the program is being further developed and evaluated. Evidence from future studies in a Dutch population may help elucidate the mechanisms behind the effectiveness of a digitally enabled CLI-WL.
Abbreviations
- CLI
combined lifestyle intervention
- CLI-WL
combined lifestyle intervention for weight loss
- CVD
cardiovascular disease
- FBM
Fogg Behavioral Model
- LDL
low-density lipoprotein
- RIVM
Rijksinstituut voor Volksgezondheid en Milieu (Dutch National Institute for Public Health and the Environment)
Data Availability
The data sets generated during and/or analyzed during this study are available from the corresponding author on reasonable request.
Footnotes
Authors' Contributions: RG had the original ideation of the manuscript, and made significant contributions to data collection and the drafting of the manuscript. JCF was the main contributor to the first draft of the manuscript. PF was the main contributor to the data analysis. SH contributed to ideation and discussion. SK was involved in the original study ideation. SvD contributed to the Methods, Results, and Discussion sections of the manuscript. NC, HvO, and HP contributed to the Introduction and Discussion sections of the manuscript. BHRW contributed to the Methods and Discussion sections of the manuscript. All authors gave input toward and approved the final manuscript.
Conflicts of Interest: RG, JCF, PF, SH, SK, and SvD are employed by Ancora Health BV. Additionally, JCF, PF, RG, SK, SH, and SvD own shares of Ancora Health BV. As the funder, Ancora Health BV provided support in the form of salaries for all employees. The other authors have no conflicts of interest to declare.
References
- 1.Roth GA, Mensah GA, Johnson CO, Addolorato G, Ammirati E, Baddour LM, Barengo NC, Beaton AZ, Benjamin EJ, Benziger CP, Bonny A, Brauer M, Brodmann M, Cahill TJ, Carapetis J, Catapano AL, Chugh SS, Cooper LT, Coresh J, Criqui M, DeCleene N, Eagle KA, Emmons-Bell S, Feigin VL, Fernández-Solà J, Fowkes G, Gakidou E, Grundy SM, He FJ, Howard G, Hu F, Inker L, Karthikeyan G, Kassebaum N, Koroshetz W, Lavie C, Lloyd-Jones D, Lu HS, Mirijello A, Temesgen AM, Mokdad A, Moran AE, Muntner P, Narula J, Neal B, Ntsekhe M, Moraes de Oliveira G, Otto C, Owolabi M, Pratt M, Rajagopalan S, Reitsma M, Ribeiro ALP, Rigotti N, Rodgers A, Sable C, Shakil S, Sliwa-Hahnle K, Stark B, Sundström J, Timpel P, Tleyjeh IM, Valgimigli M, Vos T, Whelton PK, Yacoub M, Zuhlke L, Murray C, Fuster V, GBD-NHLBI-JACC Global Burden of Cardiovascular Diseases Writing Group Global Burden of Cardiovascular Diseases and Risk Factors, 1990-2019: Update From the GBD 2019 Study. J Am Coll Cardiol. 2020 Dec 22;76(25):2982–3021. doi: 10.1016/j.jacc.2020.11.010. https://air.unimi.it/handle/2434/809754 .S0735-1097(20)37775-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sun H, Saeedi P, Karuranga S, Pinkepank M, Ogurtsova K, Duncan BB, Stein C, Basit A, Chan JC, Mbanya JC, Pavkov ME, Ramachandaran A, Wild SH, James S, Herman WH, Zhang P, Bommer C, Kuo S, Boyko EJ, Magliano DJ. IDF Diabetes Atlas: global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045. Diabetes Res Clin Pract. 2022 Jan;183:109119. doi: 10.1016/j.diabres.2021.109119.S0168-8227(21)00478-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Blüher M. Obesity: global epidemiology and pathogenesis. Nat Rev Endocrinol. 2019 May 27;15(5):288–298. doi: 10.1038/s41574-019-0176-8.10.1038/s41574-019-0176-8 [DOI] [PubMed] [Google Scholar]
- 4.OECD Health Policy Studies . The heavy burden of obesity: the economics of prevention. Paris: OECD Publishing; 2019. [Google Scholar]
- 5.Hill JO, Wyatt HR, Peters JC. Energy balance and obesity. Circulation. 2012 Jul 03;126(1):126–132. doi: 10.1161/CIRCULATIONAHA.111.087213. https://europepmc.org/abstract/MED/22753534 .126/1/126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Chau JY, Grunseit AC, Chey T, Stamatakis E, Brown WJ, Matthews CE, Bauman AE, van der Ploeg HP. Daily sitting time and all-cause mortality: a meta-analysis. PLoS One. 2013 Nov 13;8(11):e80000. doi: 10.1371/journal.pone.0080000. https://dx.plos.org/10.1371/journal.pone.0080000 .PONE-D-13-19234 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Berendsen BA, Hendriks MR, Rutten GM, Kremers SP, Savelberg HH, Schaper NC. The added value of frequent physical activity group sessions in a combined lifestyle intervention: a cluster randomised trial in primary care. Prev Med Rep. 2020 Dec;20:101204. doi: 10.1016/j.pmedr.2020.101204. https://linkinghub.elsevier.com/retrieve/pii/S2211-3355(20)30163-7 .S2211-3355(20)30163-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lake A, Townshend T. Obesogenic environments: exploring the built and food environments. J R Soc Promot Health. 2006 Nov 30;126(6):262–267. doi: 10.1177/1466424006070487. [DOI] [PubMed] [Google Scholar]
- 9.Capers PL, Fobian AD, Kaiser KA, Borah R, Allison DB. A systematic review and meta-analysis of randomized controlled trials of the impact of sleep duration on adiposity and components of energy balance. Obes Rev. 2015 Sep 22;16(9):771–782. doi: 10.1111/obr.12296. https://europepmc.org/abstract/MED/26098388 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Konttinen H. Emotional eating and obesity in adults: the role of depression, sleep and genes. Proc Nutr Soc. 2020 Aug;79(3):283–289. doi: 10.1017/S0029665120000166.S0029665120000166 [DOI] [PubMed] [Google Scholar]
- 11.Dohle S, Hartmann C, Keller C. Physical activity as a moderator of the association between emotional eating and BMI: evidence from the Swiss Food Panel. Psychol Health. 2014 Apr 23;29(9):1062–1080. doi: 10.1080/08870446.2014.909042. [DOI] [PubMed] [Google Scholar]
- 12.Gezondheidsenquête/Leefstijlmonitor [Health survey/Lifestyle monitor] Rijksinstituut voor Volksgezondheid en Milieu. 2017. [2023-06-06]. https://www.rivm.nl/leefstijlmonitor/gezond-gewicht .
- 13.Sharma M. Behavioural interventions for preventing and treating obesity in adults. Obes Rev. 2007 Sep;8(5):441–449. doi: 10.1111/j.1467-789X.2007.00351.x.OBR351 [DOI] [PubMed] [Google Scholar]
- 14.Greenway FL. Physiological adaptations to weight loss and factors favouring weight regain. Int J Obes. 2015 Aug 21;39(8):1188–1196. doi: 10.1038/ijo.2015.59. https://europepmc.org/abstract/MED/25896063 .ijo201559 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Arnett DK, Blumenthal RS, Albert MA, Buroker AB, Goldberger ZD, Hahn EJ, Himmelfarb CD, Khera A, Lloyd-Jones D, McEvoy JW, Michos ED, Miedema MD, Muñoz D, Smith SC, Virani SS, Williams KA, Yeboah J, Ziaeian B. 2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2019 Sep 10;140(11):e596–e646. doi: 10.1161/CIR.0000000000000678. https://www.ahajournals.org/doi/abs/10.1161/CIR.0000000000000678?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Guerra F, Stringhini S, Vollenweider P, Waeber G, Marques-Vidal P. Socio-demographic and behavioural determinants of weight gain in the Swiss population. BMC Public Health. 2015 Jan 31;15(1):73. doi: 10.1186/s12889-015-1451-9. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-015-1451-9 .s12889-015-1451-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jackson CL, Wee CC, Hurtado DA, Kawachi I. Obesity trends by industry of employment in the United States, 2004 to 2011. BMC Obes. 2016 Apr 2;3(1):20. doi: 10.1186/s40608-016-0100-x. https://bmcobes.biomedcentral.com/articles/10.1186/s40608-016-0100-x .100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.van der Heiden W, Lacroix J, Moll van Charante E, Beune E. GPs' views on the implementation of combined lifestyle interventions in primary care in the Netherlands: a qualitative study. BMJ Open. 2022 Feb 04;12(2):e056451. doi: 10.1136/bmjopen-2021-056451. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=35121605 .bmjopen-2021-056451 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Gecombineerde Leefstijlinterventie (GLI) Zorginstituut Netherlands. [2023-04-20]. https://www.zorginstituutnederland.nl/Verzekerde+zorg/gecombineerde-leefstijlinterventie-gli-zvw .
- 20.Hassan Y, Head V, Jacob D, Bachmann MO, Diu S, Ford J. Lifestyle interventions for weight loss in adults with severe obesity: a systematic review. Clin Obes. 2016 Dec 27;6(6):395–403. doi: 10.1111/cob.12161. [DOI] [PubMed] [Google Scholar]
- 21.van Rinsum C, Gerards S, Rutten G, Philippens N, Janssen E, Winkens B, van de Goor I, Kremers S. The Coaching on Lifestyle (CooL) intervention for overweight and obesity: a longitudinal study into participants' lifestyle changes. Int J Environ Res Public Health. 2018 Apr 04;15(4):680. doi: 10.3390/ijerph15040680. https://www.mdpi.com/resolver?pii=ijerph15040680 .ijerph15040680 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Schutte BAM, Haveman-Nies A, Preller L. One-year results of the BeweegKuur Lifestyle Intervention implemented in Dutch primary healthcare settings. Biomed Res Int. 2015;2015:484823–7. doi: 10.1155/2015/484823. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Duijzer G, Haveman-Nies A, Jansen SC, Beek JT, van Bruggen R, Willink MGJ, Hiddink GJ, Feskens EJM. Effect and maintenance of the SLIMMER diabetes prevention lifestyle intervention in Dutch primary healthcare: a randomised controlled trial. Nutr Diabetes. 2017 May 08;7(5):e268. doi: 10.1038/nutd.2017.21.nutd201721 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mailey E, Huberty J, Dinkel D, McAuley E. Physical activity barriers and facilitators among working mothers and fathers. BMC Public Health. 2014 Jun 27;14:657. doi: 10.1186/1471-2458-14-657. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-14-657 .1471-2458-14-657 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Akinosun AS, Polson R, Diaz-Skeete Y, De Kock JH, Carragher L, Leslie S, Grindle M, Gorely T. Digital technology interventions for risk factor modification in patients with cardiovascular disease: systematic review and meta-analysis. JMIR Mhealth Uhealth. 2021 Mar 03;9(3):e21061. doi: 10.2196/21061. https://mhealth.jmir.org/2021/3/e21061/ v9i3e21061 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008 Jul 08;57(4):660–680. doi: 10.1111/j.1464-0597.2008.00341.x. [DOI] [Google Scholar]
- 27.Hori JH, Sia EX, Lockwood KG, Auster-Gussman LA, Rapoport S, Branch OH, Graham SA. Discovering engagement personas in a digital diabetes prevention program. Behav Sci. 2022 May 24;12(6):159. doi: 10.3390/bs12060159. https://www.mdpi.com/resolver?pii=bs12060159 .bs12060159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Valinskas S, Nakrys M, Aleknavičius K, Jonusas J, Lileikienė A. User engagement and weight loss facilitated by a mobile app: retrospective review of medical records. JMIR Form Res. 2023 Jan 24;7:e42266. doi: 10.2196/42266. https://formative.jmir.org/2023//e42266/ v7i1e42266 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ritchie ND, Phimphasone-Brady P, Sauder KA, Amura CR. Perceived barriers and potential solutions to engagement in the National Diabetes Prevention Program. ADCES Pract. 2021 Jan 04;9(1):16–20. doi: 10.1177/2633559x20966275. [DOI] [Google Scholar]
- 30.Toro-Ramos T, Michaelides A, Anton M, Karim Z, Kang-Oh L, Argyrou C, Loukaidou E, Charitou MM, Sze W, Miller JD. Mobile delivery of the Diabetes Prevention Program in people with prediabetes: randomized controlled trial. JMIR Mhealth Uhealth. 2020 Jul 08;8(7):e17842. doi: 10.2196/17842. https://mhealth.jmir.org/2020/7/e17842/ v8i7e17842 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Chen F, Su W, Becker SH, Payne M, Castro Sweet CM, Peters AL, Dall TM. Clinical and economic impact of a digital, remotely-delivered intensive behavioral counseling program on Medicare beneficiaries at risk for diabetes and cardiovascular disease. PLoS One. 2016;11(10):e0163627. doi: 10.1371/journal.pone.0163627. https://dx.plos.org/10.1371/journal.pone.0163627 .PONE-D-16-12461 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Castela Forte J, Gannamani R, Folkertsma P, Kumaraswamy S, Mount S, van Dam S, Hoogsteen J. Changes in blood lipid levels after a digitally enabled cardiometabolic preventive health program: pre-post study in an adult Dutch general population cohort. JMIR Cardio. 2022 Mar 23;6(1):e34946. doi: 10.2196/34946. https://cardio.jmir.org/2022/1/e34946/ v6i1e34946 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Castela Forte J, Folkertsma P, Gannamani R, Kumaraswamy S, van Dam S, Hoogsteen J. Effect of a digitally-enabled, preventive health program on blood pressure in an adult, Dutch general population cohort: an observational pilot study. Int J Environ Res Public Health. 2022 Mar 31;19(7):4171. doi: 10.3390/ijerph19074171. https://www.mdpi.com/resolver?pii=ijerph19074171 .ijerph19074171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Castela Forte J, Gannamani R, Folkertsma P, Kanthappu S, van Dam S, Wolffenbuttel BHR. A pilot study on the prevalence of micronutrient imbalances in a Dutch general population cohort and the effects of a digital lifestyle program. Nutrients. 2022 Mar 29;14(7):1426. doi: 10.3390/nu14071426. https://www.mdpi.com/resolver?pii=nu14071426 .nu14071426 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Fogg B. Tiny habits: the small changes that change everything. Boston, MA: Houghton Mifflin Harcourt; 2019. [Google Scholar]
- 36.Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O'Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015 Mar 19;350:h1258. doi: 10.1136/bmj.h1258. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=25791983 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009 Jan;36(1):24–34. doi: 10.1007/s10488-008-0197-4. https://europepmc.org/abstract/MED/19104929 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011 Mar;38(2):65–76. doi: 10.1007/s10488-010-0319-7. https://europepmc.org/abstract/MED/20957426 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Perski O, Short C. Acceptability of digital health interventions: embracing the complexity. Transl Behav Med. 2021 Jul 29;11(7):1473–1480. doi: 10.1093/tbm/ibab048. https://europepmc.org/abstract/MED/33963864 .6272497 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Thomas D. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2016 Jun 30;27(2):237–246. doi: 10.1177/1098214005283748. [DOI] [Google Scholar]
- 41.Ritchie J, Lewis J, McNaughton-Nicholls C, Ormston R. Qualitative research practice: a guide for social science students and researchers. 2nd edition. Thousand Oaks, CA: SAGE Publications; 2013. [Google Scholar]
- 42.Bian RR, Piatt GA, Sen A, Plegue MA, De Michele ML, Hafez D, Czuhajewski CM, Buis LR, Kaufman N, Richardson CR. The effect of technology-mediated diabetes prevention interventions on weight: a meta-analysis. J Med Internet Res. 2017 Mar 27;19(3):e76. doi: 10.2196/jmir.4709. https://www.jmir.org/2017/3/e76/ v19i3e76 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Patel ML, Wakayama LN, Bennett GG. Self-monitoring via digital health in weight loss interventions: a systematic review among adults with overweight or obesity. Obesity. 2021 Mar 23;29(3):478–499. doi: 10.1002/oby.23088. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Sepah SC, Jiang L, Ellis RJ, McDermott K, Peters AL. Engagement and outcomes in a digital Diabetes Prevention Program: 3-year update. BMJ Open Diabetes Res Care. 2017 Sep 07;5(1):e000422. doi: 10.1136/bmjdrc-2017-000422. https://drc.bmj.com/lookup/pmidlookup?view=long&pmid=28948027 .bmjdrc-2017-000422 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Beleigoli AM, Andrade AQ, Cançado AG, Paulo MN, Diniz MDFH, Ribeiro AL. Web-based digital health interventions for weight loss and lifestyle habit changes in overweight and obese adults: systematic review and meta-analysis. J Med Internet Res. 2019 Jan 08;21(1):e298. doi: 10.2196/jmir.9609. https://www.jmir.org/2019/1/e298/ v21i1e298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.van Rinsum C, Gerards SMPL, Rutten GJM, van de Goor I, Kremers SPJ. Coaching op Leefstijl (CooL) Tilburg University. 2008. [2023-01-05]. https://pure.uvt.nl/ws/portalfiles/portal/31271452/Tranzo_vd_Goor_eindrapport_coaching_op_leefstijlcool_2018.pdf .
- 47.Silberman JM, Kaur M, Sletteland J, Venkatesan A. Outcomes in a digital weight management intervention with one-on-one health coaching. PLoS One. 2020 Apr 30;15(4):e0232221. doi: 10.1371/journal.pone.0232221. https://dx.plos.org/10.1371/journal.pone.0232221 .PONE-D-19-33381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.van Duijn HJ, Belo JN, Blom JW, Velberg ID, Assendelft WJ. Revised guidelines for cardiovascular risk management - time to stop medication? A practice-based intervention study. Br J Gen Pract. 2011 Jun;61(587):e347–e352. doi: 10.3399/bjgp11X578025. https://bjgp.org/lookup/pmidlookup?view=long&pmid=21801514 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Kario K, Nomura A, Harada N, Okura A, Nakagawa K, Tanigawa T, Hida E. Efficacy of a digital therapeutics system in the management of essential hypertension: the HERB-DH1 pivotal trial. Eur Heart J. 2021 Oct 21;42(40):4111–4122. doi: 10.1093/eurheartj/ehab559. https://europepmc.org/abstract/MED/34455443 .6358480 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Mao AY, Chen C, Magana C, Caballero Barajas K, Olayiwola JN. A mobile phone-based health coaching intervention for weight loss and blood pressure reduction in a national payer population: a retrospective study. JMIR Mhealth Uhealth. 2017 Jun 08;5(6):e80. doi: 10.2196/mhealth.7591. https://mhealth.jmir.org/2017/6/e80/ v5i6e80 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Roussell MA, Kris-Etherton P. Effects of lifestyle interventions on high-density lipoprotein cholesterol levels. J Clin Lipidol. 2007 Mar;1(1):65–73. doi: 10.1016/j.jacl.2007.02.005.S1933-2874(07)00010-4 [DOI] [PubMed] [Google Scholar]
- 52.Widmer RJ, Collins NM, Collins CS, West CP, Lerman LO, Lerman A. Digital health interventions for the prevention of cardiovascular disease: a systematic review and meta-analysis. Mayo Clin Proc. 2015 Apr;90(4):469–480. doi: 10.1016/j.mayocp.2014.12.026. https://europepmc.org/abstract/MED/25841251 .S0025-6196(15)00073-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Gecombineerde leefstijlinterventie 2021: de groei in aantal deelnemers zet door [Factsheet Combined Lifestyle Intervention 2021] Rijksinstituut voor Volksgezondheid en Milieu. 2021. [2023-01-05]. https://open.overheid.nl/repository/ronl-61d5690f-2259-44d7-ad05-b9d93650c483/1/pdf/factsheet-gecombineerde-leefstijlinterventie-2021.pdf .
- 54.Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D. Evidence-based strategies in weight-loss mobile apps. Am J Prev Med. 2013 Nov;45(5):576–582. doi: 10.1016/j.amepre.2013.04.025.S0749-3797(13)00426-1 [DOI] [PubMed] [Google Scholar]
- 55.Auster-Gussman LA, Lockwood KG, Graham SA, Pitter V, Branch OH. Engagement in digital health app-based prevention programs is associated with weight loss among adults age 65. Front Digit Health. 2022;4:886783. doi: 10.3389/fdgth.2022.886783. https://europepmc.org/abstract/MED/35663278 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Ufholz K, Werner J. The efficacy of mobile applications for weight loss. Curr Cardiovasc Risk Rep. 2023 Mar 23;17(4):83–90. doi: 10.1007/s12170-023-00717-2. https://europepmc.org/abstract/MED/36974130 .717 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Haas K, Hayoz S, Maurer-Wiesner S. Effectiveness and feasibility of a remote lifestyle intervention by dietitians for overweight and obese adults: pilot study. JMIR Mhealth Uhealth. 2019 Apr 11;7(4):e12289. doi: 10.2196/12289. https://mhealth.jmir.org/2019/4/e12289/ v7i4e12289 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Werkzame elementen van gecombineerde leefstijlinterventies. Rijksinstituut voor Volksgezondheid en Milieu. 2019. [2023-04-15]. https://www.loketgezondleven.nl/sites/default/files/2019-05/190510_011324_120568_Werkzame_elementen_GLI_A4L_V5_TG.pdf .
- 59.Cradock KA, ÓLaighin G, Finucane FM, Gainforth HL, Quinlan LR, Ginis KAM. Behaviour change techniques targeting both diet and physical activity in type 2 diabetes: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017 Feb 08;14(1):18. doi: 10.1186/s12966-016-0436-0. https://ijbnpa.biomedcentral.com/articles/10.1186/s12966-016-0436-0 .10.1186/s12966-016-0436-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Agachi E, Bijmolt THA, Mierau JO, van Ittersum K. Adoption of the website and mobile app of a preventive health program across neighborhoods with different socioeconomic conditions in the Netherlands: longitudinal study. JMIR Hum Factors. 2022 Feb 02;9(1):e32112. doi: 10.2196/32112. https://humanfactors.jmir.org/2022/1/e32112/ v9i1e32112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Chen Y, Perez-Cueto FJA, Giboreau A, Mavridis I, Hartwell H. The promotion of eating behaviour change through digital interventions. Int J Environ Res Public Health. 2020 Oct 15;17(20):7488. doi: 10.3390/ijerph17207488. https://www.mdpi.com/resolver?pii=ijerph17207488 .ijerph17207488 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Azar KMJ, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, Palaniappan LP. Mobile applications for weight management: theory-based content analysis. Am J Prev Med. 2013 Nov;45(5):583–589. doi: 10.1016/j.amepre.2013.07.005.S0749-3797(13)00431-5 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data sets generated during and/or analyzed during this study are available from the corresponding author on reasonable request.