Abstract
Background
Mobile health (mHealth) apps show vast potential in supporting patients and health care systems with the increasing prevalence and economic costs of noncommunicable diseases (NCDs) worldwide. However, despite the availability of evidence-based mHealth apps, a substantial proportion of users do not adhere to them as intended and may consequently not receive treatment. Therefore, understanding the factors that act as barriers to or facilitators of adherence is a fundamental concern in preventing intervention dropouts and increasing the effectiveness of digital health interventions.
Objective
This review aimed to help stakeholders develop more effective digital health interventions by identifying factors influencing the continued use of mHealth apps targeting NCDs. We further derived quantified adherence scores for various health domains to validate the qualitative findings and explore adherence benchmarks.
Methods
A comprehensive systematic literature search (January 2007 to December 2020) was conducted on MEDLINE, Embase, Web of Science, Scopus, and ACM Digital Library. Data on intended use, actual use, and factors influencing adherence were extracted. Intervention-related and patient-related factors with a positive or negative influence on adherence are presented separately for the health domains of NCD self-management, mental health, substance use, nutrition, physical activity, weight loss, multicomponent lifestyle interventions, mindfulness, and other NCDs. Quantified adherence measures, calculated as the ratio between the estimated intended use and actual use, were derived for each study and compared with the qualitative findings.
Results
The literature search yielded 2862 potentially relevant articles, of which 99 (3.46%) were included as part of the inclusion criteria. A total of 4 intervention-related factors indicated positive effects on adherence across all health domains: personalization or tailoring of the content of mHealth apps to the individual needs of the user, reminders in the form of individualized push notifications, user-friendly and technically stable app design, and personal support complementary to the digital intervention. Social and gamification features were also identified as drivers of app adherence across several health domains. A wide variety of patient-related factors such as user characteristics or recruitment channels further affects adherence. The derived adherence scores of the included mHealth apps averaged 56.0% (SD 24.4%).
Conclusions
This study contributes to the scarce scientific evidence on factors that positively or negatively influence adherence to mHealth apps and is the first to quantitatively compare adherence relative to the intended use of various health domains. As underlying studies mostly have a pilot character with short study durations, research on factors influencing adherence to mHealth apps is still limited. To facilitate future research on mHealth app adherence, researchers should clearly outline and justify the app’s intended use; report objective data on actual use relative to the intended use; and, ideally, provide long-term use and retention data.
Keywords: intended use, adherence, engagement, attrition, retention, mHealth, eHealth, digital health intervention, noncommunicable disease, NCD, mobile phone
Introduction
Rationale
Digital health interventions (DHIs) show vast potential in supporting patients and health care systems with the globally increasing prevalence and economic costs of noncommunicable diseases (NCDs), which is the leading causes of death and disability worldwide [1,2]. More specifically, mobile health (mHealth) apps are now considered accessible and scalable solutions to promoting behavior change among patients, improving health outcomes, and reducing health care costs [3-5]. Correspondingly, the number of available mHealth apps has continuously grown to >300.000, with approximately 200 new mHealth apps released each day [2,6].
However, despite increasing evidence and availability, mHealth apps are subject to significant dropout rates, with a substantial proportion of users not adhering to them as intended [7,8]. Recent research has shown that up to 80% of all participants in mHealth interventions only engage at a minimum level, do not log into the mHealth app more than once, and do not consistently use the app in the long term [9]. Another study examining mHealth app use in more extensive real-world settings reported low retention rates, with only 3.9% of participants using mHealth apps for >15 days [10]. The reported low adherence and high attrition levels further highlight the necessity of developing more effective models, best practices, and interventions [8,11].
As nonadherence relative to intended use jeopardizes treatment success and, thus, might lead to an increased number of hospitalizations, it is considered a fundamental concern in the development of mHealth apps [8,12-15]. However, the scientific body of literature lacks concise conceptualizations and measures for the intended use of mHealth apps, whereas intervention components and factors influencing adherence remain to be explored [13,16]. Following previous studies, we define adherence as “the degree to which the user followed the program as it was designed,” which can be paraphrased as “adherence relative to the intended use” [13,17,18].
With smartphone apps being the primary intervention component, adherence relative to the intended use is principally informed by user acceptance and the use of information technology [19]. Previous research underscores the necessity of mHealth apps that must be first accepted and used in an intended way to then achieve a desired health behavior change [3,19]. Correspondingly, previous research has identified factors affecting the uptake of and engagement with health and well-being smartphone apps [11,20-23]. Many of these strategies and factors, such as well-designed reminders, self-monitoring features, and embedded health professional support, have been applied across various health domains [11,20,21]. Some of these factors, such as reminders, can be further applied as retention methods and strategies for cohort studies in general and may thus extend the scope of DHIs [24,25].
Identifying the factors that influence adherence relative to intended use may support and extend these findings. Given previous research and their relation to technology use and acceptance, we can assume that these factors may be not only generalizable across various health behavior domains but also be applicable to DHIs using alternative information technologies. To our knowledge, no systematic review has been conducted on the factors influencing adherence to mHealth apps designed to prevent or manage NCDs. Furthermore, to the best of our knowledge, no review has previously explored the quantifying of adherence to assess qualitatively identified factors.
Objectives
Preventing intervention dropouts and thus increasing the effectiveness of mHealth apps requires an understanding of the factors that act as barriers to or facilitators of intervention adherence. This review aimed to identify factors influencing adherence relative to the intended use of mHealth apps, which may help stakeholders better plan, develop, and evaluate mHealth apps. To help readers navigate through the identified factors, we further categorized them into intervention-related factors that app developers can potentially improve upon through product changes (eg, the inclusion of certain app features) and patient-related factors that are hardly adjustable (eg, user characteristics). These factors were separated into their potential positive or negative influences on adherence.
In the absence of a universally agreed-upon approach to measuring adherence to mHealth interventions, we exploratively derived an adherence score as the ratio between the intended and actual use of each study to describe adherence quantitatively and consistently. The primary aim of the resulting adherence score was to quantitatively assess the findings from the qualitative extraction of factors influencing adherence. As the intended use varies substantially across different mHealth apps, we extracted the intended use for each included mHealth app individually. We then compared the intended use with the actual use reported in the corresponding study. To the best of our knowledge, this exploratory approach of a quantified adherence score has not been applied previously.
In summary, this review aimed to answer the following research questions:
Which intervention-related factors influence adherence relative to the intended use of mHealth apps targeting NCDs in adults?
Which patient-related factors influence adherence relative to the intended use of mHealth apps targeting NCDs in adults?
How do the adherence rates of mHealth apps for NCDs compare across different health domains?
Methods
Database Selection and Search Strategy
This review was conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses; Multimedia Appendix 1). A review protocol was submitted to the Federal Office of Public Health of the Swiss Confederation on October 7, 2020, but was not publicly registered.
The electronic databases Embase (including MEDLINE and PubMed), Web of Science, Scopus, and ACM Digital Library were searched using a predefined search strategy that included search terms related to mHealth apps, app use, and study design (Multimedia Appendix 2). The search terms were customized for each electronic database, and if the respective database allowed it, the corresponding Medical Subject Heading terms or topics were also integrated. Articles published in English between June 2007 (release of the iPhone) and December 2020, which focused on adult populations, were included. Studies that focused on communicable diseases were excluded. The inclusion and exclusion criteria listed in Textbox 1 were used to identify relevant articles.
List of eligibility criteria (Population, Intervention, Comparison, Outcomes, and Study component [PICOS] along with inclusion and exclusion criteria and applied filters).
Inclusion criteria
Participants: adults aged ≥18 years; studies that included individuals aged ≥16 years were included if at least 70% of the participants were aged ≥18 years
Intervention and context: studies investigating digital interventions that aimed to change ≥1 health behavior and the stated goal of the intervention was to prevent or treat a noncommunicable disease or condition
Comparison: any kind of comparison
-
Outcomes
Qualitative: factors predicting adherence or nonadherence relative to the intended use
Quantitative: information on the actual and intended use of the intervention or information on adherence relative to the intended use
Study design: primary and secondary studies, including randomized controlled trials, systematic reviews, meta-analyses, observational studies, single-center experiments, feasibility studies, pilot studies, and experimental studies
Exclusion criteria
Participants: children and adolescents aged <18 years and animals
-
Intervention and context:
Studies with the smartphone not being the primary intervention component
Interventions not targeting noncommunicable diseases; for example, communicable diseases (influenza, norovirus, Ebola, and COVID-19)
Comparison: none
Outcomes: the study does not contain information on the actual and intended use of the intervention
Study design: animal and laboratory studies, case reports, case series, narrative reviews, expert opinions, editorials, conference abstracts, and study protocols
Applied filters
Time: studies published from June 2007 onward
Language: English
Access: open access or via institutional log-in
Screening Process and Eligibility Criteria
The selection of publications was conducted in several steps (Figure 1). First, potentially relevant publications were identified by searching the literature databases. After excluding duplicates, titles and abstracts were independently reviewed by 3 researchers (SH, RJ, and AMR) according to the inclusion and exclusion criteria listed in Textbox 1. Disagreements were resolved through discussion. In a second screening step, the full texts of relevant articles were independently reviewed by 4 researchers (SH, RJ, AMR, and JLM) concerning the fulfillment of the inclusion and exclusion criteria. Discrepancies were again resolved through discussions. The web-based program Covidence (Veritas Health Innovation) was used for the entire process. After applying the search strategies outlined in Multimedia Appendix 2, the resulting database reference lists were imported into the Covidence database. The following Covidence features were used in the process: duplicate removal, title and abstract screening, full-text review, and export of PRISMA flowchart.
Data Extraction
The following information was extracted for each included study: general study characteristics, study population characteristics, intervention characteristics, factors influencing adherence relative to intended use, and information on app use (Multimedia Appendix 3 [20,26-123]).
General study characteristics included the title, first author, year of publication, journal name, country, study design, and health domain.
Study population characteristics comprised age, gender, type of population (clinical or general population), type of disease, and number of study participants.
Intervention characteristics were app name, smartphone operating system (universal, Android only, or iOS only), type of mHealth app offered (publicly available or research apps), app developer (private company or nonprofit organization), level of personal support (no personal support during the intervention or continuous personal support), external monetary incentives and their value in US dollars, intervention duration in days, and effectiveness of the intervention in terms of health outcomes.
Factors influencing adherence relative to intended use were extracted and characterized as intervention-related factors (factors that developers can potentially improve through product changes) or patient-related factors (factors that can hardly be influenced by app developers, such as user characteristics). These factors were further categorized based on their positive or negative influence on adherence.
Information on app use comprised intended app use, actual app use, the number of intended intervention interactions, and interaction frequency (eg, daily or weekly intended use). The adherence score was defined as adherence relative to the intended use and was derived as the quantified ratio of intended use to actual use.
Synthesis and Statistical Analyses
As a first step, the identified studies were categorized based on the mHealth app they investigated as follows: apps targeting NCD self-management (including the four main NCDs: asthma, diabetes, cardiovascular disease [CVD], and cancer), mental health disorders (anxiety and depression), substance use disorders (alcohol and tobacco), and behavioral risk factors (nutrition, physical activity, and weight loss). The categories were then further refined into the following health domains: NCD self-management (asthma management, diabetes management, CVD management, cancer management, and medication adherence), mental health (anxiety, depression, and multidisciplinary and others), substance use (alcohol, tobacco, and multidisciplinary and others), nutrition, physical activity, weight loss, multicomponent lifestyle interventions, and other NCDs.
In the second step, intervention-related and patient-related factors that were outlined in the studies as barriers to or facilitators of adherence were qualitatively evaluated, summarized within the health domain, and categorized based on their positive or negative influence.
In the third step, the adherence score was derived for each study focusing directly on a specific mHealth app (97/99, 98%) and was calculated as the ratio of intended use to actual use. The mean adherence scores were calculated for each health domain.
In the fourth step, correlations of adherence scores with other extracted variables were examined, and where possible, the qualitative results from step 2 were quantitatively compared for each health domain. Quantitative analyses were performed using SPSS Statistics (version 27; IBM Corp). Correlations of adherence scores with continuous variables (eg, the average age of study participants) were calculated using the Pearson correlation. Correlations with ordinal variables (eg, level of personal support) were calculated using the Spearman correlation.
Finally, a list of universally relevant factors with recommendations for the development and evaluation of mHealth apps was developed.
Results
Selection and Inclusion of Studies
The search of electronic databases was performed on January 3, 2021, and yielded 2862 articles. After excluding duplicates, 70.72% (2024/2862) of publications remained for the title and abstract screening. Subsequently, the full texts of 17.34% (351/2024) of articles were examined. Of the 351 studies, 99 (28.2%) were finally included in the data synthesis. Figure 1 visualizes the selection process and reasons for exclusion.
Characteristics of Included Studies
In total, 99 studies were included in this review. Of these 99 studies, 2 (2%) were systematic reviews, and 97 (98%) evaluated specific mHealth apps. Randomized controlled trials were the most frequent study type (35/97, 36%), followed by pilot trials (31/97, 32%), pilot randomized controlled trials (12/97, 12%), cohort studies, mixed methods studies, and observational studies (each 5/97, 5%). Most of the studies were conducted in North America (37/97, 38%), followed by Europe (34/97, 35%), Australia (15/97, 15%), and Asia (10/97, 10%). Of the 97 studies, 90 (93%) were published within the past 5 years: 46 (47%) in 2020, 12 (12%) in 2019, 12 (12%) in 2018, 9 (9%) in 2017, 8 (8%) in 2016, 2 (2%) in 2015, 4 (4%) in 2014, and 4 (4%) in 2013. The mean intervention duration was 111.4 (SD 132; range 7-730) days, with 27% (26/97) of studies lasting 1 to 4 weeks, 46% (46/97) of studies lasting between 1 and 3 months, 18% (17/97) of studies lasting between 3 and 12 months, and 9% (7/97) of studies lasting longer than a year. In 32% (31/97) of studies, monetary incentives were provided to the participants as compensation. The mean derived incentive value was US $105.42 (SD US $18.65; range US $7 to US $430).
Characteristics of Study Populations
The total number of participants in the included studies evaluating specific mHealth apps was 72,046. The mean number of study participants was 750.5 (SD 2800.7; range 9-19,233). Of the 96 studies reporting exact participants numbers, 65 (68%) had <100 participants, 21 (22%) had 100 to 1000 participants, and only 10 (10%) studies had >1000 study participants. In several studies, most study participants had a pre-existing condition (82/97, 85%), with mental health conditions being the most prevalent (21/97, 22%), followed by obesity and being overweight (15/97, 15%), substance abuse (9/97, 9%), cancer (7/97, 7%), diabetes (5/97, 5%), CVD (5/97, 5%), and sleep disorder (4/97, 4%). In 15% (15/97) of studies, most participants were healthy. The overall mean age was 44.6 (SD 12.9; range 19.9-86) years, and the mean percentage of women was 62% (SD 22.8%; range 0%-100%).
Characteristics of mHealth Apps
Of the 97 reviewed apps, 50 (51%) were available for both iOS and Android. The remaining apps were exclusively available on either iOS or Android platforms (both 17/97, 18%). The authors of 13% (13/98) of studies did not clearly outline on which platforms the apps were distributed. Of the 97 reviewed apps, 47 (48%) were publicly available, whereas 52 (54%) were exclusively available to study participants. Approximately 38% (37/97) of apps were developed by private commercial companies (eg, software companies), and 64% (62/97) of apps were developed by nonprofit organizations (eg, academic institutes). Of the studies that clearly outlined their study procedure, 34% (32/93) included personal contact with health personnel during the study as an intervention component. In comparison, 66% (61/93) of the apps provided only personal support in the app onboarding phase. Of the 54 studies evaluating the app’s effectiveness on a primary outcome, the authors of 34 (63%) studies highlighted their app as effective, and the authors of 20 (37%) studies highlighted their app as ineffective. The most common explanation of intended use, according to the authors, or derived from information on intervention design, was daily tracking (eg, daily diary entries; 36/97, 36%), followed by activity completion (eg, completion of a certain amount of coaching modules; 19/97, 20%), daily use (eg, daily log-in; 17/97, 18%), daily activity completion (6/97, 6%), weekly tracking (5/97, 5%), weekly use (4/97, 4%), activity completion+daily tracking (3/97, 3%), weekly use time (eg, using the app 1 hour per day; 2/97, 2%), prolonged use (eg, no inactivity for >2 weeks; 2/97, 2%), and biweekly tracking (1/97, 1%). Approximately 95% (92/96) of studies reported data on actual use based on objective app use data, and 4% (4/96) of studies reported data based on qualitative feedback from users. The mean adherence score across all interventions was 56.0% (SD 24.4%; range 2.6%-96.0%). The mean number of interactions within the study period amounted to 90.1 (SD 145.9; range 1-730) interactions. Of the 97 apps, 14 (14%) apps were intended for ≥2 daily interactions with the app, 53 (55%) apps were intended for 1 daily interaction, and 17 (18%) were intended for weekly interactions; in 13 (13%) apps, users only had to use the app once a month to be considered adherent.
Characteristics of Health Domains
As displayed in Table 1, the included studies evaluating specific mHealth apps were categorized into the following health domains based on the individual app intervention focus: NCD self-management (17/97, 18%); mental health (20/97, 21%); substance use (9/97, 9%); nutrition (7/97, 7%); physical activity (6/97, 6%); weight loss (9/97, 9%); multicomponent lifestyle interventions (8/97, 8%); and mindfulness, including breathing and meditation interventions (9/97, 9%). Studies categorized in the domains of NCD self-management, mental health, and substance use were further subcategorized to report intervention and patient-related factors influencing intervention adherence at a more granular level. The studies (17/97, 18%) targeting NCD self-management were subcategorized into diabetes management (6/17, 35%), cancer management (5/17, 29%), respiratory disease management (3/17, 18%), CVD management (2/17, 12%), and medication adherence (1/17, 6%). Studies categorized in the mental health domain (20/97, 21%) were further divided into apps focusing on anxiety (2/20, 10%), depression (9/20, 45%), and multidisciplinary and other (9/20, 45%). The latter subdomain included other mental health problems such as bipolar disorders or combinations of various mental health problems. Studies in the substance use domain were further separated into apps addressing alcohol (2/9, 22%), tobacco (6/9, 67%), or a mix of various substances (1/9, 11%). Another 12% (12/97) of studies, which was a heterogeneous group targeting NCDs other than diabetes, cancer, CVD, respiratory disease, or medication adherence, were clustered into other NCDs (eg, intestinal and renal disease, insomnia, pain, venous leg ulcers, and dyslipidemia).
Table 1.
Health domains | Studies, n (%) | References | |||
NCDa self-management | 17 (18) | [26-42] | |||
|
Diabetes management | 6 (6) | [29-34] | ||
|
Cancer management | 5 (5) | [37-41] | ||
|
Respiratory disease management | 3 (3) | [26-28] | ||
|
Cardiovascular disease management | 2 (2) | [35,36] | ||
|
Medication adherence | 1 (1) | [42] | ||
Mental health | 20 (21) | [43-62] | |||
|
Anxiety | 2 (2) | [43,44] | ||
|
Depression | 9 (9) | [45-53] | ||
|
Multidisciplinary and others | 9 (9) | [54-62] | ||
Substance use | 9 (9) | [63-71] | |||
|
Alcohol | 2 (2) | [63,64] | ||
|
Tobacco | 6 (6) | [65-70] | ||
|
Multidisciplinary and others | 1 (1) | [71] | ||
Nutrition | 7 (7) | [72-77,123] | |||
Physical activity | 6 (6) | [78-83] | |||
Weight loss | 9 (9) | [84-92] | |||
Multicomponent lifestyle interventions | 8 (8) | [93-100] | |||
Mindfulness (including breathing and meditation) | 9 (9) | [101-109] | |||
Other NCDs | 12 (12) | [110-121] | |||
All domains | 97 (100) | [26-121,123] |
aNCD: noncommunicable disease.
As outlined in Table 2, the mean number of participants was highest for studies that focused on substance use (2337.6, SD 6344.8; range 9-19,233) and lowest for other NCDs (54.8, SD 48.6; range 15-189), followed by weight loss interventions (73.2, SD 54.4; range 17-176).
Table 2.
Health domains | Participants, N | Values, mean (SD) | Values, median (IQR) | Values, range |
NCDa self-management | 15,111 | 888.9 (2433.3) | 56 (113.5-31) | 10-9051 |
Mental health | 5710 | 285.5 (470.1) | 81 (231.8-31) | 14-1709 |
Substance use | 21,038 | 2337.6 (6344.8) | 99 (683.0-24) | 9-19,233 |
Nutrition | 13,042 | 2173.7 (5195.1) | 22 (3342-12) | 12-12,777 |
Physical activity | 946 | 157.7 (147.5) | 151 (301-22) | 19-301 |
Weight loss | 659 | 73.2 (54.4) | 50 (120.5-28.5) | 17-176 |
MLIb | 2274 | 284.3 (531.9) | 64.5 (331.3-29.3) | 20-1561 |
Mindfulness | 12,608 | 1400.9 (4031.5) | 46 (128-21.5) | 15-12,151 |
Other NCDs | 658 | 54.8 (48.6) | 44 (59.8-20.3) | 15-189 |
All domains | 72,046 | 750.5 (2800.7) | 56 (129.5-26) | 9-19,233 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
As displayed in Table 3, the mean participant age was highest in apps targeting NCD self-management (57.7, SD 7.3; range 45-70.9 years) and lowest for mental health apps (35.9, SD 5.9; range 19.9-46.5 years).
Table 3.
Health domains | Values, mean (SD) | Values, median (IQR) | Values, range |
NCDa self-management | 57.7 (7.3) | 56.5 (64.2-52.6) | 45.0-70.9 |
Mental health | 35.9 (5.9) | 36.6 (40.2-33.9) | 19.9-46.5 |
Substance use | 40.8 (9.6) | 44.0 (48.8-35.3) | 20.5-49.9 |
Nutrition | 44.0 (16.6) | 45.0 (60.0-27.2) | 22.0-64.7 |
Physical activity | 47.1 (15.2) | 42.0 (63.6-38.0) | 26.8-68.0 |
Weight loss | 42.5 (11.0) | 45.8 (49.6-35.2) | 20.0-54.4 |
MLIb | 43.7 (18.7) | 39.0 (48.8-34.9) | 23.6-86.0 |
Mindfulness | 43.7 (14.7) | 42.8 (52.8-33.5) | 20.2-70.9 |
Other NCDs | 45.6 (10.3) | 43.6 (55.2-36.0) | 34.0-64.9 |
All domains | 44.6 (12.9) | 42.9 (52.7-35.8) | 19.9-86.0 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
Female populations were generally overrepresented (Table 4), especially in studies conducted on mindfulness interventions (76.7%, SD 20.2%; range 44.8%-100%). Only studies conducted on apps targeting substance use featured more men than women (percentage of women: mean 49.3%, SD 14.1%; range 27.7%-78%).
Table 4.
Health domains | Values (%), mean (SD) | Values (%), median (IQR) | Values (%), range |
NCDa self-management | 53.6 (30.9) | 50.3 (82.8-31.5) | 0-100 |
Mental health | 64.0 (16.5) | 65.9 (72.6-58.4) | 27.0-95.2 |
Substance use | 49.3 (14.1) | 50.5 (55.3-39.6) | 27.7-78.0 |
Nutrition | 67.7 (25.5) | 71.5 (90.5-44.4) | 31.0-94.0 |
Physical activity | 60.6 (16.5) | 64.0 (73.8-50.9) | 30.4-73.9 |
Weight loss | 60.7 (27.5) | 68.9 (81.0-42.5) | 1.3-85.0 |
MLIb | 66.8 (12.5) | 62.9 (78.6-60.0) | 51.0-88.3 |
Mindfulness | 76.7 (20.2) | 80.2 (94.6-55.7) | 44.8-100 |
Other NCDs | 64.0 (26.4) | 68.1 (87.5-45.8) | 19.0-100 |
All domains | 62.0 (22.8) | 63.2 (78.9-48.0) | 0-100 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
As outlined in Table 5, studies conducted on apps for weight loss had the most prolonged mean intervention duration (214, SD 216.3; range 65-730 days), and studies on nutrition had the shortest mean intervention duration (52.5, SD 55.7; range 7-172 days).
Table 5.
Health domains | Values, mean (SD) | Values, median (IQR) | Values, range |
NCDa self-management | 129.1 (87.9) | 91.3 (180-73.5) | 30-365 |
Mental health | 97.6 (137) | 56 (78.8-30) | 28-577.9 |
Substance use | 109.2 (192.1) | 56 (90.5-17.6) | 14-615 |
Nutrition | 52.5 (55.7) | 28 (56-21) | 7-172 |
Physical activity | 74.3 (28) | 81 (100-49) | 28-100 |
Weight loss | 214 (216.3) | 180 (273.8-70) | 56-730 |
MLIb | 79.6 (50.7) | 87 (91.3-33.3) | 21-182.5 |
Mindfulness | 107.1 (142.3) | 42 (202.7-29) | 21-365 |
Other NCDs | 111 (126.6) | 56 (159.4-31.5) | 14-365 |
All domains | 111.4 (132) | 60.8 (100-30) | 7-730 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
Table 6 shows distributions of total intended interactions with the apps over the course of the individual studies. The mean number of total intended interactions was highest for apps targeting weight loss (210.5, SD 213.3; range 52-730) and lowest for nutrition apps (31.8, SD 27.8; range 4-82.5).
Table 6.
Health domains | Values, mean (SD) | Values, median (IQR) | Values, range |
NCDa self-management | 141.6 (184.3) | 90 (178.5-35) | 6-615.4 |
Mental health | 64.5 (124.6) | 39.5 (57.5-6) | 4-577.9 |
Substance use | 51.3 (56.2) | 19.1 (88.9-9) | 4-170.7 |
Nutrition | 31.8 (27.8) | 21 (56-10) | 4-82.5 |
Physical activity | 60.8 (35.3) | 67 (93.3-24) | 12-100 |
Weight loss | 210.5 (213.3) | 168 (259.3-78) | 52-730 |
MLIb | 40.2 (36.3) | 25.7 (81-6.8) | 1-90 |
Mindfulness | 144.1 (243.8) | 30 (197.2-24.5) | 21-730 |
Other NCDs | 39.8 (35.3) | 35 (65.5-5.8) | 2-107.1 |
All domains | 90.1 (145.9) | 51 (90-20.1) | 1-730 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
The distribution of adherence scores by health domain is summarized in Table 7. The mean adherence scores were highest in the domain of other NCDs (69.9%, SD 18.5%; range 33.3%-90.5%), followed by multicomponent lifestyle interventions aimed at changing multiple behaviors simultaneously (61.3%, SD 22.5%; range 32.4%-96%). Apps from the substance use domain had the lowest adherence scores (46.1%, SD 33%; range 9.1%-84%).
Table 7.
Health domains | Values (%), mean (SD) | Values (%), median (IQR) | Values (%), range |
NCDa self-management | 53.4 (24.7) | 63.4 (72.5-25.5) | 14.0-89.5 |
Mental health | 56.6 (26.2) | 61.0 (83.4-32.2) | 15.0-91.5 |
Substance use | 46.1 (33.0) | 24.2 (81.1-18.0) | 9.1-84.0 |
Nutrition | 49.1 (32.1) | 48.9 (84.3-26.8) | 2.6-91.4 |
Physical activity | 54.7 (16.6) | 55.5 (71.3-39.9) | 31.2-72.0 |
Weight loss | 49.1 (21.5) | 43.1 (61.6-38.2) | 16.0-93.2 |
MLIb | 61.3 (22.5) | 56.1 (81.6-42.4) | 32.4-96.0 |
Mindfulness | 59.0 (18.5) | 66.7 (73.7-37.2) | 33.3-81.9 |
Other NCDs | 69.9 (18.5) | 72.4 (87.6-53.4) | 33.3-90.5 |
All domains | 56.0 (24.4) | 60.4 (76.0-34.5) | 2.6-96.0 |
aNCD: noncommunicable disease.
bMLI: multicomponent lifestyle intervention.
Multimedia Appendix 4 [20,26-123] lists the identified intervention-related and patient-related factors with a positive or negative influence on adherence for each health domain in detail. The results per health domain are summarized in the following sections.
NCD Self-management
Factors Influencing Adherence to NCD Self-management Apps
Diabetes Management
Intervention-related factors that positively influenced adherence to diabetes apps included automated and passive data collection within the app [31,34], customized reminders [31], game-based elements [32], and human-like app characteristics [32]. Manual data collection by users [31,34], lack of adjustment to users’ personal needs [34], and fast uptake of app activities after initiation [34] were associated with higher intervention dropouts and lower adherence.
Patient-related factors positively affecting adherence to diabetes apps were the following user characteristics: low extraversion [33], high educational level [33], openness to new experiences [33], exacerbated history of diabetes [33,34], and recent diagnosis of the disease [33,34]. Regarding the influence of user age on adherence, the results were contradictory. In one of the studies, users of older age were more adherent [34]; in contrast, another study found that older age was associated with weaker technology acceptance [33].
Cancer Management
Intervention-related factors that positively affected adherence to apps targeting patients with cancer included ongoing contact or telecoaching with health care professionals [37], personalization of users’ needs and cultural tailoring [38,39], and customizable reminders and notifications [39,40]. Furthermore, one of the studies showed that a continuous, nondelayed study course positively affected adherence [40].
The following user characteristics were positively associated with adherence: increased age, higher level of education, being married or in a relationship, and higher self-efficacy [37,40]. Furthermore, the active employment status of the users, leading to less available time for the intervention, was associated with lower adherence, especially among female users [38,40].
Respiratory Disease Management
In the context of intervention-related factors, personalization [27], app design, and ease of use [27,28], as well as personal contact or communication with a health care professional, were all positively associated with adherence [27,28].
Patient-related factors included the recruitment strategy and recruitment location. It was shown that users recruited personally and on site were more adherent than users recruited on the web or via social media [26]. Furthermore, the perceived health benefits and the sense of contributing to the science of the users were associated with better adherence [26]. The following user characteristics were negatively related to adherence: higher BMI [27], depression diagnosis [27], low educational level [27], and low smartphone literacy [28].
CVD Management
User interactions with the app through gamification, primarily through a personalized feedback and reward system, were associated with better adherence to apps targeting CVD self-management [36]. In addition, easy communication and data exchange between users and their health coaches positively affected adherence [35].
Patient-related factors that positively affected adherence were the user characteristics of hypertension diagnosis [122] and the high clinical demand of the patient [36]. Lack of technical experience with mobile devices and advanced age of patients were associated with lower adherence [35].
Medication Adherence
One of the studies using an app targeting medication adherence related to various NCDs did not include information about dedicated factors influencing adherence [42].
Quantitative Analysis of NCD Self-management Apps
Across the 5 considered subdomains, the mean adherence score was highest for one app targeting medication adherence (89.5%), followed by the subdomains cancer management (61.4%, SD 19.6%), respiratory disease management (52.7%, SD 21.5%), diabetes management (44.9%, SD 28.6%), and CVD management (41.5%, SD 28.9%). On average, adherence to mHealth apps targeting NCD self-management was 53.4% (SD 24.7%) across all the 5 health domains.
There was a strong positive, significant correlation between adherence score and the average age of study participants (r=0.624; 16/97, 16%; P=.01), which is consistent with the results of the 2 included publications [34,37]. There was no significant correlation between the level of personal support (rs14=0.150; P=.58) or gender (r=0.037; 16/97, 16%; P=.89) and adherence scores across studies targeting NCD self-management.
Mental Health
Factors Influencing Adherence to Mental Health Apps
Anxiety
Compared with manual data collection by users, passive data collection was identified as an effective intervention-related factor in improving adherence in one of the studies [43]. It was also reported that technical problems negatively affected adherence and that iOS users had lower adherence than Android users [43].
Depression
The following intervention-related factors were positively linked with adherence to mHealth apps targeting depression: alternating intervention components and immediate feedback to maintain participant attention [49,52]; individualized features such as personalized representation of intervention progress, encouragement, and daily health tips [47]; offline app functionality and data plan independence [50]; a user-friendly and visually appealing app layout (eg, using a large font or highlighting essential app elements on the home screen) [53]; and evidence-based problem-solving therapies and content [47]. In contrast, a long study duration [49], competitive effects from other apps [50], and declining interest because of waiting times [47] were negatively linked to adherence.
The following user characteristics had a positive impact on adherence: local recruitment [45], ethnic minority background [48], and female gender [49]. In contrast, other characteristics negatively influenced adherence, including Latin America as a geographical origin [47], privacy concerns [47], low income [47], poor baseline depression [48,50] or anxiety, married relationship status [48], and lack of time [53]. In addition, remote recruitment (eg, via a web-based form [45,51]) was identified as a patient-related factor that negatively influences adherence.
Multidisciplinary and Others
The included studies identified individual functions that had a positive impact on adherence, such as crisis plans [58]; self-monitoring and visualization features [56]; tracking of stressful events [58]; tracking mood states with interactive mood charts [58]; visual feedback with personalized graphics interchange format images [62]; and dashboards with information on activity, sleep quality, mood development, and heart rate [61]. In addition, reminders through customizable push notifications were associated with better adherence [62]. Furthermore, the integration of health care professionals was positively linked to adherence [57]. Another study showed that integrating multiple intervention components and avoiding repetition and monotony had a positive impact on adherence [58]. Finally, lack of time for implementation and technical problems were negatively linked to adherence [58].
Patient-related factors positively influencing adherence included the following user characteristics: high IQ [56], increased age [58], increased risk of suicide [60], general interest in the app [54], and a trusting relationship between the person being treated and the organization providing the intervention [55]. In contrast, the following user characteristics negatively affected adherence: long treatment history [54], critical pre-existing conditions (eg, chronic psychotic illness [54]), increased overall mental health burden [56], increased mania-like symptoms [56], privacy concerns [57], or a perceived lack of usefulness of the app [58]. In addition, it was found that the app may lead to an unwanted reminder of one’s condition, which negatively affects adherence [58].
Quantitative Analysis of Mental Health Apps
The mean adherence score for the mental health apps was 56.6% (SD 26.2%). The mean adherence scores for apps offering support for anxiety, depression, and other mental health conditions were 67.4% (SD 33.8%), 45.3% (SD 28.1%), and 65.6% (SD 20.93%), respectively.
Regarding the positive effect of incorporating personal support from health care professionals into the intervention reported by Steare et al [57], the correlation between adherence score and the level of personal support for mental health apps, in general, was nonsignificant (rs17=0.230; P=.33). Compared with the qualitative data synthesis regarding the relationship between adherence score and average age [58], as well as the gender of student participants [49], no significant relationships were found quantitatively (r=0.096; 19/97, 20%; P=.70, and r=−0.149; 20/97, 21%; P=.53, respectively). Regarding the negative effect of long study durations [49], the correlation between adherence score and intervention duration in days was nonsignificant (r=−0.127; 20/97, 21%; P=.60). Compared with the difference between the iOS and Android operating systems mentioned in the qualitative analysis [43], the differences between the adherence score and smartphone operating system (rs17=0.450; P=.05) were likewise positive in the quantitative analysis.
Substance Use
Factors Influencing Adherence to Substance Use Apps
Alcohol
Reminders in the form of daily push notifications were associated with better adherence [63]. Furthermore, personalization and customized content and features were positively linked to adherence [64]. A study also showed that gamification and gamified elements such as levels or rewards positively affected adherence [64]. Finally, variations and options in app design and offer within the app positively affected adherence [64].
The following user characteristics positively affected adherence as patient-related factors: female gender, low-risk alcohol consumption, high education level, reduced substance use, and increased age [64]. Doubts about efficacy and forgetfulness had a negative influence [64].
Tobacco
It was found that reminders in the form of daily push notifications positively affected adherence [69]. In addition, personalization and customized content in the app had the same impact [70]. The integration of and interaction with human coaches were positively associated with adherence [69]. Furthermore, the included studies found some specific features that increased adherence: tracking functions for self-monitoring (eg, as a diary [68,69]), a craving toolbox [69], all-general advice on quitting, and functions for stress and mood management [70].
Regarding patient-related factors, adherence was positively influenced by the following user characteristics: lower initial acceptance of cravings [67], younger age [66], and minimum level of digital skills among users [66].
Multidisciplinary and Others
One of the studies showed that the inclusion of several feedback modules is an effective technique for increasing adherence [71]. Otherwise, the included studies did not provide further information on factors influencing adherence [71].
Quantitative Analysis of Substance Use Apps
On average, the mHealth apps for substance use had an adherence score of 46.1% (SD 33.0%). Apps targeting alcohol use had a higher adherence score (51.5%, SD 38.6%) than those targeting tobacco use (38.0%, SD 32.7%). An app that combined both health behaviors had an adherence score of 83.4%.
Regarding the positive effect of incorporating human coaching into the intervention reported by Webb et al [69], the correlation between adherence score and the level of personal support for substance use apps, in general, was not significant (rs6=0.126; P=.77). Compared with the qualitative data synthesis in terms of the relationship between adherence score and average age [64,66] and gender of study participants [64], no significant relationships were found quantitatively (r=−0.094, 9/97, 9%, P=.81 and r=0.394, 9/97, 9%, P=.30, respectively).
Nutrition
Factors Influencing Adherence to Nutrition Apps
Personalization of the intervention and certain app functions (personalized overview features of daily goals, recipe suggestions, lookup sections, camera or photograph-taking functions, and barcode scanners) were associated with better adherence to apps targeting nutrition [73,74,76]. Moreover, customized reminders and notifications and the integration of gamification elements combined with incentives enhanced engagement [73]. App handling and user-friendliness further positively influenced adherence [73,76]. The included studies pointed out the importance of the onboarding process, whereas enrollment methods with personal contact [123] had a positive impact, as well as appropriate guidance and tutorials at the beginning [73]. In addition, a relationship between uptake of the intervention activities and adherence was found, whereas starting the intervention on mornings and weekdays, in contrast to weekends, had a positive effect on the use of the mHealth app [75]. Finally, technical difficulties negatively affected adherence [72,73].
Several user characteristics had a positive influence. These were employment at a university [77], female gender [74], high degree of dietary preferences [75], and time and cognitive capacity devoted to the app [75]. The results were inconsistent concerning the age of the user. One of the studies associated older age with more adherence [74], whereas another showed the opposite [73].
Quantitative Analysis of Nutrition Apps
On average, the mHealth apps for nutrition had a mean adherence score of 49.1% (SD 32.1%). The positive effect of the inclusion of personal communication with health care professionals [73,75,123] was confirmed quantitatively, and the correlation between the adherence score and the level of personal support during the study period was strongly positive and significant (rs4=0.878; P=.02). Regarding the relationship between adherence score and age [73,74] and gender of study participants [74], no significant relationships were found quantitatively (r=−0.143; 7/97, 7%; P=.79, and r=0.234; 6/97, 6%; P=.66, respectively).
Physical Activity
Factors Influencing Adherence to Physical Activity Apps
Of the 6 included studies targeting physical activity, 2 (33%) showed that customizable push notifications positively affected adherence [79,83]. In addition, the intervention-related factor, gamification, was associated with higher engagement [79]. Furthermore, social features, such as competitions, social comparison, and challenges, positively affected adherence [80,83]. In addition, personalization and customization were positively linked to adherence, especially customizable app functions regarding exercise plans, nutrition suggestions, and calorie lists [79,80,83]. Personal communication with and integration of health care professionals positively affected adherence [82]. Finally, technical difficulties negatively affected adherence [78].
The following user characteristics positively affected adherence: age [79], healthy BMI [79], and a positive attitude toward technology [78]. In contrast, users with increased disease severity, depressive symptoms, low quality of life, and poor access to transportation showed worse adherence [78]. In addition, privacy concerns and a lack of perceived benefits negatively influenced adherence [82].
Quantitative Analysis of Physical Activity Apps
On average, mHealth apps for improving physical activity had an adherence score of 54.7% (SD 16.6%). Regarding the positive effect of personal communication with health care professionals in the intervention [82], the correlation between the adherence score and level of personal support during the study period was not significant (rs3=0.289; P=.64). Compared with the qualitative data synthesis regarding the relationship between adherence score and average age [79], no significant correlations were found quantitatively (r=0.047; 6/97, 6%; P=.93).
Weight Loss
Factors Influencing Adherence to Weight Loss Apps
The included studies focusing on weight loss apps identified a positive influence of reminders in the form of push notifications on adherence [88,92]. Just-in-time intervention components were associated with better adherence [87]. The same was found for newsfeeds with social components [88]. The studies highlighted that personal contact and integration of health care professionals positively influenced adherence [84,85,91]. Moreover, a correlation was found between high adherence and unlimited digital access via the app, as well as providing a data plan with no supplementary costs [89].
Several studies further identified the following user characteristics as patient-related factors to be positively linked to adherence: rural population [85], positive expectations regarding the intervention [88], prior experience with mHealth apps [88], a high sense of responsibility [86], and reinforcements through personal environment [85]. In contrast, dislike of the study equipment [86] and depression symptoms [89] adversely affected adherence.
Quantitative Analysis of Weight Loss Apps
On average, the mHealth apps for weight loss had an adherence score of 49.1% (SD 21.5%).
Regarding the positive effect of incorporating personal communication with health care professionals into the intervention [84,85,91], the quantitative analysis did not reveal a significant correlation (rs7=0.174; P=.65).
Mindfulness
Factors Influencing Adherence to Mindfulness Apps
As most mindfulness apps that met the inclusion criteria of this review did not distinctively aim to treat a chronic mental condition but rather to increase well-being and reduce work-related stress, we categorized them as a separate category. Factors identified in the mindfulness domain may still be relevant for the mental health domain, as mindfulness-based therapy has been cited as a promising intervention for treating anxiety and depression in previous research [124].
The included studies reported that automated and interactive data collection and processing positively affected adherence [101,106]. The studies also showed that customizable features such as tracking stress and mood [109], visualizing personal progress, and immediate feedback positively affected adherence [103]. In addition, using in-app tutorials or video content was associated with better adherence [103]. Furthermore, time and place influenced adherence: users who used the app in the evening and at home were more adherent in the long term [106,107]. In contrast, extensive app interactions and lack of variety in the app content harmed adherence [107].
Regarding patient-related factors, the studies identified the following user characteristics to be positively related to adherence: increased age [102,108], positive expectations toward the app [106,108], intrinsic motivation [108], and a current physical diagnosis [106] in contrast to a mental health diagnosis.
Quantitative Analysis of Mindfulness Apps
On average, mHealth apps related to mindfulness had an adherence score of 59.0% (SD 18.5%). Regarding the positive relationship between adherence score and average age [102,108], the quantitative analysis also yielded a moderately positive but nonsignificant correlation (r=0.404; 9/97, 9%; P=.28).
Multicomponent Lifestyle Interventions
Factors Influencing Adherence to Multicomponent Lifestyle Intervention Apps
Approximately 8% (8/97) of studies targeted mHealth apps focusing on multiple lifestyle behaviors (mostly a combination of physical activity, diet, weight loss, and sometimes sleep, stress, or headaches).
The included studies reported that the integration of health care professionals during the intervention, app usability, and language positively influenced adherence [95,98]. However, it was also shown that social networking and competition through social comparison in terms of physical activity level had a positive impact only if individuals had a healthy BMI [97]. In addition, app features such as audiovisual presentation of health-related information or reminders in the form of push notifications positively affected adherence [93,98]. Finally, personalization and tailoring of the app to customized needs (eg, through gamification) had a positive impact on adherence [97,98].
In addition to these factors, the following characteristics also positively affected adherence: increased age [95,100] and trust in the health care professionals of the intervention [95,100]. Finally, other characteristics negatively affected adherence. These included the lack of engagement of other participants in social comparison features [97], negative emotions related to self-monitoring during periods of weight [97], shift work schedules [98], and technical difficulties in using the app [93].
Quantitative Analysis of Multicomponent Lifestyle Intervention Apps
On average, mHealth apps targeting multicomponent lifestyle interventions had an adherence score of 61.3% (SD 22.5%).
The positive effect of integrating health care professionals as personal support into the intervention [95,98] could not be analyzed quantitatively as none of the included multicomponent lifestyle interventions offered consistent, continuous support by health care professionals (only during the onboarding phase). Regarding the mentioned positive relationship between adherence score and average age [95,100], the quantitative analysis also yielded a moderately positive but nonsignificant correlation (r=0.416; 8/97, 8%; P=.31).
Other NCDs
Factors Influencing Adherence to Other NCD Apps
In a study on an mHealth app treating insomnia, better adherence was linked to ease of use and the easiness of therapy directives [110]. Another study on insomnia treatment found that easy access and reminder options or notifications had a positive impact [113]. In the field of chronic pain management and interventions, a study found a positive impact on adherence to microinteractions [111]. It was also shown in the same field that personalization had a positive impact [112]. In a study on the care of advanced chronic kidney disease, the integration of complementary visits to health care professionals or to a clinic showed a positive impact on adherence [117]. Furthermore, blood pressure and test result features and an automatic integrated transfer of blood pressure readings had a positive impact [117].
Regarding patient-related factors, a study on the treatment of irritable bowel syndrome showed that the simultaneous use of other technical devices positively affected adherence. Another study showed that high anxiety scores negatively affected adherence [119]. A study on the effects of a long-term smartphone-based self-monitoring intervention in patients with lipid metabolism disorders found that older age had a positive impact on adherence. In contrast, low acceptability, lack of time, health problems, and lack of motivation had a negative impact [118]. The user characteristic of the female gender positively influenced adherence in a study about an app for a lower leg physical activity intervention for individuals with chronic venous leg ulcers [114]. Furthermore, in a study on an mHealth app targeting inflammatory bowel disease, it was found that old age, low level of education, and lack of perceived usefulness negatively affected adherence [115].
Quantitative Analysis of Other NCD Apps
On average, mHealth apps categorized in the domain of other NCDs had an adherence score of 69.9% (SD 18.5%). Regarding the positive effect of complementary visits to health care professionals for the care of chronic kidney disease [117], the correlation between the adherence score and the level of personal support during the study period was nonsignificant (rs10=0.290; P=.36). The quantitative analysis supports the finding that female participants are more adherent [118] to some degree, as the correlation between the adherence score and mean percentage of female participants was moderately positive but nonsignificant (r=0.385; 12/97, 12%; P=.22). Regarding the relationship between adherence score and average age [118], the quantitative analysis yielded conflicting results (r=−0.619; 12/97, 12%; P=.03).
Multi-Domain Review
One of the two included systematic reviews featured a multi-domain review focusing on uptake and engagement with mHealth apps in various health domains [20]. First, it showed a positive impact of goal setting, reward offerings, complementary web access, coping games, and self-monitoring. In addition, the low cost of the app helped increase acceptance [20].
The external influence of using an app through health care professionals, friends, and family or by reading user reviews was outlined as having a positive influence. Furthermore, community networking and the connection between the app and health professional support had a positive influence [20]. The study also found the following user characteristics to be positively linked to adherence: female gender, aged <44 years, living in urban areas, good educational level, high income, curiosity, higher health literacy, and app awareness [20]. In addition, interactivity, an established routine to use the app, and customization of the app had a positive impact [20]. In contrast, cognitive overload and unmet expectations negatively influenced adherence [20].
Explorative Analysis of Adherence Scores
To gain further insights into the universal applicability of the results identified in individual health domains, a quantitative analysis was conducted on the total number of primary studies included. The analysis revealed a positive correlation between adherence score and level of personal support during the study period (rs91=0.199; P=.06). With respect to various user characteristics, the quantitative analysis did not find significant differences in either average age (r=0.105; 94/97, 97%; P=.32) or gender distribution (r=−0.031; 95/97, 97%; P=.77). Furthermore, no significant quantitative differences were found between healthy participants and participants with chronic diseases (rs95=−0.049; P=.63). A quantitative comparison of studies with monetary incentives and those without such incentives also revealed no significant effect on adherence scores (rs92=0.000; P=.99). However, the monetary value of the incentive, measured in US dollars, had a significant effect on the adherence score (r=0.465; 30/97, 31%; P=.01). Apps that were only offered in the context of scientific studies had a significantly higher adherence score than those that were publicly available via app stores (rs95=0.324; P=.001). The quantitative analysis did not find any significant differences between Android and iOS with regard to the adherence score (rs83=0.019; P=.87). Furthermore, the quantitative analysis showed a higher adherence score for apps developed by private app development companies than for those developed by public institutions or research groups (rs95=0.164; P=.11). The correlation between adherence score and intervention duration (r=−0.138; 97/97, 100%; P=.18) was negative but positive in relation to the number of intended app interactions per day (r=0.176; 97/97, 100%; P=.09). The comparison of adherence scores and the total number of intended app interactions (r=0.040, 97/97, 100%; P=.70) yielded no significant results. Studies with a higher number of app users had significantly lower adherence scores (r=−0.228; 96/97, 99%; P=.03).
Discussion
Intervention-Related Factors Influencing Adherence
Regarding the first research question, the intervention-related factors described in the following sections were identified most frequently across all health domains, suggesting universal applicability to increase mHealth app adherence relative to the intended use.
User-friendliness and Technical Stability
Approximately 18% (17/97) of studies from 6 health domains cited a user-friendly app design or technical stability as criteria for increased app use [27,28,43,50,53,58,72-74,76,78, 93-95,110,113,115,116]. The term user-friendliness describes a software interface that enables a simple, clean, intuitive, and reliable user experience (UX). App developers can thus promote adherence by making the app easy to use and providing a compelling and visually appealing app design (eg, by using sufficiently large fonts or highlighting essential app elements) [53]. Technical problems can be reduced through closed beta tests while optimizing the UX through user interface or UX design changes before app release. Accordingly, the quantitative analysis revealed higher adherence scores for apps created by private app development companies, which may have more technical expertise in developing and publishing apps than public institutions or research groups. Quantitative analysis also revealed higher adherence scores for apps developed by private companies, which may have more expertise across the value chain than public institutions or research groups. As most of the included mHealth apps had a pilot character (ie, developed by small academic teams with no or only short testing periods), it can be assumed that the current body of mHealth apps does not yet realize its full potential in terms of usability and technical stability, thus indicating the potential to improve adherence.
Personalization, Customization, and Tailoring
Approximately 16% (16/97) of studies from 8 different health domains reported a positive impact of personalized content on adherence [27,38,39,58,62,64,66,73,74,76,83,85,91,97,98,113]. This included individualized app features (such as a crisis plan), metrics, visualizations based on individual user data (eg, displaying intervention progress), personalized feedback and health suggestions, and individualized app content tailored to the needs and characteristics of users. These findings align with previous reviews that have summarized that an individualized app positively influences user engagement [20,125]. Accordingly, developers of mHealth apps should consider the target group’s characteristics and needs in the app design process and ideally make the app tailored to a specific user group, personalized to the individual, and customizable.
Individualized Reminders
In 13% (13/97) of studies across 8 different health domains, reminders, primarily realized through push notifications, were highlighted as an effective method of improving adherence to mHealth app interventions [31,39,40,62,63,69,73,79, 83,88,92-94,113]. Essential to the success of this technique is the consideration of users’ individual needs in terms of their schedule, as a user’s lack of time undermines adherence [38-40,53,58,118]. Ideally, users receive reminders when they are in a state of receptivity, which has also been suggested by previous research on just-in-time-adaptive interventions [126,127]. In this regard, working and leisure time schedules should be considered, and the timing of reminders should be adapted accordingly, particularly when patients are in the privacy and comfort of their homes. A recent review reported that reminders are helpful for people with busy schedules and when they are forgetful but also mentioned the risk that push notifications can threaten users’ social identity if they are received at an inappropriate time or place [20]. Therefore, users should be able to customize the reminders and adapt them to their circumstances.
Personal Support From Health Care Professionals
In 12% (12/97) of studies from 8 different health domains, personal support from a health care professional during the intervention was cited as a reason for improved adherence [28,35,37,57,69,82,84,91,95,98,117,123]. In this context, the integration of health care professionals past the initial app onboarding can be realized in various ways, including regular clinic visits, complementary telephone support, and communication options with health care professionals integrated into the app. In addition, apps can facilitate communication between patients and health care professionals through automated data exchanges. Quantitative analysis revealed a positive correlation between adherence and level of personal support during the study period for all health domains, which was also confirmed by previous studies [20,128]. Consequently, it can be assumed that hybrid systems that combine automated app content with elements of human support achieve higher adherence rates than those achieved by interventions without human support. Although the ideal ratio between human-computer interactions and sole human interactions in mHealth app interventions remains to be explored, new technologies such as conversational agents show promising results in simulating personal support without the need for human support and may enable increased levels of automation [129-132].
Elements of Gamification and Social Features
Elements of gamification were described as effective in increasing adherence in 12% (12/97) of studies across 6 different health domains [32,36,47,49,52,64,73,78-80,83,97,98]. These elements included levels, reward systems, social characters, contests, and leaderboards. This aligns with other reviews that list rewards and games as factors that positively affect adherence [20,125]. However, although game elements such as social competitions may increase engagement by encouraging others, the idea of defeating peers may also have a negative influence [20]. In 6% (6/97) of studies from 5 health domains, social features were found to positively affect adherence; for example, in the form of social networks, contests, leaderboards, or newsfeeds with social components [52,73,75,83,88,97]. However, social components should be included with caution and ideally tested, as social comparison with less-motivated participants can also harm adherence [97]. Accordingly, a recent review concluded that social contests increase engagement but may also have a negative effect [20]. In general, this study supports previous research outlining the positive effects of gamification and social features on DHIs [133-141].
Passive and Automated Data Collection, Processing, and Transmission
The positive influence of passive and automated data collection, processing, and transmission was reported in 5% (5/97) of studies from the health domains NCD self-management [31,34], other NCDs [117], mindfulness [101], and meditation [106]. Thus, developers can increase adherence by automating repetitive tasks to reduce user burden. In this regard, developers are advised to use smartphone sensor technology (eg, a camera to capture food data or accelerometer data to capture physical activity) and complementary devices (eg, a smartwatch to measure heart rate) to remove the repetition and monotony of intervention tasks, which are listed as reasons for nonadherence [58,60,70].
Monetary Incentives
Monetary incentives such as vouchers, lottery tickets, or direct cash contributions were given to participants in 31 of the 97 included primary studies [30,33,44,45,47,48,51,53,56,61, 62,64,65,68-72,77,81,88,90,98,101,104-106,108,109,114,116]. However, the qualitative synthesis did not yield results regarding the effect of such monetary incentives as an additional intervention component on adherence. The quantitative comparison between studies with monetary incentives and those without such incentives also found no effect on adherence. However, the monetary value of the incentive, measured in US dollars, had a significantly positive effect on adherence scores. In the context of these findings, app developers may consider whether monetary incentives are helpful and the level of compensation that is sufficient to achieve a relevant effect.
Other Intervention-Related Factors
Other notable intervention-related factors included integrating an app tutorial [73,103], presenting information in audiovisual formats [98], and offering a large variety of app content [64]. Approximately 3% (3/97) of studies also noted financial costs (eg, data plan use) as a barrier to adherence [20,89,92]. Therefore, developers may want to consider offering their mHealth app free of charge and only transferring large amounts of data when the device is connected to a wireless network. Other studies in this review also reported that time delays within the intervention, long intervention durations, low engagement of other participants, and competitive effects of other mHealth apps were associated with low adherence. The included studies also outlined data protection and user privacy as positively affecting adherence [20,47,57,82], which aligns with previous research calling developers to create robust and transparent mHealth apps that satisfy security and privacy demands to foster user acceptance and trust [142-145].
Patient-Related Factors Influencing Adherence
Regarding the second research question, the patient-related factors described in the following section were identified.
Characteristics of Study Participants
Approximately 43% (42/97) of studies from 9 different health domains reported a wide variety of user characteristics that affect adherence, including age, gender, place of residence, marital status, health status, treatment history, education, employment status, income, and work hours [26-28,33-38,40,47-50,54,56,58,60,64,66,67,73-75,77-79, 85,86,88,89,95,98,100,102,106,108,114,115,118,119,122]. The quantitative analysis did not reveal significant effects of average age, gender distribution, or pre-existing conditions on adherence across all included apps. Consequently, the results from previous reviews, which indicate higher engagement among female or younger users, could not be replicated [20,125]. The specific health domains of NCD self-management and other NCDs showed a significant correlation between adherence scores and the average age of study participants, with the first one being positive and the latter being negative. Further research is required to understand the effects of sociodemographic characteristics and health status on adherence to mHealth apps. The findings of this study suggest that these effects may vary depending on the targeted health domain.
User characteristics associated with a low adherence were lack of technical competence, lack of health literacy, and lack of experience with mHealth apps, which could potentially be improved through preintervention training. Other negative factors, such as privacy concerns, low expectations of the app, and low trust in the health care professionals conducting the intervention, could potentially be challenged through personal communication in the onboarding phase (eg, by discussing the privacy policy or outlining intervention benefits). As lack of time on the users’ side was referenced to negatively affect adherence [53,58,107,118], helping patients with time management might also have a positive effect.
Type of Participant Recruitment
In 4% (4/97) of studies from the fields of NCD self-management [26], mental health [45,51], and nutrition [123], the user recruitment channel was mentioned as a relevant factor affecting adherence. Users who were made aware of the intervention on the web (eg, via social media) had lower adherence than users recruited locally and in person. This could explain why apps that were only offered in the context of studies on personal onboarding processes had significantly higher adherence scores than those publicly accessible via app stores. As the mHealth sector further matures and more mHealth apps are made available to the public via app stores, this factor might have an increasingly negative effect on overall adherence. Developers may overcome this issue by optimizing the UX of their mHealth app in the onboarding phase. As highlighted previously, offering personal support from health care professionals before and during the onboarding process is likely to increase adherence.
Adherence Scores Across Health Domains
Regarding the third research question, this review outlined the differences between health domains in terms of adherence scores. The adherence score of all 97 included mHealth apps averaged 56.0% (SD 24.4%), representing a generally higher adherence level to mHealth apps than previous research suggests [9,10,146]. This could be attributed to the fact that some studies excluded participants who did not perform a certain level of activity (eg, downloading the app). Regarding the short intervention periods with a median of 60.8 days, it is questionable whether the included health apps could reach similar adherence scores in more prolonged studies. Adherence scores by health domain were highest for the other NCDs (69.9%, SD 18.5%), a heterogeneous group of mHealth apps targeting less common NCDs such as intestinal and renal disease, insomnia, pain, venous leg ulcers, and dyslipidemia. Multicomponent lifestyle interventions aimed at changing multiple behaviors simultaneously (61.3%, SD 22.5%) had the second-highest adherence scores, whereas apps targeting substance use had the lowest (46.1%, SD 46.1%). The relatively low adherence levels of mHealth apps treating substance use could be explained by the nature of their intervention design, making it difficult to differentiate between nonadherent users and users who stopped using the app after a successful behavior change. Another explanation could be that substance use disorders are comorbid with depressive disorders. Several qualitative findings indicate that symptoms or a diagnosis of depression negatively affect adherence [27,48,50,78,89]. This also aligns with our findings that apps offering depression support had an even lower average adherence score of 45.3% (SD 28.1%).
Another explanation and potential bias for the difference in adherence scores are asymmetric distributions of trials compared with real-world applications within health domains, represented by the mean number of participants (substance use 2337.6, SD 6344.8; multicomponent lifestyle interventions 284.3, SD 531.9; and other NCDs 54.8, SD 48.6). In general, studies with a higher number of participants had significantly lower adherence scores (r=−0.228; 96/97, 99%; P=.03). Furthermore, apps that were only offered in the context of scientific studies had a significantly higher adherence score than those publicly available via app stores (rs95=0.324; P=.001). Surprisingly, these differences could not be explained by longer study duration (r=−0.138; 97/97, 100%; P=.18) or the number of intended app interactions (r=0.040; 97/97, 100%; P=.70). Thus, our study supports and provides quantitative evidence for previous findings outlining engagement within trials to significantly differ from real-world applications [147-149]. Further real-world longitudinal studies are necessary to explain these differences.
Although calculating an adherence score as the ratio between intended and actual use has several limitations, this exploratory approach enabled the quantification and comparison of adherence across different mHealth apps to a reasonable extent. The quantitative analysis of adherence scores yielded few significant results but fit qualitative findings regarding positive or negative influences on adherence in most instances, which supports the potential validity of the concept.
The results of explorative analysis based on adherence scores should be considered cautiously. Although we did not find a significant correlation between study duration or the number of intended app interactions and the adherence score, it is possible that other factors, such as patient characteristics, could influence adherence. Further research is needed to establish effective adherence measures. By reporting this novel quantified measure of adherence for individual studies and collectively for defined health domains, we hope researchers will test and challenge our approach, potentially developing more effective measures that help us quantify adherence and make it comparable across heterogeneous groups of mHealth apps.
Limitations
This study had several limitations. The first limitation is the heterogeneity of the included studies. The studies differ in terms of the characteristics of the target populations (eg, type of pre-existing condition, age, gender, education level, comorbidities, employment status, and experience with mobile technologies) and study duration (a few weeks to over a year). In addition, mHealth apps within the studies and their intended use varied significantly. The problem of the undiversified reach of mHealth interventions, predominantly including female and White participants living in high-income countries [150], also accounts for this study. Approximately 90% (87/97) of these studies were conducted in North America, Australia, or Europe. Similarly, women were overrepresented, with an average proportion of 62% (SD 22.8%). Most included studies had a pilot character, with 80% (77/96) of the studies including <200 participants and 73% (71/97) of the studies having a duration of <100 days. Whether individual study results can be replicated in more controlled and longitudinal studies in the future is questionable. In addition, there were differences in terms of additional monetary incentives and the level of personal support complementary to the use of mHealth interventions. Moreover, the mHealth apps investigated in the studies showed substantial heterogeneity in their goals (eg, increasing physical activity and reducing tobacco consumption). Overall, this limited the generalizability of our results.
This limitation was overcome by categorizing the results into different health domains. However, mHealth apps also exhibited key differentiating characteristics within their health domain, such as their stage of development (prototype vs established app), developer (nonprofit vs private company), the use of peripheral devices (eg, a smartwatch for passive data collection), app features (eg, social features such as leaderboards and elements of gamification), or the level of quality (eg, in terms of the user interface, UX, or technical stability). Another limitation is that few studies considered individual intervention components separately and evaluated their effectiveness, which complicates the identification of intervention-related factors. A further limitation of this study is the inclusion of nonrandomized studies, which, on the one hand, allowed a more extensive consideration of objective app use data but, by contrast, precluded conducting a risk of bias assessment.
The calculation of adherence scores as the ratio between intended and actual use also implies some noteworthy drawbacks. The intended use of the mHealth app, which was derived from the study design or study author comments, was also heterogeneous and differed depending on the mHealth app design (eg, tracking daily symptoms or completing a certain number of coaching sessions), interaction frequency (eg, daily or weekly), and interaction duration (weeks to years). Furthermore, the intended use was rarely justified by applying theory, evidence, or rationale, which has also been addressed in previous studies [13]. In some instances, the intended use could be derived from the intervention design; however, many studies had to be excluded as the app’s intended use was unclear or not stated at all. However, it can be positively highlighted that the actual mHealth app use extracted for the adherence score was based on objective app use data in approximately 96% (92/96) of cases.
Conclusions
This study contributes to the scarce scientific evidence on factors influencing adherence to mHealth apps and is the first to derive quantified adherence scores for various health domains to validate qualitative findings and explore adherence benchmarks.
This paper contains various detailed presentations of the central results. The most detailed presentation of adherence factors extracted from individual studies is outlined in Multimedia Appendix 4. We further classify the factors within the defined health domains and report the results collectively. Finally, we discuss the most common factors influencing adherence across all the health domains. As mHealth apps within health domains remain heterogeneous, we encourage readers to always consider information from the corresponding individual studies outlined in Multimedia Appendix 4 when implementing their interventions according to the factors reported in this review.
Our findings indicate that the following intervention-related factors positively influence mHealth app adherence: user-friendly and technically stable app design, customizable push notifications, personalized app content, passive data tracking, an integrated app tutorial, offering the app free of charge, and the integration of personal support into the mHealth app. Furthermore, gamification and social features show promising effects but may be limited to specific health domains. Time delays within the intervention, long intervention durations, low engagement of other participants, and the competitive effects of other mHealth apps were associated with low mHealth app adherence.
Regarding patient-related factors, the following user characteristics were associated with low mHealth app adherence: lack of technical competence, low health literacy, low self-efficacy, low education level, mental health burden, lack of experience with mHealth apps, privacy concerns, low expectations of the app, low trust in health care professionals conducting the intervention, and lack of time on the users’ side. Age, gender, and pre-existing condition were frequently mentioned factors but differed across and sometimes conflicted within the health domains. Furthermore, personal user recruitment appeared to positively influence adherence as opposed to web-based user recruitment.
The adherence score of the 97 included mHealth apps averaged 56.0% (SD 24.4%). Adherence scores were highest for mHealth apps targeting less common NCDs such as intestinal and renal disease, insomnia, pain, venous leg ulcers, and dyslipidemia. Multicomponent lifestyle interventions had the second-highest adherence scores, whereas apps targeting substance use had the lowest. Exploratory analysis of adherence scores revealed quantitative evidence for higher adherence rates within trials than in real-world applications.
Overall, research on the factors that positively or negatively influence adherence to mHealth apps is still limited. The underlying studies often had a pilot character with a short study duration, and the implementation of techniques was inconsistent. As most mHealth apps contain multiple intervention components, causal statements about individual factors are not possible and require more controlled and longitudinal studies in the future. To facilitate future research on mHealth app adherence; researchers should clearly outline and justify the app’s intended use, report objective data on actual use relative to the intended use; and ideally, provide long-term use and retention data. Further research is needed to establish effective adherence measures.
Acknowledgments
This study was partially supported by the Federal Office of Public Health of the Swiss Confederation and CSS Insurance, Switzerland. This research was also partially supported by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise Program and was partly conducted at the Future Health Technologies program, which was established collaboratively between the Swiss Federal Institute of Technology in Zürich and the National Research Foundation Singapore. This research was supported by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise Program. The Federal Office of Public Health, CSS Insurance, and the National Research Foundation had no role in the study design, data collection, data analysis and interpretation, writing the manuscript, or reviewing and approving the manuscript for publication.
Abbreviations
- CVD
cardiovascular disease
- DHI
digital health intervention
- mHealth
mobile health
- NCD
noncommunicable disease
- PICOS
Population, Intervention, Comparison, Outcomes, and Study component
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- UX
user experience
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
Applied search strategies.
Data extraction sheet.
Intervention-related and patient-related factors influencing adherence by health domain.
Footnotes
Authors' Contributions: RJ conceived the study using inputs from TK. RJ, SH, AMR, and JLM contributed to search strategy, screening, data extraction, and data synthesis. RJ wrote the report and conducted the statistical analyses. TK, SH, EF, JLM, and ASS provided methodological guidance and feedback on the manuscript. All authors reviewed and approved the final manuscript.
Conflicts of Interest: RJ, EF, and TK are affiliated with the Centre for Digital Health Interventions, a joint initiative between the Department of Management, Technology, and Economics at the Swiss Federal Institute of Technology in Zürich and the Institute of Technology Management at the University of St Gallen, which is partly funded by the Swiss health insurer CSS. The CSS was not involved in any stage of the study. EF and TK are also the cofounders of Pathmate Technologies, a university spin-off company that creates and delivers digital clinical pathways. However, Pathmate Technologies was not involved in this study.
References
- 1.Noncommunicable diseases. World Health Organization. 2021. Apr 13, [2022-04-12]. https://www.who.int/news-room/fact-sheets/detail/noncommunicable-diseases .
- 2.mHealth. eHealth Suisse. 2021. Aug 03, [2022-04-12]. https://www.e-health-suisse.ch/gemeinschaften-umsetzung/ehealth-aktivitaeten/mhealth.html .
- 3.Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatol. 2015 May 19;6:27882. doi: 10.3402/ejpt.v6.27882. http://europepmc.org/abstract/MED/25994025 .27882 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Wang Y, Xue H, Huang Y, Huang L, Zhang D. A systematic review of application and effectiveness of mHealth interventions for obesity and diabetes treatment and self-management. Adv Nutr. 2017 May;8(3):449–62. doi: 10.3945/an.116.014100. http://europepmc.org/abstract/MED/28507010 .8/3/449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Shaw J, Agarwal P, Desveaux L, Palma DC, Stamenova V, Jamieson T, Yang R, Bhatia RS, Bhattacharyya O. Beyond "implementation": digital health innovation and service design. NPJ Digit Med. 2018 Sep 20;1:48. doi: 10.1038/s41746-018-0059-8. doi: 10.1038/s41746-018-0059-8.59 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Aitken M, Clancy B, Nass D. The Growing Value of Digital Health - Evidence and Impact on Human Health and the Healthcare System. IQVIA Institute. 2017. Nov 7, [2022-04-12]. https://www.iqvia.com/insights/the-iqvia-institute/reports/the-growing-value-of-digital-health .
- 7.Hesser H. Estimating causal effects of internet interventions in the context of nonadherence. Internet Interv. 2020 Aug 29;21:100346. doi: 10.1016/j.invent.2020.100346. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(20)30112-3 .S2214-7829(20)30112-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Eysenbach G. The law of attrition. J Med Internet Res. 2005 Mar 31;7(1):e11. doi: 10.2196/jmir.7.1.e11. https://www.jmir.org/2005/1/e11/ v7e11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Internet Res. 2020 Sep 29;22(9):e20283. doi: 10.2196/20283. https://www.jmir.org/2020/9/e20283/ v22i9e20283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Baumel A, Muench F, Edan S, Kane JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res. 2019 Sep 25;21(9):e14567. doi: 10.2196/14567. https://www.jmir.org/2019/9/e14567/ v21i9e14567 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, Müller AM, Wark PA, Vandelanotte C, Poppe L, Hingle MD, Crutzen R. Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies. J Med Internet Res. 2018 Nov 16;20(11):e292. doi: 10.2196/jmir.9397. https://www.jmir.org/2018/11/e292/ v20i11e292 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Morrissey EC, Corbett TK, Walsh JC, Molloy GJ. Behavior change techniques in apps for medication adherence: a content analysis. Am J Prev Med. 2016 May;50(5):e143–6. doi: 10.1016/j.amepre.2015.09.034.S0749-3797(15)00637-6 [DOI] [PubMed] [Google Scholar]
- 13.Sieverink F, Kelders SM, van Gemert-Pijnen JE. Clarifying the concept of adherence to eHealth technology: systematic review on when usage becomes adherence. J Med Internet Res. 2017 Dec 06;19(12):e402. doi: 10.2196/jmir.8578. https://www.jmir.org/2017/12/e402/ v19i12e402 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Pedersen DH, Mansourvar M, Sortsø C, Schmidt T. Predicting dropouts from an electronic health platform for lifestyle interventions: analysis of methods and predictors. J Med Internet Res. 2019 Sep 04;21(9):e13617. doi: 10.2196/13617. https://www.jmir.org/2019/9/e13617/ v21i9e13617 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Trinh H, Shamekhi A, Kimani E, Bickmore TW. Predicting user engagement in longitudinal interventions with virtual agents. Proceedings of the 18th International Conference on Intelligent Virtual Agents; IVA '18; November 5-8, 2018; Sydney, Australia. New York, NY, USA: Association for Computing Machinery; 2018. Nov, pp. 9–16. [DOI] [Google Scholar]
- 16.Baumel A, Yom-Tov E. Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most. Transl Behav Med. 2018 Sep 08;8(5):793–8. doi: 10.1093/tbm/ibx037.4868564 [DOI] [PubMed] [Google Scholar]
- 17.Kernebeck S, Busse TS, Ehlers JP, Vollmar HC. [Adherence to digital health interventions: definitions, methods, and open questions] Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2021 Oct;64(10):1278–84. doi: 10.1007/s00103-021-03415-9. http://europepmc.org/abstract/MED/34559252 .10.1007/s00103-021-03415-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. 2011 Aug 05;13(3):e52. doi: 10.2196/jmir.1772. https://www.jmir.org/2011/3/e52/ v13i3e52 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Venkatesh V, Thong JY, Xu X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q. 2012 Mar;36(1):157–78. doi: 10.2307/41410412. [DOI] [Google Scholar]
- 20.Szinay D, Jones A, Chadborn T, Brown J, Naughton F. Influences on the uptake of and engagement with health and well-being smartphone apps: systematic review. J Med Internet Res. 2020 May 29;22(5):e17572. doi: 10.2196/17572. https://www.jmir.org/2020/5/e17572/ v22i5e17572 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Borghouts J, Eikey E, Mark G, De Leon C, Schueller SM, Schneider M, Stadnick N, Zheng K, Mukamel D, Sorkin DH. Barriers to and facilitators of user engagement with digital mental health interventions: systematic review. J Med Internet Res. 2021 Mar 24;23(3):e24387. doi: 10.2196/24387. https://www.jmir.org/2021/3/e24387/ v23i3e24387 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Nahum-Shani I, Rabbi M, Yap J, Philyaw-Kotov ML, Klasnja P, Bonar EE, Cunningham RM, Murphy SA, Walton MA. Translating strategies for promoting engagement in mobile health: a proof-of-concept microrandomized trial. Health Psychol. 2021 Dec;40(12):974–87. doi: 10.1037/hea0001101. http://europepmc.org/abstract/MED/34735165 .2022-00033-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Nahum-Shani I, Shaw SD, Carpenter SM, Murphy SA, Yoon C. Engagement in digital interventions. Am Psychol (forthcoming) 2022 Mar 17; doi: 10.1037/amp0000983.2022-41985-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Teague S, Youssef GJ, Macdonald JA, Sciberras E, Shatte A, Fuller-Tyszkiewicz M, Greenwood C, McIntosh J, Olsson CA, Hutchinson D, SEED Lifecourse Sciences Theme Retention strategies in longitudinal cohort studies: a systematic review and meta-analysis. BMC Med Res Methodol. 2018 Nov 26;18(1):151. doi: 10.1186/s12874-018-0586-7. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-018-0586-7 .10.1186/s12874-018-0586-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Booker CL, Harding S, Benzeval M. A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health. 2011 Apr 19;11:249. doi: 10.1186/1471-2458-11-249. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-11-249 .1471-2458-11-249 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Hui CY, McKinstry B, Walton R, Pinnock H. A mixed method observational study of strategies to promote adoption and usage of an application to support asthma self-management. J Innov Health Inform. 2019 Jan 09;25(4):243–53. doi: 10.14236/jhi.v25i4.1056. https://informatics.bmj.com/lookup/pmidlookup?view=long&pmid=30672405 . [DOI] [PubMed] [Google Scholar]
- 27.Rodriguez Hermosa JL, Fuster Gomila A, Puente Maestu L, Amado Diago CA, Callejas González FJ, Malo De Molina Ruiz R, Fuentes Ferrer ME, Álvarez Sala-Walther JL, Calle Rubio M. Compliance and utility of a smartphone app for the detection of exacerbations in patients with chronic obstructive pulmonary disease: cohort study. JMIR Mhealth Uhealth. 2020 Mar 19;8(3):e15699. doi: 10.2196/15699. https://mhealth.jmir.org/2020/3/e15699/ v8i3e15699 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Deng N, Chen J, Liu Y, Wei S, Sheng L, Lu R, Wang Z, Zhu J, An J, Wang B, Lin H, Wang X, Zhou Y, Duan H, Ran P. Using mobile health technology to deliver a community-based closed-loop management system for chronic obstructive pulmonary disease patients in remote areas of China: development and prospective observational study. JMIR Mhealth Uhealth. 2020 Nov 25;8(11):e15978. doi: 10.2196/15978. https://mhealth.jmir.org/2020/11/e15978/ v8i11e15978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Sittig S, Wang J, Iyengar S, Myneni S, Franklin A. Incorporating behavioral trigger messages into a mobile health app for chronic disease management: randomized clinical feasibility trial in diabetes. JMIR Mhealth Uhealth. 2020 Mar 16;8(3):e15927. doi: 10.2196/15927. https://mhealth.jmir.org/2020/3/e15927/ v8i3e15927 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dugas M, Crowley K, Gao GG, Xu T, Agarwal R, Kruglanski AW, Steinle N. Individual differences in regulatory mode moderate the effectiveness of a pilot mHealth trial for diabetes management among older veterans. PLoS One. 2018 Mar 7;13(3):e0192807. doi: 10.1371/journal.pone.0192807. https://dx.plos.org/10.1371/journal.pone.0192807 .PONE-D-17-20552 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Padhye NS, Wang J. Pattern of active and inactive sequences of diabetes self-monitoring in mobile phone and paper diary users. Annu Int Conf IEEE Eng Med Biol Soc. 2015;2015:7630–3. doi: 10.1109/EMBC.2015.7320159. [DOI] [PubMed] [Google Scholar]
- 32.Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J, Bird D, Williams E, Lotfaliany M, Oldenburg B. My Diabetes Coach, a mobile app-based interactive conversational agent to support type 2 diabetes self-management: randomized effectiveness-implementation trial. J Med Internet Res. 2020 Nov 05;22(11):e20322. doi: 10.2196/20322. https://www.jmir.org/2020/11/e20322/ v22i11e20322 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Su J, Dugas M, Guo X, Gao GG. Influence of personality on mHealth use in patients with diabetes: prospective pilot study. JMIR Mhealth Uhealth. 2020 Aug 10;8(8):e17709. doi: 10.2196/17709. https://mhealth.jmir.org/2020/8/e17709/ v8i8e17709 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Böhm AK, Jensen ML, Sørensen MR, Stargardt T. Real-world evidence of user engagement with mobile health for diabetes management: longitudinal observational study. JMIR Mhealth Uhealth. 2020 Nov 06;8(11):e22212. doi: 10.2196/22212. https://mhealth.jmir.org/2020/11/e22212/ v8i11e22212 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Harzand A, Witbrodt B, Davis-Watts ML, Alrohaibani A, Goese D, Wenger NK, Shah AJ, Zafari AM. Feasibility of a smartphone-enabled cardiac rehabilitation program in male veterans with previous clinical evidence of coronary heart disease. Am J Cardiol. 2018 Nov 01;122(9):1471–6. doi: 10.1016/j.amjcard.2018.07.028. http://europepmc.org/abstract/MED/30217377 .S0002-9149(18)31500-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kaplan AL, Cohen ER, Zimlichman E. Improving patient engagement in self-measured blood pressure monitoring using a mobile health technology. Health Inf Sci Syst. 2017 Oct 7;5(1):4. doi: 10.1007/s13755-017-0026-9. http://europepmc.org/abstract/MED/29081974 .26 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Crafoord MT, Fjell M, Sundberg K, Nilsson M, Langius-Eklöf A. Engagement in an interactive app for symptom self-management during treatment in patients with breast or prostate cancer: mixed methods study. J Med Internet Res. 2020 Aug 10;22(8):e17058. doi: 10.2196/17058. https://www.jmir.org/2020/8/e17058/ v22i8e17058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Baik SH, Oswald LB, Buscemi J, Buitrago D, Iacobelli F, Perez-Tamayo A, Guitelman J, Penedo FJ, Yanez B. Patterns of use of smartphone-based interventions among Latina breast cancer survivors: secondary analysis of a pilot randomized controlled trial. JMIR Cancer. 2020 Dec 08;6(2):e17538. doi: 10.2196/17538. https://cancer.jmir.org/2020/2/e17538/ v6i2e17538 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Benze G, Nauck F, Alt-Epping B, Gianni G, Bauknecht T, Ettl J, Munte A, Kretzschmar L, Gaertner J. PROutine: a feasibility study assessing surveillance of electronic patient reported outcomes and adherence via smartphone app in advanced cancer. Ann Palliat Med. 2019 Apr;8(2):104–11. doi: 10.21037/apm.2017.07.05. doi: 10.21037/apm.2017.07.05.apm.2017.07.05 [DOI] [PubMed] [Google Scholar]
- 40.Min YH, Lee JW, Shin YW, Jo MW, Sohn G, Lee JH, Lee G, Jung KH, Sung J, Ko BS, Yu JH, Kim HJ, Son BH, Ahn SH. Daily collection of self-reporting sleep disturbance data via a smartphone app in breast cancer patients receiving chemotherapy: a feasibility study. J Med Internet Res. 2014 May 23;16(5):e135. doi: 10.2196/jmir.3421. https://www.jmir.org/2014/5/e135/ v16i5e135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Greer JA, Jacobs JM, Pensak N, Nisotel LE, Fishbein JN, MacDonald JJ, Ream ME, Walsh EA, Buzaglo J, Muzikansky A, Lennes IT, Safren SA, Pirl WF, Temel JS. Randomized trial of a smartphone mobile app to improve symptoms and adherence to oral therapy for cancer. J Natl Compr Canc Netw. 2020 Feb;18(2):133–41. doi: 10.6004/jnccn.2019.7354.jnccn19136 [DOI] [PubMed] [Google Scholar]
- 42.Mira JJ, Navarro I, Botella F, Borrás F, Nuño-Solinís R, Orozco D, Iglesias-Alonso F, Pérez-Pérez P, Lorenzo S, Toro N. A Spanish pillbox app for elderly patients taking multiple medications: randomized controlled trial. J Med Internet Res. 2014 Apr 04;16(4):e99. doi: 10.2196/jmir.3269. https://www.jmir.org/2014/4/e99/ v16i4e99 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and efficacy of an mHealth game for managing anxiety: "Flowy" randomized controlled pilot trial and design evaluation. Games Health J. 2016 Feb;5(1):50–67. doi: 10.1089/g4h.2015.0033. [DOI] [PubMed] [Google Scholar]
- 44.Miller CB, Gu J, Henry AL, Davis ML, Espie CA, Stott R, Heinz AJ, Bentley KH, Goodwin GM, Gorman BS, Craske MG, Carl JR. Feasibility and efficacy of a digital CBT intervention for symptoms of Generalized Anxiety Disorder: a randomized multiple-baseline study. J Behav Ther Exp Psychiatry. 2021 Mar;70:101609. doi: 10.1016/j.jbtep.2020.101609.S0005-7916(19)30269-1 [DOI] [PubMed] [Google Scholar]
- 45.Dahne J, Collado A, Lejuez CW, Risco CM, Diaz VA, Coles L, Kustanowitz J, Zvolensky MJ, Carpenter MJ. Pilot randomized controlled trial of a Spanish-language Behavioral Activation mobile app (¡Aptívate!) for the treatment of depressive symptoms among united states Latinx adults with limited English proficiency. J Affect Disord. 2019 May 01;250:210–7. doi: 10.1016/j.jad.2019.03.009. http://europepmc.org/abstract/MED/30870770 .S0165-0327(18)33073-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Mantani A, Kato T, Furukawa TA, Horikoshi M, Imai H, Hiroe T, Chino B, Funayama T, Yonemoto N, Zhou Q, Kawanishi N. Smartphone cognitive behavioral therapy as an adjunct to pharmacotherapy for refractory depression: randomized controlled trial. J Med Internet Res. 2017 Nov 03;19(11):e373. doi: 10.2196/jmir.8602. https://www.jmir.org/2017/11/e373/ v19i11e373 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Pratap A, Renn BN, Volponi J, Mooney SD, Gazzaley A, Arean PA, Anguera JA. Using mobile apps to assess and treat depression in Hispanic and Latino populations: fully remote randomized clinical trial. J Med Internet Res. 2018 Aug 09;20(8):e10130. doi: 10.2196/10130. https://www.jmir.org/2018/8/e10130/ v20i8e10130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, Anguera JA. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res. 2016 Dec 20;18(12):e330. doi: 10.2196/jmir.6482. https://www.jmir.org/2016/12/e330/ v18i12e330 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Economides M, Lehrer P, Ranta K, Nazander A, Hilgert O, Raevuori A, Gevirtz R, Khazan I, Forman-Hoffman VL. Feasibility and efficacy of the addition of heart rate variability biofeedback to a remote digital health intervention for depression. Appl Psychophysiol Biofeedback. 2020 Jun;45(2):75–86. doi: 10.1007/s10484-020-09458-z. http://europepmc.org/abstract/MED/32246229 .10.1007/s10484-020-09458-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Hung S, Li MS, Chen YL, Chiang JH, Chen YY, Hung GC. Smartphone-based ecological momentary assessment for Chinese patients with depression: an exploratory study in Taiwan. Asian J Psychiatr. 2016 Oct;23:131–6. doi: 10.1016/j.ajp.2016.08.003.S1876-2018(16)30204-0 [DOI] [PubMed] [Google Scholar]
- 51.Deady M, Glozier N, Calvo R, Johnston D, Mackinnon A, Milne D, Choi I, Gayed A, Peters D, Bryant R, Christensen H, Harvey SB. Preventing depression using a smartphone app: a randomized controlled trial. Psychol Med. 2022 Feb;52(3):457–66. doi: 10.1017/S0033291720002081.S0033291720002081 [DOI] [PubMed] [Google Scholar]
- 52.Furukawa TA, Horikoshi M, Fujita H, Tsujino N, Jinnin R, Kako Y, Ogawa S, Sato H, Kitagawa N, Shinagawa Y, Ikeda Y, Imai H, Tajika A, Ogawa Y, Akechi T, Yamada M, Shimodera S, Watanabe N, Inagaki M, Hasegawa A. Cognitive and behavioral skills exercises completed by patients with major depression during smartphone cognitive behavioral therapy: secondary analysis of a randomized controlled trial. JMIR Ment Health. 2018 Jan 11;5(1):e4. doi: 10.2196/mental.9092. https://mental.jmir.org/2018/1/e4/ v5i1e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Collins DA, Harvey SB, Lavender I, Glozier N, Christensen H, Deady M. A pilot evaluation of a smartphone application for workplace depression. Int J Environ Res Public Health. 2020 Sep 16;17(18):6753. doi: 10.3390/ijerph17186753. https://www.mdpi.com/resolver?pii=ijerph17186753 .ijerph17186753 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bonet L, Torous J, Arce D, Blanquer I, Sanjuan J. ReMindCare app for early psychosis: pragmatic real world intervention and usability study. JMIR Mhealth Uhealth. 2020 Nov 06;8(11):e22997. doi: 10.2196/22997. https://mhealth.jmir.org/2020/11/e22997/ v8i11e22997 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Tighe J, Shand F, Ridani R, Mackinnon A, De La Mata N, Christensen H. Ibobbly mobile health intervention for suicide prevention in Australian Indigenous youth: a pilot randomised controlled trial. BMJ Open. 2017 Jan 27;7(1):e013518. doi: 10.1136/bmjopen-2016-013518. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=28132007 .bmjopen-2016-013518 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Ryan KA, Babu P, Easter R, Saunders E, Lee AJ, Klasnja P, Verchinina L, Micol V, Doil B, McInnis MG, Kilbourne AM. A smartphone app to monitor mood symptoms in bipolar disorder: development and usability study. JMIR Ment Health. 2020 Sep 22;7(9):e19476. doi: 10.2196/19476. https://mental.jmir.org/2020/9/e19476/ v7i9e19476 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Steare T, O'Hanlon P, Eskinazi M, Osborn D, Lloyd-Evans B, Jones R, Rostill H, Amani S, Johnson S. Smartphone-delivered self-management for first-episode psychosis: the ARIES feasibility randomised controlled trial. BMJ Open. 2020 Aug 26;10(8):e034927. doi: 10.1136/bmjopen-2019-034927. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=32847902 .bmjopen-2019-034927 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Hidalgo-Mazzei D, Reinares M, Mateu A, Nikolova VL, Del Mar Bonnín C, Samalin L, García-Estela A, Pérez-Solá V, Young AH, Strejilevich S, Vieta E, Colom F. OpenSIMPLe: a real-world implementation feasibility study of a smartphone-based psychoeducation programme for bipolar disorder. J Affect Disord. 2018 Dec 01;241:436–45. doi: 10.1016/j.jad.2018.08.048.S0165-0327(18)30848-6 [DOI] [PubMed] [Google Scholar]
- 59.Proudfoot J, Clarke J, Birch M, Whitton AE, Parker G, Manicavasagar V, Harrison V, Christensen H, Hadzi-Pavlovic D. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013 Nov 18;13:312. doi: 10.1186/1471-244X-13-312. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/1471-244X-13-312 .1471-244X-13-312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Porras-Segovia A, Molina-Madueño RM, Berrouiguet S, López-Castroman J, Barrigón ML, Pérez-Rodríguez MS, Marco JH, Díaz-Oliván I, de León S, Courtet P, Artés-Rodríguez A, Baca-García E. Smartphone-based ecological momentary assessment (EMA) in psychiatric patients and student controls: a real-world feasibility study. J Affect Disord. 2020 Sep 01;274:733–41. doi: 10.1016/j.jad.2020.05.067.S0165-0327(20)30440-7 [DOI] [PubMed] [Google Scholar]
- 61.Ponzo S, Morelli D, Kawadler JM, Hemmings NR, Bird G, Plans D. Efficacy of the digital therapeutic mobile app BioBase to reduce stress and improve mental well-being among university students: randomized controlled trial. JMIR Mhealth Uhealth. 2020 Apr 06;8(4):e17767. doi: 10.2196/17767. https://mhealth.jmir.org/2020/4/e17767/ v8i4e17767 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Beard C, Ramadurai R, McHugh RK, Pollak JP, Björgvinsson T. HabitWorks: development of a CBM-I smartphone app to augment and extend acute treatment. Behav Ther. 2021 Mar;52(2):365–78. doi: 10.1016/j.beth.2020.04.013.S0005-7894(20)30063-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Bell L, Garnett C, Qian T, Perski O, Williamson E, Potts HW. Engagement with a behavior change app for alcohol reduction: data visualization for longitudinal observational study. J Med Internet Res. 2020 Dec 11;22(12):e23369. doi: 10.2196/23369. https://www.jmir.org/2020/12/e23369/ v22i12e23369 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Laurens MC, Pieterse ME, Brusse-Keizer M, Salemink E, Ben Allouch S, Bohlmeijer ET, Postel MG. Alcohol avoidance training as a mobile app for problem drinkers: longitudinal feasibility study. JMIR Mhealth Uhealth. 2020 Apr 14;8(4):e16217. doi: 10.2196/16217. https://mhealth.jmir.org/2020/4/e16217/ v8i4e16217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Herbec A, Brown J, Shahab L, West R, Raupach T. Pragmatic randomised trial of a smartphone app (NRT2Quit) to improve effectiveness of nicotine replacement therapy in a quit attempt by improving medication adherence: results of a prematurely terminated study. Trials. 2019 Sep 02;20(1):547. doi: 10.1186/s13063-019-3645-4. https://trialsjournal.biomedcentral.com/articles/10.1186/s13063-019-3645-4 .10.1186/s13063-019-3645-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Pallejà-Millán M, Rey-Reñones C, Barrera Uriarte ML, Granado-Font E, Basora J, Flores-Mateo G, Duch J. Evaluation of the Tobbstop mobile app for smoking cessation: cluster randomized controlled clinical trial. JMIR Mhealth Uhealth. 2020 Jun 26;8(6):e15951. doi: 10.2196/15951. https://mhealth.jmir.org/2020/6/e15951/ v8i6e15951 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Zeng EY, Heffner JL, Copeland WK, Mull KE, Bricker JB. Get with the program: adherence to a smartphone app for smoking cessation. Addict Behav. 2016 Dec;63:120–4. doi: 10.1016/j.addbeh.2016.07.007. http://europepmc.org/abstract/MED/27454354 .S0306-4603(16)30248-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Vilardaga R, Rizo J, Ries RK, Kientz JA, Ziedonis DM, Hernandez K, McClernon FJ. Formative, multimethod case studies of learn to quit, an acceptance and commitment therapy smoking cessation app designed for people with serious mental illness. Transl Behav Med. 2019 Nov 25;9(6):1076–86. doi: 10.1093/tbm/iby097. http://europepmc.org/abstract/MED/30445507 .5184643 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Webb J, Peerbux S, Smittenaar P, Siddiqui S, Sherwani Y, Ahmed M, MacRae H, Puri H, Bhalla S, Majeed A. Preliminary outcomes of a digital therapeutic intervention for smoking cessation in adult smokers: randomized controlled trial. JMIR Ment Health. 2020 Oct 06;7(10):e22833. doi: 10.2196/22833. https://mental.jmir.org/2020/10/e22833/ v7i10e22833 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Hébert ET, Ra CK, Alexander AC, Helt A, Moisiuc R, Kendzor DE, Vidrine DJ, Funk-Lawler RK, Businelle MS. A mobile just-in-time adaptive intervention for smoking cessation: pilot randomized controlled trial. J Med Internet Res. 2020 Mar 09;22(3):e16907. doi: 10.2196/16907. https://www.jmir.org/2020/3/e16907/ v22i3e16907 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Witkiewitz K, Desai SA, Bowen S, Leigh BC, Kirouac M, Larimer ME. Development and evaluation of a mobile intervention for heavy drinking and smoking among college students. Psychol Addict Behav. 2014 Sep;28(3):639–50. doi: 10.1037/a0034747. http://europepmc.org/abstract/MED/25000269 .2014-27999-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Chang AR, Bailey-Davis L, Hetherington V, Ziegler A, Yule C, Kwiecen S, Graboski E, Melough MM, Collins C, Anderson C. Remote dietary counseling using smartphone applications in patients with stages 1-3a chronic kidney disease: a mixed methods feasibility study. J Ren Nutr. 2020 Jan;30(1):53–60. doi: 10.1053/j.jrn.2019.03.080. http://europepmc.org/abstract/MED/31078403 .S1051-2276(19)30156-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Chen YS, Wong JE, Ayob AF, Othman NE, Poh BK. Can Malaysian young adults report dietary intake using a food diary mobile application? A pilot study on acceptability and compliance. Nutrients. 2017 Jan 13;9(1):62. doi: 10.3390/nu9010062. https://www.mdpi.com/resolver?pii=nu9010062 .nu9010062 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Hendrie GA, Hussain MS, Brindal E, James-Martin G, Williams G, Crook A. Impact of a mobile phone app to increase vegetable consumption and variety in adults: large-scale community cohort study. JMIR Mhealth Uhealth. 2020 Apr 17;8(4):e14726. doi: 10.2196/14726. https://mhealth.jmir.org/2020/4/e14726/ v8i4e14726 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Helander E, Kaipainen K, Korhonen I, Wansink B. Factors related to sustained use of a free mobile app for dietary self-monitoring with photography and peer feedback: retrospective cohort study. J Med Internet Res. 2014 Apr 15;16(4):e109. doi: 10.2196/jmir.3084. https://www.jmir.org/2014/4/e109/ v16i4e109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Orlemann T, Reljic D, Zenker B, Meyer J, Eskofier B, Thiemt J, Herrmann HJ, Neurath MF, Zopf Y. A novel mobile phone app (OncoFood) to record and optimize the dietary behavior of oncologic patients: pilot study. JMIR Cancer. 2018 Nov 20;4(2):e10703. doi: 10.2196/10703. https://cancer.jmir.org/2018/2/e10703/ v4i2e10703 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Robinson E, Higgs S, Daley AJ, Jolly K, Lycett D, Lewis A, Aveyard P. Development and feasibility testing of a smart phone based attentive eating intervention. BMC Public Health. 2013 Jul 09;13:639. doi: 10.1186/1471-2458-13-639. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-13-639 .1471-2458-13-639 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Bentley CL, Powell L, Potter S, Parker J, Mountain GA, Bartlett YK, Farwer J, O'Connor C, Burns J, Cresswell RL, Dunn HD, Hawley MS. The use of a smartphone app and an activity tracker to promote physical activity in the management of chronic obstructive pulmonary disease: randomized controlled feasibility study. JMIR Mhealth Uhealth. 2020 Jun 03;8(6):e16203. doi: 10.2196/16203. https://mhealth.jmir.org/2020/6/e16203/ v8i6e16203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Edney S, Ryan JC, Olds T, Monroe C, Fraysse F, Vandelanotte C, Plotnikoff R, Curtis R, Maher C. User engagement and attrition in an app-based physical activity intervention: secondary analysis of a randomized controlled trial. J Med Internet Res. 2019 Nov 27;21(11):e14645. doi: 10.2196/14645. https://www.jmir.org/2019/11/e14645/ v21i11e14645 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Edney SM, Olds TS, Ryan JC, Vandelanotte C, Plotnikoff RC, Curtis RG, Maher CA. A social networking and gamified app to increase physical activity: cluster RCT. Am J Prev Med. 2020 Feb;58(2):e51–62. doi: 10.1016/j.amepre.2019.09.009.S0749-3797(19)30415-5 [DOI] [PubMed] [Google Scholar]
- 81.Kramer JN, Künzler F, Mishra V, Smith SN, Kotz D, Scholz U, Fleisch E, Kowatsch T. Which components of a smartphone walking app help users to reach personalized step goals? Results from an optimization trial. Ann Behav Med. 2020 Jun 12;54(7):518–28. doi: 10.1093/abm/kaaa002. http://europepmc.org/abstract/MED/32182353 .5809236 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Landers MR, Ellis TD. A mobile app specifically designed to facilitate exercise in Parkinson disease: single-cohort pilot study on feasibility, safety, and signal of efficacy. JMIR Mhealth Uhealth. 2020 Oct 05;8(10):e18985. doi: 10.2196/18985. https://mhealth.jmir.org/2020/10/e18985/ v8i10e18985 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Luhanga ET, Hippocrate AA, Suwa H, Arakawa Y, Yasumoto K. Identifying and evaluating user requirements for smartphone group fitness applications. IEEE Access. 2018 Jan 15;6:3256–69. doi: 10.1109/access.2018.2793844. [DOI] [Google Scholar]
- 84.Allen JK, Stephens J, Dennison Himmelfarb CR, Stewart KJ, Hauck S. Randomized controlled pilot study testing use of smartphone technology for obesity treatment. J Obes. 2013;2013:151597. doi: 10.1155/2013/151597. doi: 10.1155/2013/151597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Bennett GG, Steinberg D, Askew S, Levine E, Foley P, Batch BC, Svetkey LP, Bosworth HB, Puleo EM, Brewer A, DeVries A, Miranda H. Effectiveness of an app and provider counseling for obesity treatment in primary care. Am J Prev Med. 2018 Dec;55(6):777–86. doi: 10.1016/j.amepre.2018.07.005. http://europepmc.org/abstract/MED/30361140 .S0749-3797(18)32105-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Carter MC, Burley VJ, Nykjaer C, Cade JE. Adherence to a smartphone application for weight loss compared to website and paper diary: pilot randomized controlled trial. J Med Internet Res. 2013 Apr 15;15(4):e32. doi: 10.2196/jmir.2283. https://www.jmir.org/2013/4/e32/ v15i4e32 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Forman EM, Goldstein SP, Crochiere RJ, Butryn ML, Juarascio AS, Zhang F, Foster GD. Randomized controlled trial of OnTrack, a just-in-time adaptive intervention designed to enhance weight loss. Transl Behav Med. 2019 Nov 25;9(6):989–1001. doi: 10.1093/tbm/ibz137.5585540 [DOI] [PubMed] [Google Scholar]
- 88.Hales S, Turner-McGrievy GM, Wilcox S, Fahim A, Davis RE, Huhns M, Valafar H. Social networks for improving healthy weight loss behaviors for overweight and obese adults: a randomized clinical trial of the social pounds off digitally (Social POD) mobile app. Int J Med Inform. 2016 Oct;94:81–90. doi: 10.1016/j.ijmedinf.2016.07.003.S1386-5056(16)30154-X [DOI] [PubMed] [Google Scholar]
- 89.Ifejika NL, Bhadane M, Cai CC, Noser EA, Grotta JC, Savitz SI. Use of a smartphone-based mobile app for weight management in obese minority stroke survivors: pilot randomized controlled trial with open blinded end point. JMIR Mhealth Uhealth. 2020 Apr 22;8(4):e17816. doi: 10.2196/17816. https://mhealth.jmir.org/2020/4/e17816/ v8i4e17816 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Stephens JD, Yager AM, Allen J. Smartphone technology and text messaging for weight loss in young adults: a randomized controlled trial. J Cardiovasc Nurs. 2017;32(1):39–46. doi: 10.1097/JCN.0000000000000307. http://europepmc.org/abstract/MED/26646593 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Svetkey LP, Batch BC, Lin PH, Intille SS, Corsino L, Tyson CC, Bosworth HB, Grambow SC, Voils C, Loria C, Gallis JA, Schwager J, Bennett GB. Cell phone intervention for you (CITY): a randomized, controlled trial of behavioral weight loss intervention for young adults using mobile technology. Obesity (Silver Spring) 2015 Nov;23(11):2133–41. doi: 10.1002/oby.21226. doi: 10.1002/oby.21226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Tanaka K, Sasai H, Wakaba K, Murakami S, Ueda M, Yamagata F, Sawada M, Takekoshi K. Professional dietary coaching within a group chat using a smartphone application for weight loss: a randomized controlled trial. J Multidiscip Healthc. 2018 Jul 16;11:339–47. doi: 10.2147/JMDH.S165422. doi: 10.2147/JMDH.S165422.jmdh-11-339 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Horsch C, Spruit S, Lancee J, van Eijk R, Beun RJ, Neerincx M, Brinkman WP. Reminders make people adhere better to a self-help sleep intervention. Health Technol (Berl) 2017;7(2):173–88. doi: 10.1007/s12553-016-0167-x. http://europepmc.org/abstract/MED/29201588 .167 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Horsch CH, Lancee J, Griffioen-Both F, Spruit S, Fitrianie S, Neerincx MA, Beun RJ, Brinkman WP. Mobile phone-delivered cognitive behavioral therapy for insomnia: a randomized waitlist controlled trial. J Med Internet Res. 2017 Apr 11;19(4):e70. doi: 10.2196/jmir.6524. https://www.jmir.org/2017/4/e70/ v19i4e70 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Göransson C, Wengström Y, Hälleberg-Nyman M, Langius-Eklöf A, Ziegert K, Blomberg K. An app for supporting older people receiving home care - usage, aspects of health and health literacy: a quasi-experimental study. BMC Med Inform Decis Mak. 2020 Sep 15;20(1):226. doi: 10.1186/s12911-020-01246-3. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-020-01246-3 .10.1186/s12911-020-01246-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Murawski B, Plotnikoff RC, Rayward AT, Oldmeadow C, Vandelanotte C, Brown WJ, Duncan MJ. Efficacy of an m-health physical activity and sleep health intervention for adults: a randomized waitlist-controlled trial. Am J Prev Med. 2019 Oct;57(4):503–14. doi: 10.1016/j.amepre.2019.05.009.S0749-3797(19)30241-7 [DOI] [PubMed] [Google Scholar]
- 97.Laranjo L, Quiroz JC, Tong HL, Arevalo Bazalar M, Coiera E. A mobile social networking app for weight management and physical activity promotion: results from an experimental mixed methods study. J Med Internet Res. 2020 Dec 08;22(12):e19991. doi: 10.2196/19991. https://www.jmir.org/2020/12/e19991/ v22i12e19991 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Oftedal S, Burrows T, Fenton S, Murawski B, Rayward AB, Duncan MJ. Feasibility and preliminary efficacy of an m-health intervention targeting physical activity, diet, and sleep quality in shift-workers. Int J Environ Res Public Health. 2019 Oct 10;16(20):3810. doi: 10.3390/ijerph16203810. https://www.mdpi.com/resolver?pii=ijerph16203810 .ijerph16203810 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Recio-Rodriguez JI, Agudo-Conde C, Martin-Cantera C, González-Viejo MN, Fernandez-Alonso MD, Arietaleanizbeaskoa MS, Schmolling-Guinovart Y, Maderuelo-Fernandez JA, Rodriguez-Sanchez E, Gomez-Marcos MA, Garcia-Ortiz L, EVIDENT Investigators Short-term effectiveness of a mobile phone app for increasing physical activity and adherence to the Mediterranean diet in primary care: a randomized controlled trial (EVIDENT II Study) J Med Internet Res. 2016 Dec 19;18(12):e331. doi: 10.2196/jmir.6814. https://www.jmir.org/2016/12/e331/ v18i12e331 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Seng EK, Prieto P, Boucher G, Vives-Mestres M. Anxiety, incentives, and adherence to self-monitoring on a mobile health platform: a naturalistic longitudinal cohort study in people with headache. Headache. 2018 Nov;58(10):1541–55. doi: 10.1111/head.13422. http://europepmc.org/abstract/MED/30334248 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Avalos LA, Aghaee S, Kurtovich E, Quesenberry Jr C, Nkemere L, McGinnis MK, Kubo A. A mobile health mindfulness intervention for women with moderate to moderately severe postpartum depressive symptoms: feasibility study. JMIR Ment Health. 2020 Nov 12;7(11):e17405. doi: 10.2196/17405. https://mental.jmir.org/2020/11/e17405/ v7i11e17405 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Bostock S, Crosswell AD, Prather AA, Steptoe A. Mindfulness on-the-go: effects of a mindfulness meditation app on work stress and well-being. J Occup Health Psychol. 2019 Feb;24(1):127–38. doi: 10.1037/ocp0000118. http://europepmc.org/abstract/MED/29723001 .2018-19565-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Chandler J, Sox L, Diaz V, Kellam K, Neely A, Nemeth L, Treiber F. Impact of 12-month smartphone breathing meditation program upon systolic blood pressure among non-medicated stage 1 hypertensive adults. Int J Environ Res Public Health. 2020 Mar 17;17(6):1955. doi: 10.3390/ijerph17061955. https://www.mdpi.com/resolver?pii=ijerph17061955 .ijerph17061955 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Champion L, Economides M, Chandler C. The efficacy of a brief app-based mindfulness intervention on psychosocial outcomes in healthy adults: a pilot randomised controlled trial. PLoS One. 2018 Dec 31;13(12):e0209482. doi: 10.1371/journal.pone.0209482. https://dx.plos.org/10.1371/journal.pone.0209482 .PONE-D-18-16913 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Goldberg SB, Imhoff-Smith T, Bolt DM, Wilson-Mendenhall CD, Dahl CJ, Davidson RJ, Rosenkranz MA. Testing the efficacy of a multicomponent, self-guided, smartphone-based meditation app: three-armed randomized controlled trial. JMIR Ment Health. 2020 Nov 27;7(11):e23825. doi: 10.2196/23825. https://mental.jmir.org/2020/11/e23825/ v7i11e23825 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Huberty J, Vranceanu AM, Carney C, Breus M, Gordon M, Puzia ME. Characteristics and usage patterns among 12,151 paid subscribers of the calm meditation app: cross-sectional survey. JMIR Mhealth Uhealth. 2019 Nov 03;7(11):e15648. doi: 10.2196/15648. https://mhealth.jmir.org/2019/11/e15648/ v7i11e15648 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Lengacher CA, Reich RR, Ramesar S, Alinat CB, Moscoso M, Cousin L, Marino VR, Elias MN, Paterson CL, Pleasant ML, Rodriguez CS, Wang HL, Kip KE, Meng H, Park JY. Feasibility of the mobile mindfulness-based stress reduction for breast cancer (mMBSR(BC)) program for symptom improvement among breast cancer survivors. Psychooncology. 2018 Feb;27(2):524–31. doi: 10.1002/pon.4491. http://europepmc.org/abstract/MED/28665541 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Mahlo L, Windsor TD. Feasibility, acceptability, and preliminary efficacy of an app-based mindfulness-meditation program among older adults. Gerontologist. 2021 Jul 13;61(5):775–86. doi: 10.1093/geront/gnaa093.5871388 [DOI] [PubMed] [Google Scholar]
- 109.Walsh KM, Saab BJ, Farb NA. Effects of a mindfulness meditation app on subjective well-being: active randomized controlled trial and experience sampling study. JMIR Ment Health. 2019 Jan 08;6(1):e10844. doi: 10.2196/10844. https://mental.jmir.org/2019/1/e10844/ v6i1e10844 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Aji M, Glozier N, Bartlett D, Peters D, Calvo RA, Zheng Y, Grunstein R, Gordon C. A feasibility study of a mobile app to treat insomnia. Transl Behav Med. 2021 Mar 16;11(2):604–12. doi: 10.1093/tbm/ibaa019.5813538 [DOI] [PubMed] [Google Scholar]
- 111.Gentili C, Zetterqvist V, Rickardsson J, Holmström L, Simons LE, Wicksell RK. ACTsmart: guided smartphone-delivered acceptance and commitment therapy for chronic pain-a pilot trial. Pain Med. 2021 Feb 23;22(2):315–28. doi: 10.1093/pm/pnaa360. http://europepmc.org/abstract/MED/33200214 .5983827 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 112.Hauser-Ulrich S, Künzli H, Meier-Peterhans D, Kowatsch T. A smartphone-based health care chatbot to promote self-management of chronic pain (SELMA): pilot randomized controlled trial. JMIR Mhealth Uhealth. 2020 Apr 03;8(4):e15806. doi: 10.2196/15806. https://mhealth.jmir.org/2020/4/e15806/ v8i4e15806 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Kang SG, Kang JM, Cho SJ, Ko KP, Lee YJ, Lee HJ, Kim L, Winkelman JW. Cognitive behavioral therapy using a mobile application synchronizable with wearable devices for insomnia treatment: a pilot study. J Clin Sleep Med. 2017 Apr 15;13(4):633–40. doi: 10.5664/jcsm.6564. doi: 10.5664/jcsm.6564.jc-00376-16 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Kelechi TJ, Prentice MA, Mueller M, Madisetti M, Vertegel A. A lower leg physical activity intervention for individuals with chronic venous leg ulcers: randomized controlled trial. JMIR Mhealth Uhealth. 2020 May 15;8(5):e15015. doi: 10.2196/15015. https://mhealth.jmir.org/2020/5/e15015/ v8i5e15015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.McCombie A, Walmsley R, Barclay M, Ho C, Langlotz T, Regenbrecht H, Gray A, Visesio N, Inns S, Schultz M. A noninferiority randomized clinical trial of the use of the smartphone-based health applications IBDsmart and IBDoc in the care of inflammatory bowel disease patients. Inflamm Bowel Dis. 2020 Jun 18;26(7):1098–109. doi: 10.1093/ibd/izz252.5603780 [DOI] [PubMed] [Google Scholar]
- 116.Minen MT, Schaubhut KB, Morio K. Smartphone based behavioral therapy for pain in multiple sclerosis (MS) patients: a feasibility acceptability randomized controlled study for the treatment of comorbid migraine and ms pain. Mult Scler Relat Disord. 2020 Nov;46:102489. doi: 10.1016/j.msard.2020.102489. http://europepmc.org/abstract/MED/32950893 .S2211-0348(20)30564-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Ong SW, Jassal SV, Miller JA, Porter EC, Cafazzo JA, Seto E, Thorpe KE, Logan AG. Integrating a smartphone-based self-management system into usual care of advanced CKD. Clin J Am Soc Nephrol. 2016 Jun 06;11(6):1054–62. doi: 10.2215/CJN.10681015. https://cjasn.asnjournals.org/cgi/pmidlookup?view=long&pmid=27173169 .CJN.10681015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Steinert A, Eicher C, Haesner M, Steinhagen-Thiessen E. Effects of a long-term smartphone-based self-monitoring intervention in patients with lipid metabolism disorders. Assist Technol. 2020;32(2):109–16. doi: 10.1080/10400435.2018.1493710. [DOI] [PubMed] [Google Scholar]
- 119.Weerts ZZ, Heinen KG, Masclee AA, Quanjel AB, Winkens B, Vork L, Rinkens PE, Jonkers DM, Keszthelyi D. Smart data collection for the assessment of treatment effects in irritable bowel syndrome: observational study. JMIR Mhealth Uhealth. 2020 Nov 02;8(11):e19696. doi: 10.2196/19696. https://mhealth.jmir.org/2020/11/e19696/ v8i11e19696 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 120.Isetta V, Torres M, González K, Ruiz C, Dalmases M, Embid C, Navajas D, Farré R, Montserrat JM. A new mHealth application to support treatment of sleep apnoea patients. J Telemed Telecare. 2017 Jan;23(1):14–8. doi: 10.1177/1357633X15621848.1357633X15621848 [DOI] [PubMed] [Google Scholar]
- 121.Zia J, Schroeder J, Munson S, Fogarty J, Nguyen L, Barney P, Heitkemper M, Ladabaum U. Feasibility and usability pilot study of a novel irritable bowel syndrome food and gastrointestinal symptom journal smartphone app. Clin Transl Gastroenterol. 2016 Mar 03;7(3):e147. doi: 10.1038/ctg.2016.9. http://europepmc.org/abstract/MED/26938478 .ctg20169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Choi JY, Choi H, Seomun G, Kim EJ. Mobile-application-based interventions for patients with hypertension and ischemic heart disease: a systematic review. J Nurs Res. 2020 Oct;28(5):e117. doi: 10.1097/JNR.0000000000000382.00134372-202010000-00008 [DOI] [PubMed] [Google Scholar]
- 123.Linardon J, Shatte A, Rosato J, Fuller-Tyszkiewicz M. Efficacy of a transdiagnostic cognitive-behavioral intervention for eating disorder psychopathology delivered through a smartphone app: a randomized controlled trial. Psychol Med (forthcoming) 2020 Sep 25;:1–12. doi: 10.1017/S0033291720003426.S0033291720003426 [DOI] [PubMed] [Google Scholar]
- 124.Hofmann SG, Sawyer AT, Witt AA, Oh D. The effect of mindfulness-based therapy on anxiety and depression: a meta-analytic review. J Consult Clin Psychol. 2010 Apr;78(2):169–83. doi: 10.1037/a0018555. http://europepmc.org/abstract/MED/20350028 .2010-05835-004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 125.Wang C, Qi H. Influencing factors of acceptance and use behavior of mobile health application users: systematic review. Healthcare (Basel) 2021 Mar 22;9(3):357. doi: 10.3390/healthcare9030357. https://www.mdpi.com/resolver?pii=healthcare9030357 .healthcare9030357 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.Mishra V, Künzler F, Kramer JN, Fleisch E, Kowatsch T, Kotz D. Detecting receptivity for mHealth interventions in the natural environment. Proc ACM Interact Mob Wearable Ubiquitous Technol. 2021 Jun;5(2):74. doi: 10.1145/3463492. http://europepmc.org/abstract/MED/34926979 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 127.Künzler F, Mishra V, Kramer JN, Kotz D, Fleisch E, Kowatsch T. Exploring the state-of-receptivity for mHealth interventions. Proc ACM Interact Mob Wearable Ubiquitous Technol. 2019 Dec 11;3(4):1–27. doi: 10.1145/3369805. http://europepmc.org/abstract/MED/34926979 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 128.Fortuna KL, Muralidharan A, Goldstein CM, Venegas M, Glass JE, Brooks JM. Certified peer specialists' perspective of the barriers and facilitators to mobile health engagement. J Technol Behav Sci. 2020 Dec;5(4):318–23. doi: 10.1007/s41347-020-00138-7. http://europepmc.org/abstract/MED/33163620 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Rubin A, Livingston NA, Brady J, Hocking E, Bickmore T, Sawdy M, Kressin N, Saitz R, Simon S. Computerized relational agent to deliver alcohol brief intervention and referral to treatment in primary care: a randomized clinical trial. J Gen Intern Med. 2022 Jan;37(1):70–7. doi: 10.1007/s11606-021-06945-9. http://europepmc.org/abstract/MED/34145518 .10.1007/s11606-021-06945-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 130.Kowatsch T, Lohse KM, Erb V, Schittenhelm L, Galliker H, Lehner R, Huang EM. Hybrid ubiquitous coaching with a novel combination of mobile and holographic conversational agents targeting adherence to home exercises: four design and evaluation studies. J Med Internet Res. 2021 Feb 22;23(2):e23612. doi: 10.2196/23612. https://www.jmir.org/2021/2/e23612/ v23i2e23612 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 131.Kowatsch T, Schachner T, Harperink S, Barata F, Dittler U, Xiao G, Stanger C, Wangenheim FV, Fleisch E, Oswald H, Möller A. Conversational agents as mediating social actors in chronic disease management involving health care professionals, patients, and family members: multisite single-arm feasibility study. J Med Internet Res. 2021 Feb 17;23(2):e25060. doi: 10.2196/25060. https://www.jmir.org/2021/2/e25060/ v23i2e25060 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 132.Abdullah AS, Gaehde S, Bickmore T. A tablet based embodied conversational agent to promote smoking cessation among veterans: a feasibility study. J Epidemiol Glob Health. 2018 Dec;8(3-4):225–30. doi: 10.2991/j.jegh.2018.08.104. http://europepmc.org/abstract/MED/30864768 .j8/3-4/225 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 133.De Croon R, Geuens J, Verbert K, Vanden AV. A systematic review of the effect of gamification on adherence across disciplines. Proceedings of the 3rd International Conference on HCI in Games: Experience Design and Game Mechanics; HCI-Games '21; July 24-29, 2021; Virtual. Washington, DC, USA: Springer International Publishing; 2021. Jul, pp. 168–84. [DOI] [Google Scholar]
- 134.Litvin S, Saunders R, Maier MA, Lüttke S. Gamification as an approach to improve resilience and reduce attrition in mobile mental health interventions: a randomized controlled trial. PLoS One. 2020 Sep 2;15(9):e0237220. doi: 10.1371/journal.pone.0237220. https://dx.plos.org/10.1371/journal.pone.0237220 .PONE-D-19-35191 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.Blok AC, Sadasivam RS, Amante DJ, Kamberi A, Flahive J, Morley J, Conigliaro J, Houston TK. Gamification to motivate the unmotivated smoker: the "take a break" digital health intervention. Games Health J. 2019 Aug;8(4):275–84. doi: 10.1089/g4h.2018.0076. http://europepmc.org/abstract/MED/31219347 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 136.Boyle SC, Earle AM, LaBrie JW, Smith DJ. PNF 2.0? Initial evidence that gamification can increase the efficacy of brief, web-based personalized normative feedback alcohol interventions. Addict Behav. 2017 Apr;67:8–17. doi: 10.1016/j.addbeh.2016.11.024. http://europepmc.org/abstract/MED/27978426 .S0306-4603(16)30416-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 137.Harris MA. Maintenance of behaviour change following a community-wide gamification based physical activity intervention. Prev Med Rep. 2018 Nov 3;13:37–40. doi: 10.1016/j.pmedr.2018.11.009. https://linkinghub.elsevier.com/retrieve/pii/S2211-3355(18)30266-3 .S2211-3355(18)30266-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 138.González-González C, Río NG, Navarro-Adelantado V. Exploring the benefits of using gamification and videogames for physical exercise: a review of state of art. Int J Interact Multimed Artif Intell. 2018 Sep;5(2):46–52. doi: 10.9781/ijimai.2018.03.005. [DOI] [Google Scholar]
- 139.Abdul Rahim MI, Thomas RH. Gamification of medication adherence in epilepsy. Seizure. 2017 Nov;52:11–14. doi: 10.1016/j.seizure.2017.09.008. https://linkinghub.elsevier.com/retrieve/pii/S1059-1311(17)30529-0 .S1059-1311(17)30529-0 [DOI] [PubMed] [Google Scholar]
- 140.Johnson D, Deterding S, Kuhn KA, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: a systematic review of the literature. Internet Interv. 2016 Nov;6:89–106. doi: 10.1016/j.invent.2016.10.002. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(16)30038-0 .S2214-7829(16)30038-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 141.Floryan M, Chow PI, Schueller SM, Ritterband LM. The model of gamification principles for digital health interventions: evaluation of validity and potential utility. J Med Internet Res. 2020 Jun 10;22(6):e16506. doi: 10.2196/16506. https://www.jmir.org/2020/6/e16506/ v22i6e16506 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 142.Sampat BH, Prabhakar B. Privacy risks and security threats in mHealth apps. J Int Technol Inf Manag. 2017;26(4):126–53. https://scholarworks.lib.csusb.edu/jitim/vol26/iss4/5/ [Google Scholar]
- 143.Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Privacy and security in mobile health apps: a review and recommendations. J Med Syst. 2015 Jan;39(1):181. doi: 10.1007/s10916-014-0181-3. [DOI] [PubMed] [Google Scholar]
- 144.Hutton L, Price BA, Kelly R, McCormick C, Bandara AK, Hatzakis T, Meadows M, Nuseibeh B. Assessing the privacy of mHealth apps for self-tracking: heuristic evaluation approach. JMIR Mhealth Uhealth. 2018 Oct 22;6(10):e185. doi: 10.2196/mhealth.9217. https://mhealth.jmir.org/2018/10/e185/ v6i10e185 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 145.Dehling T, Gao F, Schneider S, Sunyaev A. Exploring the far side of mobile health: information security and privacy of mobile health apps on iOS and Android. JMIR Mhealth Uhealth. 2015 Jan 19;3(1):e8. doi: 10.2196/mhealth.3672. https://mhealth.jmir.org/2015/1/e8/ v3i1e8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 146.Linardon J, Fuller-Tyszkiewicz M. Attrition and adherence in smartphone-delivered interventions for mental health problems: a systematic and meta-analytic review. J Consult Clin Psychol. 2020 Jan;88(1):1–13. doi: 10.1037/ccp0000459.2019-66487-001 [DOI] [PubMed] [Google Scholar]
- 147.Baumel A, Torous J, Edan S, Kane JM. There is a non-evidence-based app for that: a systematic review and mixed methods analysis of depression- and anxiety-related apps that incorporate unrecognized techniques. J Affect Disord. 2020 Aug 01;273:410–21. doi: 10.1016/j.jad.2020.05.011.S0165-0327(20)30769-2 [DOI] [PubMed] [Google Scholar]
- 148.Mohr DC, Weingardt KR, Reddy M, Schueller SM. Three problems with current digital mental health research . . . and three things we can do about them. Psychiatr Serv. 2017 May 01;68(5):427–9. doi: 10.1176/appi.ps.201600541. http://europepmc.org/abstract/MED/28412890 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 149.Baumel A, Edan S, Kane JM. Is there a trial bias impacting user engagement with unguided e-mental health interventions? A systematic comparison of published reports and real-world usage of the same programs. Transl Behav Med. 2019 Nov 25;9(6):1020–33. doi: 10.1093/tbm/ibz147.5613435 [DOI] [PubMed] [Google Scholar]
- 150.Kohl LF, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013 Jul 16;15(7):e146. doi: 10.2196/jmir.2665. https://www.jmir.org/2013/7/e146/ v15i7e146 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
Applied search strategies.
Data extraction sheet.
Intervention-related and patient-related factors influencing adherence by health domain.