Unpacking mHealth interventions: A systematic review of behavior change techniques used in randomized controlled trials assessing mHealth effectiveness

Short abstract

Objective

Mobile health interventions have surged in popularity but their implementation varies widely and evidence of effectiveness is mixed. We sought to advance understanding of the diversity of behavior change techniques in mHealth interventions, especially those that leverage advanced mobile technologies.

Methods

We conducted a systematic review of articles published between 2007 and 2017 in high-impact journals in medicine, medical informatics, and health psychology to identify randomized controlled trials in which the effectiveness of an mobile health intervention was tested. Search terms included a mix of general (e.g. mobile health), hardware (e.g. Android, iPhone), and format (e.g. SMS, application) terms.

Results

In a systematic review of 21 studies, we found the techniques of personalization, feedback and monitoring, and associations were most commonly used in mobile health interventions, but there remains considerable opportunity to leverage more sophisticated aspects of ubiquitous computing. We found that prompts and cues were the most common behavior change techniques used in effective trials, but there was notable overlap in behavior change techniques used in ineffective trials.

Conclusions

Our results identify techniques that are commonly used in mobile health interventions and highlight pathways to advance the science of mobile health.

Introduction

The ubiquity of mobile phones has generated immense opportunity for the delivery of innovative solutions to some of the most pressing healthcare problems, including prevention and treatment of chronic diseases. The term mobile health (mHealth) refers to the use of mobile and wireless devices to improve health and deliver care, and was first coined over a decade ago.¹ The introduction of the first iPhone in 2007 marked the beginning of a decade of technological advancements that have afforded increasingly interactive interventions for behavior change.² Between 2011 and 2018, smartphone adoption grew from 35% to 77% of Americans, and 95% own a mobile phone of some kind.³ Adoption remains high even among traditionally underserved populations, including in 70% of Medicaid recipients.⁴ High levels of mobile ownership suggest that a major advantage of mHealth initiatives is their wide accessibility.

mHealth is not only accessible but also holds great appeal for consumers. The number of installations of wellness and health applications (apps) has reached an estimated 3.35 billion⁵ worldwide. Although provider interest in mHealth has generally lagged patients’ enthusiasm, their attitudes have grown more positive and an increasing number of providers are incorporating digital health into their practice.⁶ In line with this, the market value of mHealth is projected to reach US$46 billion in 2020, almost double that of electronic health records.⁷

As the popularity of mHealth has surged, so too has the number of technologies and features leveraged by mobile interventions. Mobile interventions have become increasingly sophisticated in their technology and diverse in their approaches to changing and sustaining health behaviors. In many ways, this charge has been led by innovations in industry, with the development of apps targeting health behavior change outpacing scientific evidence⁸ and even theory.^9,10 In particular, little research has sought to summarize the characteristics of mHealth interventions in detail, and those that do often neglect some novel techniques that are growing in popularity with the affordances of advanced technology. Therefore, we endeavored to review over 10 years of research published in high-impact journals testing the effectiveness of mHealth for improving lifestyle behaviors and chronic condition management (CCM), summarizing the behavior change techniques (BCTs) they employed. In doing so, we sought to chart the evolution of increasing technological sophistication in mHealth, delve deeper into specific BCTs leveraged, and identify gaps in the literature.

Many systematic reviews have assessed the effectiveness of mHealth for a wide range of health behaviors and outcomes.^11–13 Meta-analyses have revealed that even simple text-messaging interventions can improve smoking cessation, weight loss, and medication adherence,^11,14–16 and that behavior change may persist after an intervention has stopped.¹⁷ Reviews of smartphone apps for health behavior change reveal similarly promising results for diabetes self-management,^18–20 weight loss,²¹ and management of other long-term conditions.²²

Although reviews of mHealth research have often supported its overall effectiveness, it is not uncommon to find only modest effect sizes,¹⁷ a persistent difficulty for participants to reach recommended health behavior guidelines despite progress in the right direction,¹⁸ or mixed evidence of effectiveness.^8,13,15,23

One reason for the range in effectiveness of mHealth interventions is that they differ in the types of BCTs used, ranging from reminders and self-tracking to more complex interventions that involve peers and team-based competitions. Consequently, some reviews have focused on understanding the specific BCTs applied in mHealth interventions and potential links to effectiveness.^14,24–26 However, existing taxonomies of BCTs may have been developed with in-person interventions and/or older technology in mind, missing out on some promising techniques that are made easier with advanced technology.²⁷ For example, gamification and context-aware interventions that dynamically adapt to an individual’s psychological state and environment in a given moment are increasingly viable and popular.^28–31 Although these new techniques are, in some respects, extensions of more traditional behavioral change approaches (e.g. rewards and feedback) that operate through similar mechanisms, they have evolved in response to the granular data that can more easily be collected from mobile technologies.

The literature underscores the diversity in mHealth interventions to improve lifestyle and CCM behaviors, and this diversity will only grow as more sophisticated technologies afford implementation of novel BCTs. The present research aims to extend these findings by summarizing characteristics of interventions targeting a broader range of health behavior and highlighting state-of-the-art technological applications to explore future directions for mHealth. Specifically, this paper aims to: (a) describe the change in technology being used in mHealth research, (b) summarize the BCTs being employed in randomized controlled trial (RCTs) with a focus on understanding the use of BCTs that can take advantage of increasingly sophisticated technology, and (c) compare commonly used BCTs in effective and ineffective trials published in high-impact journals.

Methods

We reviewed research published in the last decade to chart a period of advancement in mobile technologies from the release of the first-generation iPhone to today’s market in which smartphone capabilities and popularity have both surged. To this end, we conducted a systematic review of original research aiming to change lifestyle (e.g. weight loss) and CCM behaviors (e.g. controlling glucose) published in prominent medical, medical informatics, and health psychology journals.

Search strategy

Journals

Other reviews have identified over 500 publications² assessing the effectiveness of mHealth interventions and over 200 RCTs⁵ in particular. Given that we were interested in manually coding the specific BCTs used in different mHealth interventions, it was necessary to narrow the scope of the review to identify a practical number of studies that would nonetheless reflect what may be considered the state-of-the-art in mHealth. Therefore, we limited our scope to reviewing articles published in top journals to get a picture of the aspects of mHealth gaining traction in high-impact journals. We consulted Thomson Reuter’s Journal Citation Reports to identify the top 15 general medical journals with the highest impact factors. To identify these publications, we filtered impact factors for journals in the following categories: healthcare sciences and services; health policy and services; medicine, general, and internal; medical informatics; medicine, research, and experimental; nursing; primary healthcare; public, environmental, and occupational health; social sciences, biomedical. In addition to general medical journals, we identified the top two journals within the specialties of medical informatics and health psychology. Table 1 presents the 19 journals selected for review.

Table 1.

Journals selected for review.

Ranking	Journal
General medical
1	New England Journal of Medicine
2	The Lancet
3	JAMA: Journal of the American Medical Association
4	Nature Medicine
5	BMJ: British Medical Journal
6	Lancet Global Health
7	Annals of Internal Medicine
8	Science Translational Medicine
9	JAMA Internal Medicine
10	Journal of Managed Care Pharmacy
11	Annual Review of Medicine
12	Journal of Clinical Investigation
13	Journal of Experimental Medicine
14	PLOS Medicine
15	MMWR: Morbidity and Mortality Weekly Report
Medical informatics
1	Journal of Medical Internet Research
2	Journal of the American Medical Informatics Association
Health psychology
1	Health Psychology
2	Psychology & Health

Search terms

Search terms were generated after consulting previously published mHealth reviews.^15,26,32 The search terms captured keywords reflecting general terms related to mHealth, and search terms specific to hardware and medium of delivery (see Table 2).

Table 2.

Search terms used.

Category	Terms
General search terms	“mHealth,” “mobile health,” “mobile phone,” “mobile tech*”
Hardware search terms	“Android,” “blackberry,” “cell phone,” “cellular phone,” “cellphone” “iPad,” “iPhone,” “PDA,” “personal digital assistant,” “smartphone,” “tablet”
SMS search terms	“sms,” “text messag*”
App search terms	“app,” “mobile app,*” “smartphone app*”

Given the extensive number of mHealth-related studies published in Journal of Medical Internet Research, we qualified the search within this journal by including terms narrowing our search to randomized controlled trials (RCTs).

Selection criteria

Interventions and outcomes

Randomized controlled trials in which randomization occurred at the individual or cluster (e.g. hospital) level were included. Only studies in which mHealth tools and features were the primary intervention under evaluation were included. Studies with telehealth interventions that could have been delivered strictly by landline (e.g. coaching delivered via phone calls) without any wireless components were excluded. Similarly, interventions that were primarily web-based such as those that required participants to log behavior on a website accessed by computer, with little mobile component, were also excluded. Comparators could involve usual care or any type of intervention (another behavior change intervention, etc.). Some interventions included both mobile- and web-based or in-person components. In such cases, studies were included if more of the BCTs were delivered via the mobile components (e.g. texting, app-based tracking).

Studies were included if the primary outcome of interest reflected self-reported or objectively measured lifestyle change (physical activity, weight loss) or CCM. Conditions related to mental health (e.g. depression, anxiety, substance use including smoking) were excluded from this review although we acknowledge their importance to physical health outcomes and CCM.

Studies were first screened by title and abstract to identify whether they were RCTs testing the effectiveness of mHealth on behavior change in relation to our outcomes of interest. Many articles at this stage were excluded because the study assessed the validity or usability of a particular mHealth tool. Articles that were deemed relevant based on title and abstract were read and screened further. At this stage, studies were often excluded because they tested the effectiveness of a telehealth intervention rather than an mHealth intervention.

Data extraction and coding of BCTs

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for data extraction were followed.³³ A research assistant and the first author independently extracted information about study background (year, authors, etc.), sample (eligibility criteria, number of participants, etc.), intervention(s) and comparator(s), and outcomes (primary and secondary).

BCTs were coded using an established taxonomy of 93 techniques hierarchically organized into 16 higher-order categories and, within those, 93 lower-order categories.²⁷ The 16 higher-order categories consist of a wide-ranging set of BCTs including social support (lower-order categories include emotional support), natural consequences (e.g. information about health consequences), associations (e.g. prompts/cues), and reward and threat (e.g. material incentive for behavior). Two coders were trained on the taxonomy using available online materials³⁴ and independently coded each article. A third coder (the first author) reviewed these codes and resolved discrepancies. If an article cited another publication for details about the intervention or comparator protocols, that publication was also reviewed for coding. All BCTs used in mHealth intervention arms were initially coded, including those that were delivered in person. However, we summarized results for intervention arms to only include BCTs that were directly implemented (e.g. reminders sent by text) with or facilitated by (e.g. tailored coaching sessions based on data collected via an app) mobile technologies. This was to highlight the unique features leveraged by mobile technologies in the interventions rather than components that could be delivered in traditional intervention models.

Finally, we supplemented the BCT taxonomy with two additional higher-order categories intended to capture techniques common in mHealth interventions: personalization and gamification. Personalization captured information about the extent to which interventions or messaging was tailored to the participant. We included an additional category for personalization to reflect the trend towards greater tailoring and customization in sophisticated smartphone-based interventions as seen in just-in-time adaptive interventions (JITAIs) and others.^29,30 Gamification refers to integrating game mechanisms into non-game contexts, such as using leaderboards and point systems that reward certain behavior.²⁸ Gamification is also becoming an increasingly popular feature of mHealth interventions³⁵ and we included a unique category for this in our BCT coding to better capture its use.

In some cases, personalization and gamification techniques overlapped with other BCTs included in the original BCT taxonomy (e.g. use of non-material rewards), but we nonetheless found that inclusion of additional gamification categories led to more comprehensive coding and insights given its popularity in mHealth applications. Moreover, several codes in the BCT taxonomy are overlapping (e.g. restructuring social environment and avoiding/reducing exposure to cues for the behavior); therefore, we did not consider that the additions were inconsistent with its application. The full list of personalization and gamification techniques are available in Table 3.

Table 3.

Newly proposed behavior change technique (BCT) categories.

No.	Label	Definition	Examples
17. Personalization
17.1	Tailoring to demographic characteristics	Tailors messaging or other intervention content to the participant’s demographic information.	Text messages reference patient by their name.
17.2	Tailoring to health status	Tailors messaging/intervention content to the participant’s initial health status.	Text message content differs based on whether patient is smoker or non-smoker.
17.3	Tailoring to psychological characteristics	Tailors messaging/intervention content to the participant’s psychological characteristics/traits.	Text messages differ in content depending on the motivational readiness of the participant.
17.4	Adjusting intervention content to performance	Adjusting messaging/intervention content based on current performance	Adjusting step goals based on preceding week’s steps achieved.
17.5	General/Not Enough Detail	General coding category when personalization details are not specified.
18. Gamification
18.1	Earn points	Performing behavior or achieving desired outcomes earns points.	Earn points for every 500 steps/
18.2	Earn badges/levels	Reaching specific goals earns participants a badge or ‘level’ up.	Earning badge for walking up 10 flights of stairs in one day.
18.3	Leaderboards	Performance relative to others is displayed. Note: Should also code 6.2, social comparison.	App displays where participants rank in total number of steps for the week.
18.4	Competitions	Participants compete against one another to perform the most healthy behavior/earn the most points. Competitions are different from informal social comparison opportunities, and include a defined period for competition, defined competitors, and defined behaviors or outcomes assessed for the competition Note: Should also code 6.2, social comparison.	Teams of employees compete with each other to log the most steps in a month.

Plan of analysis

We anticipated that the variability in employed BCTs would not afford a formal quantitative analysis, therefore all planned analyses consisted of descriptive summaries of the included articles. To address Aim 1, we planned to summarize the technology leveraged in intervention arms including SMS, personal digital assistants (PDAs), apps, and wearables. To address Aim 2, we planned to summarize the use of higher- and lower-order BCTs used in intervention and comparator arms. When summarizing BCTs in the intervention arms, we focused on those that were deployed using mobile technologies, although all were initially coded. Finally, planned analyses for Aim 3 involved descriptively classifying effectiveness according to reporting of statistically significant improvements in an article’s primary outcome(s) in intervention arms over comparator arms. We then planned to summarize the common BCTs leveraged in the intervention arms of studies classified as effective and ineffective for descriptive comparison. Although this approach is not a conclusive summary of evidence, it has been used in other reviews to provide an overview of findings that can characterize the state of research in mHealth²³ and other medical domains.^36,37

Results

Search results and study selection

Search results and study selection are summarized according with the PRISMA flowchart in Figure 1. After screening for relevance, 21 RCTs were included in the review ranging in publication date from 2008–2017. Reflecting the surging interest in mHealth, 14 of 21 studies (67%) were published in the latest 5 years included in our review, 2013–2017.

Figure 1.

Flowchart depicting search results and article exclusion.

Outcome and sample characteristics

Primary outcomes of each study were summarized to understand which lifestyle and CCM behaviors and outcomes were most frequently studied in mHealth research (see Table 4 for summaries of articles). The most common behavior targeted was physical activity (k = 5) whereas the most common health outcome targeted was weight change (k = 5), both of which are important in preventing and managing a wide range of health conditions. In addition to exploring what behaviors and outcomes were targeted in mHealth research, we were interested in understanding who is often targeted for lifestyle and CCM behavior change. Therefore, we summarized the targeted populations in the RCTs based on health-related eligibility criteria. The most frequently targeted population was patients diagnosed with chronic conditions (40.1% of articles) but overweight and obese persons (22.7% of articles) were also targeted in a substantial number of studies. Although a majority of studies recruited patients with a medical condition, nearly one-third of studies (32.2%) recruited participants with no medical condition to target lifestyle behaviors.

Table 4.

Summary of articles reviewed.

Outcome category	Article	Sample criteria	N	Comparator(s)	Intervention(s)	Tech	Primary outcomes	Secondary outcomes
Physical Activity	Direito et al. (2015)	Healthy 14–17-year olds	51	Usual behavior	Intervention 1: nonimmersive app (get running) Intervention 2: immersive app (Zombies, Run)	App	Cardiorespiratory fitness (time to complete 1 mile run/walk test)	1. PA levels (accelerometry and self-reported), 2. PA Enjoyment, 3. Psychological need satisfaction, 4. PA Self-efficacy, 5. Acceptability and usability of the app
	Mistry et al. (2015)	General adults	337		Intervention 1: Generic text messages about PA Intervention 2: Generic text messages about action planning for PA Intervention 3: Tailored text messsages about action planning for PA	SMS	Physical activity over previous 7 days (self-report)	1. Quantity of action plans, 2. Quality of action plans
	Patel et al. (2017)	Adults in Framingham Heart Cohort (with family member in cohort as well)	200 adults, 94 families		Intervention 1: Tracking daily step counts with wearable device/smartphone, step goals, daily feedback by text or email Intervention 2: Intervention 1+ gamification earning points and progress through levels based on physical activity goal achievement	App	Proportion of participant-days that step goals were achieved during intervention	1. Proportion of participant-days step goals achieved during follow-up period, 2. Change in mean daily steps during intervention and follow-up
	Prestwich et al. (2009)	General young adults (students at university)	155	Comparator 1: completed survey measures, nothing else Comparator 2: read a motivational messaged to manipulate components of PMT Comparator 3: PMT message + formed implementation intentions	Intervention 1: PMT message + SMS text reminders to exercise Intervention 2: PMT message + Implementation intentions + SMS	SMS	PA (self-report, sustained for at least 20–30 mins)	Motivation
PA (cont’d)	Prestwich et al. (2010)	Inactive adults	149	Reading information about being active	Intervention 1: information +  implementation intentions + SMS reminders about plan Intervention 2: information +  implementation intentions + SMS goal reminder	SMS	No. of days walked briskly/fast > 30 mins (self-reported)	1. No. of days exercised brisk/fast > 30mins, 2. Implementation and goal recall, 3. Weight, 4.Waist-to-hip ratio
Medication Adherence	Lester et al. (2010)	HIV	538	Standard care	Weekly SMS messages from a clinic nurse that required a response within 48 h	SMS	1. Self-reported ART adherence 2. Plasma HIV-1 viral RNA load suppression	Rate of attrition
	Liu et al. (2015)	Tuberculosis	4173	Standard care selected by patient/doctor per National TB Control Program	Intervention 1: SMS reminding patient to take medication, reminding patient of the monthly dispensing visit Intervention 2: medication monitor reminding patient to take medication and reminding patient of the monthly dispensing visit Intervention 3: combined SMS and medication monitor	SMS	Poor medication adherence (percentage of patient-months in which a patient missed at least 20% of doses)	1. Percentage of doses missed over the whole treatment period, 2. Percentage of patients who missed at least 10% of their doses
	Mira et al. (2014)	Multimorbid patients taking multiple medications (older than 65 years)	99	Oral and written information on safe use of their medications	Use of medication self-management app	App	1. Missed doses 2. Medication errors	1. Level of independence, 2. Self-perceived health status, 3. Biochemical test results
Composite Lifestyle Measures	Pfaeffli Dale et al. (2015)	Coronary heart disease	123	Center-based cardiac rehabilitation (usual care)	Comparator + personalized mHealth program with daily SMS text messages and supporting website	SMS	Adherence to healthy lifestyle behaviors (self-reported composite)	1. Blood pressure, 2. Lipid profile, 3. Weight, 4. BMI, 5. Waist-to-hip ratio, 6. Medication adherence score, 7. Self-efficacy, 8. Illness perceptions, 9. Anxiety and/or depression
Composite Lifestyle Measures (cont’d)	Spring et al. (2012)	Adults with elevated saturated fat and low fruit and vegetable intake, high sedentary leisure time, and low physical activity	200		Intervention 1: health coaching for increasing fruit/vegetable intake and PA + tracking + incentives; Intervention 2: HC for decreasing fat and sedentary leisure + tracking + incentives Intervention 3: HC for decreasing fat intake and increasing PA + tracking + incentives Intervention 4: HC for increasing fruit/vegetable intake and decreasing sedentary leisure + tracking + incentives	PDA	Composite Diet-Activity Improvement (self-report)	1. Sedentary Leisure (min), 2. PA (min), 3. Fruits and Vegetables (servings), 4. Calories from Saturated Fat (%)
Weight/BMI	De Niet et al. (2012)	Overweight and obese children (7–12 years old)	141	Big Friends Club Lifestyle intervention	BFC lifestyle intervention + send weekly self-monitoring data on relevant parameters + (tailored) feedback + open-ended communication (as needed)	SMS	BMI	Drop-out
	Jakicic et al. (2016)	BMI 25–40	351	Low calorie diet, prescribed physical activity, group counselling sessions + web-based self-monitoring of diet and physical activity with website at 6 mths	Low calorie diet, prescribed physical activity, group counselling sessions + wearable device and accompanying web interface to monitor diet and physical activity	Wearable	Weight change	1. BMI, 2. Fat Mass, 3. Lean Mass, 4. Body fat %, 5.Bone Mass, 6. Total body bone mineral density, 7. Cardiorespiratory fitness
	Laing et al. (2014)	BMI > 25	212	Usual care	Use of MyFitnessPal app	App	Weight change	1. Systolic blood pressure, 2. Healthy diet in past 7 days, 3. Physical activity in past 7 days, 4. Exercise sessions in past 7 days, 5. Self-efficacy in achieving weight loss goal, 6. Self-efficacy in making healthy food/exercise choices, 7. Frequency of app use, 8. Satisfaction
Weight/BMI (cont’d)	Spring et al. (2013)	BMI 25–40	69	MOVE group sessions	MOVE sessions + PDA tracking + goal monitoring + individualized coaching	PDA	Weight change at 6 months	Weight change at 12 months
	Turner-McGrievey & Tate (2011)	BMI 25–45	96	Educational podcast	Educational podcast + diet and physical activity monitoring app + interactions with counselors via Twitter	App	Weight change	1. Intentional physical activity change, 2. Change in energy intake, 3. Change in fat intake, 4. Change in weight-loss self-efficacy, 5. Change in weight-loss knowledge, 6. Change in eating behaviors
HbA1c	Kirwan et al. (2013)	Type 1 diabetes	53	Usual Care	Use of Glucose Buddy app, weekly text message feedback from diabetes educator	App	HbA1c change	1. Diabetes-related self-efficacy, 2. Quality of life, 3. Self-care
	Wayne et al. (2015)	Type 2 diabetes	131	Health coaching	Health coaching + Connected Wellness Platform (goal setting and progress monitoring)	App	HbA1c change	1. Weight, 2. BMI, 3. Waist circumference, 4. Satisfaction with Life, 5. Anxiety and Depression, 6. Positive and Negative Affect, 7. Short Form Health Survey
Other	Chow et al. (2015)	Coronary heart disease	710	Usual care (typically community follow-up with majority referred to inpatient cardiac rehabilitation)	Tobacco, Exercise and Diet Message (TEXT ME) trial: 4 text messages/wk for 6 months tailored to baseline characteristics	SMS	Plasma LDL-C	1. Systolic blood pressure, 2. BMI, 3. Total cholesterol level, 4. Waist circumference, 5. Heart rate, 6. Total physical activity, 7. Smoking status, 8. Proportion achieving combined risk factor control
Other (cont’d)	Ryan et al. (2012)	Asthma	288	Education session + clinical care + paper monitoring	Education session + clinical care + paper monitoring + Twice daily recording and mobile based transmission of symptoms, drug use, and peak flow with immediate feedback	App	1. Asthma control (self-report) 2. Asthma self-efficacy	1. Mini-asthma quality of life, 2. Adverse medical events, 3. Prescriptions of asthma drugs 4. Modified patient enablement, 5. Proportion of patients defaulting from clinical follow-up
	Shet et al. (2014)	HIV	631	Standard care based on national guidelines	Customized, interactive, automated voice reminders, and pictorial message sent weekly	SMS	Time to virological failure	1. ART adherence measured by pill count, 2. Death rate, 3. Attrition rate
	Elbert et al. (2016)	General adult population (> 16 years)	146	Comparator: Usual behavior, only completed pro- and post-intervention surveys	Intervention: monthly text-based or audio-based tailored health information and feedback delivered via mobile app	App	1. Fruit intake 2. Vegetable intake

Shade represents effectiveness of study. Red = no difference between comparator(s) and intervention(s) or worse performance of interventions on study’s primary outcome(s), green = intervention(s) yielded significant improvements on primary outcome(s) compared to comparator(s), yellow = mixed effects of the interventions on primary outcome(s), and no shade = no direct comparison between an mHealth intervention and comparator (i.e. all groups involved some mHealth component).

App: application; PDA: personal digital assistant; PA: physical activity; PMT: protection motivation theory; ART: antiretroviral therapy; HC: health coaching; BMI: body mass index.

Intervention and comparator characteristics

Mobile technologies

With the release of the first-generation iPhone in 2007, we sought to understand how the technologies used in mHealth interventions have evolved in the last decade. Overall, the use of SMS (k = 9, 42.9%) and apps/wearables (k = 10, 47.6%) were nearly evenly split with the remaining studies using PDAs (k = 2, 9.5%) as the form of technology for the intervention. As expected, the adoption of apps in mHealth interventions grew in the later years of publication. Of the six articles published in the years 2007–2012, only one study tested the effectiveness of an app or wearable, four studied effects of SMS interventions, and one employed PDAs. In contrast, nine of 15 articles published in the years 2013–2017 studied the effectiveness of apps or wearables for improved health behavior and outcomes. Still, seven studies also examined the effects of SMS-based interventions, suggesting that simpler health interventions delivered by text remain popular.

Lower-order BCT summary

Of greatest interest to our review, there were considerable differences in the use of BCTs across comparator (n = 20) and intervention arms (n = 32). It should be noted that seven comparator arms were described as “usual care” for which there was insufficient information to reliably code the use of BCTs. Considering the 93 lower-order categories, intervention arms employed (M = 5.16, SD = 2.62) more BCTs than did comparator arms (M = 2.15, SD = 2.08), t(50) = 4.34, p < .001. The most frequently used BCTs in the intervention arms included self-monitoring behavior (50.0% of arms), feedback on behavior (46.9% of arms), and adjusting intervention content to performance (40.6%). In comparator arms, self-monitoring of behavior (20.0%) and feedback on outcomes of behavior (20.0% of arms) were the most common BCTs applied.

Higher-order BCT summary

To enhance comprehension and meaningfulness of comparisons between comparator and intervention arms, we also summarized implementation of BCTs at the higher-order level, providing information about the 18 overarching categories (see Figure 2). These comparisons revealed how popular BCTs are often implemented in both mHealth and comparator arms but also highlighted differences that reflected the unique strengths of mobile-based interventions. For example, feedback and monitoring (35.0% of comparators, 71.9% of interventions) and goals and planning (25.0% of comparators, 46.9% of interventions) ranked among the most frequently used in both types of arms, although they were still much more common in the intervention arms. In contrast, personalization was much more frequently leveraged in interventions (78.1%) than comparators (5.0%) as was the use of associations (59.4% vs. 5.0% of arms) such as reminders.

Figure 2.

Summary of higher-order behavior change techniques (BCTs) used in comparator and intervention arms.

These differences in prevalence reflect the flexibility in mobile technologies to easily adapt content and automate delivery of interventions, offering advantages over print and in-person interventions. Where goal-setting and self-monitoring can be implemented in a wide range of settings, personalization and associations such as reminders are more easily facilitated by advances in mobile technology. Somewhat unexpectedly, gamification was only used in 6.3% of intervention arms despite enthusiasm for its potential in mHealth.³¹ This might reflect broader trends in delayed adoption of many of the more sophisticated features of mobile technology. In line with this, personalization was typically simplistic in its execution including tailoring to demographic information,³⁸ health status (e.g. smoker or non-smoker),³⁹ and time of notifications.⁴⁰ Nonetheless, developments in JITAIs are increasingly allowing for greater complexity in tailoring mobile-based interventions.^30,41,42

Effectiveness

We based this summary on findings from 18 studies in which mHealth interventions were compared against interventions or usual care that did not use mobile technologies, excluding three studies in the review that compared effectiveness of different mHealth interventions against each other.^35,43,44

The summary of these 18 studies suggests that evidence of mHealth effectiveness remains inconclusive: eight studies (44.4%) reported non-significant differences improvements in intervention arms compared to comparator arms, six (33.3%) reported significant improvements, three reported a significant difference for at least one, but not all, primary outcomes (16.7%), and one study found that outcomes in the intervention arm were worse than those in the comparator arm (5.6%).

For further insight into why some interventions yield significant improvements over comparators but not others, we examined the top five BCTs used in the intervention arms of effective (six studies, eight arms) studies and those of studies finding that mHealth interventions were ineffective or detrimental (nine studies, 10 arms). As illustrated in Table 5, a wide range of BCTs were implemented in effective studies with only the use of prompts or cues appearing in most arms. In addition, BCTs frequently used in ineffective studies are generally well supported in health behavior change literature,^45–47 suggesting a need for better understanding of best practices to implement such techniques with mobile technology.

Table 5.

Ranking of behavior change techniques (BCTs) used in effective and ineffective studies.

Ranking	BCT	% of arms
Effective studies
1	Prompts/cues	87.5
2	General personalization	50.0
3	Goal setting (behavior)	37.5
4	Action planning	37.5
Ineffective studies
1	Self-monitoring of behavior	70.0
2	Social support (unspecified)	60.0
3	Feedback on behavior	50.0
4	Prompts/cues	40.0

Discussion

Summary of findings

mHealth interventions to improve lifestyle behaviors and CCMs have surged in the last decade and are leveraging increasingly sophisticated technology. Although SMS-based mobile interventions remained prominent, our findings suggest mHealth is progressively moving toward implementation of apps and wearable interventions. Our review also found that mHealth is being applied to address a diversity of lifestyle behaviors and health outcomes, reflecting its adaptability to different content and health domains. Our review sheds light on the BCTs commonly being used in mHealth interventions, finding frequent use of personalization, feedback and monitoring, prompts and cues, and goals and planning. Similar BCTs were also found to be common in reviews of mHealth interventions targeting physical activity and sedentary behavior,²⁶ commercially available apps for physical activity,⁴⁸ and apps for medication adherence.⁴⁹

There was a moderate amount of overlap in the BCTs used in mHealth interventions and comparators consisting of in-person or paper-based interventions. Nonetheless, frequent usage of personalization in intervention arms highlighted some of the unique strengths of mobile technologies. Moreover, the prominence of personalization underscores the benefit to its inclusion in existing taxonomies of BCTs, particularly as personalized adaptation is increasingly feasible with evolving technology and analytics. More generally, our findings suggest that current taxonomies may benefit from broadening their consideration of BCTs from traditional approaches in the psychological and public health literature to include approaches that have emerged from industry and technology-focused fields. Although it remains to be seen if such techniques yield additional benefit beyond those already well established in the behavior change literature, incorporation into existing frameworks would better enable such comparisons.

Consistent with other reviews that found mixed effectiveness of mHealth,^13,15,23 results also suggested there remains a need to optimize use of many common BCTs for better outcomes. To this end, there are opportunities to leverage more sophisticated wireless technologies including optimizing self-monitoring with automated sensors, finding more effective means of providing online social support, and designing more meaningful feedback mechanisms based on real-time data.

Limitations

There are several limitations of this review worth noting. The review focused on RCTs published in top journals to provide a snapshot in the evolution of the technology and behavioral change techniques being applied in mHealth. As a result, this review is not a comprehensive assessment of mHealth for lifestyle management or CCM. Despite this limitation, our review contributes to the literature by exploring the potential utility of incorporating new BCTs that can more fully leverage the strengths of mobile technologies into an existing taxonomy. It also extends reviews that focused on a narrower set of outcomes,²⁶ focused on commercial apps,^48,49 or reviewed the broader mHealth literature without examining differences in BCTs or other intervention characteristics in detail.^12,23 In addition, our review focused on comparing the BCTs in intervention arms that were delivered by mobile technologies to the BCTs in comparator arms. This was to highlight the uniquely mobile aspects of mHealth interventions but, as a result, our review may miss the importance of pairing mHealth with in-person or paper-and-pencil interventions for effectiveness. Future reviews may examine this possibility for additional insights.

There are also some limitations of the BCT taxonomy approach used to summarize intervention characteristics. This taxonomy allows for coding of different BCTs but does not assess the intensity or dosage of interventions. Consequently, an intervention that sends participants a reminder about their step goal once a month is equivalent to an intervention that sends participants a reminder once a week. Similarly, the taxonomy does not capture information about the content of the BCTs. As such, studies that use the same BCTs in multiple arms that target different behaviors (e.g. increasing fruit and vegetable intake vs. reducing fat intake)⁴⁴ or use different framing (e.g. approach vs. avoidance) are not described well by this taxonomy. Still, the taxonomy provides an excellent starting point to systematically describe mHealth interventions, which are frequently discussed in similar terms despite their substantial diversity. In future, systematic reviews adopting this taxonomy to summarize health behavior change interventions may try to incorporate some of this missing contextual information by introducing methods of classifying dosage, framing, and other characteristics.

Implications and future opportunities

This review highlights the need to provide details about the specific BCTs being leveraged in interventions and comparator arms to facilitate systematic comparisons across wide-ranging mHealth studies. In addition, findings also underscore the need to systematically vary applications of different BCTs across interventions for further insights into best practices. Current mHealth interventions typically bundle a multitude of BCTs together, making it difficult to discern what features drive success or failure. Finally, persistently mixed evidence of effectiveness suggests a need to better understand the heterogeneity of treatment effects in mobile interventions. Studies finding that individuals with different personality characteristics differentially benefit from mHealth treatments^50,51 point to a need to move beyond “one-size-fits-all” interventions. Although the promise of mHealth has not yet been fully realized, future research may provide insight into how to target the right people with the right type of intervention in a clinical setting for better outcomes.

Conflict of interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Contributorship

MD directed the initial research plan, served as lead author, mediated discussions about the merit of abstracts/articles, trained research assistants for coding of the articles, reconciled discrepancies in coding, and performed statistical analysis. GG contributed to development of the research questions and plan, provided input in discussions about the merit of abstracts/articles, suggested approaches to the analysis and reporting of results, and reviewed/edited drafts of the manuscript. RA served as a subject matter expert due to her research in digital health and provided meaningful contribution to forming the research questions, search strategy, and writing of the manuscript.

Ethical approval

This research involved no human or animal subjects and therefore was not required to undergo ethical review by an Institutional Review Board.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Guarantor

MD

ORCID iD

Michelle Dugas https://orcid.org/0000-0003-1400-4515

Peer review

This manuscript was reviewed by reviewers who have chosen to remain anonymous.