Skip to main content

Some NLM-NCBI services and products are experiencing heavy traffic, which may affect performance and availability. We apologize for the inconvenience and appreciate your patience. For assistance, please contact our Help Desk at info@ncbi.nlm.nih.gov.

JMIR mHealth and uHealth logoLink to JMIR mHealth and uHealth
. 2021 Dec 10;9(12):e25129. doi: 10.2196/25129

Behavioral Theories and Motivational Features Underlying eHealth Interventions for Adolescent Antiretroviral Adherence: Systematic Review

Alemitu Mequanint Bezabih 1,, Kathrin Gerling 1, Workeabeba Abebe 2, Vero Vanden Abeele 1
Editor: Lorraine Buis
Reviewed by: Sherif Badawy, Lisa Kuhns
PMCID: PMC8709919  PMID: 34890353

Abstract

Background

eHealth systems provide new opportunities for the delivery of antiretroviral therapy (ART) adherence interventions for adolescents. They may be more effective if grounded in health behavior theories and behavior change techniques (BCTs). Prior reviews have examined the effectiveness, feasibility, and acceptability of these eHealth systems. However, studies have not systematically explored the use of health behavior theories and BCTs in the design of these applications.

Objective

The purpose of this review was to explore whether health behavior theories and BCTs were considered to ground designs of eHealth systems supporting adolescents’ (10-24 years) ART adherence. More specifically, we examined which specific theories and BCTs were applied, and how these BCTs were implemented as design features. Additionally, we investigated the quality and effect of eHealth systems.

Methods

A systematic search was performed on IEEE Xplore, ACM, ScienceDirect, PubMed, Scopus, and Web of Science databases from 2000 to 2020. Theory use and BCTs were coded using the Theory Coding Scheme and the Behavior Change Technique Taxonomy version 1 (BCTTv1), respectively. Design features were identified using the lenses of motivational design for mobile health (mHealth). The number of BCTs and design features for each eHealth system and their prevalence across all systems were assessed.

Results

This review identified 16 eHealth systems aiming to support ART adherence among adolescents. System types include SMS text message reminders (n=6), phone call reminders (n=3), combined SMS text message and phone call reminders (n=1), electronic adherence monitoring devices (n=3), smartphone apps (n=1), smartphone serious games (n=1), gamified smartphone apps (n=1), leveraging existing social media (n=2), web-based applications (n=1), videoconferencing (n=1), and desktop applications (n=1). Nine were grounded in theory, of which 3 used theories extensively. The impact of adolescent developmental changes on ART adherence was not made explicit. A total of 42 different BCTs and 24 motivational design features were used across systems. Ten systems reported positive effects on 1 or more outcomes; however, of these ten systems, only 3 reported exclusively positive effects on all the outcomes they measured. As much as 6 out of 16 reported purely no effect in all the outcomes measured.

Conclusions

Basic applications (SMS text messaging and phone calls) were most frequent, although more advanced systems such as mobile apps and games are also emerging. This review indicated gaps in the use of theory and BCTs, and particularly the impact of developmental changes on ART adherence was not adequately considered. Together with adopting a developmental orientation, future eHealth systems should effectively leverage health theories and consider developing more advanced systems that open the door to using BCTs more comprehensively. Overall, the impact of eHealth systems on adolescent ART adherence and its mediators is promising, but conclusive evidence on effect still needs to be provided.

Keywords: HIV, adolescents, ART adherence, eHealth, health theories, behavior change techniques, motivational design principles

Introduction

Background

HIV disproportionately affects adolescents worldwide (an extended definition covering ages 10-24 [1] is used here). AIDS is the first cause of death among adolescents in Africa and the second worldwide [2]. There is no cure for HIV yet. However, antiretroviral therapy (ART) is an effective measure to control HIV if properly adhered to. Unfortunately, suboptimal ART adherence is common among adolescents with HIV. While there is an overall improvement in other age groups in the epidemic control of HIV, when compared with other age categories [3], adolescents are characterized by (1) higher treatment dropout rate [4,5], (2) lower viral suppression achievement [6], (3) rising AIDS-related illnesses [5], and (4) a smaller decrease in AIDS-related deaths.

While adolescents share several barriers to ART adherence with adults [7], there are also challenges unique to adolescents that further complicate adherence [8-12]. Some of these challenges emerge from the unique developmental changes associated with adolescence, including biological, cognitive, and psychosocial changes [13-19]. Adolescence is a period of cognitive maturation; however, this is a gradual process, and (younger) adolescents are still limited in formal and hypothetical thinking [17]. In periods of stress, even older adolescents may regress to simplistic preformal reasoning. Consequently, they may not foresee the long-term importance of ART adherence and underestimate the severity of the HIV condition and the susceptibility of facing nonadherence consequences [20]. This in turn can lead to risk-taking behaviors. Additionally, adolescence is a period of becoming autonomous in which control over their own lives is paramount [21]. Therefore, threats to personal agency, for example, impositions from health professionals, requesting to comply with ART, are likely met with psychological reactance, an aversive response, possibly resulting in nonadherence. Adolescence is also a developmental period characterized by an orientation toward the peer group and the need to conform [22]. Because of the need to maintain appearances and fit in with their peers, and possibly engage in sexual relations [8], adolescents may choose to hide or even completely deny having HIV, especially if the disease is asymptomatic. As an unfortunate consequence, nonadherence to ART and death rates among adolescents living with HIV are disconcerting.

Prior Work

In the last decade, the availability of eHealth systems has dramatically increased [23]. eHealth refers to health services, information, and support that are delivered or enhanced through web-based technologies and related software applications [24], including SMS text messaging, web-based applications, social media, mobile apps, and games. eHealth interventions are also increasingly being used to improve ART adherence, and integrated into HIV self-management and service delivery [25-28]. Overall, eHealth is considered a promising approach to deliver effective interventions for ART treatment, for both adult [29-32] and adolescent groups [27,33-35].

ART adherence is a complex health behavior determined by multiple sociobehavioral factors, and for adolescents, further complicated by unique developmental changes at the biological, social, and psychological level. Prior reviews of eHealth ART adherence systems for adolescents have examined the effectiveness, feasibility, and acceptability [33-36] and found that such systems have generally encouraging impact. Similar findings have also been synthesized for other chronic health conditions [34,37-39]. However, to the best of the authors’ knowledge, no reviews have systematically explored the extent to which health behavior theories ground the intervention, guide the selection of behavior change techniques (BCTs), or inform the design features in the app itself. This is surprising, as several studies suggest that grounding the design of eHealth systems in theory is associated with increased effectiveness [40-42]. Specific to HIV, recent systematic reviews also revealed that, for adults, designing eHealth systems based on behavioral theory is associated with efficacy in improving adherence to HIV medication [30].

Health behavior theories may provide a comprehensive understanding of adolescent’s adherence behavior and its determinant factors [43]. A number of theories are already applied to model HIV medication adherence [44], including the Health Belief Model [45], Information–Motivation–Behavioral Skills Model [46,47], Social Cognitive Theory [48], Theory of Reasoned Action [49], Theory of Planned Behavior [50], and Transtheoretical Model [51]. Therefore, health behavior theories can provide insights on achieving behavior change, and hence could support the design of eHealth systems that specifically consider adolescent adherence behavior.

Derived from the aforementioned theories and models, several behavior change strategies exist that may influence, motivate, or persuade people to adhere to healthy behaviors. These strategies are organized into taxonomies such as the Behavior Change Technique Taxonomy version 1 (BCTTv1) of Michie et al [52] or Cialdini’s influence techniques [53]. Systematic reviews also revealed that using such specific techniques facilitate behavior change, and are associated with efficacy in improving adherence to HIV medication [30]. Note that while these frameworks are applied to clinical practice, they are still technology agnostic. They apply to human-delivered interventions, first and foremost.

Hence, for eHealth interventions, such BCTs still need translation into designed features of a delivery platform. Also here, frameworks exist to guide researchers, such as Fogg’s persuasive principles [54,55], persuasive system design principles of Oinas-Kukkonen and Harjumaa [56], lenses of motivational design for mHealth features by Geuens et al [57], or taxonomies of gamification elements [58-60]. Different from the BCTs, these necessitate and describe features of a technology-enabled intervention. Despite their applied nature, here too, research has shown the need for design considerations to be based on health behavior change theories [40,42,61].

In sum, designing an eHealth intervention implies a 3-stage process: (1) understanding health behaviors through insight from appropriate theories, (2) defining appropriate BCTs as elements of the intervention, and (3) a translation into designed features for a chosen eHealth platform [42,57,62]. An illustration of this pipeline is given in Figure 1. Ideally, step 3 (designing features) is proceeded by steps 1 (understanding through theory) and 2 (specifying BCTs) [57]. However, this is not a mandate and researchers/app designers may jump to step 3 directly [42]. Considering this design pipeline perspective, it is therefore interesting to investigate whether theories matter for quality and impact of eHealth interventions for ART adherence of adolescents as well [42].

Figure 1.

Figure 1

A stepwise design process of e-Health behavioral interventions. BCT: behavior change technique; PSD: Persuasive Systems Design.

Research Objectives

The purpose of this systematic review is to assess the extent to which studies implement the different steps of this pipeline (health behavior theory > BCT > designed features) and how this is related to the quality and impact of eHealth systems to promote adolescents’ ART adherence. Therefore, we explore the research questions (RQs) in Textbox 1.

Research questions (RQs).

  • RQ1. Are eHealth interventions addressing antiretroviral therapy (ART) adherence among adolescents with HIV grounded in health behavior theory?

    • Which theories are used?

    • How often were theories used?

    • Do theories used specifically address developmental changes related to adolescence?

  • RQ2. Do the eHealth interventions addressing ART adherence among adolescents rely on behavior change techniques (BCTs)?

    • Which BCTs are used?

    • How many BCTs are used by interventions?

    • Are BCTs linked to behavior change theories?

  • RQ3. How are eHealth interventions addressing ART adherence among adolescents implementing the BCTs as design features?

    • What platforms are chosen?

    • Which features are designed?

    • How many design features are used in the different platforms?

  • RQ4. What are the quality and impact of the eHealth interventions and how do they relate to grounding in theories related to health behavior and behavior change?

    • What is the evidence quality of the interventions?

    • What is the impact of the interventions?

    • What is the relation between grounding in theory and impact of the interventions?

Methods

Overview

The process of formulating the RQs and the search strategy was guided by the PICO(S) (Patient/Population/Problem, Intervention, Comparison, Outcome, Study design) concept of Cochrane Collaboration [63]. We used the PRIMA guidelines as a basis for conducting and reporting this systematic review [64].

Search Strategy

The search query was crafted as a combination of the PICO text words and then applied on the databases, limited to metadata fields search (title, abstract, and keyword). We restricted the search on eHealth interventions pertaining to ART adherence among adolescents, excluding those regarding other HIV care services such as HIV testing. Search terms were structured as per the syntax of each database (Multimedia Appendix 1). The entire search query was refined via several tests and peer reviews. To expand the search into an interdisciplinary space, electronic databases relevant to technology and medical fields (IEEE Xplore, ACM, ScienceDirect, PubMed, Scopus, and Web of Science) were searched on April 25, 2019, including all papers up to this date. A secondary search was conducted on all databases on January 22, 2021, to check for new relevant citations. The search sting was formulated as follows:

[HIV OR “Human Immunodeficiency Virus” OR “HIV/AIDS” OR “Acquired Immunodeficiency Syndrome” OR “HIV-positive” OR “HIV+” OR “living with HIV”] AND [adolescent OR teen* OR young OR youth] AND [ARV OR antiretroviral OR “Antiretroviral Therapy” OR “HIV treatment” OR “HIV care” ] AND [“eHealth” OR “e-health” OR “electronic health” OR “digital health” OR telemedicine OR “tele-medicine” OR technology OR “computer-based” OR “web” OR “web-based” OR Internet OR online OR “social media” OR “social networking” OR “mHealth” OR “m-health” OR “mobile health” OR “mobile phone” OR “cell phone” OR “cellular phone” OR smartphone OR “text message” OR SMS OR “short message service” OR “app” OR “application” OR game OR videogame OR gamif* OR “play”] AND [adherence OR attrition OR dropout OR drop-out OR completers OR “lost to follow-up” OR withdrawal OR nonresponse OR non-response OR “completion” OR “did not complete” OR retention OR loss OR compliance OR concordance]

Eligibility Criteria

This review focused on eHealth interventions designed for adolescents to support ART adherence. We developed and applied the inclusion/exclusion criteria listed in Textbox 2.

Inclusion and exclusion criteria.

Inclusion Criteria

  • eHealth interventions designed for adolescents (age average between 10 and 24 years) to improve HIV medication adherence.

  • Studies clearly describing the intervention content and characteristics.

  • Interventions empirically evaluating antiretroviral therapy (ART) adherence, measured as one of the following:

    • Primary adherence behavior–related outcomes (eg, change in knowledge and attitude about HIV and ART, self-efficacy in taking ART medication, social support).

    • ART adherence (directly measured):

      • Objective measure (eg, using real-time electronic adherence monitoring, pill count).

      • Subjective measure (eg, self-report, caregiver report).

    • Biological outcomes (eg, CD4 count, viral load suppression).

  • Peer-reviewed articles published in English (journal or conference).

Exclusion Criteria

  • Interventions designed for other age groups or health professionals (or mixed but no age subgroup analysis).

  • Abstracts, reviews, protocols (however, we kept papers describing an already included eHealth system to get extra information about the intervention), ongoing works, books, book chapters.

  • Interventions that only evaluated user experience, acceptability, or feasibility but not ART adherence.

  • Interventions that focused on other HIV care services such as reducing risky behaviors, promoting HIV testing, or pretreatment care.

Screening and Inclusion

A multistep screening process (Figure 2) was applied to get to the final included interventions. As a first step, 529 papers were obtained, and duplicates (n=157) were removed. Next, 372 unique papers were screened by applying the criteria in Textbox 2 on both title and abstract. After this screening, 63 papers remained. In case of doubt on title/abstract information, papers were simply added to the next phase. In the fourth step, the 63 full papers were read and screened against the inclusion/exclusion criteria, resulting in further removal of 40 papers, eventually retaining 23 papers describing 14 different interventions. When available, various papers on an intervention (protocol, feasibility study, user experience study, pilot test, and randomized controlled trial [RCT]) were all kept to the end for further reference of intervention details. In April 2021, a second database search was performed to capture any new studies, resulting in 165 new unique citations. Following the same screening process, 11 papers were screened (after excluding 154) via title/abstract screening. Full-text reading of these papers resulted in 2 papers describing 2 eHealth systems for final inclusion. Totally, out of 694 papers from both searches, 16 different eHealth apps were included and analyzed.

Figure 2.

Figure 2

Screening and inclusion process.

Data Extraction and Analysis

We coded relevant characteristics including intervention name, publication year, country, delivery technology, study design, population, sample size, follow-up duration, intervention summary, theory use and justification of theory selection, consideration of developmental changes related to adolescence, outcomes, and effectiveness.

Coding of Behavior Theories, Behavior Change Techniques, and Designed Features

Behavior Change Theories

We used the Theory Coding Scheme (TCS) developed by Michie and Prestwich [65] to describe the theory basis of each intervention and to assess to what extent theories were utilized. This checklist has 19 items to verify whether an intervention mentions a theory or model, to what extent a theory or model is used in designing intervention features, and whether the theory is tested in pre/poststudy. Item 1 verifies whether a particular theory is mentioned in the studies, whereas items 2 and 4-11 measure to what extent the theory is used during designing interventions. Item 3 checks whether more than 1 theory is applied. Item 12a verifies whether the impact on adherence mediators was measured. The remaining items were left uncoded as they deal with reliability of methods in measuring and testing theory, and theory refinement, which is beyond the scope of this study. Each item was coded as 1 if applied and 0 if not present. As a last step and composite measure, the included eHealth systems were graded on the extent of theory usage as no, low, medium, or high usage. Studies were labeled as follows: “no,” if there was no mention of theory, or they mentioned a theory but there was no grounding of the intervention on it (TCS item 1); “low,” if it was explicitly stated that theory concepts were used to design the intervention (1 or more of the TCS items 2, 5, 8, and 11); “medium,” if all intervention techniques originated from theory concepts (TCS item 7 or 9); “high,” when all theory concepts were addressed, or used to select participants or tailor interventions (1 or more of TCS items 4, 6, and 10).

Consideration of Developmental Changes

We investigated studies for the presence of discussions concerning how developmental theory concepts influence ART adherence among adolescents. This examination was particularly inspired by TCS item 1 which says “Theory/model of behavior mentioned—Models/theories that specify relations among variables, in order to explain or predict behavior are mentioned, even if the intervention is not based on this theory” [65]. Hence, we examined the presence of explicit discussions on how developmental changes (biological, social, psychological) would “explain or predict” (to use the exact words) ART adherence among adolescents.

Behavior Change Techniques

For coding BCTs from intervention descriptions, BCTTv1 [52] was used. BCTTv1 is a well-established taxonomy with an extensive list of theoretical methods of behavior change, containing 93 BCTs grouped into 16 clusters. It has been widely applied to specify intervention techniques in various behavioral domains such as physical activity [66], alcohol use [67], and medication adherence [68]; as well as to identify the presence of BCTs in existing interventions [41,62]. To examine the use of BCTs in interventions, the prevalence of individual BCT across all interventions was calculated. Similarly, we also calculated the total number of BCTs per intervention. Considering the complexity of coding BCTs, coders completed a certified online training on BCT taxonomy (BCTTv1) [69].

Designed Features

Because BCTs are only descriptions of behavior change from a psychological perspective, in other words they are technology agnostic, we additionally coded the designed features, using the lenses of motivational design for mHealth developed by Geuens et al [57]. Geuens et al [57] explained how theoretical concepts of behavior change can be translated into design principles, by including also implementation instantiations of these principles through examples of mobile app features. These lenses of motivational designs provide implementation-level descriptions of design principles, also encompassing persuasive principles of [54-56]. The prevalence of individual design features among systems and the number of features per each system are calculated.

Impact

Because interventions differ substantially in measuring their impact, each outcome measure was coded (mediators, adherence, or health outcomes) as positive effect (+), no effect (0), or negative effect (–). Hence, we did not exclude any outcome measures or limit ourselves to direct measures of adherence such as medication intake or viral load. This inclusive approach is justified by the Information–Motivation–Behavioral Skills Model [47] of ART adherence, as it accommodates a broad range of outcome measures [47,70], and is widely adopted in ART adherence research [71-73]. This model conceptualizes ART adherence as a function of 3 mediators: information about HIV and ART, motivation to take medication, and behavioral skills required for taking medication. An increase in any of these constructs is theorized to result in improved adherence behavior which in turn produces favorable health outcomes.

Methodological Quality Assessment

Finally, we evaluated the strength of evidence for the methodological quality of included interventions with respect to the review questions, using the quality assessment method used in Johnson et al [74], with a minor modification: we discerned pre/posttest studies from single-subject and case studies (Table 1). This method was first used to assess the quality of evidence for the impact of computer games and serious games on learning [75,76], and later for their impact on health and well-being [74]. It has 5 criteria against which every included intervention is scored from 1 to 3. Adding up each of the 5 marks gives a possible maximum score of 15. A subsample of interventions (4/15, 26.67%) was coded independently by 2 coders (first and last authors). Interrater reliability was calculated using intraclass correlation coefficient with 2-way mixed effects and absolute agreement. The score was 0.89, showing a good agreement between the 2 coders. The quality measure here refers to the quality of clinical validation test (study design, eg, RCT, pre/post; sample size), not the quality in terms of design and development of eHealth systems (ie, integration of theory, BCTs, design elements).

Table 1.

Evidence quality assessment method.

Criterion Min score Max score
How appropriate is the research design for addressing the question, or subquestions of this review: randomized controlled trails (3), quasi-experimental study (2.5), pre/posttest design (2), case study, single subject-experimental design (1)? 1 3
How appropriate are the methods and analysis? 1 3
How generalizable are the findings of the study to the target population with respect to the size and representativeness of sample? 1 3
How relevant is the particular focus of the study (including conceptual focus, context, sample, and measures) for addressing the question or subquestions of this review? 1 3
To what extent can the study findings be trusted in answering the study question(s)? 1 3

Results

Overview

Of the 16 included systems, most were built in the United States (n=12), 2 in Nigeria, 1 in Uganda, and 1 in Argentina. Some studies (n=5) intentionally included participants with poor adherence performance. Half of the systems employed pre–post designs, whereas the other half used RCTs for clinical validation. Table 2 shows the list of included studies, and the summary of interventions is provided in Multimedia Appendix 2.

Table 2.

Included studies.

No. Intervention studiesa References
1 Whiteley et al [77,78]
2 Tanner et al [79,80]
3 Stankievich et al [81]
4 Spratt et al [82]
5 Shegog et al [83]
6 Belzer et al [84-86]
7 Saberi et al [87]
8 Linnemayr et al [88,89]
9 Puccio et al [90]
10 Naar-King et al [91,92]
11 Hightow-Weidman et al [93]
12 Dowshen et al [94,95]
13 Garofalo et al [96]
14 Dworkin et al [97-99]
15 Dulli et al [100]
16 Abiodun et al [101]

aFor interventions with multiple studies, only the first author of one of the papers is used.

RQ1: Are eHealth Interventions Grounded in Behavior Theory?

Which Theories Were Commonly Applied to Inform Behavior Change?

A total of 10 different theories were mentioned (Table 3), of which 3 theories appeared commonly, namely, Social Cognitive Theory, the Information–Motivation–Behavioral Skills Model, and Motivational Interviewing. The complete theory coding sheet of included studies using the TCS is provided in Multimedia Appendix 3.

Table 3.

Theories used by the included interventions.

Theory Frequency Interventions
Social Cognitive Theory 4 Tanner et al [79,80], Shegog et al [83], Hightow-Weidman et al [93], Garofalo et al [96]
Information–Motivation–Behavioral Skills Model 3 Whiteley et al [77,78], Linnemayr et al [88,89], Dworkin et al [97-99]
Motivational Interviewing 3 Spratt et al [82], Shegog et al [83], Naar-King et al [91,92]
Fogg Behavior Model 1 Hightow-Weidman et al [93]
Empowerment Theory 1 Tanner et al [79,80]
Transtheoretical Model 1 Spratt et al [82]
Stress, Appraisal, and Coping Theory 1 Belzer et al [84-86]
Narrative Communication (Storytelling) 1 Hightow-Weidman et al [93]
Ecological Momentary Intervention 1 Dowshen et al [94,95]
Social Action Theory 1 Puccio et al [90]

Were Behavior Change Theories Used Extensively?

Of the 16 eHealth systems, 9 were grounded in theory. However, the extent of theory utilization (the extent to which interventions address particular theory-relevant constructs [65]) varies substantially. Four interventions were supported by more than 1 theory. Of these, 1 (Hightow-Weidman et al [93]) was guided by 3 theories, whereas 3 interventions (Tanner et al [79,80], Spratt et al [82], and Shegog et al [83]) combined 2 theories. Table 3 provides an overview of the specific theories used per intervention. The remaining 7 interventions were not grounded in theory. While 3 of them mentioned a particular theory and its constructs in relation to adherence, they were not utilizing it to inform the design of the intervention. The remaining 4 did not refer to theory at all.

Based on the degree of application of theories in designing interventions, that is, based on the TCS [65] (also see Multimedia Appendix 3), we grouped studies into 4 usage categories as stated in the “Methods” section: no, low, medium, and high (Table 4). As much as 7 of 16 interventions have no use of theory, 5 have low theory usage, 1 used theory moderately, and 3 used theories extensively.

Table 4.

The extent of theory usage of the included interventions, based on the Theory Coding Scheme [67].

Theory usage category Theory Coding Scheme items Interventions
No


No theory mentioned Not applicable Stankievich et al [81], Saberi et al [87], Dulli et al [100], Abiodun et al [101]
Mentioned theory 1 Puccio et al [90], Linnemayr et al [88,89], Dowshen et al [94,95]
Low 2, 5, 8, 11 Spratt et al [82], Shegog et al [83], Belzer et al [84-86], Naar-King et al [91,92], Garofalo et al [96]
Medium 7, 9 Whiteley et al [77,78]
High 4, 6, 10 Tanner et al [79,80], Hightow-Weidman et al [93], Dworkin et al [97-99]

Were Developmental Changes Related to Adolescence Considered?

Given the importance of using suitable theoretical foundation for interventions that address adolescents (see the “Introduction” section), we explored whether the studies included in our review adequately address this aspect in how they report their work. Hence, we entirely examined them for information concerning the influence of developmental changes (biological, social, psychological) on ART adherence among adolescents. For example, we explored whether the studies considered the question of which theories could work better for adolescents (ie, which theory would provide better coverage of factors associated with developmental changes). Our findings suggest that none of the theory-informed eHealth interventions explicitly discussed theory selection from a developmental perspective: none of the studies provided a discussion of why or how the respective theories were appropriate for adolescents, suggesting lack of consideration of developmental changes. However, they mentioned previous use of those health theories in behavior change research including in adolescent populations (see Multimedia Appendix 2), although they did not include explicit reasoning for their choice. This may suggest that, in general, developmental changes related to adolescence are currently not included in the choice of theoretical foundation for interventions to increase ART adherence among adolescents in a transparent way, leaving room for future work that explicitly draws from suitable theory to achieve better outcomes as suggested by [102]. Additionally, we searched for evidence that developmental changes were accounted for in the intervention design—whether any specific design features were related to these changes—but no such explicit association was found.

RQ2: Are eHealth Interventions Using Behavior Change Techniques?

Which Behavior Change Techniques Were Most Common?

Across the 16 eHealth systems reviewed, a total of 42 BCTs were identified (Multimedia Appendix 4). The most popular technique was “Prompting/cueing,” which was used by 11 interventions. The second most frequent technique was “Social support (unspecified),” used in 10 interventions. The third was “Problem solving,” used in 8 interventions. Next, “Monitoring of behavior by others without feedback” was used 7 times, and “Information about health consequences,” “Credible source,” “Social support (emotional),” and “Instructions on how to perform behavior” were each used 5 times. “Demonstration of the behavior” has been used 4 times and the remaining techniques appeared 3 times or less.

How Many BCTs Were Used Per Intervention?

The median number of BCTs used was 5. The intervention with the highest number of techniques was by Dworkin et al [97-99] utilizing 17 different ones. The lowest number of BCTs was found in Abiodun et al [101], using 1 technique. A complete list of details on how many techniques each intervention has applied is provided in Multimedia Appendix 4.

Are Behavior Change Techniques Linked to Behavior Change Theories?

Most theory-based studies (7/9: Shegog et al [83], Belzer et al [84-86], Garofalo et al [96], Whiteley et al [77,78], Tanner et al [79,80], Hightow-Weidman et al [93], Dworkin et al [97-99]) linked at least one intervention technique to 1 theory (TCS item 8) and at least one theory-relevant construct to an intervention technique (TCS item 11). However, only half (4/9: Whiteley et al [77,78], Tanner et al [79,80], Hightow-Weidman et al [93], Dworkin et al [97-99]) linked all theory-relevant constructs to at least one intervention technique (TCS item 10), and only 5 out of 9 (Whiteley et al [77,78], Tanner et al [79,80], Hightow-Weidman et al [93], Garofalo et al [96], Dworkin et al [97-99]) linked all intervention techniques to at least one theory-relevant construct (TCS item 7). Two (Shegog et al [83] and Naar-King et al [91,92]) studies used theory constructs to tailor intervention techniques to recipients (TCS item 6), but no study selected recipients for the intervention based on theory constructs (TCS item 4).

RQ3. How Are eHealth Interventions Designed?

What Platforms Were Used to Implement eHealth?

Many of the systems were simplistic applications from a technical perspective developed on basic phones (ie, SMS text messaging [n=6] and phone calls [n=3]; Table 5). However, advanced applications designed for smartphones were also emerging (n= 3). These smartphone-based apps were designed in various forms—ordinary apps, serious games, and gamified apps. Already existing social media apps were also utilized. Electronic adherence monitoring devices (electronic medication containers that look like ordinary bottles or mobile phones, eg, WisePill) were also common, but mainly used in combination with other platforms and not as a standalone system. The primary purpose of these devices was to objectively measure adherence, except in 1 intervention (Spratt et al [82]) in which it was used to deliver reminders in the form of blinking lights and chime sounds. Other systems included web-based applications (desktop/laptop), remote videoconferencing, and desktop applications (Naar-King et al [91,92]). Such systems were, however, less frequent, each appearing just once.

Table 5.

Type of systems in included studies.

System type Frequency Study
SMS text messaging 6 Stankievich et al [81], Spratt et al [82], Linnemayr et al [88,89], Dowshen et al [94,95], Garofalo et al [96], Abiodun et al [101]
Phone call 3 Spratt et al [82], Puccio et al [90], Belzer et al [84-86]
Electronic adherence monitoring devicea 3 Whiteley et al [77,78], Spratt et al [82], Linnemayr et al [88,89]
Smartphone app 1 Dworkin et al [97-99]
Smartphone serious game 1 Whiteley et al [77,78]
Gamified smartphone app 1 Hightow-Weidman et al [93]
Social media 2 Tanner et al [79,80], Dulli et al [100]
Web-based application (desktop/laptop) 1 Shegog et al [83]
Videoconferencing 1 Saberi et al [87]
Desktop applications 1 Naar-King et al [91,92]

aUsed in combination with others, not as a standalone intervention system.

Which Design Features Were Common?

Out of the 28 motivational design features proposed by Geuens et al [57], we found 24, with the most frequent features being “Reminders,” “Personalization,” and “General information”—appearing 11, 10, and 9 times, respectively (Multimedia Appendix 5). Information to educate adolescents about HIV and ART adherence was sometimes tailored to participants based on personal profiles—hence “Microtailoring.” “Instructions” on how to perform certain tasks such as taking medication and talking to providers were also detected. In some interventions, generic information and instructions were from health care expert sources (ie, “Expertise”). Asking patients to manually enter information (ie, “Logging”) about performance of their behavior (eg, whether they took medication or not) or outcome data (eg, viral load, CD4 count) was also common, although sometimes this was also done automatically, via “Tracking,” using electronic devices such as medication adherence monitoring devices.

How Many Design Features Were Used in the Different Platforms?

The median number of design features was 4. The intervention with the highest number of design features (n=15) was Hightow-Weidman et al [93], while the interventions with the lowest number of features (n=1) were Puccio et al [90] and Abiodun et al [101] (Multimedia Appendix 5).

RQ4. What Are the Quality and Impact of the eHealth Interventions and How Do They Relate to Grounding in Theory?

Quality

We adopted Johnson et al’s [74] method to categorize papers on methodological quality, computing the quality of evidence score, ranging from 5 to 15. Papers with a rating 8 or below are categorized as “weak evidence,” 9-12 as “moderate evidence,” and 13 and above as “strong evidence.” Six interventions scored strong on quality of evidence, 4 moderate, and the remaining 7 weak (Table 6). The quality ratings only pertain to the strength of empirical evidence for outcome effects, and do not judge the overall quality of the studies.

Table 6.

Impact of included interventions on Integrated Behavioral Model mediators of antiretroviral therapy adherence among adolescents and quality ratings.

Interventions Theoretical grounding and motivational features Quality and effectivenessa

Overall quality of theory integration (Table 4) Behavior change techniques, n Design features, n HIV knowledge Antiretroviral therapy (ART) knowledge ART motivation (personal motivation) Social support (social motivation) ART self-efficacy ART medication adherence Medical appointment adherence Viral load CD4 count Quality of evidence
Whiteley et al [77], [78]d,e Medium 15 10 + + 0 0 0 + + 15
Tanner et al [79], [80]e,f High 16 12 + + 11
Hightow-Weidman et al [93]e High 15 15 + + + 9
Dworkin et al [97]-[99]e High 17 14 0 0 + 12
Stankievich et al [81]g No 2 3 0 6
Spratt et al [82]e,g Low 9 4 0 - 6
Saberi et al [87]g No 7 2 0 0 0 6
Linnemayr et al [88], [89]g No 3 2 0 13
Puccio et al [90]g No 3 1 0 0 5
Naar-King et al [91], [92]g Low 11 4 0 0 15
Dowshen et al [94], [95]g No 2 3 + 0 0 8
Garofalo et al [96]g Low 4 4 + 0 13
Shegog et al [83]g Low 2 5 + + + + 7
Belzer et al [84]-[86]g Low 4 2 0 0 + + 11
Dulli et al [100]g No 6 4 + 0 0 13
Abiodun et al [101]g No 1 1 0 + 14

a“+” means positive effect; “0” means no effect; “–” means negative effect.

bTrue for newly started ART; no significant effect on patients who stayed longer on ART.

cHigher usage of theory and motivational features, scoring at least medium and high once.

dElectronic monitoring alone (control) acts as a better intervention than additional signal and SMS text message reminders (intervention).

eLower usage of theory and motivational features.

Impact

As mentioned in the “Methods” section, outcome measures were coded following Information–Motivation–Behavioral Skills Model’s conceptualization of ART adherence behavior as a function of 3 mediators: information, motivation, and behavioral skills [47]. Therefore, the measures corresponding to these parameters are knowledge on HIV and ART, personal motivation and social motivation, and ART self-efficacy, respectively. Direct measures of adherence behavior are ART medication adherence and appointment adherence. Similarly, measures of biological outcomes include viral load and CD4 count. The number of measurements for each outcome, effect type, and quality of evidence is summarized in Table 6. Of the 16 eHealth systems, 10 reported positive effect on 1 or more of the outcomes measured, yet 7 of these also reported no effect on 1 or more of other outcomes. As much as 6 out of 16 reported purely no effect in all the outcomes measured.

What Is the Relation Between Grounding in Theory and Impact of the Interventions?

The nature of this review precludes any firm conclusions. A closer look at Table 6 suggests mixed results; we cannot unambiguously conclude that more extensive grounding of design features in theory related to health behavior or behavior change is associated with better (significant) effectiveness on outcomes with good evidence quality (compare studies with footnotes c and e). However, the results suggest that 10/16 (Whiteley et al [77,78], Tanner et al [79,80], Hightow-Weidman et al [93], Dworkin et al [97-99], Dowshen et al [94,95], Garofalo et al [96], Shegog et al [83], Belzer et al [84-86], Dulli et al [100], Abiodun et al [101]) of the included eHealth apps report a positive impact on ART adherence or on its mediators.

Discussion

Summary

This systematic review examined theory usage, integration of BCTs, and motivational design features and technology platforms used in existing eHealth ART adherence interventions for adolescents, and how these aspects relate to the quality and impact of interventions. Generally, we found the impact of eHealth systems on adolescent ART adherence and its mediators promising. Moreover, most included systems attempted rooting eHealth interventions in theoretical frameworks. Nevertheless, we found a gap between the discussion of theories to root an intervention and the actual application of those theories in terms of system design. Additionally, we only came across few systems that contain a considerable number of BCTs and motivational design features. Instead, elementary designs characterize current systems. In the following paragraphs, we detail the main findings and relate them to existing theoretical and empirical work.

Principal Findings

Are eHealth Interventions Grounded in Health Behavior Change Theory?

The review shows that current eHealth systems to improve adolescents’ ART adherence refer to theory only lightly. Of the 16 included eHealth systems, only 4 interventions show extensive to moderate usage of theory, while the remaining have low or no usage (Table 4). This finding contrasts with the studies that have argued that grounding the design of eHealth systems in theory is associated with increased effectiveness [40-42]. In the context of HIV in particular, designing eHealth systems based on behavioral theory is associated with efficacy in improving adherence to HIV medication [30]. This is attributed to the fact that health behavior theories provide a comprehensive understanding of ART adherence behavior and its determinant factors, to inform the design of the intervention [44,103]. Theory underutilization may result in a limited understanding of the different moderators of ART adherence among adolescents, leaving several factors unaddressed by the intervention, which in turn reduces effectiveness [104].

Moreover, our findings indicate that the context of developmental changes and their impact on ART adherence are not explicitly addressed in the included studies. This is somewhat surprising as prior research has shown that factors associated with developmental changes affect adolescents’ health including medication adherence [105]. Adolescence presents a specific developmental stage marked by profound biological, psychological, and social changes [106-111] that may affect ART adherence behavior [20]. For instance, we did not find explicit mention of how the ongoing development of cognitive capacity [17], oppositional behavior associated with becoming autonomous [21], and conformity to peer pressure [22] and the synergy it may have with HIV stigma [112] can affect ART adherence among teenagers. Being informed of these developmental theory concepts might be useful in the choice of appropriate BCTs and design features. However, the absence of explicit referral to developmental theory does not automatically imply that interventions are not (implicitly) informed by developmental theories.

Are Behavior Change Techniques Guided by Theory?

Almost half of the interventions applied only 4 or less BCTs, which may render them less effective in delivering intervention content: prior research on BCTs and health behaviors, (eg, [40-42,62]) has indicated that the number of BCTs applied in an intervention influences its effect, that is, interventions that employ more BCTs were found to have a larger effect on behavior than those that apply fewer BCTs [41]. This relatively low number of BCTs usage might be the result of a less comprehensive conceptualization of adherence and its determinants, or a less comprehensive conceptualization of adolescents’ developmental changes and their impact on ART adherence. For example, an intervention narrowing adherence to “consuming medication,” and focusing primarily on “forgetfulness” as main barrier, might end up employing the “prompts/cues” BCT only; “reminders” as the main technique can be seen in [90,94]. A deeper look through the perspective of developmental changes (ie, a reflection on why adolescents forget) might perhaps suggest another solution; for example, building adolescents’ skills on how to better integrate medications into daily life. In terms of breadth (covering a broad range of factors), reviews on barriers of adolescent’s ART adherence list many factors complicating adherence [9-11] that eHealth systems need to address. Moreover, we found that BCTs which might be relevant for adolescents such as demonstration of behavior (modeling), peer comparison, or incentivization were scarce.

What Are the Prevalent Platforms and Designed Features?

We found that most included systems were limited to SMS text messaging or phone calling. Compared with more advanced information and communications technology systems, SMS text messaging and phone calls offer the advantage of being cheap to deliver. However, such systems also limit the implementation of more sophisticated features. For example, it is challenging to deliver intervention content enriched with engaging audiovisual content. SMS text messages alone might not be sufficiently engaging to adolescents, which could be a possible explanation for researchers reporting noneffectiveness [88,113,114]. A previous work noted that for adolescents “texts that say the same thing are boring” [77], and the authors recommended dynamically changing the content of the message so that adolescents do not get tired of reading the same messages [89].

As for the designed features, “reminders (notifications)” and “personalization (adapting color schemes and skins)” were the most frequently applied followed by displaying “general information.” The remaining features were scarcely used. Providing reminders for medication, enabling customization on system features, and educating adolescents about HIV and ART are still appropriate. However, interventions could be more effective if they additionally include “social” features such as principles grouped under “reward and incentives” and “social interactions” categories [57].

What Are the Quality and Impact of the eHealth Interventions?

Of the 16 eHealth systems, 10 (Whiteley et al [77,78], Tanner et al [79,80], Hightow-Weidman et al [93], Dworkin et al [97-99], Dowshen et al [94,95], Garofalo et al [96], Shegog et al [83], Belzer et al [84-86], Dulli et al [100], Abiodun et al [101]) reported positive effect on 1 or more of the outcomes measured, yet 7 (Whiteley et al [77,78], Dworkin et al [97-99], Dowshen et al [94,95], Garofalo et al [96], Belzer et al [84-86], Dulli et al [100], Abiodun et al [101])out of these 10 also reported no effect on 1 or more of other outcomes. Six out of 16 (Stankievich et al [81], Spratt et al [82], Saberi et al [87], Linnemayr et al [88,89], Puccio et al [90], Naar-King et al [91,92]) reported purely no effect in all the outcomes measured. Overall, while evidence is mixed, the impact of these systems on ART adherence and its mediators has a positive trend. However, the nature of this review and diversity of eHealth studies preclude any firm conclusions based on our study findings (Table 6). Considering the relatively small number of digital interventions identified in this review and the mixed evidence on its impact, more digital interventions for adolescents’ HIV self-management should be evaluated to come to firm conclusions.

Implications and Recommendations

Overview

A clear understanding of theoretical insights enables designers to translate various BCTs into features appropriate to this specific audience; the way BCTs are implemented and presented to users matters in respect to their effectiveness. Moreover, implementation sophistication on top of applying relevant intervention content is paramount. In the paragraphs below, we detail the recommendations derived from this review.

Ground Interventions in Theories and Methods Tailored to Adolescents

Deciding on a particular theory is challenging for eHealth designers as a plethora of health theories exist, and there is not one theory specifically developed for adolescents. In this respect, protocols for developing behavioral interventions such as the IM (intervention mapping) [115] and capability, opportunity, motivation, behavior frameworks [116,117] may be of interest. According to IM, one should first consult existing literature to list reported causes of the target health problem (in this case, barriers/facilitators of ART adherence among adolescents). Next, concepts from this list should be linked to theoretical constructs (ie, the theory with better coverage of this list could be a good candidate). Moreover, use of a combination of multiple theories (such as Integrated Behavioral Model or any customized combination) might be considered. Complementing this approach, the practical study of the actual target group (eg, user-centered methods such as participatory design [118,119] with adolescents) might also help identify the most relevant determinants (eg, [120]) on which an intervention can focus [121].

Selection of Behavior Change Techniques Tailored to Adolescents

Incentivization holds particular potential to improve adherence to HIV care [122-125] among adolescents. Moreover, as peer pressure among teen population is high [19], implementing social-based techniques involving peer role modeling and comparisons among peers might be effective. In this respect, Hightow-Weidman et al [93] reported that participants enjoyed “social-media-like” discussion boards that prompt peers to daily discuss on HIV matters and share experiences. However, any use of social media with adolescents should be done with utmost care, discussed further below.

Additionally, methods that help adolescents analyze barriers they face, and help them generate strategies to overcome these issues might be crucial. This is already addressed by some interventions that seek to develop problem-solving skills, for example, phone conversations with a professional adherence counselor [87] or a similar discussion with a humanlike character animated in computer software [91].

Implement Sophisticated Features With More Advanced Technology Platforms

More advanced and engaging design features such as gamification and social connections are needed in eHealth systems. Although evidence on the efficacy of gamification specific to adolescents’ ART adherence is not synthesized yet, literature on gamification and adherence indicated its potential [126,127] and positive influence on health behavior change in general [74,128-132]. First, as mentioned above, adolescents might be more attracted to immediate rewards [17] (eg, points) and incentives associated with adherence achievements (eg, badges) than foreseeing future long-term health consequences. In addition to material rewards, virtual rewards in the form of gamification elements such as points, levels, leaderboards, and easter eggs might be interesting. Additionally, as adolescents are heavily influenced by peer pressure [13], integrating “social interaction” principles [57] might be important. Allowing adolescents to link and share via social media platforms, connect with others in a similar condition and demonstrating their success (social identification), know how other peers are performing (social comparison), compete or cooperate with peers on social interaction environments could be useful. However, we acknowledge that given the specific developmental characteristics of this age group and the dangers of issues related to HIV stigma (eg, concerns similar to privacy unraveling [133,134]), any such designed features should be stigma sensitive and introduced with the greatest care.

Finally, to enable using more advanced features, implementations such as desktop applications, mobile apps, games, or including gamification elements and stigma-sensitive social media–like features might be more appropriate to engage teenagers. As such applications are emerging, implementations in these platforms are warranted in future interventions.

Limitations and Future Work

As per our knowledge, this is the first systematic review to examine theory usage, BCTs, motivational design features, and technology platforms used in existing eHealth ART adherence interventions for adolescents. To investigate our main points, we used established coding frameworks and taxonomies. Nevertheless, this study comes with its limitations. First, this review focused primarily on exploring existing eHealth ART interventions for adolescents. There is a need for a more rigorous study of what best promotes ART adherence among adolescents, that is, looking at the future. Second, although established coding taxonomies were applied, and coders were trained, coding BCTs and design principles remained challenging due to variations in intervention content descriptions. Templates for reporting eHealth interventions for behavior change might be useful here. Finally, the findings in this review depended only on explicit referral to theories used to ground intervention and design. We must acknowledge that this methodological approach does not allow us to conclude that interventions and designs are not tailored toward adolescents if done implicitly. It may be that interventions are still informed by knowledge on adolescents’ developmental changes, but simply without explicit mentioning, for example, through the embodied knowledge of experts contributing to the design. Hence, future work may address this by including prespecified developmentally appropriate BCTs and incorporating these in the systematic review of eHealth interventions for ART adherence among adolescents. However, it should be noted here that, for the sake of reproducibility, design knowledge should be transparently communicated as a good practice.

Conclusions

In this review, a total of 16 eHealth interventions targeting adolescents’ ART adherence were included. Overall, the impact of these systems on ART adherence and its mediators is promising, but evidence remains mixed. We observed mostly simple applications (ie, for SMS text messages and phone calls); however, advanced smartphone apps are emerging. Moreover, most interventions applied only a limited number of BCTs and designed features. While 9/16 systems were grounded in theory, overall, health theories were utilized sparsely. Moreover, we observed a dearth of approaches addressing the specific developmental changes related to adolescence and their implications for intervention design and responsiveness to BCTs. In summary, we suggest that eHealth interventions, as well as the design of specific delivery platforms, should include health theories that are appropriate to adolescents’ development, and implement features that cater to this age group.

Acknowledgments

This work was supported by Group T Academy, Belgium and the Ministry of Science and Higher Education, Ethiopia via a joint scholarship offered to the first author.

Abbreviations

ART

antiretroviral therapy

BCT

behavior change technique

TCS

Theory Coding Scheme

Multimedia Appendix 1

Search terms structured as per the syntax of each database.

Multimedia Appendix 2

Characteristics of included studies.

Multimedia Appendix 3

Use of theory in the included interventions from the Theory Coding Scheme (TCS).

Multimedia Appendix 4

Presence of behavior change techniques (BCTs) from BCT taxonomy version 1 in the included interventions.

Multimedia Appendix 5

Presence of design principles in the included interventions from lenses of motivational principles.

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Sawyer SM, Azzopardi PS, Wickremarathne D, Patton GC. The age of adolescence. Lancet Child Adolesc Health. 2018 Mar;2(3):223–228. doi: 10.1016/S2352-4642(18)30022-1.S2352-4642(18)30022-1 [DOI] [PubMed] [Google Scholar]
  • 2.Active involvement of young people is key to ending the AIDS epidemic by 2030. [2019-08-13]. https://www.unaids.org/en/resources/presscentre/featurestories/2015/august/20150812_PACT .
  • 3.Slogrove AL, Sohn AH. The global epidemiology of adolescents living with HIV: time for more granular data to improve adolescent health outcomes. Curr Opin HIV AIDS. 2018 May;13(3):170–178. doi: 10.1097/COH.0000000000000449. http://europepmc.org/abstract/MED/29432227 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Kranzer K, Bradley J, Musaazi J, Nyathi M, Gunguwo H, Ndebele W, Dixon M, Ndhlovu M, Rehman A, Khan P, Vogt F, Apollo T, Ferrand RA. Loss to follow-up among children and adolescents growing up with HIV infection: age really matters. Journal of the International AIDS Society. 2017 Jul 17;20(1):21737. doi: 10.7448/ias.20.1.21737. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Jerene D, Abebe W, Taye K, Ruff A, Hallstrom I. Adolescents living with HIV are at higher risk of death and loss to follow up from care: Analysis of cohort data from eight health facilities in Ethiopia. PLoS One. 2019 Oct 17;14(10):e0223655. doi: 10.1371/journal.pone.0223655. https://dx.plos.org/10.1371/journal.pone.0223655 .PONE-D-19-04545 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Fokam J, Sosso SM, Yagai B, Billong SC, Djubgang Mbadie RE, Kamgaing Simo R, Edimo SV, Nka AD, Tiga Ayissi A, Yimga JF, Takou D, Moudourou S, Ngo Nemb M, Nfetam Elat J, Santoro M, Perno C, Colizzi V, Ndjolo A. Viral suppression in adults, adolescents and children receiving antiretroviral therapy in Cameroon: adolescents at high risk of virological failure in the era of "test and treat". AIDS Res Ther. 2019 Nov 19;16(1):36. doi: 10.1186/s12981-019-0252-0. https://aidsrestherapy.biomedcentral.com/articles/10.1186/s12981-019-0252-0 .10.1186/s12981-019-0252-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bezabhe WM, Chalmers L, Bereznicki LR, Peterson GM, Bimirew MA, Kassie DM. Barriers and facilitators of adherence to antiretroviral drug therapy and retention in care among adult HIV-positive patients: a qualitative study from Ethiopia. PLoS One. 2014 May 14;9(5):e97353. doi: 10.1371/journal.pone.0097353. https://dx.plos.org/10.1371/journal.pone.0097353 .PONE-D-14-00873 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Haberer J, Mellins C. Pediatric adherence to HIV antiretroviral therapy. Curr HIV/AIDS Rep. 2009 Nov;6(4):194–200. doi: 10.1007/s11904-009-0026-8. http://europepmc.org/abstract/MED/19849962 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hudelson C, Cluver L. Factors associated with adherence to antiretroviral therapy among adolescents living with HIV/AIDS in low- and middle-income countries: a systematic review. AIDS Care. 2015;27(7):805–16. doi: 10.1080/09540121.2015.1011073. [DOI] [PubMed] [Google Scholar]
  • 10.Ammon N, Mason S, Corkery J. Factors impacting antiretroviral therapy adherence among human immunodeficiency virus-positive adolescents in Sub-Saharan Africa: a systematic review. Public Health. 2018 Apr;157:20–31. doi: 10.1016/j.puhe.2017.12.010.S0033-3506(17)30423-7 [DOI] [PubMed] [Google Scholar]
  • 11.MacCarthy S, Saya U, Samba C, Birungi J, Okoboi S, Linnemayr S. "How am I going to live?": exploring barriers to ART adherence among adolescents and young adults living with HIV in Uganda. BMC Public Health. 2018 Oct 04;18(1):1158. doi: 10.1186/s12889-018-6048-7. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-018-6048-7 .10.1186/s12889-018-6048-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gray WN, Schaefer MR, Resmini-Rawlinson A, Wagoner ST. Barriers to Transition From Pediatric to Adult Care: A Systematic Review. J Pediatr Psychol. 2018 Jun 01;43(5):488–502. doi: 10.1093/jpepsy/jsx142.4670771 [DOI] [PubMed] [Google Scholar]
  • 13.Christie D, Viner R. Adolescent development. BMJ. 2005 Feb 05;330(7486):301–4. doi: 10.1136/bmj.330.7486.301. http://europepmc.org/abstract/MED/15695279 .330/7486/301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Vijayakumar N, Op de Macks Z, Shirtcliff EA, Pfeifer JH. Puberty and the human brain: Insights into adolescent development. Neurosci Biobehav Rev. 2018 Sep;92:417–436. doi: 10.1016/j.neubiorev.2018.06.004. http://europepmc.org/abstract/MED/29972766 .S0149-7634(18)30010-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Arain M, Haque M, Johal L, Mathur P, Nel W, Rais A, Sandhu R, Sharma S. Maturation of the adolescent brain. Neuropsychiatr Dis Treat. 2013;9:449–61. doi: 10.2147/NDT.S39776. doi: 10.2147/NDT.S39776.ndt-9-449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Steinberg L, Morris AS. Adolescent development. Annu Rev Psychol. 2001;52:83–110. doi: 10.1146/annurev.psych.52.1.83.52/1/83 [DOI] [PubMed] [Google Scholar]
  • 17.Steinberg L. Cognitive and affective development in adolescence. Trends Cogn Sci. 2005 Feb;9(2):69–74. doi: 10.1016/j.tics.2004.12.005.S1364-6613(04)00317-1 [DOI] [PubMed] [Google Scholar]
  • 18.Steinberg L. Risk taking in adolescence: what changes, and why? Ann N Y Acad Sci. 2004 Jun;1021:51–8. doi: 10.1196/annals.1308.005.1021/1/51 [DOI] [PubMed] [Google Scholar]
  • 19.Smetana JG, Campione-Barr N, Metzger A. Adolescent development in interpersonal and societal contexts. Annu Rev Psychol. 2006;57:255–84. doi: 10.1146/annurev.psych.57.102904.190124. [DOI] [PubMed] [Google Scholar]
  • 20.Taddeo D, Egedy M, Frappier J. Adherence to treatment in adolescents. Paediatr Child Health. 2008 Jan;13(1):19–24. doi: 10.1093/pch/13.1.19. http://europepmc.org/abstract/MED/19119348 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Lowenthal E, Matesva M, Marukutira T, Bayani O, Chapman J, Tshume O, Matshaba M, Hickson M, Gross R. Psychological Reactance is a Novel Risk Factor for Adolescent Antiretroviral Treatment Failure. AIDS Behav. 2021 May 04;25(5):1474–1479. doi: 10.1007/s10461-020-02986-z.10.1007/s10461-020-02986-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Gommans R, Sandstrom MJ, Stevens GW, ter Bogt TF, Cillessen AH. Popularity, likeability, and peer conformity: Four field experiments. Journal of Experimental Social Psychology. 2017 Nov;73:279–289. doi: 10.1016/j.jesp.2017.10.001. [DOI] [Google Scholar]
  • 23.World Health Organization . Global Diffusion of eHealth: Making Universal Health Coverage Achievable: Report of the Third Global Survey on EHealth. Geneva, Switzerland: World Health Organization; 2017. [Google Scholar]
  • 24.Eysenbach G. What is e-health? J Med Internet Res. 2001;3(2):E20. doi: 10.2196/jmir.3.2.e20. https://www.jmir.org/2001/2/e20/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Muessig KE, Nekkanti M, Bauermeister J, Bull S, Hightow-Weidman LB. A systematic review of recent smartphone, Internet and Web 2.0 interventions to address the HIV continuum of care. Curr HIV/AIDS Rep. 2015 Mar;12(1):173–90. doi: 10.1007/s11904-014-0239-3. http://europepmc.org/abstract/MED/25626718 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Muessig KE, Pike EC, Legrand S, Hightow-Weidman LB. Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review. J Med Internet Res. 2013 Jan 04;15(1):e1. doi: 10.2196/jmir.2301. https://www.jmir.org/2013/1/e1/ v15i1e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Muessig KE, LeGrand S, Horvath KJ, Bauermeister JA, Hightow-Weidman LB. Recent mobile health interventions to support medication adherence among HIV-positive MSM. Curr Opin HIV AIDS. 2017 Sep;12(5):432–441. doi: 10.1097/COH.0000000000000401. http://europepmc.org/abstract/MED/28639990 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hightow-Weidman LB, Muessig KE, Bauermeister JA, LeGrand S, Fiellin LE. The future of digital games for HIV prevention and care. Curr Opin HIV AIDS. 2017 Sep;12(5):501–507. doi: 10.1097/COH.0000000000000399. http://europepmc.org/abstract/MED/28692490 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Cooper V, Clatworthy J, Whetham J, Consortium E. mHealth Interventions To Support Self-Management In HIV: A Systematic Review. Open AIDS J. 2017;11:119–132. doi: 10.2174/1874613601711010119. http://europepmc.org/abstract/MED/29290888 .TOAIDJ-11-119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Henny KD, Wilkes AL, McDonald CM, Denson DJ, Neumann MS. A Rapid Review of eHealth Interventions Addressing the Continuum of HIV Care (2007-2017) AIDS Behav. 2018 Jan;22(1):43–63. doi: 10.1007/s10461-017-1923-2. http://europepmc.org/abstract/MED/28983684 .10.1007/s10461-017-1923-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Wang Z, Zhu Y, Cui L, Qu B. Electronic Health Interventions to Improve Adherence to Antiretroviral Therapy in People Living With HIV: Systematic Review and Meta-Analysis. JMIR Mhealth Uhealth. 2019 Oct 16;7(10):e14404. doi: 10.2196/14404. https://mhealth.jmir.org/2019/10/e14404/ v7i10e14404 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Purnomo J, Coote K, Mao L, Fan L, Gold J, Ahmad R, Zhang L. Using eHealth to engage and retain priority populations in the HIV treatment and care cascade in the Asia-Pacific region: a systematic review of literature. BMC Infect Dis. 2018 Feb 17;18(1):82. doi: 10.1186/s12879-018-2972-5. https://bmcinfectdis.biomedcentral.com/articles/10.1186/s12879-018-2972-5 .10.1186/s12879-018-2972-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Navarra AD, Gwadz MV, Whittemore R, Bakken SR, Cleland CM, Burleson W, Jacobs SK, Melkus GD. Health Technology-Enabled Interventions for Adherence Support and Retention in Care Among US HIV-Infected Adolescents and Young Adults: An Integrative Review. AIDS Behav. 2017 Nov;21(11):3154–3171. doi: 10.1007/s10461-017-1867-6. http://europepmc.org/abstract/MED/28776275 .10.1007/s10461-017-1867-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Badawy SM, Barrera L, Sinno MG, Kaviany S, O'Dwyer Linda C, Kuhns LM. Text Messaging and Mobile Phone Apps as Interventions to Improve Adherence in Adolescents With Chronic Health Conditions: A Systematic Review. JMIR Mhealth Uhealth. 2017 May 15;5(5):e66. doi: 10.2196/mhealth.7798. https://mhealth.jmir.org/2017/5/e66/ v5i5e66 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Mulawa MI, LeGrand S, Hightow-Weidman LB. eHealth to Enhance Treatment Adherence Among Youth Living with HIV. Curr HIV/AIDS Rep. 2018 Aug 29;15(4):336–349. doi: 10.1007/s11904-018-0407-y. http://europepmc.org/abstract/MED/29959649 .10.1007/s11904-018-0407-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Badawy SM, Kuhns LM. Economic Evaluation of Text-Messaging and Smartphone-Based Interventions to Improve Medication Adherence in Adolescents with Chronic Health Conditions: A Systematic Review. JMIR Mhealth Uhealth. 2016 Oct 25;4(4):e121. doi: 10.2196/mhealth.6425. https://mhealth.jmir.org/2016/4/e121/ v4i4e121 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Ramsey W, Heidelberg R, Gilbert A, Heneghan M, Badawy S, Alberts N. eHealth and mHealth interventions in pediatric cancer: A systematic review of interventions across the cancer continuum. Psychooncology. 2020 Jan;29(1):17–37. doi: 10.1002/pon.5280. doi: 10.1002/pon.5280. [DOI] [PubMed] [Google Scholar]
  • 38.Badawy SM, Cronin RM, Hankins J, Crosby L, DeBaun M, Thompson AA, Shah N. Patient-Centered eHealth Interventions for Children, Adolescents, and Adults With Sickle Cell Disease: Systematic Review. J Med Internet Res. 2018 Jul 19;20(7):e10940. doi: 10.2196/10940. https://www.jmir.org/2018/7/e10940/ v20i7e10940 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Badawy SM, Kuhns LM. Texting and Mobile Phone App Interventions for Improving Adherence to Preventive Behavior in Adolescents: A Systematic Review. JMIR Mhealth Uhealth. 2017 Apr 19;5(4):e50. doi: 10.2196/mhealth.6837. https://mhealth.jmir.org/2017/4/e50/ v5i4e50 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen Julia E W C. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012 Nov 14;14(6):e152. doi: 10.2196/jmir.2104. https://www.jmir.org/2012/6/e152/ v14i6e152 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010 Feb 17;12(1):e4. doi: 10.2196/jmir.1376. https://www.jmir.org/2010/1/e4/ v12i1e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Vollmer Dahlke Deborah, Fair K, Hong YA, Beaudoin CE, Pulczinski J, Ory MG. Apps seeking theories: results of a study on the use of health behavior change theories in cancer survivorship mobile apps. JMIR Mhealth Uhealth. 2015 Mar 27;3(1):e31. doi: 10.2196/mhealth.3861. https://mhealth.jmir.org/2015/1/e31/ v3i1e31 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Glanz K, Rimer BK, Viswanath KV. Health Behavior and Health Education: Theory, Research, and Practice. San Francisco, CA, US: Jossey-Bass; 2008. [Google Scholar]
  • 44.Amico KR, Mugavero M, Krousel-Wood MA, Bosworth HB, Merlin JS. Advantages to Using Social-Behavioral Models of Medication Adherence in Research and Practice. J Gen Intern Med. 2018 Feb 4;33(2):207–215. doi: 10.1007/s11606-017-4197-5. http://europepmc.org/abstract/MED/29204968 .10.1007/s11606-017-4197-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Rosenstock IM, Strecher VJ, Becker MH. Social Learning Theory and the Health Belief Model. Health Education Quarterly. 2016 Sep 04;15(2):175–183. doi: 10.1177/109019818801500203. [DOI] [PubMed] [Google Scholar]
  • 46.Fisher W, Fisher J, Harman J. Social Psychological Foundations of Health and Illness. Massachusetts: Blackwell Malden; 2003. The Information-Motivation-Behavioral Skills Model: A general social psychological approach to understanding and promoting health behavior; pp. 82–106. [Google Scholar]
  • 47.Fisher JD, Fisher WA, Amico KR, Harman JJ. An information-motivation-behavioral skills model of adherence to antiretroviral therapy. Health Psychol. 2006 Jul;25(4):462–73. doi: 10.1037/0278-6133.25.4.462.2006-08842-003 [DOI] [PubMed] [Google Scholar]
  • 48.Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Upper Saddle River, NJ: Prentice-Hall; 1986. [Google Scholar]
  • 49.Fishbein M. A theory of reasoned action: some applications and implications. Nebr Symp Motiv. 1980;27:65–116. [PubMed] [Google Scholar]
  • 50.Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control: From Cognition to Behavior. Berlin, Heidelberg: Springer; 1985. pp. 11–39. [Google Scholar]
  • 51.Prochaska J, Velicer W. The transtheoretical model of health behavior change. Am J Health Promot. 1997;12(1):38–48. doi: 10.4278/0890-1171-12.1.38. [DOI] [PubMed] [Google Scholar]
  • 52.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013 Aug;46(1):81–95. doi: 10.1007/s12160-013-9486-6. [DOI] [PubMed] [Google Scholar]
  • 53.Cialdini RB. Influence: Science and Practice. Boston, MA: Pearson Education; 2009. The 6 principles of persuasion; p. e1. [Google Scholar]
  • 54.Fogg BJ. Persuasive technology. Ubiquity. 2002 Dec;2002(December):2. doi: 10.1145/764008.763957. [DOI] [Google Scholar]
  • 55.Fogg B. Persuasive computers: perspectives and research directions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Internet; CHI98: ACM Conference on Human Factors and Computing Systems; April 18-23, 1998; Los Angeles, CA. New York, NY: ACM Press/Addison-Wesley Publishing Co; 1998. pp. 225–232. [Google Scholar]
  • 56.Oinas-Kukkonen H, Harjumaa M. Persuasive Systems Design: Key Issues, Process Model, and System Features. CAIS. 2009;24:485–500. doi: 10.17705/1CAIS.02428. [DOI] [Google Scholar]
  • 57.Geuens J, Geurts L, Gerling K, Croon R, Abeele V. A Dyad of Lenses for the Motivational Design of mHealth: Bridging the Gap Between Health Theory and App Design. 2019 IEEE International Conference on Healthcare Informatics (ICHI); June 10-13, 2019; Xi'an, China. 2019. pp. 1–12. [DOI] [Google Scholar]
  • 58.Chou Y. Yu-kai Chou: Gamification & Behavioral Design. [2019-10-03]. https://yukaichou.com/gamification-examples/octalysis-complete-gamification-framework/
  • 59.Marczewski A 52 Gamification Mechanics and Elements. 2017. [2019-10-03]. https://www.gamified.uk/user-types/gamification-mechanics-elements/
  • 60.Tondello G, Mora A, Nacke L. Elements of Gameful Design Emerging from User Preferences. Proceedings of the Annual Symposium on Computer-Human Interaction in Play; CHI PLAY '17: The annual symposium on Computer-Human Interaction in Play; October 15 - 18, 2017; Amsterdam The Netherlands. New York, NY, United States: Association for Computing Machinery; 2017. Oct 15, pp. 129–142. [DOI] [Google Scholar]
  • 61.Geuens J, Swinnen T, Geurts L, Westhovens R, Croon R, Vanden AV. Worriers versus Warriors:Tailoring mHealth to Address Differences in Patients with Chronic Arthritis. 2020 IEEE International Conference on Healthcare Informatics (ICHI); Eighth IEEE International Conference on Healthcare Informatics (ICHI 2020). ICHI 2020; November 30 to December 3, 2020; Oldenburg, Germany. New York, NY: IEEE; 2020. Nov 30, [DOI] [Google Scholar]
  • 62.Geuens J, Swinnen TW, Westhovens R, de Vlam Kurt, Geurts L, Vanden Abeele Vero. A Review of Persuasive Principles in Mobile Apps for Chronic Arthritis Patients: Opportunities for Improvement. JMIR Mhealth Uhealth. 2016 Oct 13;4(4):e118. doi: 10.2196/mhealth.6286. https://mhealth.jmir.org/2016/4/e118/ v4i4e118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Matthew P, Welch V. Cochrane Handbook for Systematic Reviews of Interventions. [2019-11-28]. https://training.cochrane.org/handbook/current . [DOI] [PMC free article] [PubMed]
  • 64.Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul 21;339:b2535. doi: 10.1136/bmj.b2535. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=19622551 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. 2010 Jan;29(1):1–8. doi: 10.1037/a0016939.2010-00152-001 [DOI] [PubMed] [Google Scholar]
  • 66.Devi R, Powell J, Singh S. A web-based program improves physical activity outcomes in a primary care angina population: randomized controlled trial. J Med Internet Res. 2014 Sep 12;16(9):e186. doi: 10.2196/jmir.3340. https://www.jmir.org/2014/9/e186/ v16i9e186 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Newbury-Birch D, Coulton S, Bland M, Cassidy P, Dale V, Deluca P, Gilvarry E, Godfrey C, Heather N, Kaner E, McGovern R, Myles J, Oyefeso A, Parrott S, Patton R, Perryman K, Phillips T, Shepherd J, Drummond C. Alcohol screening and brief interventions for offenders in the probation setting (SIPS Trial): a pragmatic multicentre cluster randomized controlled trial. Alcohol Alcohol. 2014;49(5):540–8. doi: 10.1093/alcalc/agu046.agu046 [DOI] [PubMed] [Google Scholar]
  • 68.Bobrow K, Brennan T, Springer D, Levitt NS, Rayner B, Namane M, Yu L, Tarassenko L, Farmer A. Efficacy of a text messaging (SMS) based intervention for adults with hypertension: protocol for the StAR (SMS Text-message Adherence suppoRt trial) randomised controlled trial. BMC Public Health. 2014 Jan 11;14:28. doi: 10.1186/1471-2458-14-28. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-14-28 .1471-2458-14-28 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.BCT Taxonomy Training. [2021-01-28]. https://www.bct-taxonomy.com/
  • 70.Fisher JD, Amico KR, Fisher WA, Harman JJ. The information-motivation-behavioral skills model of antiretroviral adherence and its applications. Curr HIV/AIDS Rep. 2008 Nov 25;5(4):193–203. doi: 10.1007/s11904-008-0028-y. [DOI] [PubMed] [Google Scholar]
  • 71.Movahed E, Morowatisharifabad MA, Farokhzadian J, Nikooie R, Hosseinzadeh M, Askarishahi M, Bidaki R. Antiretroviral Therapy Adherence Among People Living With HIV: Directed Content Analysis Based on Information-Motivation-Behavioral Skills Model. Int Q Community Health Educ. 2019 Jun 19;40(1):47–56. doi: 10.1177/0272684x19858029. [DOI] [PubMed] [Google Scholar]
  • 72.Peng Z, Yu Y, Wei W, Hou Y, Sun Z, Wang Y, Zhang L, Zhou Y, Wang Q, Cai Y. Reliability and Validity of the LifeWindows Information-Motivation-Behavioral Skills Antiretroviral Therapy Adherence Questionnaire Among HIV+ Patients in Shanghai. Patient Prefer Adherence. 2020;14:507–515. doi: 10.2147/PPA.S234041. doi: 10.2147/PPA.S234041.234041 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Chang SJ, Choi S, Kim S, Song M. Intervention Strategies Based on Information-Motivation-Behavioral Skills Model for Health Behavior Change: A Systematic Review. Asian Nursing Research. 2014 Sep;8(3):172–181. doi: 10.1016/j.anr.2014.08.002. [DOI] [Google Scholar]
  • 74.Johnson D, Deterding S, Kuhn K, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: A systematic review of the literature. Internet Interv. 2016 Nov;6:89–106. doi: 10.1016/j.invent.2016.10.002. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(16)30038-0 .S2214-7829(16)30038-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Connolly TM, Boyle EA, MacArthur E, Hainey T, Boyle JM. A systematic literature review of empirical evidence on computer games and serious games. Computers & Education. 2012 Sep;59(2):661–686. doi: 10.1016/j.compedu.2012.03.004. [DOI] [Google Scholar]
  • 76.Boyle EA, Hainey T, Connolly TM, Gray G, Earp J, Ott M, Lim T, Ninaus M, Ribeiro C, Pereira J. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Computers & Education. 2016 Mar;94:178–192. doi: 10.1016/j.compedu.2015.11.003. [DOI] [Google Scholar]
  • 77.Whiteley L, Brown L, Lally M, Heck N, van den Berg JJ. A Mobile Gaming Intervention to Increase Adherence to Antiretroviral Treatment for Youth Living With HIV: Development Guided by the Information, Motivation, and Behavioral Skills Model. JMIR Mhealth Uhealth. 2018 Apr 23;6(4):e96. doi: 10.2196/mhealth.8155. https://mhealth.jmir.org/2018/4/e96/ v6i4e96 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Whiteley L, Brown LK, Mena L, Craker L, Arnold T. Enhancing health among youth living with HIV using an iPhone game. AIDS Care. 2018 Jan 09;30(sup4):21–33. doi: 10.1080/09540121.2018.1503224. http://europepmc.org/abstract/MED/30626196 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Tanner AE, Song EY, Mann-Jackson L, Alonzo J, Schafer K, Ware S, Garcia JM, Arellano Hall E, Bell JC, Van Dam CN, Rhodes SD. Preliminary Impact of the weCare Social Media Intervention to Support Health for Young Men Who Have Sex with Men and Transgender Women with HIV. AIDS Patient Care STDS. 2018 Nov;32(11):450–458. doi: 10.1089/apc.2018.0060. http://europepmc.org/abstract/MED/30398955 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Tanner AE, Mann L, Song E, Alonzo J, Schafer K, Arellano E, Garcia JM, Rhodes SD. weCARE: A Social Media-Based Intervention Designed to Increase HIV Care Linkage, Retention, and Health Outcomes for Racially and Ethnically Diverse Young MSM. AIDS Educ Prev. 2016 Jun;28(3):216–30. doi: 10.1521/aeap.2016.28.3.216. http://europepmc.org/abstract/MED/27244190 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Stankievich E, Malanca A, Foradori I, Ivalo S, Losso M. Utility of Mobile Communication Devices as a Tool to Improve Adherence to Antiretroviral Treatment in HIV-infected Children and Young Adults in Argentina. Pediatr Infect Dis J. 2018 Apr;37(4):345–348. doi: 10.1097/INF.0000000000001807. [DOI] [PubMed] [Google Scholar]
  • 82.Spratt ES, Papa CE, Mueller M, Patel S, Killeen T, Maher E, Drayton C, Dixon TC, Fowler SL, Treiber F. Using Technology to Improve Adherence to HIV Medications in Transitional Age Youth: Research Reviewed, Methods Tried, Lessons Learned. J Gen Med (Dover) 2017;1(1):1002. http://europepmc.org/abstract/MED/30345429 . [PMC free article] [PubMed] [Google Scholar]
  • 83.Shegog R, Markham CM, Leonard AD, Bui TC, Paul ME. “+CLICK”: pilot of a web-based training program to enhance ART adherence among HIV-positive youth. AIDS Care. 2011 Sep 08;24(3):310–318. doi: 10.1080/09540121.2011.608788. [DOI] [PubMed] [Google Scholar]
  • 84.Belzer ME, Naar-King S, Olson J, Sarr M, Thornton S, Kahana SY, Gaur AH, Clark LF, Adolescent Medicine Trials Network for HIV/AIDS Interventions The use of cell phone support for non-adherent HIV-infected youth and young adults: an initial randomized and controlled intervention trial. AIDS Behav. 2014 Apr;18(4):686–96. doi: 10.1007/s10461-013-0661-3. http://europepmc.org/abstract/MED/24271347 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Belzer ME, Kolmodin MacDonell Karen, Clark LF, Huang J, Olson J, Kahana SY, Naar S, Sarr M, Thornton S, Adolescent Medicine Trials Network for HIV/AIDS Interventions Acceptability and Feasibility of a Cell Phone Support Intervention for Youth Living with HIV with Nonadherence to Antiretroviral Therapy. AIDS Patient Care STDS. 2015 Jun;29(6):338–45. doi: 10.1089/apc.2014.0282. http://europepmc.org/abstract/MED/25928772 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Sayegh CS, MacDonell KK, Clark LF, Dowshen NL, Naar S, Olson-Kennedy J, van den Berg JJ, Xu J, Belzer M. The Impact of Cell Phone Support on Psychosocial Outcomes for Youth Living with HIV Nonadherent to Antiretroviral Therapy. AIDS Behav. 2018 Oct 12;22(10):3357–3362. doi: 10.1007/s10461-018-2192-4. http://europepmc.org/abstract/MED/29948339 .10.1007/s10461-018-2192-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Saberi P, Yuan P, John M, Sheon N, Johnson MO. A pilot study to engage and counsel HIV-positive African American youth via telehealth technology. AIDS Patient Care STDS. 2013 Sep;27(9):529–32. doi: 10.1089/apc.2013.0185. http://europepmc.org/abstract/MED/23991691 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Linnemayr S, Huang H, Luoto J, Kambugu A, Thirumurthy H, Haberer JE, Wagner G, Mukasa B. Text Messaging for Improving Antiretroviral Therapy Adherence: No Effects After 1 Year in a Randomized Controlled Trial Among Adolescents and Young Adults. Am J Public Health. 2017 Dec;107(12):1944–1950. doi: 10.2105/AJPH.2017.304089. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Rana Y, Haberer J, Huang H, Kambugu A, Mukasa B, Thirumurthy H, Wabukala P, Wagner GJ, Linnemayr S. Short message service (SMS)-based intervention to improve treatment adherence among HIV-positive youth in Uganda: focus group findings. PLoS One. 2015;10(4):e0125187. doi: 10.1371/journal.pone.0125187. https://dx.plos.org/10.1371/journal.pone.0125187 .PONE-D-14-53879 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Puccio JA, Belzer M, Olson J, Martinez M, Salata C, Tucker D, Tanaka D. The use of cell phone reminder calls for assisting HIV-infected adolescents and young adults to adhere to highly active antiretroviral therapy: a pilot study. AIDS Patient Care STDS. 2006 Jun;20(6):438–44. doi: 10.1089/apc.2006.20.438. [DOI] [PubMed] [Google Scholar]
  • 91.Naar-King S, Outlaw AY, Sarr M, Parsons JT, Belzer M, Macdonell K, Tanney M, Ondersma SJ, Adolescent Medicine Network for HIV/AIDS Interventions Motivational Enhancement System for Adherence (MESA): pilot randomized trial of a brief computer-delivered prevention intervention for youth initiating antiretroviral treatment. J Pediatr Psychol. 2013 Jul;38(6):638–48. doi: 10.1093/jpepsy/jss132. http://europepmc.org/abstract/MED/23359664 .jss132 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Outlaw AY, Naar-King S, Tanney M, Belzer ME, Aagenes A, Parsons JT, Merlo LJ, Adolescent Medicine Trials Network for HIV/AIDS Interventions The initial feasibility of a computer-based motivational intervention for adherence for youth newly recommended to start antiretroviral treatment. AIDS Care. 2014 Jan;26(1):130–5. doi: 10.1080/09540121.2013.813624. http://europepmc.org/abstract/MED/23869650 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Hightow-Weidman L, Muessig K, Knudtson K, Srivatsa M, Lawrence E, LeGrand S, Hotten A, Hosek S. A Gamified Smartphone App to Support Engagement in Care and Medication Adherence for HIV-Positive Young Men Who Have Sex With Men (AllyQuest): Development and Pilot Study. JMIR Public Health Surveill. 2018 Apr 30;4(2):e34. doi: 10.2196/publichealth.8923. https://publichealth.jmir.org/2018/2/e34/ v4i2e34 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Dowshen N, Kuhns LM, Johnson A, Holoyda BJ, Garofalo R. Improving adherence to antiretroviral therapy for youth living with HIV/AIDS: a pilot study using personalized, interactive, daily text message reminders. J Med Internet Res. 2012 Apr 05;14(2):e51. doi: 10.2196/jmir.2015. https://www.jmir.org/2012/2/e51/ v14i2e51 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Dowshen N, Kuhns LM, Gray C, Lee S, Garofalo R. Feasibility of interactive text message response (ITR) as a novel, real-time measure of adherence to antiretroviral therapy for HIV+ youth. AIDS Behav. 2013 Jul;17(6):2237–43. doi: 10.1007/s10461-013-0464-6. [DOI] [PubMed] [Google Scholar]
  • 96.Garofalo R, Kuhns LM, Hotton A, Johnson A, Muldoon A, Rice D. A Randomized Controlled Trial of Personalized Text Message Reminders to Promote Medication Adherence Among HIV-Positive Adolescents and Young Adults. AIDS Behav. 2016 May;20(5):1049–59. doi: 10.1007/s10461-015-1192-x. http://europepmc.org/abstract/MED/26362167 .10.1007/s10461-015-1192-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Dworkin MS, Lee S, Chakraborty A, Monahan C, Hightow-Weidman L, Garofalo R, Qato DM, Liu L, Jimenez A. Acceptability, Feasibility, and Preliminary Efficacy of a Theory-Based Relational Embodied Conversational Agent Mobile Phone Intervention to Promote HIV Medication Adherence in Young HIV-Positive African American MSM. AIDS Educ Prev. 2019 Feb;31(1):17–37. doi: 10.1521/aeap.2019.31.1.17. [DOI] [PubMed] [Google Scholar]
  • 98.Dworkin M, Chakraborty A, Lee S, Monahan C, Hightow-Weidman L, Garofalo R, Qato D, Jimenez A. A Realistic Talking Human Embodied Agent Mobile Phone Intervention to Promote HIV Medication Adherence and Retention in Care in Young HIV-Positive African American Men Who Have Sex With Men: Qualitative Study. JMIR Mhealth Uhealth. 2018 Jul 31;6(7):e10211. doi: 10.2196/10211. https://mhealth.jmir.org/2018/7/e10211/ v6i7e10211 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Lee S, Lu Y, Chakraborty A, Dworkin M. Development of a mobile personal health guide for HIV-infected African American MSM. International Conference on Intelligent Virtual Agents; September 20–23, 2016; Los Angeles, CA. 2016. Oct 19, pp. 247–450. [DOI] [Google Scholar]
  • 100.Dulli L, Ridgeway K, Packer C, Murray KR, Mumuni T, Plourde KF, Chen M, Olumide A, Ojengbede O, McCarraher DR. A Social Media-Based Support Group for Youth Living With HIV in Nigeria (SMART Connections): Randomized Controlled Trial. J Med Internet Res. 2020 Jun 02;22(6):e18343. doi: 10.2196/18343. https://www.jmir.org/2020/6/e18343/ v22i6e18343 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Abiodun O, Ladi-Akinyemi B, Olu-Abiodun O, Sotunsa J, Bamidele F, Adepoju A, David N, Adekunle M, Ogunnubi A, Imhonopi G, Yinusa I, Erinle C, Soetan O, Arifalo G, Adeyanju O, Alawode O, Omodunbi T. A Single-Blind, Parallel Design RCT to Assess the Effectiveness of SMS Reminders in Improving ART Adherence Among Adolescents Living with HIV (STARTA Trial) J Adolesc Health. 2021 Apr;68(4):728–736. doi: 10.1016/j.jadohealth.2020.11.016.S1054-139X(20)30684-4 [DOI] [PubMed] [Google Scholar]
  • 102.Michielsen K, Chersich M, Temmerman M, Dooms T, Van Rossem R. Nothing as Practical as a Good Theory? The Theoretical Basis of HIV Prevention Interventions for Young People in Sub-Saharan Africa: A Systematic Review. AIDS Res Treat. 2012;2012:345327–18. doi: 10.1155/2012/345327. doi: 10.1155/2012/345327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Simoni JM, Ronen K, Aunon FM. Health Behavior Theory to Enhance eHealth Intervention Research in HIV: Rationale and Review. Curr HIV/AIDS Rep. 2018 Dec 3;15(6):423–430. doi: 10.1007/s11904-018-0418-8. http://europepmc.org/abstract/MED/30511186 .10.1007/s11904-018-0418-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Munro S, Lewin S, Swart T, Volmink J. A review of health behaviour theories: how useful are these for developing interventions to promote long-term medication adherence for TB and HIV/AIDS? BMC Public Health. 2007 Jun 11;7(1):104. doi: 10.1186/1471-2458-7-104. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-7-104 .1471-2458-7-104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Patton GC, Sawyer SM, Santelli JS, Ross DA, Afifi R, Allen NB, Arora M, Azzopardi P, Baldwin W, Bonell C, Kakuma R, Kennedy E, Mahon J, McGovern T, Mokdad AH, Patel V, Petroni S, Reavley N, Taiwo K, Waldfogel J, Wickremarathne D, Barroso C, Bhutta Z, Fatusi AO, Mattoo A, Diers J, Fang J, Ferguson J, Ssewamala F, Viner RM. Our future: a Lancet commission on adolescent health and wellbeing. The Lancet. 2016 Jun;387(10036):2423–2478. doi: 10.1016/s0140-6736(16)00579-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Leany B. Handbook of Adolescent Health Psychology. New York, NY: Springer; 2013. Mar 26, Brain development and health implications in adolescents; pp. 235–244. [Google Scholar]
  • 107.Linders A. International Handbook on Adolescent Health and Development. Berlin, Germany: Springer International Publishing; 2016. Nov 23, Deconstructing adolescence; pp. 15–28. [Google Scholar]
  • 108.Berenbaum S, Beltz A, Corley R. The importance of puberty for adolescent development: conceptualization and measurement. Adv Child Dev Behav. 2015 Jan 1;48:53–92. doi: 10.1016/bs.acdb.2014.11.002.S0065-2407(14)00030-5 [DOI] [PubMed] [Google Scholar]
  • 109.Bell B. Perspectives on HCI Research with Teenagers. Cham, Switzerland: Springer International Publishing; 2016. Understanding adolescents; pp. 11–27. [Google Scholar]
  • 110.O' Donohue W, Benuto L, Tolle L. Handbook of Adolescent Health Psychology. New York, NY: Springer-Verlag; 2013. [Google Scholar]
  • 111.Fitton D, Bell B. Working with teenagers within HCI research: Understanding teen-computer interaction. 28th International BCS Human Computer Interaction Conference on HCI 2014; September 9-12, 2014; Southport UK. 2014. [DOI] [Google Scholar]
  • 112.Blake Helms C, Turan JM, Atkins G, Kempf M, Clay OJ, Raper JL, Mugavero MJ, Turan B. Interpersonal Mechanisms Contributing to the Association Between HIV-Related Internalized Stigma and Medication Adherence. AIDS Behav. 2017 Jan 10;21(1):238–247. doi: 10.1007/s10461-016-1320-2. http://europepmc.org/abstract/MED/26864692 .10.1007/s10461-016-1320-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Mbuagbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills EJ, Smieja M, Dolovich L, Kouanfack C. The Cameroon Mobile Phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS One. 2012 Dec 6;7(12):e46909. doi: 10.1371/journal.pone.0046909. https://dx.plos.org/10.1371/journal.pone.0046909 .PONE-D-12-24092 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Sherman EM, Niu J, Elrod S, Clauson KA, Alkhateeb F, Eckardt P. Effect of mobile text messages on antiretroviral medication adherence and patient retention in early HIV care: an open-label, randomized, single center study in south Florida. AIDS Res Ther. 2020 May 13;17(1):16. doi: 10.1186/s12981-020-00275-2. https://aidsrestherapy.biomedcentral.com/articles/10.1186/s12981-020-00275-2 .10.1186/s12981-020-00275-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Kok G, Schaalma H, Ruiter RAC, van Empelen P, Brug J. Intervention mapping: protocol for applying health psychology theory to prevention programmes. J Health Psychol. 2004 Jan;9(1):85–98. doi: 10.1177/1359105304038379. [DOI] [PubMed] [Google Scholar]
  • 116.Michie S, van Stralen Maartje M, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011 Apr 23;6:42. doi: 10.1186/1748-5908-6-42. https://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-6-42 .1748-5908-6-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Heneghan M, Hussain T, Barrera L, Cai S, Haugen M, Duff A, Shoop J, Morgan E, Rossoff J, Weinstein J, Hijiya N, Cella D, Badawy S. Applying the COM-B model to patient-reported barriers to medication adherence in pediatric acute lymphoblastic leukemia. Pediatric Blood & Cancer. 2020:e28216. doi: 10.1002/pbc.28216. doi: 10.1002/pbc.28216. [DOI] [PubMed] [Google Scholar]
  • 118.Fitton D, Little L, Bell B. Perspectives on HCI Research with Teenagers. Cham, Switzerland: Springer International Publishing; 2016. Introduction: HCI Reaches Adolescence; pp. 1–9. [Google Scholar]
  • 119.Fitton D, Read J, Horton M. The challenge of working with teens as participants in interaction design. CHI '13: CHI Conference on Human Factors in Computing Systems; April 27-May 2, 2013; Paris, France. New York, NY: Association for Computing Machinery; 2013. [DOI] [Google Scholar]
  • 120.Badawy S, Thompson A, Liem R. Technology Access and Smartphone App Preferences for Medication Adherence in Adolescents and Young Adults With Sickle Cell Disease. Pediatr Blood Cancer. 2016 May;63(5):848–52. doi: 10.1002/pbc.25905. doi: 10.1002/pbc.25905. [DOI] [PubMed] [Google Scholar]
  • 121.Montaño D, Kasprzyk D. Health Behavior: Theory, Research, and Practice (5th edition) Hoboken, NJ: Jossey-Bass; 2015. Theory of reasoned action, theory of planned behavior, and the integrated behavioral model; pp. 95–124. [Google Scholar]
  • 122.Bassett IV, Wilson D, Taaffe J, Freedberg KA. Financial incentives to improve progression through the HIV treatment cascade. Curr Opin HIV AIDS. 2015 Nov;10(6):451–63. doi: 10.1097/COH.0000000000000196. http://europepmc.org/abstract/MED/26371461 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123.Galárraga Omar, Enimil A, Bosomtwe D, Cao W, Barker DH. Group-based economic incentives to improve adherence to antiretroviral therapy among youth living with HIV: safety and preliminary efficacy from a pilot trial. Vulnerable Child Youth Stud. 2020;15(3):257–268. doi: 10.1080/17450128.2019.1709678. http://europepmc.org/abstract/MED/33281920 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124.Galárraga Omar, Kuo C, Mtukushe B, Maughan-Brown B, Harrison A, Hoare J. iSAY (incentives for South African youth): Stated preferences of young people living with HIV. Soc Sci Med. 2020 Nov;265:113333. doi: 10.1016/j.socscimed.2020.113333. http://europepmc.org/abstract/MED/32896799 .S0277-9536(20)30552-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 125.El-Sadr WM, Donnell D, Beauchamp G, Hall HI, Torian LV, Zingman B, Lum G, Kharfen M, Elion R, Leider J, Gordin FM, Elharrar V, Burns D, Zerbe A, Gamble T, Branson B, HPTN 065 Study Team Financial Incentives for Linkage to Care and Viral Suppression Among HIV-Positive Patients: A Randomized Clinical Trial (HPTN 065) JAMA Intern Med. 2017 Aug 01;177(8):1083–1092. doi: 10.1001/jamainternmed.2017.2158. http://europepmc.org/abstract/MED/28628702 .2631560 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 126.Brown M, O'Neill N, van Woerden Hugo, Eslambolchilar P, Jones M, John A. Gamification and Adherence to Web-Based Mental Health Interventions: A Systematic Review. JMIR Ment Health. 2016 Aug 24;3(3):e39. doi: 10.2196/mental.5710. https://mental.jmir.org/2016/3/e39/ v3i3e39 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.De CR, Geuens J, Verbert K, Abeele V. A systematic review of the effect of gamification on adherence across disciplines. International Conference on Human-Computer Interaction; July 24–29, 2021; Virtual Event. 2021. [DOI] [Google Scholar]
  • 128.King D, Greaves F, Exeter C, Darzi A. ‘Gamification’: Influencing health behaviours with games. Journal of the Royal Society of Medicine. 2013 Mar 12;106(3):76–78. doi: 10.1177/0141076813480996.106/3/76 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 129.Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Serious Games. 2013 Dec 12;1(1):e3. doi: 10.2196/games.3139. https://games.jmir.org/2013/1/e3/ v1i1e3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 130.Hervas R, Ruiz-Carrasco D, Mondejar T, Bravo J. Gamification mechanics for behavioral change: a systematic review and proposed taxonomy. PervasiveHealth '17: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 23-26, 2017; Barcelona, Spain. New York, NY: Association for Computing Machinery; 2017. [DOI] [Google Scholar]
  • 131.Sardi L, Idri A, Fernández-Alemán José Luis. A systematic review of gamification in e-Health. J Biomed Inform. 2017 Jul;71:31–48. doi: 10.1016/j.jbi.2017.05.011. https://linkinghub.elsevier.com/retrieve/pii/S1532-0464(17)30106-5 .S1532-0464(17)30106-5 [DOI] [PubMed] [Google Scholar]
  • 132.Miller AS, Cafazzo JA, Seto E. A game plan: Gamification design principles in mHealth applications for chronic disease management. Health Informatics J. 2016 Jun;22(2):184–93. doi: 10.1177/1460458214537511. https://journals.sagepub.com/doi/10.1177/1460458214537511?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed .1460458214537511 [DOI] [PubMed] [Google Scholar]
  • 133.Peppet S. Unraveling Privacy: The Personal Prospectus and the Threat of a Full-Disclosure Future. 2011. Jan 1, [2021-11-10]. https://scholar.law.colorado.edu/articles/177 .
  • 134.Warner M, Gutmann A, Sasse MA, Blandford A. Privacy Unraveling Around Explicit HIV Status Disclosure Fields in the Online Geosocial Hookup App Grindr. Proc. ACM Hum.-Comput. Interact. 2018 Nov 01;2(CSCW):1–22. doi: 10.1145/3274450. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Search terms structured as per the syntax of each database.

Multimedia Appendix 2

Characteristics of included studies.

Multimedia Appendix 3

Use of theory in the included interventions from the Theory Coding Scheme (TCS).

Multimedia Appendix 4

Presence of behavior change techniques (BCTs) from BCT taxonomy version 1 in the included interventions.

Multimedia Appendix 5

Presence of design principles in the included interventions from lenses of motivational principles.


Articles from JMIR mHealth and uHealth are provided here courtesy of JMIR Publications Inc.

RESOURCES