Abstract
Background
The digitization of health care led to a steady increase in the adoption and use of mobile health (mHealth) apps. Germany is the first country in the world to cover the costs of mHealth apps through statutory health insurance. Although the benefits of mHealth apps are discussed in detail, aspects of problems and barriers are rarely studied.
Objective
This scoping review aimed to map and categorize the evidence on problems and barriers related to the use of mHealth apps.
Methods
Systematic searches were conducted in the MEDLINE, Embase, and PsycINFO databases. Additional searches were conducted on JMIR Publications and on websites of relevant international organizations. The inclusion criteria were publications dealing with apps similar to those approved in the German health care system, publications addressing problems and barriers related to the use of mHealth apps, and articles published between January 1, 2015, and June 8, 2021. Study selection was performed by 2 reviewers. The manuscript was drafted according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. The analysis of the included publications and categorization of problems and hurdles were performed using MAXQDA (VERBI Software GmbH).
Results
The database search identified 1479 publications. Of the 1479 publications, 21 (1.42%) met the inclusion criteria. A further 8 publications were included from citation searching and searching in JMIR Publications. The identified publications were analyzed for problems and barriers. Problems and barriers were classified into 10 categories (“validity,” “usability,” “technology,” “use and adherence,” “data privacy and security,” “patient-physician relationship,” “knowledge and skills,” “individuality,” “implementation,” and “costs”). The most frequently mentioned categories were use and adherence (eg, incorporating the app into daily life or dropouts from use; n=22) and usability (eg, ease of use and design; n=19).
Conclusions
The search identified various problems and barriers in the context of mHealth apps. Although problems at the app level (such as usability) are studied frequently, problems at the system level are addressed rather vaguely. To ensure optimal use of and care with mHealth apps, it is essential to consider all types of problems and barriers. Therefore, researchers and policy makers should have a special focus on this issue to identify the needs for quality assurance.
International Registered Report Identifier (IRRID)
RR2-10.2196/32702
Keywords: mobile health, mHealth, app, Digital Health Application, DHA, Digitale Gesundheitsanwendungen, DiGA, problem, barrier, mobile phone
Introduction
Background
Since the development of the iPhone in 2007, the proliferation of apps has steadily increased. In particular, mobile health (mHealth) solutions, such as web applications or native apps, are increasingly diffused and provide many approaches to support users’ health. They can be applied in health monitoring and surveillance, for health promotion and raising awareness, communication and reporting, data collection, telemedicine, emergency medical care, point-of-care support, and decision support [1].
With the aim of benefiting from the potential of new technologies, such as mHealth apps for health care, the Digital Healthcare Act was introduced in Germany in December 2019. Hereby, particular mHealth apps with a low-risk class (I or IIa according to the Medical Device Regulation or, within the scope of the transitional provisions, the Medical Device Directive), known as Digital Health Applications (Digitale Gesundheitsanwendungen [DiGA]), became part of the German health care system [2,3]. During the corresponding approval process, the “Fast-Track Process for DiGA,” mHealth apps have to fulfill a predefined set of criteria. Among other things, these aim to prevent safety issues and problems with data privacy and security and to guarantee benefits either in the form of medical benefits or patient-relevant structure and process improvements for the patient [4]. mHealth apps that meet these requirements can be included in the DiGA directory. The apps listed in this directory are reimbursable by statutory health insurers. Currently, approximately 40 DiGA are listed and subsequently reimbursable. Although the German Fast-Track Process for DiGA is currently unique in the world, it has been announced that it will also be applied in France [5].
Many publications are addressing the possible benefits of mHealth apps. For example, mHealth apps for behavior change (either as a stand-alone intervention or as part of a larger intervention) have been shown to positively impact health outcomes compared with standard care and can be a useful adjunct in behavior change health interventions [6]. In addition, Liu et al [7] examined the effectiveness of mHealth apps for assisted self-care interventions in patients with type 2 diabetes, hypertension, or both and found that they were effective in improving blood glucose levels and blood pressure control. Wang et al [8] systematically reviewed the effectiveness of mHealth apps for monitoring and managing mental health symptoms or disorders and found that they have the potential to monitor or improve symptoms of certain mental health disorders, such as anxiety, stress, alcohol disorder, sleep disorder, depression, suicidal behaviors, and posttraumatic stress disorders. Finally, rising DiGA prescription numbers and strong interest from physicians and psychotherapists indicate that DiGA are expected to have the potential to improve care and, in some cases, fill existing gaps in care [9].
Objectives
Nevertheless, as in other sectors and areas of health care, problems and barriers might arise in the context of mHealth apps. Therefore, an integrated application of mHealth in health care systems requires a comprehensive analysis of problems and barriers to adequately address potential challenges and risks in advance. To the best of our knowledge, problems and barriers related to mHealth have not yet been gathered systematically. Such a compilation would be the precondition to analyze whether certain problems require further governance and regulation during the processes of development, approval, dissemination, or use. Therefore, this study aimed to systematically search the literature to identify problems and barriers related to the use of mHealth apps similar to DiGA. The identified problems and barriers were compiled and categorized.
Methods
Overview
A scoping review was conducted to identify the problems and barriers related to the use of mHealth apps. This research was guided by the 5 mandatory stages for scoping reviews proposed by Arksey and O’Malley [10], which were further developed by Levac et al [11]. The manuscript was drafted according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist [12]. The corresponding research protocol was published in JMIR Research Protocols [13].
Search Strategy
A systematic search for articles published between January 1, 2015, and June 8, 2021, was conducted using bibliographic databases (MEDLINE, Embase, and PsycINFO). The search strategies were developed through discussion (GDG and CS) and with the aid of an experienced researcher (SN).
To develop a suitable search string for the systematic search in the MEDLINE, Embase, and PsycINFO databases, the methodology, issues, participants (MIP) scheme including methodology (all methodologies), issues (problems and barriers related to mHealth apps), and participants (main focus on patients and health care providers) was adapted [14]. Subsequently, the search terms and links between them were defined. Searches for defined terms were restricted to the occurrence in the abstract, title, and keywords. If there were indexing terms (Medical Subject Headings and Emtree), the search string was extended accordingly. The final search strategy for each database can be found in the research protocol [13].
Results were loaded into the EndNote reference management program (version X9; Clarivate). To supplement additional evidence, JMIR Publications was searched on January 18 and 19, 2022, and the reference lists of included studies were investigated on eligible articles.
The search in JMIR Publications was performed using the search function on the journal’s website. For this purpose, the problem terms were combined with either the term “mHealth app” or the term “mobile app.” This adjustment was made owing to a consensus paper recommended by the editor [15].
Apart from the bibliographic databases and reference lists, gray literature sources such as reports, guidelines, and working papers were searched via institutional websites. A full list of the institutions considered can be found in the corresponding research protocol [13].
The search for gray literature was conducted based on the institutional website in question. If available, search fields were used to identify publications using search words related to mHealth apps. Otherwise, relevant subpages with reference to the topic of mHealth apps were searched.
Eligibility Criteria
The inclusion criteria were articles focused on problems and barriers related to the use of mHealth apps that were similar to the German DiGA concept. Journal papers were included if they were peer reviewed; published in 2015 or later; and were written in English, German, or French. Papers were included irrespective of their research method. See Textbox 1 or the research protocol [13] for the detailed inclusion criteria. The criteria that had to be met for mHealth apps to be classified as being similar to DiGA can be derived from the exclusion criteria in Textbox 2. Reviews and app assessments of mHealth app categories, which in principle could also be implemented as DiGA or have already been implemented, were also assessed as being similar to DiGA and consequently included as well.
Inclusion criteria.
Articles mentioning problems and barriers related to the use of mobile health (mHealth) apps.
A problem term mentioned in the abstract or title is related to the use of mHealth apps.
Publication with a focus on mHealth apps.
The included mHealth apps were similar to Digitale Gesundheitsanwendungen.
Articles published in 2015 or later.
Language: English, German, or French.
Exclusion criteria.
Did not provide an answer to the research question.
The problem term mentioned in the abstract or title was not related to the investigated mobile health (mHealth) app.
Publication does not focus on mHealth apps.
-
Examined mHealth apps fulfill ≥1 of the following criteria:
Not used by the patient
No relation to illness, injury, or disability
Primary prevention
The medical purpose is not achieved through the main digital functions
Research protocol or conference abstract.
Article published before 2015.
Language other than English, German, or French.
Exclusion criteria were not providing an answer to the research question or not having at least one of the predefined problem terms related to the investigated app (“difficulty,” “obstacle,” “problem,” “issue,” “challenge,” or “barrier”) in the title or abstract. Further articles were excluded if the investigated mHealth apps were not similar to DiGA (not for patient use; no relation to illness, injury, or disability; for primary prevention; or not achieving its medical purpose through the main digital functions); the publication date was before 2015; or the language was other than English, German, or French. Furthermore, research protocols and conference abstracts were excluded from this study. The exclusion criteria are presented in Textbox 2 or in more detail in the research protocol [13].
Article Screening and Data Extraction
Duplicates were removed after downloading citations and transferring them into EndNote. Screening and selection were performed in 2 steps. In a first step, 2 reviewers (GDG and CS) independently assessed the titles and abstracts. In a second step, articles included for full-text screening were independently assessed by the same reviewers using exclusion criteria (Textbox 2). In case of disagreement, conflicts were resolved by a third person (SN).
The 2 reviewers (GDG and CS) used MAXQDA (VERBI Software GmbH) to independently mark and extract relevant text characteristics of the included articles. A previously developed data-charting form was used for the extraction. Extracted data consisted of metadata, such as article characteristics as well as information related to the underlying research question—problems and barriers related to the use of mHealth apps. Thus, the relevant items were author, year, study country, study participants, type of study, underlying diseases, and problems and barriers related to the use of mHealth apps.
Synthesis of Results
After evaluating the included studies, the results were summarized in a descriptive manner. The identified problems and barriers were grouped into clusters. Whenever a problem or barrier arose that could not be sorted into an existing cluster, a new cluster was created. Finally, the respective clusters were appropriately named according to the problems and barriers they contained. In addition, the results were summarized, systemized, and presented in Multimedia Appendix 1 [16-44] and Multimedia Appendix 2 [16-44].
Results
Selection of Sources of Evidence
The systematic search yielded 1479 articles after removing duplicates (Figure 1). Of these 1479 articles, 72 (4.87%) studies were screened in full text, and subsequently, 21 (1.42%) studies met the inclusion criteria [16-36]. Additionnaly, 3 studies were identified by screening the references of the included studies [37-39] and 5 studies were identified from the search in JMIR Publications [40-44]. The search on institutional websites did not yield any further results. Of the 1479 articles, 29 (1.96%) studies were included in this scoping review. The full-text screening process and reasons for exclusion are summarized in Multimedia Appendix 3 [16-36,45-95].
Included Studies
Of the 29 articles included, 25 (86%) were primary studies [16,18-22,24-27,30-44] and 4 (14%) were nonsystematic reviews [17,23,28,29]. The United States (8/29, 26%) and the United Kingdom (5/29, 17%) were the countries with most included studies. All studies are listed in Multimedia Appendix 1. The included studies varied widely in terms of study design, underlying diseases, sample sizes, and sample composition. Furthermore, the objectives of the investigation varied. Of the 29 articles included, 18 (62%) articles focused on 1 app [16,18,19,22,25,26,30,32,33,36-44], 2 (7%) articles focused on multiple apps [24,35], and 9 (31%) articles did not focus on a specific app or device [17,21,23,24,27-29,34,35]; 8 (28%) studies included had a qualitative design [16,18,21,32,34,37,39,42], 5 (17%) studies were quantitative [22,24,27,31,35], 12 (41%) had a mixed methods design (qualitative and quantitative) [19,20,25,26,30,33,36,38,40,41,43,44], and 4 (14%) studies were reviews [17,23,28,29] (Multimedia Appendix 1). Most qualitative studies were based on interviews [16,26,30,32-34,39-42,44], focus group studies [18,21,36], or included both [19,38,43]. Quantitative research methods were mostly questionnaire studies [19,20,22,26,30,31,33,35,36,38,40,41,44]. Of the 29 articles included, 3 (10%) studies included a randomized controlled trial [19,20,38]. Overall, the studies included between 1 [37] and 1040 participants [31]. For further information on the included articles, refer to Multimedia Appendix 1.
Synthesis of Results
Overview
The problems and barriers identified in the included studies were categorized into 10 major groups. The included studies usually addressed several different problems and barriers. Multimedia Appendix 2 provides an overview of the categories of problems and barriers that were found in each article. The 10 groups included “validity,” “usability,” “technology,” “use and adherence,” “data privacy and data security,” “patient-physician relationship,” “knowledge and skills,” “individuality,” “implementation,” and “costs” (Figure 2).
Validity
Problems with validity were addressed in 16 articles [16,18,21,23-30,33,35,39,40,44]. Of these, 3 described quantitative studies [24,27,35], 4 described qualitative studies [16,18,21,39], 6 were mixed-design studies [25,26,30,33,40,44], and 3 were reviews [23,28,29]. Problems addressed in these studies were mainly in the area of contents, outcomes, and user input.
Problems in validity concerning the contents and outcomes of some mHealth apps were due to a lack of accordance with clinical standards. A fundamental problem was found in missing empirical evidence [24,27,29].
Some content was declared as inappropriate [18], wrong [24], or ambiguous [24,33,40]. Patients and health care staff stated that the depth and quality of information was often not suitable [21,39]. One quantitative study found that a few apps provided details about the underlying formulas used for calculations [24]. In 2 studies, some users criticized that functions did not meet their needs [35,40].
The lack of added value was perceived or assumed in qualitative and quantitative studies [21,25-27,44]. Some studies described mHealth solutions as inferior to usual care [21,23,29,30] or mentioned adverse effects or even harm [16,21,27,28,39]. One mixed-design study found that physiotherapists were skeptical about whether a hybrid setting including an mHealth app could be conducive to building and maintaining a robust working alliance between patients and physiotherapists [25].
In addition to problems with app content, an app assessment study found problems with user inputs and their validation [24]. In another study, patients described problems with changing the entered values [39]. Only a few apps provided guidance based on user-entered data. This was especially important in mental health crises or the risk of suicide [27]. Some apps caused inappropriate alerts after incorrect data entry in the settings component [44]. Patients manipulated the generated results by deliberately entering incorrect values to receive better feedback from the app [39]. Therefore, the medical benefits of the app could be reduced. Apps including physical exercises also faced the problem of validation. Lack of feedback on the correctness of exercise executions led to a feeling of insecurity and incorrect execution of exercises [25].
Health care professionals described app measurements, calculations, and the resulting data provided to the user as imprecise and inaccurate [16]. App assessment and interviews with patients revealed that incorrect results, despite correct input values, were a problem [24,39]. In 1 study, health care providers criticized that mHealth apps were not able to consider each aspect related to the subjects separately [33].
Usability
In total, 19 articles described the problems and barriers related to the usability of mHealth apps [16,18-20,22,25,26,29,30,33,35,37-44]. Two quantitative studies [22,35], 5 qualitative studies [16,18,37,39,42], 11 mixed-design studies [19,20,25,26,30,33,38,40,41,43,44], and 1 semistructured review [29] addressed usability as a problem. On the one hand, usability issues related to appearance or contents were seen in the software (the apps themselves), and on the other hand, problems were found in the hardware (executing devices). Some articles cited usability as an unspecified problem, among others [16,20,44].
Both patients and health care professionals described the design of mHealth apps as problematic [16,18,25,26,33,37,39,43,44]. Some apps included nonintuitive navigation or interfaces [26,29,37,38,44] or were generally difficult to use [18,19,22,30,35,41,42]. Three studies found that an insufficient or no user manual was provided [30,39,43]. Further issues with usability were observed in bulkiness or size of devices [19,37,40], visual unattractiveness, and discomfort [20].
Technology
Technical problems were mentioned in 18 articles [16,18-20,22,24-27,29,33,37-40,42-44] and were found in both devices and software. Three quantitative studies [22,24,27], 5 qualitative studies [16,18,37,39,42], 9 mixed-design studies [19,20,25,26,33,38,40,43,44], and 1 review [29] described problems related to technology.
A case study with an older user found a dependence on technological support [37]. Patients faced issues related to hardware, such as lack of free storage space on the smartphone, short battery life [20], and use of small devices with small screens, such as smartphones [44]. Some patients still use feature phones with limited functions compared with smartphones and accordingly cannot use apps [22].
Software-related issues were seen in functionality [27,43], challenges with software updates, and technical issues with operating systems [44]. Patients reported bugs, glitches, or intermittent screen freezes in 2 apps [16,44]. Technological failures may lead to physician-induced errors [33]. In addition to technological problems, it was stated that detecting these potential issues before app distribution is a challenge [24].
A further issue was observed in terms of compatibility. Problems for patients could result from incompatibility or difficulties between apps and running devices [18,20,26,38], between running and external devices [19,20], and connection to a server [40] or electronic health records [42].
Some articles mentioned technical problems that were not described further [19,25,29,37,39,44]. One mixed-design study referred to technical difficulties with access but did not provide further details [38].
Use and Adherence
Problems in the category of use and adherence were found in 4 quantitative studies [22,24,31,35], 6 qualitative studies [16,18,21,37,39,42], 9 mixed-design studies [19,20,25,26,30,38,40,43,44], and 3 reviews [17,28,29]. Qualitative research with patients as well as health care professionals and 1 review found a common problem of lack of adherence [16,29,39,42]. Many studies have reported high dropout rates [18-20,22,26,28-31,35,38,40]. In 2 studies, patients expressed minimal or no interest in the use of mHealth apps [42,44]. Problems cited regarding use and adherence included lack of motivation, additional burden on patients, social or disease context, lack of time and integration of the app into daily life, and lack of personalized elements.
Patients and health care professionals perceived lack of motivation [18,21] and lack of engagement in users [16,19,25,40,43] as reasons for low adherence and a high number of dropouts. In 1 study, users expressed that they had forgotten to use the app [20].
Some patients perceived the app as an additional burden or found it overwhelming [19,42,44]. Some participants did not update their goals to conform to expert recommendations and maintain achievable goals [19]. Otherwise, patients expressed concerns about being judged if they did not complete or missed lessons [37]. Two qualitative studies revealed that some patients did not use the app based on the given advice [39,42].
Some social situations [19,20,24,25,37] or disease-specific contexts [37] were reported as being problematic. Environmental influences [19,26] and special use cases [19] were further issues. One review stated that distraction by other web-based activities could be a problem [29].
Patients pointed out that the lack of a pause option [26] and difficulties with integration in everyday life can be a major barrier to adoption [44]. A further risk was a possible interference of technology use on relationships [40].
Lack of time was a major factor that was decreasing use [20,31,42,44]. Repetitive, long, complicated, and boring content reinforced the problem and might lead to even less time spent on mHealth apps [19,21,25,26,29,38].
Qualitative studies and reviews have shown that the lack of human factor also affected use and adherence. In other words, mHealth apps lacked personal touch, empathy, and complex aspects of human interaction [17,21]. Communication was sometimes seen as ineffective [29]. Some people will not use mHealth apps and reject them because they see their recovery as a process that depends only on the health care professionals caring for them [16].
Data Privacy and Security
Data security and data privacy were addressed in 12 publications [16,18,21,27-29,33-35,40-42]. Thereof, 2 studies had a quantitative design [27,35], 5 studies had a qualitative design [16,18,21,34,42], 3 studies were mixed-design studies [33,40,41], and 2 publications included reviews [28,29]. There are mainly 2 groups of problems related to generated or collected data.
On the one hand, there are data security and data privacy problems [16,18,21,27,29,33-35,41,42]. On the other hand, there are problems with nontransparent communication of data privacy policies [21,27,28,40].
First, concerns regarding weak security arise in the context of data security and privacy [34,35]. Thus, a study of patients who are chronically ill found that 37.2% of them reported being concerned about the disclosure of personal information [35]. Further problems regarding data security and privacy were access without permission [16] and possible breaches of and concerns about confidentiality [16,27,33,39,42]. One app assessment study emphasized in its discussion that when data are stored on provider servers, there is an increased risk that the data will be used or sold for undesirable purposes [27]. Finally, health care practitioners mentioned problems regarding the identification of individuals by unauthorized data access [21] and patients worried about the unpredictable consequences of data leaks [34].
The other problem was the transparency of data handling [40]. Although some apps did not provide privacy policies [27,28], others were not clear or difficult to understand [21,27].
Patient-Physician Relationship
In this context, the patient-physician relationship refers to all types of relationships between patients and health care providers. Thus, it includes therapeutic relationships as well. Problems in this category were described in 13 articles [16,21,23,25,27,29-32,34,38,40,44] and included “the attempt to replace the clinician,” “lack of a therapeutic alliance,” “negative impact on the relationship,” “information inequalities,” and “the question of responsibility.” This category was addressed in 2 quantitative studies [27,31], 4 qualitative studies [16,21,32,34], 5 mixed-design studies [25,30,38,40,44], and 2 reviews [23,29].
Both patients and health care professionals mentioned problems with the lack of face-to-face contact. Both assumed preferences for face-to-face communication for some patients and providers [21,34]. Health care professionals have particularly emphasized the lack of nonverbal communication and para-communication associated with face-to-face conversations [21]. Nevertheless, the spectrum of physician replacement ranges from taking over individual decisions [40] to complete replacement [21,23,44]. One review described substantially lower treatment effects due to the substitution of face-to-face intervention [29].
The absence of a treating person resulted in a lack of therapeutic space [38] and therapeutic alliance [21,25] considered vital for successful therapeutic care [21]. Without human support, 1 study found difficulties with user engagement in active components [31].
Problems with the “patient-physician relationship” also occurred when mHealth apps were integrated into the treatment process. Even if technology can assist in health care, concerns regarding interference with relationships are pronounced by patients [34] and health care providers [21]. Physiotherapists saw that mutual trust could suffer from continuously monitoring a patient [25].
The limited capacity to export or download data reports reduces the ability to communicate directly from the app with others [27]. Information asymmetries can arise, and specialists could end up in situations in which patients receive treatment results before they do [32].
Finally, the responsibilities are altered and might lead to new problems. Physicians expressed concern that they have to handle additional data or alerts and that the use of mHealth apps could lead to the detraction of the patient’s self-management [16]. Physicians who did not engage as leaders in digital interventions were also seen as problematic in 1 study [30].
Knowledge and Skills
Problems and barriers related to knowledge and skills were identified in 4 quantitative studies [22,24,27,35], 7 qualitative studies [16,18,21,34,37,39,42], 4 mixed-design studies [19,30,33,41], and 3 reviews [17,23,29]. In some studies, it was found that patients had limited digital literacy [41] or abilities and experience regarding the use of mHealth apps [16,18,19,22,27,33,37]. In other cases, wrong perception [21,22,34,35] and a lack of knowledge [19,21,24,33,41] were seen as problematic.
Little, bad, or no experience with apps is seen as a major problem [18,19,42] and fosters the issue of low abilities and confidence with technology use [16,19]. Although young individuals showed few difficulties in app use, older patients, especially those with conditions such as dementia [27] or declining cognitive functions [37], face difficulties in app use [19]. A special problem is that older adult users have more problems because they use their mobile phones for known functions and discourage themselves from learning new technology through trial and error [22].
A major barrier for app use is found in its perception. Irrespective of individual apps, some patients believe that mobile phones [34] and apps [22,35] are complicated and difficult to use. Patients might also feel dismissed because they see inferior care in digital products compared with face-to-face contact [21].
In addition to the abovementioned problems in digital literacy [41], literacy in general and numeracy were found to be a barrier for app use [21,24]. In 2 studies, participants did not understand specific app functions [19,33].
Clinicians experienced similar problems as patients. Low experience and skills were frequently observed [16,19,21,23,29,30,39]. Some clinicians even had a more negative attitude toward this type of intervention than patients [17]. Others expressed a lack of confidence in the integration of technology in health care [21].
Individuality
A further problem mentioned in 15 articles [16,17,19,21,25,26,29,33,35-37,39,40,43,44] is the intention or capability to customize mHealth apps to the individual needs of patients. One quantitative study [35], 4 qualitative studies [16,21,37,39], 8 mixed-design studies [19,25,26,33,36,40,43,44], and 2 reviews [17,29] included problems and barriers corresponding to individuality. This is, for example, expressed in the fact that mHealth apps are usually not adapted to each individual [17,19,33,35-37,40,44]. Thus, the authors discussed the difficulty in designing attractive and useful programs for all patients, which are at least as effective as standard therapy [17,36], and pronounced the difficulties due to the diversity of the target users, especially in terms of age [33,35,37] and diseases [35]. Furthermore, the authors described individualization of functions due to perceptual impairments [37] and motor or physical issues [44] to be problematic. In 1 study, patients indicated that the goals set by the app were too simple and that the app could not be customized to their needs as much as necessary [40].
Different functions are affected by a lack of individualization. Patients and health care professionals expressed that exercise programs often consist of a fixed number of different standard exercises [16,25,26], that data input is limited to imprecise standardized possibilities [39], and that communication provided by the mHealth app is unadjusted [21,43,44]. A special problem is the “cold start problem.” It describes the need for time at the beginning of the intervention to personalize the app content to the user profile through artificial intelligence [26].
Implementation
The implementation of mHealth apps in health care systems faces different problems. Problems related to implementation were found in 4 quantitative studies [22,24,31,35], 4 qualitative studies [16,21,39,42], 5 mixed-design studies [30,38,40,41,44], and 4 reviews [17,23,28,29].
Barriers to access were seen as a problem for implementation. These occurred because of a lack of infrastructure, socioeconomic conditions, or social reasons. Lack of access (eg, lack of smartphones or broadband and computers) is a fundamental barrier for the use of mHealth apps [22,35,38,42]. Disparities in access subsequently foster concerns that only a fraction of users benefit from apps in health care [21,22,29]. Issues in the context of equity may stem from income or disability and result in nonequally distributed devices and connectivity [28]. Further barriers to access concerned stigma and culture [31] as well as language [28,31]. However, no further information was given on these barriers.
Further problems concerned transferability of study effects to real-world care and organizational barriers, such as lack of capacity or preparedness of health care systems and reimbursement structures. Successful transfer into clinical practice was seen as a problem [17,23,41]. Many questions, for example, regarding modes of action or for which target groups app-based therapy is most suitable, are still unanswered. Thus, mHealth programs showing effectiveness in experimental settings do not necessarily show good results in real health care settings [17]. Staff members reported low expectations and low confidence in the ability of national health care systems to implement digital tools [21]. Barriers for implementation were lack of health system readiness, organizational resistance to change, and policy uncertainties [44]. Approval of apps, for example, by the US Food and Drug Administration, focuses on safety and minimal effectiveness thresholds and does not provide sufficient information for decision makers [28]. Reimbursement options are not uniform [28], and a lack of collaboration among stakeholders, such as developers, health care professionals, and patients, in the design and development process affects acceptance and adoption [16].
Low acceptance is a 2-fold problem. On the one hand, some professionals have less interest in information in apps than in paper-based information. This was highlighted by patients commenting that care providers always asked for paper forms despite information being provided in app format [39]. On the other hand, professionals need to be open to the use of mHealth apps because their strong leadership engagement and promotion are fundamental for mHealth use [30,35].
Health care professionals see the use of digital solutions as an additional burden placed on them [21,40,42] and express fear regarding the complexity of, and the responsibility for, identifying and managing risk [21]. Interacting with mHealth apps was frequently seen as obstructive for workflows [21,28,42].
Three further problems concerning the implementation were as follows: first, some app manufacturers were not available and did not respond to requests [24,42]; second, some users expressed the amount of choice being overwhelming [16]; and finally, frequent app updates, requiring evaluation of new and confirmation of old functions, were potential problems [24].
Costs
Costs were mentioned in 10 articles [18,21,27-29,31,34,35,42,44]. Of these, 3 had a quantitative design [27,31,35], 4 were qualitative studies [18,21,34,42], 1 had a mixed-design [44], and 2 were reviews [28,29]. On the patient’s side, the use of mHealth apps might be problematic because it always requires a running device [21] and often requires data transmission [34,35]. One study mentioned potential costs for apps as a concern [18]. Furthermore, a problem for patients is the lack of opportunity to test and evaluate apps before they are purchased [27]. These costs usually have to be borne by patients and might lead to socioeconomic inequalities [21]. Another problem for patients is the lack of opportunity to test and evaluate apps before purchasing them [27].
As with traditional health services, health care practitioners need time to integrate mHealth apps into their treatment. However, this effort is often not reimbursed [28,29,42,44]. Therefore, providers demanded that the time used for mHealth interventions be compensated in the same way as face-to-face treatments [28]. Some clinicians questioned the value of investing in mHealth apps and preferred investing in staff training and staff employment rather than digital tools [21]. One article did not specify the problem of costs [31].
Discussion
Principal Findings
This scoping review maps the evidence on potential problems and barriers related to the use of mHealth apps fulfilling the basic criteria of DiGA. The inclusion criteria were as follows: (1) low-risk class (I or IIa); (2) use by the patient; (3) relation to illness, injury, or disability; (4) not for primary prevention; and (5) the medical purpose is achieved through the main digital function. To the best of our knowledge, this is the first scoping review on this topic.
In total, 29 studies on mHealth apps met the inclusion criteria. The included studies showed large heterogeneity, and identified problems and barriers were often only a by-product in the included articles.
Most of the studies originate from English-speaking countries. Thereof, 8 originated from the United States [18,27-31,42,43], 5 from the United Kingdom [19,21,24,40,41], and 2 from Ireland [24,28]. Four studies were conducted in Asian countries (Multimedia Appendix 1). Two of these were from China [35,37] and Korea [22,34]. Despite the presupposed DiGA similarity of the apps described in the studies, none of the included studies were from Germany.
The included studies differed substantially in terms of study design (Multimedia Appendix 1). A total of 8 studies had a qualitative design, and 5 studies had a quantitative design. Furthermore, 12 mixed methods studies and 4 reviews were included. Most of the included studies used interviews [16,19,25,30,32-34,38-44], questionnaires [20,22,30,31,33,35,36,38,40,41], and focus groups [18,21,36,38,43]. Only 3 studies used a randomized controlled trial [19,20,38].
The study populations investigated also varied widely (Multimedia Appendix 1). Although some studies focused on relatively balanced study populations [31], other studies included very specific populations, such as people with a military background with posttraumatic stress disorder [30] or an older woman with insomnia [37].
Identification of relevant aspects and categorization of problems and barriers was independently done by 2 reviewers. The categorization was performed by clustering aspects into consistent groups. New groups of problems and barriers were compiled if an identified problem could not be matched with the existing groups. This proceeding revealed 10 major categories of problems and barriers on a super ordinated level: “validity,” “usability,” “technology,” “use and adherence,” “data privacy and data security,” “patient-physician relationship,” “knowledge and skills,” “individuality,” “implementation,” and “costs.”
The categorization into the 10 problem groups is an approach to systematize problems and barriers in the context of mHealth use identified in the literature. In addition to the categories defined by the scoping review, it would be possible to include further categories or subcategories. For example, “demographics” could be such a category. This could include identified problems, such as the problems of older patients using the app or socioeconomic inequalities that pose problems to access. Although it would, in principle, be conceivable to define other problem categories, our research approach has proven to be well suited to identify relevant categories. All the identified problems and barriers could be clearly assigned to a category.
In addition, “actuality” would be another problem category that could be considered, as outdated content or technology could, in the worst case, lead to a compromise of patient safety. Unfortunately, in this review, no relevant texts, including this type of problem, were identified. Our final 10 categories were formed qualitatively based on the available evidence and should be used as a fundamental basis for further discussion and research.
While conducting the scoping review and interpreting the results, it was suggested that there might be some correlations between the problem categories. Thus, 1 category might have a direct influence on another category. For example, such correlations were suspected between “use and adherence” to mHealth apps and their “usability” or between “implementation” and “knowledge and skills.” However, as these are not confirmed results of the scoping review, these assumptions should be pursued in further studies.
Our results show that research in the area of problems and barriers is still rare compared with research on opportunities and possibilities. The problem categories identified can be attributed to the mHealth apps themselves, on the one hand, and their integration into the health care system, on the other hand. Regarding app-level problems (eg, “validity,” “usability,” “technology,” and “data privacy and data security”), there are already quality assessment tools especially developed for mHealth apps [96-99] that aim to ensure the quality of apps. Other issues such as “use and adherence,” “patient-physician relationship,” “knowledge and skills,” “implementation,” and “costs,” affect the entire health care system. In contrast to quality assurance approaches at the app level, such approaches do not yet exist at the system level. Further research is needed, particularly in this area. Only if the integration of mHealth apps into the health care system succeeds as a whole will patients sustainably benefit from the new technology. To achieve this goal, it is mandatory to explore those problems and barriers affecting various stakeholders. Not only scientists but also policy makers should have a special focus on these types of issues and address them within research and regulations.
In Germany, mHealth apps applying for the DiGA directory are initially examined for safety and suitability for use, data protection and information security, interoperability, robustness, consumer protection, ease of use, support of health care providers, quality of medical content, and patient safety, as well as evidence of positive health care effects [4]. Other categories of problems, such as “use and adherence,” “patient-physician relationship,” and especially “implementation” and “costs” are not sufficiently addressed, especially in high-quality studies, and need further investigation.
The problem categories identified can serve as a starting point for further research. For the less well-studied ones, systematic studies of higher quality and scoping reviews should delineate the field; for the better-studied problem categories, such as “validity,” “usability,” “technology,” and “data privacy and data security,” systematic reviews might be more useful to gain insights. However, in addition to further reviews in this area of research, it is important to consider the results of primary studies.
Limitations
This review had some limitations. The search was not restricted to certain study types to capture a broad evidence base and include aspects currently under discussion. Therefore, in addition to quantitative and qualitative studies, narrative reviews were included, as long as they met the inclusion criteria. Often, the included articles addressed the problems and barriers only incidentally. Only including these different types of items enabled us to create a broad evidence base. This might be a starting point for further research on certain categories such as implementation.
As the systematization of individual problems has taken a lot of time, more recent evidence should also be examined. However, here the approach of examining problem categories should be explicitly pursued.
During the screening process, we did not determine the agreement between the 2 reviewers or the κ coefficient. Nevertheless, in cases of disagreement, we involved a third person. Thus, the inclusion or exclusion of texts was done qualitatively. Furthermore, we have listed the studies that were excluded in the full-text screening with the reason for each in Multimedia Appendix 3 to make our investigation more transparent and comprehensible to third parties.
Conclusions
The findings of this scoping review are relevant not only for DiGA but also for all kinds of mHealth apps. Ten categories of problems and barriers were identified. Issues at the app level such as “validity,” “usability,” “technology,” “data privacy and security,” and “individuality” are addressed in several studies and are partly considered in quality assurance systems; problems and barriers related to the level (“use and adherence,” “patient-physician relationship,” “knowledge and skills,” “implementation,” and “costs”) of health care system are rarely extensively studied. Further research is essential to optimize the integration of mHealth apps into health care, especially in the area of system-related problems. In addition to serving as a starting point for further research, it is imperative that identified problems and barriers are considered in the development of new mHealth apps.
Acknowledgments
This study is part of a larger research project (continuous quality assurance of Digital Health Applications [“QuaSiApps”]). This project was funded by the Federal Joint Committee. The funders had no influence in the study design, conduct of the study, or the decision to publish or prepare the manuscript. The authors acknowledge the support from the Open Access Publication Fund of the University of Duisburg-Essen.
Abbreviations
- DiGA
Digitale Gesundheitsanwendungen
- mHealth
mobile health
- MIP
methodology, issues, participants
- PRISMA-ScR
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
Overview of the included articles.
Problems mentioned in the articles.
Studies assessed in the full-text screening and exclusion criteria.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Abaza H, Marschollek M. mHealth application areas and technology combinations*. A comparison of literature from high and low/middle income countries. Methods Inf Med. 2017 Aug 08;56(7):e105–22. doi: 10.3414/ME17-05-0003. http://www.thieme-connect.com/DOI/DOI?10.3414/ME17-05-0003 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Driving the digital transformation of Germany’s healthcare system for the good of patients. Bundesministerium für Gesundheit (BMG) 2019. Nov, [2022-06-29]. https://www.bundesgesundheitsministerium.de/en/digital-healthcare-act.html .
- 3.Sauermann S, Herzberg J, Burkert S, Habetha S. DiGA - a chance for the German healthcare system. J Eur CME. 2021 Dec 23;11(1):2014047. doi: 10.1080/21614083.2021.2014047. https://europepmc.org/abstract/MED/34992948 .2014047 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.The fast-track process for digital health applications (DiGA) according to section 139e SGB V. A guide for manufacturers, service providers and users. Bundesinstitut für Arzneimittel und Medizinprodukte. 2020. Aug 07, [2022-08-24]. https://www.bfarm.de/SharedDocs/Downloads/EN/MedicalDevices/DiGA_Guide.html .
- 5.Healthcare innovation 2030. Shaping France as the leading European nation in innovation and sovereignty in healthcare. Ministère des Solidarités et de la Santé. 2021. Jun 29, [2022-08-24]. https://solidarites-sante.gouv.fr/IMG/pdf/dossier_de_presse-innovation_sante_2030-en.pdf .
- 6.Iribarren SJ, Akande TO, Kamp KJ, Barry D, Kader YG, Suelzer E. Effectiveness of mobile apps to promote health and manage disease: systematic review and meta-analysis of randomized controlled trials. JMIR Mhealth Uhealth. 2021 Jan 11;9(1):e21563. doi: 10.2196/21563. https://mhealth.jmir.org/2021/1/e21563/ v9i1e21563 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Liu K, Xie Z, Or CK. Effectiveness of mobile app-assisted self-care interventions for improving patient outcomes in type 2 diabetes and/or hypertension: systematic review and meta-analysis of randomized controlled trials. JMIR Mhealth Uhealth. 2020 Aug 04;8(8):e15779. doi: 10.2196/15779. https://mhealth.jmir.org/2020/8/e15779/ v8i8e15779 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Wang K, Varma DS, Prosperi M. A systematic review of the effectiveness of mobile apps for monitoring and management of mental health symptoms or disorders. J Psychiatr Res. 2018 Dec;107:73–8. doi: 10.1016/j.jpsychires.2018.10.006.S0022-3956(18)30828-8 [DOI] [PubMed] [Google Scholar]
- 9.Geier AS. Digitale Gesundheitsanwendungen (DiGA) auf dem Weg zum Erfolg – die Perspektive des Spitzenverbandes Digitale Gesundheitsversorgung. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2021 Oct;64(10):1228–31. doi: 10.1007/s00103-021-03419-5.10.1007/s00103-021-03419-5 [DOI] [PubMed] [Google Scholar]
- 10.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. doi: 10.1080/1364557032000119616. https://www.tandfonline.com/doi/abs/10.1080/1364557032000119616 . [DOI] [Google Scholar]
- 11.Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010 Sep 20;5:69. doi: 10.1186/1748-5908-5-69. https://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-5-69 .1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MD, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Ö, Straus SE. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018 Oct 02;169(7):467–73. doi: 10.7326/M18-0850. https://www.acpjournals.org/doi/abs/10.7326/M18-0850?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .2700389 [DOI] [PubMed] [Google Scholar]
- 13.Giebel GD, Speckemeier C, Abels C, Börchers K, Wasem J, Blase N, Neusser S. Problems and barriers related to the use of digital health applications: protocol for a scoping review. JMIR Res Protoc. 2022 Apr 21;11(4):e32702. doi: 10.2196/32702. https://www.researchprotocols.org/2022/4/e32702/ v11i4e32702 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Strech D, Synofzik M, Marckmann G. Systematic reviews of empirical bioethics. J Med Ethics. 2008 Jun;34(6):472–7. doi: 10.1136/jme.2007.021709.34/6/472 [DOI] [PubMed] [Google Scholar]
- 15.Lewis TL, Boissaud-Cooke MA, Aungst TD, Eysenbach G. Consensus on use of the term "App" versus "Application" for reporting of mHealth research. J Med Internet Res. 2014 Jul 17;16(7):e174. doi: 10.2196/jmir.3460. https://www.jmir.org/2014/7/e174/ v16i7e174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Argent R, Slevin P, Bevilacqua A, Neligan M, Daly A, Caulfield B. Clinician perceptions of a prototype wearable exercise biofeedback system for orthopaedic rehabilitation: a qualitative exploration. BMJ Open. 2018 Oct 25;8(10):e026326. doi: 10.1136/bmjopen-2018-026326. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=30366919 .bmjopen-2018-026326 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Barceló-Soler A, Baños RM, López-Del-Hoyo Y, Mayoral F, Gili M, García-Palacios A, García-Campayo J, Botella C. Interventions of computerized psychotherapies for depression in primary care in Spain. Actas Esp Psiquiatr. 2019 Nov;47(6):236–46. https://www.actaspsiquiatria.es/repositorio//21/122/ENG/21-122-ENG-236-46-459497.pdf . [PubMed] [Google Scholar]
- 18.Beer JM, Smith KN, Kennedy T, Mois G, Acena D, Gallerani DG, McDonnell KK, Owens OL. A focus group evaluation of breathe easier: a mindfulness-based mHealth app for survivors of lung cancer and their family members. Am J Health Promot. 2020 Sep;34(7):770–8. doi: 10.1177/0890117120924176. [DOI] [PubMed] [Google Scholar]
- 19.Bentley CL, Powell L, Potter S, Parker J, Mountain GA, Bartlett YK, Farwer J, O'Connor C, Burns J, Cresswell RL, Dunn HD, Hawley MS. The use of a smartphone app and an activity tracker to promote physical activity in the management of chronic obstructive pulmonary disease: randomized controlled feasibility study. JMIR Mhealth Uhealth. 2020 Jun 03;8(6):e16203. doi: 10.2196/16203. https://mhealth.jmir.org/2020/6/e16203/ v8i6e16203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Browne S, Kechadi MT, O'Donnell S, Dow M, Tully L, Doyle G, O'Malley G. Mobile health apps in pediatric obesity treatment: process outcomes from a feasibility study of a multicomponent intervention. JMIR Mhealth Uhealth. 2020 Jul 08;8(7):e16925. doi: 10.2196/16925. https://mhealth.jmir.org/2020/7/e16925/ v8i7e16925 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bucci S, Berry N, Morris R, Berry K, Haddock G, Lewis S, Edge D. "They are not hard-to-reach clients. We have just got hard-to-reach services." Staff views of digital health tools in specialist mental health services. Front Psychiatry. 2019 May 10;10:344. doi: 10.3389/fpsyt.2019.00344. https://europepmc.org/abstract/MED/31133906 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Chung K, Kim S, Lee E, Park JY. Mobile app use for insomnia self-management in urban community-dwelling older Korean adults: retrospective intervention study. JMIR Mhealth Uhealth. 2020 Aug 24;8(8):e17755. doi: 10.2196/17755. https://mhealth.jmir.org/2020/8/e17755/ v8i8e17755 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cuijpers P, Kleiboer A, Karyotaki E, Riper H. Internet and mobile interventions for depression: opportunities and challenges. Depress Anxiety. 2017 Jul;34(7):596–602. doi: 10.1002/da.22641. [DOI] [PubMed] [Google Scholar]
- 24.Huckvale K, Adomaviciute S, Prieto JT, Leow MK, Car J. Smartphone apps for calculating insulin dose: a systematic assessment. BMC Med. 2015 May 06;13:106. doi: 10.1186/s12916-015-0314-7. https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-015-0314-7 .10.1186/s12916-015-0314-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kowatsch T, Lohse KM, Erb V, Schittenhelm L, Galliker H, Lehner R, Huang EM. Hybrid ubiquitous coaching with a novel combination of mobile and holographic conversational agents targeting adherence to home exercises: four design and evaluation studies. J Med Internet Res. 2021 Feb 22;23(2):e23612. doi: 10.2196/23612. https://www.jmir.org/2021/2/e23612/ v23i2e23612 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Luna-Perejon F, Malwade S, Styliadis C, Civit J, Cascado-Caballero D, Konstantinidis E, Abdul SS, Bamidis PD, Civit A, Li YC. Evaluation of user satisfaction and usability of a mobile app for smoking cessation. Comput Methods Programs Biomed. 2019 Dec;182:105042. doi: 10.1016/j.cmpb.2019.105042. https://linkinghub.elsevier.com/retrieve/pii/S0169-2607(18)31842-X .S0169-2607(18)31842-X [DOI] [PubMed] [Google Scholar]
- 27.Minen MT, Gopal A, Sahyoun G, Stieglitz E, Torous J. The functionality, evidence, and privacy issues around smartphone apps for the top neuropsychiatric conditions. J Neuropsychiatry Clin Neurosci. 2021;33(1):72–9. doi: 10.1176/appi.neuropsych.19120353. https://europepmc.org/abstract/MED/32669020 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Mohr DC, Azocar F, Bertagnolli A, Choudhury T, Chrisp P, Frank R, Harbin H, Histon T, Kaysen D, Nebeker C, Richards D, Schueller SM, Titov N, Torous J, Areán PA, Banbury Forum on Digital Mental Health Banbury forum consensus statement on the path forward for digital mental health treatment. Psychiatr Serv. 2021 Jun;72(6):677–83. doi: 10.1176/appi.ps.202000561. https://europepmc.org/abstract/MED/33467872 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Okorodudu DE, Bosworth HB, Corsino L. Innovative interventions to promote behavioral change in overweight or obese individuals: a review of the literature. Ann Med. 2015 May;47(3):179–85. doi: 10.3109/07853890.2014.931102. https://europepmc.org/abstract/MED/25011006 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Possemato K, Kuhn E, Johnson EM, Hoffman JE, Brooks E. Development and refinement of a clinician intervention to facilitate primary care patient use of the PTSD coach app. Transl Behav Med. 2017 Mar;7(1):116–26. doi: 10.1007/s13142-016-0393-9. https://europepmc.org/abstract/MED/27234150 .10.1007/s13142-016-0393-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pratap A, Renn BN, Volponi J, Mooney SD, Gazzaley A, Arean PA, Anguera JA. Using mobile apps to assess and treat depression in Hispanic and Latino populations: fully remote randomized clinical trial. J Med Internet Res. 2018 Aug 09;20(8):e10130. doi: 10.2196/10130. https://www.jmir.org/2018/8/e10130/ v20i8e10130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ravn Jakobsen P, Hermann AP, Søndergaard J, Wiil UK, Clemensen J. Development of an mHealth application for women newly diagnosed with osteoporosis without preceding fractures: a participatory design approach. Int J Environ Res Public Health. 2018 Feb 13;15(2):330. doi: 10.3390/ijerph15020330. https://www.mdpi.com/resolver?pii=ijerph15020330 .ijerph15020330 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Sobrinho A, da Silva LD, Perkusich A, Pinheiro ME, Cunha P. Design and evaluation of a mobile application to assist the self-monitoring of the chronic kidney disease in developing countries. BMC Med Inform Decis Mak. 2018 Jan 12;18(1):7. doi: 10.1186/s12911-018-0587-9. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-018-0587-9 .10.1186/s12911-018-0587-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Son YJ, Oh S, Kim EY. Patients' needs and perspectives for using mobile phone interventions to improve heart failure self-care: a qualitative study. J Adv Nurs. 2020 Sep;76(9):2380–90. doi: 10.1111/jan.14455. [DOI] [PubMed] [Google Scholar]
- 35.Sun L, Wang Y, Greene B, Xiao Q, Jiao C, Ji M, Wu Y. Facilitators and barriers to using physical activity smartphone apps among Chinese patients with chronic diseases. BMC Med Inform Decis Mak. 2017 Apr 19;17(1):44. doi: 10.1186/s12911-017-0446-0. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-017-0446-0 .10.1186/s12911-017-0446-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wirken L, van Middendorp H, Hooghof CW, Bremer TE, Hopman SP, van der Pant KA, Hoitsma AJ, Hilbrands LB, Evers AW. Development and feasibility of a guided and tailored internet-based cognitive-behavioural intervention for kidney donors and kidney donor candidates. BMJ Open. 2018 Jun 30;8(6):e020906. doi: 10.1136/bmjopen-2017-020906. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=29961018 .bmjopen-2017-020906 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Chen YX, Hung YP, Chen HC. Mobile application-assisted cognitive behavioral therapy for insomnia in an older adult. Telemed J E Health. 2016 Apr;22(4):332–4. doi: 10.1089/tmj.2015.0064. [DOI] [PubMed] [Google Scholar]
- 38.Hatcher S, Whittaker R, Patton M, Miles WS, Ralph N, Kercher K, Sharon C. Web-based therapy plus support by a coach in depressed patients referred to secondary mental health care: randomized controlled trial. JMIR Ment Health. 2018 Jan 23;5(1):e5. doi: 10.2196/mental.8510. https://mental.jmir.org/2018/1/e5/ v5i1e5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Skar JB, Garnweidner-Holme LM, Lukasse M, Terragni L. Women's experiences with using a smartphone app (the Pregnant+ app) to manage gestational diabetes mellitus in a randomised controlled trial. Midwifery. 2018 Mar;58:102–8. doi: 10.1016/j.midw.2017.12.021.S0266-6138(17)30546-6 [DOI] [PubMed] [Google Scholar]
- 40.Kellett S, Easton K, Cooper M, Millings A, Simmonds-Buckley M, Parry G. Evaluation of a mobile app to enhance relational awareness and change during cognitive analytic therapy: mixed methods case series. JMIR Ment Health. 2020 Dec 18;7(12):e19888. doi: 10.2196/19888. https://mental.jmir.org/2020/12/e19888/ v7i12e19888 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Hardy A, Wojdecka A, West J, Matthews E, Golby C, Ward T, Lopez ND, Freeman D, Waller H, Kuipers E, Bebbington P, Fowler D, Emsley R, Dunn G, Garety P. How inclusive, user-centered design research can improve psychological therapies for psychosis: development of SlowMo. JMIR Ment Health. 2018 Dec 05;5(4):e11222. doi: 10.2196/11222. https://mental.jmir.org/2018/4/e11222/ v5i4e11222 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Thies K, Anderson D, Cramer B. Lack of adoption of a mobile app to support patient self-management of diabetes and hypertension in a federally qualified health center: interview analysis of staff and patients in a failed randomized trial. JMIR Hum Factors. 2017 Oct 03;4(4):e24. doi: 10.2196/humanfactors.7709. https://humanfactors.jmir.org/2017/4/e24/ v4i4e24 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Thirumalai M, Rimmer JH, Johnson G, Wilroy J, Young HJ, Mehta T, Lai B. TEAMS (Tele-Exercise and Multiple Sclerosis), a tailored telerehabilitation mHealth app: participant-centered development and usability study. JMIR Mhealth Uhealth. 2018 May 24;6(5):e10181. doi: 10.2196/10181. https://mhealth.jmir.org/2018/5/e10181/ v6i5e10181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Woods LS, Duff J, Roehrer E, Walker K, Cummings E. Patients' experiences of using a consumer mHealth app for self-management of heart failure: mixed-methods study. JMIR Hum Factors. 2019 May 02;6(2):e13009. doi: 10.2196/13009. https://humanfactors.jmir.org/2019/2/e13009/ v6i2e13009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Akbar S, Coiera E, Magrabi F. Safety concerns with consumer-facing mobile health applications and their consequences: a scoping review. J Am Med Inform Assoc. 2020 Feb 01;27(2):330–40. doi: 10.1093/jamia/ocz175. https://europepmc.org/abstract/MED/31599936 .5585394 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Ana FA, Loreto MS, José LM, Pablo SM, María Pilar MJ, Myriam SL. Mobile applications in oncology: a systematic review of health science databases. Int J Med Inform. 2020 Jan;133:104001. doi: 10.1016/j.ijmedinf.2019.104001.S1386-5056(18)30315-0 [DOI] [PubMed] [Google Scholar]
- 47.Armontrout JA, Torous J, Cohen M, McNiel DE, Binder R. Current regulation of mobile mental health applications. J Am Acad Psychiatry Law. 2018 Jun;46(2):204–11. doi: 10.29158/JAAPL.003748-18.46/2/204 [DOI] [PubMed] [Google Scholar]
- 48.Castelnuovo G, Zoppis I, Santoro E, Ceccarini M, Pietrabissa G, Manzoni GM, Corti S, Borrello M, Giusti EM, Cattivelli R, Melesi A, Mauri G, Molinari E, Sicurello F. Managing chronic pathologies with a stepped mHealth-based approach in clinical psychology and medicine. Front Psychol. 2015 Apr 14;6:407. doi: 10.3389/fpsyg.2015.00407. https://europepmc.org/abstract/MED/25926801 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Christopoulos KA, Cunningham WE, Beckwith CG, Kuo I, Golin CE, Knight K, Flynn PM, Spaulding AC, Coffin LS, Kruszka B, Kurth A, Young JD, Mannheimer S, Crane HM, Kahana SY. Lessons learned from the implementation of seek, test, treat, retain interventions using mobile phones and text messaging to improve engagement in HIV care for vulnerable populations in the United States. AIDS Behav. 2017 Nov;21(11):3182–93. doi: 10.1007/s10461-017-1804-8. https://europepmc.org/abstract/MED/28578543 .10.1007/s10461-017-1804-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Claborn KR, Meier E, Miller MB, Leavens EL, Brett EI, Leffingwell T. Improving adoption and acceptability of digital health interventions for HIV disease management: a qualitative study. Transl Behav Med. 2018 Mar 01;8(2):268–79. doi: 10.1093/tbm/ibx025. https://europepmc.org/abstract/MED/29385547 .4827734 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Dithmer M, Rasmussen JO, Grönvall E, Spindler H, Hansen J, Nielsen G, Sørensen SB, Dinesen B. "The heart game": using gamification as part of a telerehabilitation program for heart patients. Games Health J. 2016 Feb;5(1):27–33. doi: 10.1089/g4h.2015.0001. https://europepmc.org/abstract/MED/26579590 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Dunne S, Close H, Richards N, Ellison A, Lane AR. Maximizing telerehabilitation for patients with visual loss after stroke: interview and focus group study with stroke survivors, carers, and occupational therapists. J Med Internet Res. 2020 Oct 23;22(10):e19604. doi: 10.2196/19604. https://www.jmir.org/2020/10/e19604/ v22i10e19604 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Eno AK, Ruck JM, Van Pilsum Rasmussen SE, Waldram MM, Thomas AG, Purnell TS, Garonzik Wang JM, Massie AB, Al Almmary F, Cooper LM, Segev DL, Levan MA, Henderson ML. Perspectives on implementing mobile health technology for living kidney donor follow-up: in-depth interviews with transplant providers. Clin Transplant. 2019 Aug;33(8):e13637. doi: 10.1111/ctr.13637. https://europepmc.org/abstract/MED/31194892 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Fiorini RA, De Giacomo P, L'Abate L. Towards resilient telehealth support for clinical psychiatry and psychology: a strategic review. Stud Health Technol Inform. 2015;213:275–8. doi: 10.3233/978-1-61499-538-8-275. [DOI] [PubMed] [Google Scholar]
- 55.Foong HF, Kyaw BM, Upton Z, Tudor Car L. Facilitators and barriers of using digital technology for the management of diabetic foot ulcers: a qualitative systematic review. Int Wound J. 2020 Oct;17(5):1266–81. doi: 10.1111/iwj.13396. https://europepmc.org/abstract/MED/32390305 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Forman EM, Goldstein SP, Crochiere RJ, Butryn ML, Juarascio AS, Zhang F, Foster GD. Randomized controlled trial of OnTrack, a just-in-time adaptive intervention designed to enhance weight loss. Transl Behav Med. 2019 Nov 25;9(6):989–1001. doi: 10.1093/tbm/ibz137.5585540 [DOI] [PubMed] [Google Scholar]
- 57.Furlong L, Morris M, Serry T, Erickson S. Mobile apps for treatment of speech disorders in children: an evidence-based analysis of quality and efficacy. PLoS One. 2018 Aug 9;13(8):e0201513. doi: 10.1371/journal.pone.0201513. https://dx.plos.org/10.1371/journal.pone.0201513 .PONE-D-17-17944 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Glynn L, Casey M, Walsh J, Hayes PS, Harte RP, Heaney D. Patients' views and experiences of technology based self-management tools for the treatment of hypertension in the community: a qualitative study. BMC Fam Pract. 2015 Sep 09;16:119. doi: 10.1186/s12875-015-0333-7. https://bmcfampract.biomedcentral.com/articles/10.1186/s12875-015-0333-7 .10.1186/s12875-015-0333-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Gorini A, Mazzocco K, Triberti S, Sebri V, Savioni L, Pravettoni G. A P5 approach to m-Health: design suggestions for advanced mobile health technology. Front Psychol. 2018 Oct 31;9:2066. doi: 10.3389/fpsyg.2018.02066. https://air.unimi.it/handle/2434/622950 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Grau I, Kostov B, Gallego JA, Grajales Iii F, Fernández-Luque L, Sisó-Almirall A. Método de valoración de aplicaciones móviles de salud en español: el índice iSYScore. Semergen. 2016;42(8):575–83. doi: 10.1016/j.semerg.2015.12.001.S1138-3593(15)00428-1 [DOI] [PubMed] [Google Scholar]
- 61.Griffin N, Kehoe M. A questionnaire study to explore the views of people with multiple sclerosis of using smartphone technology for health care purposes. Disabil Rehabil. 2018 Jun;40(12):1434–42. doi: 10.1080/09638288.2017.1300332. [DOI] [PubMed] [Google Scholar]
- 62.Halbron M, Joubert M, Sonnet E. m-santé francophone et diabète : mise au point. Med Mal Metab. 2016 May;10(3):243–53. doi: 10.1016/S1957-2557(16)30057-8. [DOI] [Google Scholar]
- 63.Jacobson NC, Summers B, Wilhelm S. Digital biomarkers of social anxiety severity: digital phenotyping using passive smartphone sensors. J Med Internet Res. 2020 May 29;22(5):e16875. doi: 10.2196/16875. https://www.jmir.org/2020/5/e16875/ v22i5e16875 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Jimenez-Molina A, Gaete-Villegas J, Fuentes J. ProFUSO: business process and ontology-based framework to develop ubiquitous computing support systems for chronic patients' management. J Biomed Inform. 2018 Jun;82:106–27. doi: 10.1016/j.jbi.2018.04.001. https://linkinghub.elsevier.com/retrieve/pii/S1532-0464(18)30065-0 .S1532-0464(18)30065-0 [DOI] [PubMed] [Google Scholar]
- 65.Jindal D, Gupta P, Jha D, Ajay VS, Goenka S, Jacob P, Mehrotra K, Perel P, Nyong J, Roy A, Tandon N, Prabhakaran D, Patel V. Development of mWellcare: an mHealth intervention for integrated management of hypertension and diabetes in low-resource settings. Glob Health Action. 2018;11(1):1517930. doi: 10.1080/16549716.2018.1517930. https://europepmc.org/abstract/MED/30253691 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Jogova M, Shaw J, Jamieson T. The regulatory challenge of mobile health: lessons for Canada. Healthc Policy. 2019 Feb;14(3):19–28. doi: 10.12927/hcpol.2019.25795. https://europepmc.org/abstract/MED/31017863 .hcpol.2019.25795 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Jones M, DeRuyter F, Morris J. The digital health revolution and people with disabilities: perspective from the United States. Int J Environ Res Public Health. 2020 Jan 07;17(2):381. doi: 10.3390/ijerph17020381. https://www.mdpi.com/resolver?pii=ijerph17020381 .ijerph17020381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Kincaid PS. Implications of Hispanics using mHealth applications to self-manage diabetes: a quantitative, cross-sectional analysis. Northcentral University. 2020. [2023-04-18]. https://www.proquest.com/openview/b534cef8f58809d94761aa23abf95e08/1?pq-origsite=gscholar&cbl=44156 .
- 69.Kruse C, Betancourt J, Ortiz S, Valdes Luna SM, Bamrah IK, Segovia N. Barriers to the use of mobile health in improving health outcomes in developing countries: systematic review. J Med Internet Res. 2019 Oct 09;21(10):e13263. doi: 10.2196/13263. https://www.jmir.org/2019/10/e13263/ v21i10e13263 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Lhotska L, Cheshire P, Pharow P, Macku D. Non-technical issues in design and development of personal portable devices. Stud Health Technol Inform. 2016;221:46–50. doi: 10.3233/978-1-61499-633-0-46. [DOI] [PubMed] [Google Scholar]
- 71.MacKinnon GE, Brittain EL. Mobile health technologies in cardiopulmonary disease. Chest. 2020 Mar;157(3):654–64. doi: 10.1016/j.chest.2019.10.015. https://europepmc.org/abstract/MED/31678305 .S0012-3692(19)34117-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Maloney CA, Abel WD, McLeod HJ. Jamaican adolescents' receptiveness to digital mental health services: a cross-sectional survey from rural and urban communities. Internet Interv. 2020 Sep;21:100325. doi: 10.1016/j.invent.2020.100325. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(19)30040-5 .S2214-7829(19)30040-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Messner EM, Probst T, O’Rourke T, Stoyanov S, Baumeister H. mHealth applications: potentials, limitations, current quality and future directions. In: Baumeister H, Montag C, editors. Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics. Cham, Switzerland: Springer; 2019. pp. 235–48. [Google Scholar]
- 74.Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Internet Res. 2020 Sep 29;22(9):e20283. doi: 10.2196/20283. https://www.jmir.org/2020/9/e20283/ v22i9e20283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Miranda JJ, Moscoso MG, Yan LL, Diez-Canseco F, Málaga G, Garcia HH, Ovbiagele B. Addressing post-stroke care in rural areas with Peru as a case study. Placing emphasis on evidence-based pragmatism. J Neurol Sci. 2017 Apr 15;375:309–15. doi: 10.1016/j.jns.2017.02.027. https://europepmc.org/abstract/MED/28320158 .S0022-510X(17)30123-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Morera EP, de la Torre Díez I, Garcia-Zapirain B, López-Coronado M, Arambarri J. Security recommendations for mHealth apps: elaboration of a developer's guide. J Med Syst. 2016 Jun;40(6):152. doi: 10.1007/s10916-016-0513-6.10.1007/s10916-016-0513-6 [DOI] [PubMed] [Google Scholar]
- 77.Neubeck L, Cartledge S, Dawkes S, Gallagher R. Is there an app for that? Mobile phones and secondary prevention of cardiovascular disease. Curr Opin Cardiol. 2017 Sep;32(5):567–71. doi: 10.1097/HCO.0000000000000428. [DOI] [PubMed] [Google Scholar]
- 78.Ng MM, Firth J, Minen M, Torous J. User engagement in mental health apps: a review of measurement, reporting, and validity. Psychiatr Serv. 2019 Jul 01;70(7):538–44. doi: 10.1176/appi.ps.201800519. https://europepmc.org/abstract/MED/30914003 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Nightingale R, Hall A, Gelder C, Friedl S, Brennan E, Swallow V. Desirable components for a customized, home-based, digital care-management app for children and young people with long-term, chronic conditions: a qualitative exploration. J Med Internet Res. 2017 Jul 04;19(7):e235. doi: 10.2196/jmir.7760. https://www.jmir.org/2017/7/e235/ v19i7e235 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Nouri SS, Avila-Garcia P, Cemballi AG, Sarkar U, Aguilera A, Lyles CR. Assessing mobile phone digital literacy and engagement in user-centered design in a diverse, safety-net population: mixed methods study. JMIR Mhealth Uhealth. 2019 Aug 29;7(8):e14250. doi: 10.2196/14250. https://mhealth.jmir.org/2019/8/e14250/ v7i8e14250 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Nymberg VM, Bolmsjö BB, Wolff M, Calling S, Gerward S, Sandberg M. 'Having to learn this so late in our lives…' Swedish elderly patients' beliefs, experiences, attitudes and expectations of e-health in primary health care. Scand J Prim Health Care. 2019 Mar;37(1):41–52. doi: 10.1080/02813432.2019.1570612. https://europepmc.org/abstract/MED/30732519 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Pedersen DH, Mansourvar M, Sortsø C, Schmidt T. Predicting dropouts from an electronic health platform for lifestyle interventions: analysis of methods and predictors. J Med Internet Res. 2019 Sep 04;21(9):e13617. doi: 10.2196/13617. https://www.jmir.org/2019/9/e13617/ v21i9e13617 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Peprah P, Abalo EM, Agyemang-Duah W, Budu HI, Appiah-Brempong E, Morgan AK, Akwasi AG. Lessening barriers to healthcare in rural Ghana: providers and users' perspectives on the role of mHealth technology. A qualitative exploration. BMC Med Inform Decis Mak. 2020 Feb 10;20(1):27. doi: 10.1186/s12911-020-1040-4. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-020-1040-4 .10.1186/s12911-020-1040-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Roberts AL, Potts HW, Koutoukidis DA, Smith L, Fisher A. Breast, prostate, and colorectal cancer survivors' experiences of using publicly available physical activity mobile apps: qualitative study. JMIR Mhealth Uhealth. 2019 Jan 04;7(1):e10918. doi: 10.2196/10918. https://mhealth.jmir.org/2019/1/e10918/ v7i1e10918 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Safdari R, Shams Abadi AR, Pahlevany Nejad S. Improve health of the elderly people with m-health and technology. Iran J Ageing. 2018;13(3):288–99. doi: 10.32598/sija.13.3.288. https://salmandj.uswr.ac.ir/article-1-1393-en.pdf . [DOI] [Google Scholar]
- 86.Sahin C. Rules of engagement in mobile health: what does mobile health bring to research and theory? Contemp Nurse. 2018;54(4-5):374–87. doi: 10.1080/10376178.2018.1448290. [DOI] [PubMed] [Google Scholar]
- 87.Saner H, van der Velde E. eHealth in cardiovascular medicine: a clinical update. Eur J Prev Cardiol. 2016 Oct;23(2 suppl):5–12. doi: 10.1177/2047487316670256.23/2_suppl/5 [DOI] [PubMed] [Google Scholar]
- 88.Silva BM, Rodrigues JJ, de la Torre Díez I, López-Coronado M, Saleem K. Mobile-health: a review of current state in 2015. J Biomed Inform. 2015 Aug;56:265–72. doi: 10.1016/j.jbi.2015.06.003. https://linkinghub.elsevier.com/retrieve/pii/S1532-0464(15)00113-6 .S1532-0464(15)00113-6 [DOI] [PubMed] [Google Scholar]
- 89.Smith B, Magnani JW. New technologies, new disparities: the intersection of electronic health and digital health literacy. Int J Cardiol. 2019 Oct 01;292:280–2. doi: 10.1016/j.ijcard.2019.05.066. https://europepmc.org/abstract/MED/31171391 .S0167-5273(18)36997-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Terhorst Y, Messner EM, Schultchen D, Paganini S, Portenhauser A, Eder AS, Bauer M, Papenhoff M, Baumeister H, Sander LB. Systematic evaluation of content and quality of English and German pain apps in European app stores. Internet Interv. 2021 Apr;24:100376. doi: 10.1016/j.invent.2021.100376. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(21)00016-6 .S2214-7829(21)00016-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Tokgöz P, Hrynyschyn R, Hafner J, Schönfeld S, Dockweiler C. Digital health interventions in prevention, relapse, and therapy of mild and moderate depression: scoping review. JMIR Ment Health. 2021 Apr 16;8(4):e26268. doi: 10.2196/26268. https://mental.jmir.org/2021/4/e26268/ v8i4e26268 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Williams K, Markwardt S, Kearney SM, Karp JF, Kraemer KL, Park MJ, Freund P, Watson A, Schuster J, Beckjord E. Addressing implementation challenges to digital care delivery for adults with multiple chronic conditions: stakeholder feedback in a randomized controlled trial. JMIR Mhealth Uhealth. 2021 Feb 01;9(2):e23498. doi: 10.2196/23498. https://mhealth.jmir.org/2021/2/e23498/ v9i2e23498 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Yin H, Wardenaar KJ, Wang Y, Wang N, Chen W, Zhang Y, Xu G, Schoevers RA. Mobile mental health apps in China: systematic app store search. J Med Internet Res. 2020 Jul 27;22(7):e14915. doi: 10.2196/14915. https://www.jmir.org/2020/7/e14915/ v22i7e14915 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Zhang X, Yan X, Cao X, Sun Y, Chen H, She J. The role of perceived e-health literacy in users’ continuance intention to use mobile healthcare applications: an exploratory empirical study in China. Inf Technol Dev. 2018;24(2):198–223. doi: 10.1080/02681102.2017.1283286. [DOI] [Google Scholar]
- 95.Zhao P, Yoo I, Lancey R, Varghese E. Mobile applications for pain management: an app analysis for clinical usage. BMC Med Inform Decis Mak. 2019 May 30;19(1):106. doi: 10.1186/s12911-019-0827-7. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-019-0827-7 .10.1186/s12911-019-0827-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015 Mar 11;3(1):e27. doi: 10.2196/mhealth.3422. https://mhealth.jmir.org/2015/1/e27/ v3i1e27 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS) JMIR Mhealth Uhealth. 2016 Jun 10;4(2):e72. doi: 10.2196/mhealth.5849. https://mhealth.jmir.org/2016/2/e72/ v4i2e72 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Baumel A, Faber K, Mathur N, Kane JM, Muench F. Enlight: a comprehensive quality and therapeutic potential evaluation tool for mobile and web-based eHealth interventions. J Med Internet Res. 2017 Mar 21;19(3):e82. doi: 10.2196/jmir.7270. https://www.jmir.org/2017/3/e82/ v19i3e82 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Llorens-Vernet P, Miró J. The mobile app development and assessment guide (MAG): Delphi-based validity study. JMIR Mhealth Uhealth. 2020 Jul 31;8(7):e17760. doi: 10.2196/17760. https://mhealth.jmir.org/2020/7/e17760/ v8i7e17760 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Overview of the included articles.
Problems mentioned in the articles.
Studies assessed in the full-text screening and exclusion criteria.