Skip to main content
Journal of Integrative and Complementary Medicine logoLink to Journal of Integrative and Complementary Medicine
. 2022 Nov 14;28(11):851–861. doi: 10.1089/jicm.2021.0458

Delivery of Complementary and Integrative Health Using Virtual Health Resources: A Scoping Review

Jolie N Haun 1,2, Amy C Alman 2, Esther Jean-Baptiste 1, Christine Melillo 1,, Julie McMahon-Grenz 1, Jacquelyn M Paykel 3
PMCID: PMC9700349  PMID: 35819410

Abstract

Introduction:

Complementary and integrative health (CIH) modalities promote overall health and well-being and can be beneficial for individuals with a range of conditions. Traditionally, CIH has been delivered in person. COVID-19 created a need to identify sustainable remote delivery options to assure access to CIH while practicing public health recommendations. This scoping review maps the opportunities and challenges to remotely delivered CIH.

Materials and methods:

A scoping review was conducted between June 2020 and October 2020 using the following search engines: PubMed, Academic Search Premier, PsycINFO, CINAHL, Cochrane Reviews, and the Cochrane Clinical Trial Collections. Search results investigating remote CIH delivery were restricted to articles written in English, published after 1990.

Results:

Of the 10,884 articles identified, after review for content and methods, 330 articles were included. Most articles were randomized controlled trials (n = 170), applied mindfulness (n = 203), and targeted mental and behavioral health conditions (n = 182). Interventions were primarily delivered through mobile applications (n = 151) and web-based platforms (n = 86). Most commonly reported barriers were adherence (n = 24), resource requirements (e.g., time and space) (n = 23), and technology-related issues (n = 21). Although most studies did not report facilitators (n = 217), most commonly reported facilitators were social and technologic supports, accessibility, usability, perceptions, and rewards. Participant outcomes measured were broad and included movement (n = 88), stress (n = 68), and pain (n = 54). Intervention characteristic outcomes most often measured were satisfaction and usability (n = 5).

Conclusions:

This scoping literature review identified many articles addressing remote delivery of CIH, but few reporting on the implementation of remotely delivered CIH. Findings suggest remotely delivered CIH, specifically mindfulness and meditation-based modalities, is a viable treatment option for a diverse range of health conditions. Feasibility studies and larger sample sizes are recommended to strengthen the scientific evidence.

Keywords: complementary and integrative health, health delivery, remote delivery, health care, scoping review

Introduction

Complementary and integrative health (CIH) modalities promote overall health and well-being and can be beneficial for individuals with a range of conditions.1–5 Where “conventional” refers to mainstream Western approaches to medicine, nonmainstream approaches used in conjunction with conventional medicine are considered “complementary.”6 Complementary modalities include acupuncture; meditation and mindfulness activities; hypnosis; chiropractic; massage and other body work-based techniques; yoga; Tai Chi; qigong; and biofeedback. “Integrative health” brings conventional and complementary approaches together in a coordinated way.

Traditionally, CIH modalities were delivered in-person, often with “hands-on” approaches and there is a vast knowledge of CIH outcomes based on in-person delivery.7,8 The COVID-19 pandemic created a priority to identify sustainable means of remotely delivering care to ensure patient access to services while reducing contact. The priority to remotely deliver care poses unique challenges and opportunities for delivering CIH modalities.9 The unique contribution of this article to the literature is the focus on the virtual delivery of CIH, given the need for remote access in the current pandemic climate.

CIH represents many heterogeneous modalities.7 To further complicate matters, these modalities have demonstrated the capacity for remote delivery using a multitude of approaches. Research on CIH has been proliferating for the last 30 years, including the conduct of randomized controlled trials and systematic reviews in a variety of populations of video and audio resources, including telephones, telehealth, and mobile applications, making comparison of findings across studies difficult.

There is a gap in the literature on the identification of best practices, barriers and facilitators, and relevant outcomes in remotely delivering CIH—as this is an emergent approach to delivering CIH. Adding to this body of knowledge can inform efforts to ensure CIH modalities are accessible to patients, particularly in a climate where remote delivery might be a necessity (i.e., pandemic).

Heterogeneity among CIH remotely delivered interventions, coupled with the lack of adequate reporting, made conducting a systematic literature review of the effectiveness of remotely delivered CIH interventions not feasible, as such, the authors opted to use a scoping literature review.10 The goal of this scoping review is to map the current literature on the use of virtual health resources (VHR) to remotely deliver CIH, and the opportunities and challenges. This article does not attempt to address the efficacy or effectiveness because they did not limit their search to a scoped body of literature with comparable outcomes.

The authors performed a broad review of this literature to be able to characterize the scope of remote delivery of CIH modalities, including the health status of populations under study, the technologies and methods used, feasibility of remote delivery of CIH, and the facilitators and barriers of the different approaches. The comprehensive breadth of the review, including asynchronous and synchronous approaches and projects including both remote and in-person delivery components, was intended to fully assess the opportunity for leveraging use of VHR to make CIH more accessible. From this review, the authors identified the best practices and promising policies in remote delivery of CIH. Information from this scoping review will inform the development of future research intervention protocols that build on the findings to address the current gaps in the literature.

Materials and Methods

Study design

The authors conducted a scoping review10 to map the scope, feasibility, relevant patient and delivery outcome measures, and recommendations for remote delivery of CIH programs using VHR. To establish a broad net for their scoping review, they included a broad definition of CIH and multiple methods for delivery with no limitations on the study design, condition, or health status under investigation, as the intent was to gather information that could benefit future implementation of remotely delivered CIH programs. This scoping review was part of a larger program evaluation that was determined by the local VA Research and Development Service to be a quality improvement project, and thus not subject to the institutional review board review for research.

Search engines and terms

Searches were conducted using the following search engines: PubMed, Academic Search Premier, PsycINFO, CINAHL, Cochrane Reviews, and the Cochrane Clinical Trial Collections. Search terms were refined by investigator discussion, initial search results, and keyword review from relevant articles. Multiple searches were conducted using combinations of search terms to obtain as broad a review of the literature as possible. Search terms included the following for CIH modalities: “acupressure,” “acupuncture,” “meditation,” “transcendental meditation,” “mindfulness,” “repeated mantras,” “mantras,” “hypnosis,” “hypnotherapy,” “guided imagery,” “imagery, psychotherapy,” “relaxation therapy,” “chiropractic,” “massage,” “healing touch,” “therapeutic touch,” “yoga,” “tai chi,” “qi gong,” “Pilates,” “movement therapy,” “breathing exercise,” “progressive muscle relaxation,” “autogenic training,” “biofeedback,” “Feldenkrais,” “alexander technique,” “rolfing,” “trager,” “whole health,” “holistic health,” “complementary therapies,” “integrated medicine,” “integrated health,” “mindbody therapies,” or “complementary integrative health.”

Search terms for remote or virtual delivery included the following: “virtual,” “telehealth,” “remote,” “self-directed,” “electronic delivery,” “information technology,” “applications,” “apps,” “mobile,” “mobile health,” “e-health,” or “m-health.” Generic or specific terms for CIH modalities were always used in combination with terms describing a remote or virtual delivery. Reference lists from relevant systematic reviews and meta-analyses on CIH were searched for articles not previously identified in the database searches. In addition, a publication list maintained by a VA-affiliated CIH evaluation center was also searched for relevant articles. Searches were conducted between June 2020 and October of 2020.

Search and screening procedure

Each search was conducted by a single reviewer, with two authors (A.C.A. and E.J.B.) and a VA librarian conducting separate searches. Search results were uploaded to a digital platform to facilitate systematic reviews11 to assist with deduplication, screening, and full-text review. Screening of articles for inclusion and exclusion criteria was conducted by five reviewers. For each article, the title and abstract were screened by one reviewer to determine whether they met the inclusion criteria for the review. For articles where the reviewer was uncertain whether they met the criteria, the articles were discussed by all reviewers and inclusion/exclusion was determined by consensus.

Inclusion/exclusion criteria

After duplicates were removed, titles, abstracts, and methods were searched to confirm the virtual or remote delivery of one or more of the CIH modalities included in the search terms described above. This included programs that combined in-person and remote delivery, if the remote delivery involved some VHR (e.g., video, mobile app, website). Search results were restricted to peer-reviewed articles published in English after 1990 and involving only human populations. No age restrictions of the studied population were applied, as the goal was to perform an expansive review including any potential remotely delivered modality, regardless of whether it was in children or adults. There were also no restrictions on the study design or the condition or health status of the population under study.

Studies were not limited to fully synchronous or asynchronous delivery and could include aspects of both. In addition, studies could include multiple CIH interventions as well as both CIH and non-CIH interventions. Full-text articles that were not available through subscriptions at either the facility VA library or the affiliated university libraries or were not available through interlibrary loan were excluded (n = 8) (Fig. 1).

FIG. 1.

FIG. 1.

PRISMA. This diagram shows the systematic process the authors followed to include articles captured by this search.

Data collection

A custom data extraction sheet was developed and used by all reviewers for full-text reviews. Data extraction included the title, first author, publication year, journal, study population, the condition(s) under study, study design, CIH modality, type of remote delivery (i.e., website, mobile app, video), intervention details, any noted barriers or facilitators, and outcomes. While the authors extracted data on outcomes, this was not to evaluate efficacy, but to obtain information that could be useful for future implementation efforts. Since comparison of synchronous versus asynchronous delivery or fully virtual versus hybrid studies with some in-person components was not a specific objective of this study, they did not extract data specifically to be able to compare outcomes of these delivery types.

Data analysis

Once data extraction was complete, results were organized in a Microsoft Excel spreadsheet for review. Results were grouped by the type of remote delivery and summarized according to the CIH modality, publication year, conditions, and outcomes.

As there were no inclusion criteria for the conditions, there were a wide variety of conditions or patient populations included in the articles. The authors used the International Classification of Diseases, 10th Revision (ICD-10) codes to categorize conditions. A full list of the articles included in the review is given in Supplementary Appendix A.

Results

Of the 10,884 articles identified, after review for content and methods, 326 articles were included. Table 1 shows the frequency of study designs in the included articles. The majority (51.8%) of the articles reported results of a randomized controlled trial, followed by before-after (20.6%) studies looking at change pre- and post-intervention, and formative (16.0%) studies that examined the development, feasibility, and acceptability of a CIH intervention.

Table 1.

Study Design of Articles Included in Scoping Review

Study design Frequency, n (%)
Randomized controlled trial 169 (51.8)
Before-after 67 (20.6)
Formative 52 (16.0)
Noncomparative 22 (6.8)
Prospective cohort 12 (3.7)
Cross-sectional 4 (1.2)

Mental, behavioral, and neurodevelopmental conditions were the most common (54.9%) conditions addressed by the interventions in the included articles. Cognition and emotional state (29.4%), and conditions of the nervous system (21.5%) were the next two most common conditions (Table 2).

Table 2.

Types of Conditions or Health Topics Included in Articles

Condition Frequency,a n (%)
Mental, behavioral, and neurodevelopmental 179 (54.9)
Cognition and emotional state 96 (29.4)
Nervous system 70 (21.5)
Cancer 28 (8.6)
Health management 20 (6.1)
Fatigue 15 (4.6)
Musculoskeletal 11 (3.4)
Endocrine, nutritional, and metabolic 9 (2.8)
Genitourinary 9 (2.8)
Circulatory system 8 (2.5)
Pregnancy 5 (1.5)
Injury 3 (0.9)
Respiratory 2 (0.6)
Neurofibromatosis 1 (0.3)
Not specified 1 (0.3)
a

Frequencies represent the number of articles that examined the condition. Percentages do not add to 100% since articles could include multiple conditions.

Table 3 displays the technologies used for the intervention or content delivery by the CIH modality. For mindfulness, meditation, biofeedback, guided imagery, and acupressure/acupuncture, mobile applications were the most common VHR used. Compact discs (CDs) or digital video discs (DVDs) used to deliver audio or video files were the most common VHR used for yoga, hypnosis, massage, Tai Chi, qigong, and Pilates. For progressive muscle relaxation, telephone and CD/DVD were tied as the most common technologies used. Another common VHR used across the CIH modalities was a website.

Table 3.

Virtual Health Resource Used for Intervention or Content Delivery by Complementary and Integrative Health Modality

Virtual health resource Modality,a n (%)b
Mindfulness (n = 201) Meditation (n = 78) Biofeedback (n = 39) Yoga (n = 25) Guided imagery (n = 20) Progressive muscle relaxation (n = 13) Hypnosis (n = 10) Massage (n = 7) Tai Chi (n = 7) Acupressure/acupuncture (n = 6) Qigong (n = 5) Pilates (n = 3)
Mobile application 102 (50.7) 41 (52.6) 23 (59.0) 6 (24.0) 9 (45.0) 4 (30.8) 2 (20.0) 3 (42.9) 0 (0.0) 3 (50.0) 1 (20.0) 1 (33.3)
Website 55 (27.4) 20 (25.6) 1 (2.6) 8 (32.0) 1 (5.0) 0 (0.0) 1 (10.0) 3 (42.9) 1 (14.3) 1 (16.7) 2 (40.0) 0 (0.0)
CD/DVD 33 (16.4) 15 (19.2) 0 (0.0) 10 (40.0) 7 (35.0) 5 (38.5) 6 (60.0) 4 (57.1) 5 (71.4) 1 (16.7) 2 (40.0) 2 (66.7)
Telephone 20 (10.0) 5 (6.4) 2 (5.1) 2 (8.0) 5 (25.0) 5 (38.5) 1 (10.0) 1 (14.3) 1 (14.3) 0 (0.0) 0 (0.0) 1 (33.3)
Web conferencing 12 (6.0) 6 (7.7) 2 (5.1) 5 (20.0) 1 (5.0) 1 (7.7) 1 (10.0) 0 (0.0) 1 (14.3) 0 (0.0) 1 (20.0) 0 (0.0)
Text messaging 10 (5.0) 4 (5.1) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
Wearable device 6 (3.0) 1 (1.3) 11 (28.2) 0 (0.0) 0 (0.0) 1 (7.7) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
Telehealth 4 (2.0) 1 (1.3) 5 (12.8) 1 (4.0) 1 (5.0) 1 (7.7) 0 (0.0) 0 (0.0) 1 (14.3) 1 (16.7) 0 (0.0) 0 (0.0)
E-mail 3 (1.5) 3 (3.8) 1 (2.6) 0 (0.0) 0 (0.0) 1 (7.7) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
E-diary 3 (1.5) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
Biofeedback device 2 (1.0) 1 (1.3) 14 (35.9) 1 (4.0) 0 (0.0) 2 (15.4) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
Computer software 2 (1.0) 1 (1.3) 3 (7.7) 0 (0.0) 0 (0.0) 1 (7.7) 0 (0.0) 0 (0.0) 0 (0.0) 1 (16.7) 0 (0.0) 0 (0.0)
Virtual reality 2 (1.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 1 (7.7) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0)
Hand acupuncture system 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 0 (0.0) 1 (16.7) 0 (0.0) 0 (0.0)
a

Frequencies in parentheses after the complementary and integrative health modality name represents the number of articles that utilized that modality. Modality frequencies do not add to the total number of included articles (n = 329) since articles could include more than one complementary and integrative health approach.

b

Frequencies for each virtual health resource may not add to the modality frequency since multiple virtual health resources could be utilized in a single study. Percentages are calculated per modality using the modality frequency as the denominator.

CD, compact disc; DVD, digital video disc.

Outcomes measured in each study that were identified by the authors and collated during data extraction are shown in Figures 2 and 3. Not all articles identified outcome measures (e.g., protocol publications). Outcome measures and results varied across publications. Outcome measures were categorized into participant outcome measures and intervention characteristic outcome measures. The most common participant outcome constructs measured included movement (n = 88), stress (n = 68), and pain (n = 54).

FIG. 2.

FIG. 2.

Participant outcome measures. This graph shows the number of articles reporting each of the participant outcome measure constructs listed on the left of the graph (y-axis).

FIG. 3.

FIG. 3.

Intervention characteristic measures. This graph shows the number of articles reporting each of the intervention characteristic measure constructs listed on the left of the graph (y-axis).

Each construct collates several subconstructs (e.g., balance, stress awareness, pain interference). The construct of movement included a variety of subconstructs including activity tolerance,12 balance,13 and physical function.5 The construct of stress included measures of stress,14 burnout,15 and relaxation.16 Of the publications measuring pain, only one17 measured more than two subconstructs (e.g., pain intensity, pain catastrophizing, and pain interference with activities) of this complex construct. Outcomes were assessed in a variety of ways and may have been assessed quantitatively with validated measures or qualitatively, capturing participant experience.

Intervention characteristic outcomes were less often assessed. The most common characteristic measured was satisfaction and usability (n = 95). This characteristic included reported usefulness, user friendliness, and experience while engaging with the tool. Intervention engagement was often measured as time spent with the intervention (e.g., minutes per day), retention through study protocol, and sessions attended. Few publications reported on the feasibility, cost effectiveness, or data quality. Four publications did stand out as assessing a range of intervention characteristics such as satisfaction and usability, feasibility, and cost effectiveness.18–21

A primary aim of the scoping review was to synthesize the findings relevant to the facilitators of the implementation of remotely delivered CIH. Considering most included studies did not assess implementation feasibility, there were times when facilitators were not specifically author identified. In these instances, reviewers then identified facilitators of virtual implementation of CIH modalities.

Of the articles selected for this scoping review, the majority did not provide insight into facilitators of the virtual implementation of CIH modalities (n = 217; 66.3%). Synthesis of the remaining articles resulted in the identification of facilitators across five categorizations, which include social and technologic supports, accessibility, usability, perceptions, and rewards.

The categorization with the most identified facilitators in the article synthesis was categorized as supports. Facilitators within the support category varied, with the most common form of support abstracted being social support, which comprised in-person22 or online group meetings23 as well as one-on-one interaction with a CIH implementor.24 Supports also included technologic reminders to encourage engagement in the remote CIH modality such as automated and live text messages,25 e-mails,26 phone calls,27 and notifications.28 Although reported less often, the use of tracking features that include daily logs29 and employer initiatives30 that support the use of remotely delivered CIH were also included.

The second-most frequently identified facilitators were categorized as factors related to accessibility. Studies cited the availability of content 24-h a day31 or access to the intervention after the study,32 which afforded study participants the opportunity to engage in their CIH at a time of their convenience. In addition to content availability, the delivery method31 of the CIH was also cited as a facilitator since mobile applications and online formats are now ubiquitous and thus accessible for most individuals. Another factor related to accessibility was no or low cost of the remotely delivered CIH.33

The third category was usability, and article synthesis revealed CIH modalities deemed easy to use,34 simple,35 and usable for diverse populations36 while a gamified nature37 facilitated the remote utilization of CIH among participants. Perceptions of the CIH users also served as facilitators. Although less commonly abstracted from the included studies, perceiving the remote CIH as secure,38 permitting self-direction,39 satisfaction,28,40 and acceptable41 facilitated the implementation and utilization of the remote CIH. The least commonly reported facilitator was the provision of incentives in the form of money, gift cards, or even extra credit college courses facilitated the implementation of remote CIH.

Barriers to successful implementation that were identified by the article authors or by the reviewers during data extraction are shown in Table 4. Not all articles had an identified barrier, as most of the articles were not specifically designed to address feasibility. Of the barriers identified, the most common were low adherence or participation (26.4%),40 synchronous and/or in-person components that added additional constraints, such as travel, time, and space (25.3%),42 technical difficulties with the VHR used to deliver the intervention (23.1%),43 technical requirements that limited adoption (such as broadband internet or requiring a particular smartphone operating system; 14.3%),44 and condition-specific barriers, such as fatigue or embarrassment, that contributed to dissatisfaction or inability to complete the intervention (11.0%).35

Table 4.

Barriers to Implementation

Barrier Frequency,a n (%)
Low adherence/participation 24 (26.4)
Partially remote; still requires travel, time, and space 23 (25.3)
Difficulties with technology 21 (23.1)
Technical requirements limit adoption 13 (14.3)
Participants disliked aspects of the intervention 10 (11.0)
Intervention not optimized for particular condition/population 10 (11.0)
Lifestyle burdens of intervention (e.g., time required, interruptions) 9 (9.9)
Instructor time/scheduling conflicts for remote synchronous sessions 5 (5.5)
Reduced ability to provide support to participants 4 (4.4)
Intervention needs to be further developed 3 (3.3)
High intervention costs (e.g., sensors, subscription costs) 2 (2.2)
Intervention does not offer group option 2 (2.2)
Lack of experience with remote delivery among instructors 1 (1.1)
a

Frequencies represent the number of articles among those where at least one barrier was reported. Percentages do not add to 100% since articles could contain multiple barriers.

For some studies where participant feedback was obtained, participants reported that there were aspects of the intervention that they did not like, such as the voice used during content delivery, or the background music chosen (11.0%).45 Additional barriers identified for remote synchronous delivery included instructor time and scheduling conflicts (5.5%).46

Table 5 shows the most frequent limitations of the included studies that were noted during review. The most frequently identified study limitations were small sample size (46.1%), lacking generalizability (20.6%), high attrition (17.2%), possible selection bias (15.6%), and lack of or unsuitable control group for comparison (15.0%). Other common limitations included a short duration of follow-up (6.1%), self-reported outcomes or compliance with the intervention (5.6%), a lack of assessment of adherence by the study investigators (5.0%), and a short duration of the intervention (4.4%).

Table 5.

Most Frequently Identified Study Limitations

Limitation Frequency,a n (%)
Small sample size 83 (46.1)
Sample not generalizable 37 (20.6)
High attrition 31 (17.2)
Convenience sample; selection bias 28 (15.6)
No control group or unsuitable control 27 (15.0)
Short follow-up duration 11 (6.1)
Self-reported outcomes/compliance 10 (5.6)
Lack of adherence assessment 9 (5.0)
Short intervention duration 8 (4.4)
a

Frequencies represent the number of articles among those where at least one limitation was identified. Percentages do not add to 100% since articles could contain multiple limitations.

Discussion

This article presents the findings of a scoping review to identify the current state of implementation of remotely delivered CIH programs including implementation facilitators, barriers, and study outcomes. Although beyond the scope of this review, findings reflect the literature of in-person delivery of CIH with studies evaluating CIH as a treatment for diverse populations. A summary of data findings suggests that most articles were randomized controlled trials, applied mindfulness-based CIH modalities, and targeted mental and behavioral health conditions. Interventions were primarily delivered through mobile and web-based applications; outcomes measured were broad and included movement, stress, and pain; and intervention characteristic outcomes most often measured were satisfaction and usability.

Most reported barriers were adherence, resource requirements (e.g., time and space) and technology-related issues. Although most studies did not report facilitators, most reported facilitators were supports, accessibility, usability, perceptions, and rewards. Findings suggest that remotely delivered CIH, specifically mindfulness- and meditation-based modalities, is a viable treatment option for a diverse range of health conditions. Data findings inform recommendations to advance the state of the science of delivering CIH with VHR.

These scoping review data findings present evidence of both variety and rigor of study designs. Although randomized control trials are the gold standard for evidence,47 when building the science of a particular intervention (i.e., remotely delivered CIH), formative evaluations are warranted before conducting randomized control trials.48 Increasing the number of formative evaluations will help to improve the quality and effectiveness of remotely delivered CIH programs and could help to identify and alleviate potential barriers. Many of the studies in this scoping review reported small sample size as a limitation to their design.

Mental and behavioral health conditions are well known to be amenable to CIH programming.49–52 These findings reflect this in that more than 50% of the studies focused on these important health conditions. Beyond mental and behavioral health, studies focused on the gamut of conditions from every ICD-10 category from cancer to pregnancy. This finding suggests that remotely delivered CIH is a viable treatment option for diverse health conditions. While the scope of this review was limited to virtual delivery of CIH, it should be noted that this finding mirrors the literature of in-person delivery of CIH with studies evaluating CIH as a treatment for a wide variety of conditions and populations.7,8,53–57

Most studies were focused on mindfulness and meditation. This is likely due to the availability of mindfulness- and meditation-based programs and the ease of program implementation. For example, the ready availability of commercial mindfulness apps that can be easily downloaded from an app store provides an accessible, portable, and efficient means of testing mindfulness as a therapy for a variety of conditions.58–63 The emphasis on the use of VHR to deliver mindfulness and meditation is interesting considering that the most reported measured outcome was movement.

VHR used for delivering the CIH programs varied by CIH modality, most often using the efficient and portable mobile application. Mobile applications are readily developed and can provide accurate data to track participant engagement and progress, but more formal testing is needed.64 Surprisingly, the majority of remotely delivered movement CIH (i.e., yoga, qigong, Pilates, Tai Chi, massage, hypnosis) used CD/DVDs as opposed to the more adaptable mobile application. CD/DVDs may be the VHR of choice for these CIH as they may be played on a television screen that is largely visible even when in varied positions required for a movement practice. In addition, this may also reflect the historical availability of exercise videos that could be applied to CIH movement-base interventions. Similarly, progressive muscle relaxation was most often delivered via CD/DVD and telephone.

Many of these programs used more than one VHR. For example, participants may receive a CD/DVD with video education for their desired CIH modality and a weekly telephone call to assess program engagement and answer questions. Mobile, web, and CD/DVD tend to be more commonly used, but telehealth, virtual reality, and wearable devices are gaining popularity and have been more accessible in recent years. One notable finding was the relative lack of web conferencing, although this option could be feasible for increasing accessibility. The use of virtual tools to deliver CIH improved access to CIH; however, some touch-based modalities such as acupuncture, acupressure, chiropractic, professionally delivered massage, and professionally facilitated hypnosis did not emerge as feasibly delivered CIH modalities.

Reported outcomes measured in this data set were varied. Movement was the most common type of reported outcome. Movement included balance, range of motion, stress incontinence, and others. Many CIH programs aim to improve movement, and so, this finding was not surprising. Studies took care to measure pain and all its permutations such as pain intensity, pain catastrophizing, pain interference, daily pain, and average pain. The authors found the limited number of studies reporting measure of “breathing and breathing signals” and “attention and focus” to be interesting given the importance of both breath work and focus in many CIH programs, including mediation, mindfulness, Tai Chi, qigong, and yoga. Breathing and breath are important aspects of several modalities (e.g., meditation, yoga) and were rarely measured. This may be due to the difficulty in measuring such things remotely.

More research is needed to assess the efficacy of a given VHR with a given modality. Due to the number of modalities used and the number of VHR, it is beyond the scope to conclusively synthesize outcome results.

The relatively recent increase of remotely delivered CIH programs has led to many studies and publications, and more are to be expected with the onset of COVID-19. However, although the application of formative evaluations remains critical, the current literature is lacking in this evaluative approach. Although some studies looked at these qualities, few (n = 33) reported assessing feasibility, a first step to successful implementation. Even fewer reported assessing cost effectiveness or data quality of the varied CIH programs. Cost effectiveness is key in garnering fiscal support for new programming. Quality data are imperative in being able to accurately investigate programming outcomes. Additional work would benefit from including these outcomes in remotely delivered CIH programming studies and publications.

Barriers to successful implementation of remotely delivered CIH programs were most often reported as low adherence or participation (i.e., engagement), resources, and technology-related issues. Research has shown that reminders, prompting, and accountability all improve engagement in remotely delivered interventions and is consistent with the scoping review finding supports, which, include reminders, act as a facilitator in CIH engagement. Formative evaluation of new programs may be able to discern which type of intervention or program component will improve engagement for a given implementation.

Future efforts to employ the VHR to deliver CIH should employ facilitators, including supports, accessibility, usability, perceptions, and rewards. Although not a main finding, another facilitator identified in the review included the gamification of interventions. Gaming components have also been noted as key in improving engagement. Including any of these components will likely increase the successful implementation of new programs. As the intent of this review was to better understand the broad scope of remote delivery of CIH, there was a wide degree of heterogeneity in the methods and approaches used by the studies included in this review, including synchronous and asynchronous delivery, and studies with hybrid in-person and remote delivery. The effects of these differences in delivery should be objectively compared in future research.

The scope of this article is limited to the delivery of CIH using VHR. The authors recommend that in-person delivery of CIH be addressed in subsequent scoping reviews. To strengthen the scientific evidence on remotely delivered CIH, future research should also address feasibility, include larger samples, and standardize outcome measures.

Limitations should be considered when inferring results. First, since their review did not limit to specific conditions, CIH or VHR, the authors are not able to comment on the effectiveness or efficacy of virtual delivery of CIH. The volume and heterogeneity of these works precluded the ability to synthesize specific outcomes. What they did review and synthesize were the measures of outcomes. Second, the authors limited the review to English-language articles and therefore do not have a representation of all literature published in other languages. The authors also did not include gray literature. Third, although they included a broad time range (January 1990 to October 6, 2020), due to the pandemic there is very likely a surge of literature that will come from the COVID onset. However, this body of work provides a foundation for continuing these efforts.

Conclusions

This scoping literature review identified literature reporting on the implementation of remotely delivered CIH. Findings suggest that remotely delivered CIH, specifically mindfulness- and meditation-based modalities, is a viable treatment option for a diverse range of health conditions. Although mobile applications, CD/DVDs, and websites were most commonly used for remote delivery of CIH, the recent explosion of use of web conferencing applications during the COVID-19 pandemic for remote meetings is another viable option for further evaluation—although, since much of the literature the authors evaluated predated the COVID-19 pandemic, they did not find this used frequently. Formative evaluation and feasibility studies are needed to discern the value of attempting implementation on a larger scale. Larger sample sizes are needed to account for small differences and demonstrate statistical significance in findings.

In addition, the authors recommend standardization of outcome measures, including all collected outcomes in publications to include “negative” findings, to inform the strength of evidence for remotely delivered CIH. There are several means for delivering CIH remotely, each warrants consideration when addressing implementation of remotely delivered CIH. The type of VHR that works best is the CIH modality itself, and a combination of different technologies can be used to best implement the program successfully. The body of knowledge clearly indicates the feasibility of delivery of CIH remotely using VHR, which presents itself as a necessity in the current global pandemic climate, and an opportunity to expand accessibility of CIH to remote populations.

Supplementary Material

Supplemental data
Suppl_AppendixA.docx (67.1KB, docx)

Acknowledgment

The authors express their gratitude to Rachel Benzinger and Marilyn Teolis for their contributions in bringing this article to fruition.

Authors' Contributions

J.N.H. made substantial contributions to the conception and design of the work as well as the writing of the article. A.C.A. led data collection and analysis and contributed to writing of the article. E.J.B. and J.M.G. made substantial contributions to data collection and analysis and contributed to writing of the article. C.M. contributed to the data collection and analysis and the writing, editing, and submission of the article. J.M.P. contributed to the conceptualization of the work. All authors have approved the submitted version of this article. All authors have agreed both to be personally accountable for the author's own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Author Disclosure Statement

No competing financial interests exist.

Funding Information

Funding for this project was provided by Whole Health Service, James A. Haley Veterans' Hospital.

Supplementary Material

Supplementary Appendix A

References

  • 1. Elwy AR, Taylor SL, Zhao S, et al. Participating in complementary and integrative health approaches is associated with veterans' patient-reported outcomes over time. Med Care 2020;58:S125–S132. [DOI] [PubMed] [Google Scholar]
  • 2. Donahue ML, Dunne EM, Gathright EC, et al. Complementary and integrative health approaches to manage chronic pain in US military populations: Results from a systematic review and meta-analysis, 1985–2019. Psychol Serv 2021;18:295–309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Taylor SL, Herman PM, Marshall NJ, et al. Use of complementary and integrated health: A retrospective analysis of US veterans with chronic musculoskeletal pain nationally. J Altern Complement Med 2019;25:32–39. [DOI] [PubMed] [Google Scholar]
  • 4. Giannitrapani KF, Holliday JR, Miake-Lye IM, et al. Synthesizing the strength of the evidence of complementary and integrative health therapies for pain. Pain Med 2019;20:1831–1840. [DOI] [PubMed] [Google Scholar]
  • 5. Stephenson KR, Simpson TL, Martinez ME, Kearney DJ. Changes in mindfulness and posttraumatic stress disorder symptoms among veterans enrolled in mindfulness-based stress reduction. J Clin Psychol 2017;73:201–217. [DOI] [PubMed] [Google Scholar]
  • 6. Kligler B. Integrative health in the Veterans Health Administration. Med Acupunct 2017;29:187–188. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Park C. Mind-body CAM interventions: Current status and considerations for integration into clinical health psychology. J Clin Psychol 2013;69:45–63. [DOI] [PubMed] [Google Scholar]
  • 8. Astin JA, Shapiro SL, Eisenberg DM, Forys KL. Mind-body medicine: State of the science, implications for practice. J Am Board Fam Pract 2003;16:131–147. [DOI] [PubMed] [Google Scholar]
  • 9. Barnes PM, Bloom B, Nahin RL. Complementary and alternative medicine use among adults and children; United States, 2007. Natl Health Stat Report 2008;12:1–23. [PubMed] [Google Scholar]
  • 10. Arksey H, O'Malley L. Scoping studies: Towards a methodological framework. Int J Soc Res Methodol 2005;8:19–32. [Google Scholar]
  • 11. Alman A. PICO Portal. 2021. Online document at: www.picoportal.org, accessed March 7, 2022.
  • 12. Tousignant M, Corriveau H, Kairy D, et al. Tai Chi-based exercise program provided via telerehabilitation compared to home visits in a post-stroke population who have returned home without intensive rehabilitation: Study protocol for a randomized, non-inferiority clinical trial. Trials 2014;15:42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Au-Yeung S, Hui-Chan C, Tang J. Short-form Tai Chi improves standing balance of people with chronic stroke. Neurorehabil Neural Repair 2009;23:515–522. [DOI] [PubMed] [Google Scholar]
  • 14. Donesky D, Selman L, McDermott K, et al. Evaluation of the feasibility of a home-based TeleYoga intervention in participants with both chronic obstructive pulmonary disease and heart failure. J Altern Complement Med 2017;23:713–721. [DOI] [PubMed] [Google Scholar]
  • 15. Mohammed WA, Pappous A, Muthumayandi K, Sharma D. The effect of mindfulness meditation on therapists' body-awareness and burnout in different forms of practice. Eur J Physiother 2018;20:213–224. [Google Scholar]
  • 16. Carissoli C, Villani D, Triberti S, Riva G. User experience of BenEssere Mamma, a pregnancy app for women wellbeing. Annu Rev Cyberther Telemed 2016;14:195–198. [Google Scholar]
  • 17. Gardner-Nix J, Backman S, Barbati J, Grummitt J. Evaluating distance education of a mindfulness-based meditation programme for chronic pain management. J Telemed Telecare 2008;14:88–92. [DOI] [PubMed] [Google Scholar]
  • 18. Donovan E, Martin SR, Seidman LC, et al. A mobile-based mindfulness and social support program for adolescents and young adults with sarcoma: Development and pilot testing. JMIR MHealth UHealth 2019;7:e10921. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Wu G, Keyes LM, Callas P, et al. Comparison of telecommunication, community, and home-based Tai Chi exercise programs on compliance and effectiveness in elders at risk for falls. Arch Phys Med Rehabil 2010;91:849–856. [DOI] [PubMed] [Google Scholar]
  • 20. Parker AM, Malik A, Hosey M. Process evaluation and the development of behavioural interventions to improve psychological distress among survivors of critical illness. Thorax 2019;74:7–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Wells C, Malins S, Clarke S, et al. Using smart-messaging to enhance mindfulness-based cognitive therapy for cancer patients: A mixed methods proof of concept evaluation. Psychooncology 2020;29:212–219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Allexandre D, Bernstein AM, Walker E, et al. A web-based mindfulness stress management program in a corporate call center: A randomized clinical trial to evaluate the added benefit of onsite group support. J Occup Environ Med 2016;58:254–264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Brogan K. Remote healing of bipolar disorder, eating disorder not otherwise specified, posttraumatic stress disorder, fibromyalgia, and irritable Bowel syndrome through lifestyle change. Adv Mind Body Med 2017;31:4–9. [PubMed] [Google Scholar]
  • 24. Goldin PR, Lindholm R, Ranta K, et al. Feasibility of a therapist-supported, mobile phone-delivered online intervention for depression: Longitudinal observational study. JMIR Form Res 2019;3:e11509. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Moffitt-Carney KM, Duncan AB. Evaluation of a mindfulness-based mobile application with college students: A pilot study. J Am Coll Health 2021;69:208–214. [DOI] [PubMed] [Google Scholar]
  • 26. Nguyen-Feng VN, Greer CS, Frazier P. Using online interventions to deliver college student mental health resources: Evidence from randomized clinical trials. Psychol Serv 2017;14:481–489. [DOI] [PubMed] [Google Scholar]
  • 27. Freeman L, White R, Ratcliff C, et al. A randomized trial comparing live and telemedicine deliveries of an imagery-based behavioral intervention for breast cancer survivors: Reducing symptoms and barriers to care. Psychooncology 2015;24:910–918. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Turner T, Hingle M. Evaluation of a mindfulness-based mobile app aimed at promoting awareness of weight-related behaviors in adolescents: A pilot study. JMIR Res Protoc 2017;6:e67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Stephens S, Feldman BM, Bradley N, et al. Feasibility and effectiveness of an aerobic exercise program in children with fibromyalgia: Results of a randomized controlled pilot trial. Arthritis Rheum 2008;59:1399–1406. [DOI] [PubMed] [Google Scholar]
  • 30. Aikens KA, Astin J, Pelletier KR, et al. Mindfulness goes to work. J Occup Environ Med 2014;56:721–731. [DOI] [PubMed] [Google Scholar]
  • 31. Hucker A, McCabe MP. Incorporating mindfulness and chat groups into an online cognitive behavioral therapy for mixed female sexual problems. J Sex Res 2015;52:627–639. [DOI] [PubMed] [Google Scholar]
  • 32. Mason AE, Jhaveri K, Cohn M, Brewer JA. Testing a mobile mindful eating intervention targeting craving-related eating: Feasibility and proof of concept. J Behav Med 2018;41:160–173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Kearney DJ, McDermott K, Martinez M, Simpson TL. Association of participation in a mindfulness programme with bowel symptoms, gastrointestinal symptom-specific anxiety and quality of life. Aliment Pharmacol Ther 2011;34:363–373. [DOI] [PubMed] [Google Scholar]
  • 34. Cikajlo I, Cizman Staba U, Vrhovac S, et al. A cloud-based virtual reality app for a novel telemindfulness service: Rationale, design and feasibility evaluation. JMIR Res Protoc 2017;6:e108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Mikolasek M, Witt CM, Barth J. Adherence to a mindfulness and relaxation self-care app for cancer patients: Mixed-methods feasibility study. JMIR MHealth UHealth 2018;6:e11271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Reilly-Spong M, Reibel D, Pearson T, et al. Telephone-adapted mindfulness-based stress reduction (tMBSR) for patients awaiting kidney transplantation: Trial design, rationale and feasibility. Contemp Clin Trials 2015;42:169–184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Larkin F, Oostenbroek J, Lee Y, et al. Proof of concept of a smartphone app to support delivery of an intervention to facilitate mothers' mind-mindedness. PLoS One 2019;14:e0220948. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Gammon D, Strand M, Eng LS, et al. Shifting practices toward recovery-oriented care through an e-recovery portal in community mental health care: A mixed-methods exploratory study. J Med Internet Res 2017;19:e145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Collinge W, Kahn J, Soltysik R. Promoting reintegration of National Guard veterans and their partners using a self-directed program of integrative therapies: A pilot study. Mil Med 2012;177:1477–1485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Rung AL, Oral E, Berghammer L, Peters ES. Feasibility and acceptability of a mobile mindfulness meditation intervention among women: Intervention study. JMIR MHealth UHealth 2020;8:e15943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Pigeon W, Allen C, Possemato K, et al. Feasibility and acceptability of a brief mindfulness program for veterans in primary care with posttraumatic stress disorder. Mindfulness 2014;6:986–995. [Google Scholar]
  • 42. Simmons LA, Williams H, Silva S, et al. Acceptability and feasibility of a mindfulness-based intervention for pain catastrophizing among persons with sickle cell disease. Pain Manag Nurs 2019;20:261–269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Burnett-Zeigler IE, Waldron EM, Hong S, et al. Accessibility and feasibility of using technology to support mindfulness practice, reduce stress and promote long term mental health. Complement Ther Clin Pract 2018;33:93–99. [DOI] [PubMed] [Google Scholar]
  • 44. Holmqvist M, Vincent N, Walsh K. Web- vs telehealth-based delivery of cognitive behavioral therapy for insomnia: A randomized controlled trial. Sleep Med 2014;15:187–195. [DOI] [PubMed] [Google Scholar]
  • 45. Farrell-Carnahan L, Ritterband LM, Bailey ET, et al. Feasibility and preliminary efficacy of a self-hypnosis intervention available on the web for cancer survivors with insomnia. J Appl Psychol 2010;6:10–23. [Google Scholar]
  • 46. Zernicke KA, Campbell TS, Speca M, et al. A randomized wait-list controlled trial of feasibility and efficacy of an online mindfulness-based cancer recovery program: The eTherapy for cancer applying mindfulness trial. Psychosom Med 2014;76:257–267. [DOI] [PubMed] [Google Scholar]
  • 47. Zabor EC, Kaizer AM, Hobbs BP. Randomized controlled trials. Chest 2020;158:S79–S87. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 2008;337:a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Portella CFS, Ghelman R, Abdala CVM, Schveitzer MC. Evidence map on the contributions of traditional, complementary and integrative medicines for health care in times of COVID-19. Integr Med Res 2020;9:100473. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Cramer H, Lange S, Klose P, et al. Yoga for breast cancer patients and survivors: A systematic review and meta-analysis. BMC Cancer 2012;12:412. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Hall H, Cant R, Munk N, et al. The effectiveness of massage for reducing pregnant women's anxiety and depression; systematic review and meta-analysis. Midwifery 2020;90:102818. [DOI] [PubMed] [Google Scholar]
  • 52. Elwy AR, Groessl EJ, Eisen SV, et al. A systematic scoping review of yoga intervention components and study quality. Am J Prev Med 2014;47:220–232. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Wolsko PM, Eisenberg DM, Davis RB, Phillips RS. Use of mind-body medical therapies. J Gen Intern Med 2004;19:43–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Langhorst J, Wulfert H, Lauche R, et al. Systematic review of complementary and alternative medicine treatments in inflammatory bowel diseases. J Crohns Colitis 2015;9:86–106. [DOI] [PubMed] [Google Scholar]
  • 55. Lorenc A, Feder G, MacPherson H, et al. Scoping review of systematic reviews of complementary medicine for musculoskeletal and mental health conditions. BMJ Open 2018;8:e020222. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Hall H, Cramer H, Sundberg T, et al. The effectiveness of complementary manual therapies for pregnancy-related back and pelvic pain: A systematic review with meta-analysis. Medicine (Baltimore) 2016;95:e4723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Carlson LE, Zelinski E, Toivonen K, et al. Mind-body therapies in cancer: What is the latest evidence? Curr Oncol Rep 2017;19:1–11. [DOI] [PubMed] [Google Scholar]
  • 58. Clarke J, Draper S. Intermittent mindfulness practice can be beneficial, and daily practice can be harmful. An in depth, mixed methods study of the “Calm” app's (mostly positive) effects. Internet Interv 2020;19:100293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Huberty J, Green J, Glissmann C, et al. Efficacy of the mindfulness meditation mobile app “Calm” to reduce stress among college students: Randomized controlled trial. JMIR MHealth UHealth 2019;7:e14273. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Huberty J, Eckert R, Larkey L, et al. Experiences of using a consumer-based mobile meditation app to improve fatigue in myeloproliferative patients: Qualitative study. JMIR Cancer 2019;5:e14292. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Björkstrand J, Schiller D, Li J, et al. The effect of mindfulness training on extinction retention. Sci Rep 2019;9:19896. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Flett JAM, Hayne H, Riordan BC, et al. Mobile mindfulness meditation: A randomised controlled trial of the effect of two popular apps on mental health. Mindfulness 2019;10:863–876. [Google Scholar]
  • 63. Rosen KD, Paniagua SM, Kazanis W, et al. Quality of life among women diagnosed with breast Cancer: A randomized waitlist controlled trial of commercially available mobile app-delivered mindfulness training. Psychooncology 2018;27:2023–2030. [DOI] [PubMed] [Google Scholar]
  • 64. Pach D, Rogge AA, Wang J, Witt CM. Five lessons learned from randomized controlled trials on mobile health interventions: Consensus procedure on practical recommendations for sustainable research. JMIR MHealth UHealth 2021;9:e20630. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental data
Suppl_AppendixA.docx (67.1KB, docx)

Articles from Journal of Integrative and Complementary Medicine are provided here courtesy of Mary Ann Liebert, Inc.

RESOURCES