Abstract
Background
Prior to the COVID-19 pandemic, about half of patients from populations that sought care in neurology tried complementary and integrative therapies (CITs). With the increased utilization of telehealth services, we sought to determine whether patients also increased their use of virtual CITs.
Methods
We examined datasets from two separate cross-sectional surveys that included cohorts of patients with neurological disorders. One was a dataset from a study that examined patient and provider experiences with teleneurology visits; the other was a study that assessed patients with a history of COVID-19 infection who presented for neurologic evaluation. We assessed and reported the use of virtual (and non-virtual) CITs using descriptive statistics, and determined whether there were clinical characteristics that predicted the use of CITs using logistic regression analyses.
Findings
Patients who postponed medical treatment for non-COVID-19-related problems during the pandemic were more likely to seek CITs. Virtual exercise, virtual psychotherapy, and relaxation/meditation smartphone applications were the most frequent types of virtual CITs chosen by patients. In both studies, age was a key demographic factor associated with mobile/virtual CIT usage.
Interpretations
Our investigation demonstrates that virtual CIT-related technologies were utilized in the treatment of neurologic conditions during the pandemic, particularly by those patients who deferred non-COVID-related care.
Keywords: Neurology, digital health, health, telemedicine
Introduction
Patients with neurological disorders may have concerns regarding standard pharmacological treatments due to their high costs and potential side effects. 1 Consequently, patients often employ non-pharmacological interventions, such as complementary and integrative treatments (CITs), for relief. 2 CITs for neurological conditions are often divided into two broad categories: (1) behavioral interventions and (2) supplemental interventions. 3 Behavioral treatments include biofeedback and relaxation 2 ; supplemental interventions include vitamins, minerals, and herbs. Prior to the COVID-19 pandemic, approximately 50% of adults with neurologic conditions turned to CITs. 2
Due to the COVID-19 pandemic, healthcare delivery has dramatically changed. A 154% increase in telehealth visits was reported during March 2020 as compared to March 2019. 4 Studies show that this increase in teleneurology usage may be partly due to pandemic social-distancing guidelines and the broad applicability and comfort of getting medical help from one’s device.5–7 With a demonstrated increase in virtual medical care, patients might also specifically seek mobile/virtual/telehealth CITs at increasing rates to address their neurologic problems. However, many studies demonstrated that the usage of virtual platforms for medical care has been limited to specific populations, and thus may not be generalizable to all populations.5–7 Therefore, more research on the use of virtual health care, in this case, CITs, on different patient populations is significant. Several studies suggest that CITs delivered by telehealth are effective in multiple fields of medicine, including neurology, rehabilitation, and oncology. However, these studies had small sample sizes with select patient populations, and many only focused on specific CIT applications such as tai chi and stretching, there is a clear gap in the literature on the use of mobile/virtual/telehealth CITs as a whole across larger patient populations.8–12 Hence, it becomes increasingly important to assess overall CIT usage in more patient populations.
With decreased access to in-person healthcare and the vast increase in the use of telehealth services associated with the pandemic, we sought to evaluate CIT use in patients who presented to a large urban tertiary care neurology practice and to examine predictors of CIT use during the pandemic.
Methods
Standard protocol approvals, registrations, and patient consent
Both primary research studies and the sub-analyses reported herein were approved by the New York University Grossman School of Medicine Internal Review Board and were conducted by faculty and research staff in the NYU Department of Neurology. The studies reported in this article are sub-analyses of larger datasets for the Teleneurology Survey Study 13 and the Post-COVID-19 Neurology Study. Verbal consent was obtained from all subjects in the reported studies.
Teleneurology methods
Eleven neurologists who were conducting telehealth (audio-video) visits for both new and established patients between 18 May 2020 and 16 July 2020, in the NYU Department of Neurology, invited patients to participate in a research study regarding their experiences with telehealth. Interested patients who provided verbal consent underwent a telephone-based survey, which included questions about patient demographics and patients’ use of complementary or alternative therapies to manage their neurological conditions. Specifically, patients were asked, “Have you used complementary or alternative therapies to help manage your neurological problem in the last 3 months (i.e. mobile applications for relaxation, online fitness classes, virtual physical therapy, etc.)?” They could respond “No” and move on or “Yes.” If they responded yes, they were asked, “What applications, therapies have helped?” For the purposes of consistency, responses to the question regarding complementary or alternative therapies will be referred to under CIT.
Patients were asked to list specific therapies they were using; the patients were not given a list of potential therapies to choose from. To reduce selection bias, neurologists were instructed to invite study participants, to obtain verbal consent, and to administer the survey consecutively to each patient seen on a select date(s) of the telehealth visit. Survey data were entered into REDCap by a study coordinator.
The study principal investigator, co-investigators, and a data analyst performed statistical analyses. Analyses were performed using SAS v9.4 (Cary, NC). Because <5% of responses were missing for each survey question, imputation for missing values was not performed. We reported descriptive analyses, including frequencies and percentages to describe categorical variables, means, and standard deviations to characterize continuous variables. For data that were not normally distributed (as assessed visually using histograms), we reported medians and interquartile ranges for any continuous variables. We examined the effects of patients’ demographic characteristics (age, sex, and race) and clinical responses, such as chief complaints and reports of postponing medical care, due to the pandemic on their use of CITs and specifically, mobile applications/virtual therapies. We also used chi-square tests (or Fisher’s exact tests when frequency counts were small (expected values <5 per cell in 2 × 2 tables)). Student’s t-tests were used to test for associations in continuous outcomes for normally distributed data. Since headache is one of the most common neurological symptoms presented in neurology practices 14 and is also one of the most common neurological symptoms following COVID-19, we examined whether headaches are associated with CIT use. Furthermore, depression is highly associated with many neurologic complaints, 15 so we examined whether depression was related to CIT use. Both headache and depression are common symptoms for which patients are known to seek CITs.2,16
Neuro-COVID-19 methods
After Institution Review Board approval was obtained on 4 November 2020, neurologists across NYU Langone Health campuses were asked to add the names of their patients to a shared list in the electronic health record system (EPIC) following standard of care visits for neurological and/or post-COVID-19 symptoms. If a patient had not specifically opted out of being contacted for research studies in EPIC, they were contacted by a study coordinator and invited to participate in an interview capturing neurological symptoms using validated scales. Electronic written informed consent was obtained for each participant who expressed willingness to complete the study. The research coordinator administered the research assessments via telephone, via WebEx, or in person. The research team captured study-related information from standardized clinical templates EPIC and entered this information into a secure and HIPAA-compliant REDCap database. The research-related scales and questionnaire data were also stored in REDCap. Questionnaires and scales captured cognition, social determinants of health, vision, and other neurological symptoms. They also included the Headache Impact Test (HIT)-617,18 and the Neuro-QOL Depression scale. 19 The use of CIT in the context of managing post-COVID-19 symptoms was also captured. The questions regarding CIT use provided multiple-choice responses, and patients could select as many as they wished.
Analyses were performed using SAS v9.4 (Cary, NC). We examined the effects of patients’ demographic characteristics (age, sex, race, and education) and clinical outcomes such as neurological symptoms related to COVID and questionnaire results on their use of CITs, and specifically mobile applications/virtual therapies. Neuro-QOL depression scores were calculated by converting raw scores ranging from 8 to 40 to t-scores ranging from 36.9 to 75 with a mean of 50 and a standard deviation of 10. Higher t-scores indicate worsening depression. A t-score of 55 or greater indicates depression symptoms. Continuous variables were described using median and interquartile ranges and used the nonparametric Kruskal–Wallis test to test for significance. Categorical variables were reported as frequencies and percentages or odds ratios and used the chi-square test Logistic regression analyses were used for multivariate models to explore associations between continuous and categorical variables.
Role of the funding source
M. T. Minen is an NIH mHealth scholar with funding from NCCIH to conduct app-based migraine research.
Results
Teleneurology study results
Among 187 patients, the mean age was 49 + 17.5, and two-thirds (66.8%, n = 125) of patients were female (Table 1). The most common chief complaint that patients had during their visit was headache; headache was reported by 37% of patients. Most (70%, n = 130) patients reported postponing medical attention due to the pandemic. Over one-third of patients (38%, n = 71) reported using CITs to help manage their neurological problem(s) in the three months prior to the teleneurology visit (Table 2).
Table 1.
Characteristics of patients in the teleneurology survey study.
Patients surveyed | 187 | Chief complaint | % (n) |
---|---|---|---|
Age | (Mean ± SD) | Headache | 36.9% (69) |
Years | 49 ± 17.5 | Focal and generalized numbness/tingling | 11.2% (21) |
Gender | % (n) | Memory | 8% (15) |
Female | 66.8% (125) | Spine related | 6.4% (12) |
Male | 33.2% (62) | Vertigo | 5.9% (11) |
Race | % (n) | Distal symmetric peripheral neuropathy | 5.4% (10) |
White | 61.5% (115) | Concussion | 5.4% (10) |
Asian | 7.0% (13) | Seizure/spells | 3.7%(7) |
Black | 8.6% (16) | Stroke or intracranial bleed follow-up | 2.7% (5) |
Other race | 10.7% (20) | Myasthenia | 2.7% (5) |
No response or unknown | 11.8% (22) | Dizziness (not vertigo) | 1.6% (3) |
Ethnicity—Hispanic | 2.1% (4) | Mood disorder/anxiety/depression | 1.6% (3) |
Patient visit type | % (n) | Myelitis/multiple sclerosis | 1.1% (2) |
New patient | 33.2% (62) | Fasciculations/muscle twitch | 1.1% (2) |
Follow-up patient | 66.8% (125) | Evaluation for Bell’s palsy | 1.1% (2) |
*Value to the right of each bar is mean age per group.
Table 2.
Use of complementary and integrative therapy (CIT) to help manage a neurological problem (teleneurology survey study).
Type of therapy | 38% (71) |
---|---|
Virtual exercise | 15% (28) |
Relaxation/meditation App | 13.9% (26) |
virtual physical therapy | 4.3% (8) |
Home meditation practice | 2.1% (4) |
Virtual psychotherapy | 1.6% (3) |
Home meditation practice | 2.1% (4) |
Younger age was associated with seeking CITs more; patients who sought CITs were an average of 5.7 years younger (t = 2.2, P = .03). The most used app types were relaxation/meditation and virtual exercise programs. Relaxation app users were on average 10.5 years younger (P < .001), and virtual exercise app users were on average 7.7 years younger (P = .03). While overall CIT use occurred with similar frequencies for male and female patients (31% vs. 42%, χ2 = 2.0, P = .16), virtual exercise apps were used by female patients more (19% vs. 7% for male patients, P = .02). There were no significant associations between app use with race. However, only 15% of Asian patients reported seeking CITs, compared with 40% of Black patients and 41% of White patients. There were no associations between patient type (new vs. follow-up) and CIT use. Patients whose chief complaint was headache were more likely to have used a virtual exercise app (OR = 2.24, P = .047) and a relaxation app (OR 2.7, P = .02) (unadjusted ORs based on 2 × 2 tables) in the teleneurology study. No other chief complaints or CITs were associated with each other. Those who postponed medical treatment during the pandemic were significantly more likely to have sought CITs (OR = 2.0, 95% CI 1.0–4.0; P = .04). After adjusting for sex, race, chief complaint of headaches, and postponing treatment, age remained a significant predictor of virtual CIT use, with an estimated 4% decline per additional year of age (OR = 0.96, 95% CI 0.92–0.992; P = .02).
Post-COVID-19 neurology study results
The 76 patients who participated were also two-thirds female (67.1%) with an overall cohort mean age of 48 ± 13.8. Patients were mostly White (70.7%) (Table 3). Most patients self-reported having graduated from college or having had post-college training (83.8%). The main occupation listed for employed patients was professional/technical (61%). A third of participants (32.9%) reported having a history of neurological or ophthalmological disease(s). Patients reported using a variety of CITs (Figure 1). The most popular virtual/technology CIT involved virtual psychotherapy and mindfulness/meditation as a mobile application; these CITs were endorsed by 28.9% (n = 22) of participants. Other non-virtual CITs were also used frequently, which included exercise (n = 33, 43.4%) and vitamins/herbal remedy use (n = 33, 43.4%). Increased use of virtual CITs was significantly associated with younger age (median age 48 vs. 54 years, P = .03). There was a decline of 3.5% (P = .04) in the odds of using mobile/virtual CIT for each additional year of age. Age remained a significant (P = .04) predictor of virtual CIT use when adjusting for the effects of outdoor exercise, which is also a significant predictor of mobile app usage (0.02; OR 3.1, 95% CI: 1.2–8.1) but was not associated with age (P = .64), demographic characteristics and COVID neurological symptoms using logistic regression. Participants who used virtual CITs were also at 5.4× higher odds (95% CI 2.0–14.6) of having diet modifications since the pandemic started.
Table 3.
Patients who presented to neurology for COVID-19-related neurology symptoms and use of virtual CIT (post-COVID-19 neurology study).
Total | Mobile App/virtual (n = 30) | None (n = 51) | P-value | |
---|---|---|---|---|
Age—Median (Q1–Q3) [Min, Max] | 50 (35–58) [24, 72] | 48 (30–52) [24, 72] | 54 (36–61) [24, 72] | 0.0284 |
Female | 66.7% (54/81) | 76.7% (23/30) | 60.8% (31/51) | 0.1431 |
Race | 0.5536 | |||
White | 70% (56/80) | 73.3% (22/30) | 68% (34/50) | |
Asian/Pacific Islander | 8.8% (7/80) | 3.3% (1/30) | 12% (6/50) | |
African American | 7.5% (6/80) | 10% (3/30) | 6% (3/50) | |
Other race | 13.8% (11/80) | 13.3% (4/30) | 14% (7/50) | |
Ethnicity—Hispanic | 11.3% (9/80) | 10% (3/30) | 12% (6/50) | 0.7840 |
Highest grade in school completed | 0.0719 | |||
High school graduate/some college or technical training | 16.3% (13/80) | 6.7% (2/30) | 22% (11/50) | |
College graduate/post-college training | 83.8% (67/80) | 93.3% (28/30) | 78% (39/50) | |
Positive COVID-19 RT-PCR | 0.3120 | |||
Yes | 61.3% (49/80) | 53.3% (16/30) | 66% (33/50) | |
No | 30% (24/80) | 40% (12/30) | 24% (12/50) | |
N/A | 8.8% (7/80) | 6.7% (2/30) | 10% (5/50) | |
Positive COVID-19 antibodies | 0.5879 | |||
Yes | 75% (60/80) | 80% (24/30) | 72% (36/50) | |
No | 13.8% (11/80) | 13.% (4/30) | 14% (7/50) | |
N/A | 11.3% (9/80) | 6.7% (2/30) | 14% (7/50) | |
History of neurological or ophthalmological disease | 32.9% (26/79) | 23.3% (7/30) | 38.8% (19/49) | 0.1563 |
CIT: complementary and integrative therapy; RT-PCR: reverse transcription-polymerase chain reaction.
Figure 1.
Complementary and integrative therapy use by patients presenting to a neurology practice for neuro-related COVID-19-19 symptoms* (post-COVID-19 neurology study).
Any associations between neurological symptoms and the types of CITs patients reported using were also examined. Patients using virtual psychotherapy were more likely to report muscle aches (OR = 15.2, P = .002), memory changes (OR = 7.3, P = .006), word-finding difficulties (OR = 7.0, P = .007), and fatigue (OR = 7.3, P = .04). Using a mobile app for mindfulness/meditation was associated with a history of word-finding difficulties (OR = 4.7, P = .02) and fatigue (OR = 6.6, P = .048).
Among patients in the COVID-19 study reporting headache (n = 42), the most used virtual CITs were psychotherapy (n = 11, 26%) and a mobile app for mindfulness/meditation (n = 9, 21%). The most used non-virtual CITs were megavitamins (n = 19, 45%), outdoor exercise (n = 17, 40%), and herbal remedies (n = 13, 40%). Those reporting headache were no more likely to use a virtual CIT than they were to use a non-virtual CIT (43% vs. 32%, P = .35). Those with headaches had median HIT-6 scores of 59 (interquartile range (IQR) 54–67), indicating a substantial symptom burden. There were no significant differences in HIT-6 scores between groups of patients who used different categories of CIT. However, virtual CIT users reported significantly lower median HIT-6 scores (56.5, IQR 49–59) than non-virtual users (64, IQR 56–70) when aggregated (P = .04).
Those reporting depression (n = 11) had a median quality of life (QOL) t-scores of 59 (IQR 57.4–67.3), and their most used CITs were virtual psychotherapy (6, 54.5%), followed by other (5, 45.5%), meditation/mindfulness app (4, 36.4%), special diet (3, 27.3%), and megavitamins (3, 27.3%). Overall, those with depressive symptoms were more likely to report using a virtual CIT, with 82% of patients with depression using one or more compared to only 30% of those with no depression (OR = 10.6, P < .001).
Discussion
Prior to the pandemic, research has shown that virtual-based CITs are potentially beneficial to patients with neurological conditions who want to improve self-care and track their symptoms.8,20 Studies demonstrated that the use of virtual CITs put increased responsibility on the patient, which enabled them to feel more involved in their care and motivate them to maintain a healthy lifestyle.8,20 During the pandemic, and with the associated increased use of telehealth services, 4 we found several key observations regarding CIT use: (1) patients who reported postponing medical treatment were more likely to seek CITs; (2) younger patients were more likely to employ mobile/virtual CITs; (3) virtual exercise, virtual psychotherapy, and relaxation/meditation smartphone applications were the most reported types of virtual CITs employed; (4) patients who reported postponing medical treatment were more likely to seek complementary and integrative therapies (CITs).
It is unsurprising that in the pandemic, patients postponing treatments sought other options; the World Health Organization has focused on integrated health recently. In mass media, there has been a focus on supplement use for COVID-19 treatment.21,22 Prior research showed that patients who wish to avoid conventional treatments may seek telehealth CIT options. 2 Before the pandemic, telehealth CITs were attractive to patients who were geographically, economically, socially, and/or physically hindered from attending an office visit or who desired to avoid the potential side effects of pharmacological treatments. Due to their versatility and accessibility, telehealth CITs can reach a large patient population, and further research examining the advantage of in-person versus virtual CITs is warranted.
Younger patients were more likely to employ mobile/virtual CITs
In the teleneurology study, younger patients were more likely to utilize mobile/virtual CIT interventions. Likewise, the neuro-COVID-19 results indicate that age was the only predictor with an association with mobile/virtual CIT usage. This association may suggest a generational difference in exposure to and ability to use technology. The decrease in virtual CIT use with older patients could be attributed to a lack of comfort and access to the required technology forms of CIT. By increasing access to telehealth use in neurology, creating apps appropriate for geriatric use, and expanding resources dedicated to helping older patients understand how to use virtual CITs, the age gap in usage may be reduced.
Virtual CITs most reported by the neurology patients
The virtual exercise was the most used CIT in our teleneurology study. Aerobic exercise is beneficial to patients who experience migraine.23–27 Aerobic exercise improves cognitive function, sleep quality, and reduces depressive symptoms amongst patients with mild cognitive impairments, and provides benefits for patients with other neurological conditions, such as Parkinson’s disease.28–30 Virtual exercise apps may allow patients increased access to exercises that are more cost-effective and diverse. More studies are needed on the efficacy and adherence to virtual exercise apps. Finally, exercise does not carry the stigma associated with other virtual treatments, such as virtual psychotherapy.31–35 People may be more open about engaging in it publicly and even in a study.
In contrast, the most used virtual CIT reported in the COVID-19 study was virtual psychotherapy. Virtual psychotherapy was most used amongst patients with depression, headache, muscle aches, memory changes, word-finding difficulties, and fatigue. Virtual psychotherapy can be beneficial for patients with neurological symptoms, including those with co-morbid psychiatric conditions.36–38 One study on psychotherapy that employed virtual reality to treat young adults with mild to moderate depression found that virtual psychotherapy may influence patient adherence and efficacy because of increased engagement, thereby improving QOL as well as preventing long-term chronic depression. 39 Considering that some studies have shown that virtual psychotherapy is effective and can increase access to treatment for patients with neurological disorders, research should be conducted to determine if virtual psychotherapy has a durable benefit.
Other frequently used virtual CITs reported in both the teleneurology and neuro-COVID-19 studies were relaxation and meditation apps. Commercial meditation and relaxation apps, such as Calm, were already increasingly popular amongst smartphone users. 40 A 2018 survey revealed that most people decided to use mental health apps after finding them on social media. 41 There was a 10% increase in the number of downloads of mental health apps, primarily being meditation apps, during the pandemic. 42 As the pandemic has greatly affected mental health, online mindfulness interventions have become increasingly available and have helped to improve pandemic-related psychological conditions whilst maintaining social distancing. 43 Additional research is needed to measure the efficacy and adherence to these mobile CITs over time.44–49
Limitations
Our studies were single-site exploratory studies conducted with a small patient population and may not be generalizable to the whole population. In the teleneurology study, the investigators were also participant physicians, which may have led to bias. Participants might have responded with answers they believed investigators wished to hear. 50 The neuro-COVID-19 study was not done with consecutive recruitment; the patients were those with COVID-19 who likely had continuing symptoms, prompting them to seek further evaluation and care. Few patients were over the age of 65 years. Thus, there might be limited generalizability to older neurologic populations. Our studies were not observational and not randomized. Thus, there may not be diversity in terms of socioeconomic background, and our observations may not be generalizable to a broad population of patients. Furthermore, our study was limited to complementary and integrative treatments, which included supplements, but not pharmacologic medications used off-label for other purposes. Such oral formulations were increasingly used off-label, 51 but we focused more on how changes in technology as treatment changed health.
Future directions
There are many potential avenues for future investigation, such as education, implementing frameworks for virtual CITs in clinical care, and examining whether patients who initiate CITs continue their use over the long term. 52 Future improvements could involve improving the software to be more user-friendly and including CIT instructions for those not comfortable with using technology, especially in the older age groups. Further studies can also be conducted on the association between gender and usage of virtual exercise apps.
Exploring the preferences of stakeholders in CIT is crucial to the development and concurrent evidence-based trial of mHealth apps. Developers of future mobile app mindfulness/meditation interventions may benefit from involving patients with neurological conditions in the development process. The popularity of CIT methods amongst patients recording depression and headache in this study highlights the specific CIT types for which more evidence-based studies on virtual options are needed. One solution is the development and integration of digital clinics. Traditional health care approaches with digital health tools such as mobile apps could be advantageous. 53 This hybrid approach could be a more efficacious method to ease older patients into technology-based care. More studies would be needed to examine the transition from in-person CITs to virtual CITs and the adherence to treatment.
Just as patients turn to pharmacists for guidance on medications and supplements for various ailments, 51 patients need a well-established, trusted method for learning about technology-based complementary and integrative treatments. Given the ever-growing number of telehealth apps available, the creation and maintenance of an app evaluation framework could prove useful in determining the safety, efficacy, and feasibility of each app. In a 2019 panel, a group of mental health care providers and those with lived mental health experience convened to reform the American Psychiatric Association framework, adapting it to the new digital mental health field with a hierarchical level approach to app evaluation. 54 Developing a similar evaluation framework for neurological care mobile apps would allow patients and providers alike a more standard, accessible way to navigate the virtual marketplace and determine which apps will be able to provide the best-personalized care. Further, evidence-based virtual CIT maps might also be helpful in directing neurology patients to the best CITs. Such maps have been developed for using CITs during the COVID-19 pandemic, though they have not had a virtual focus. 55
Our study was inclusive of many neurological conditions, ranging from headache to stroke. Future studies might examine CIT use for an even wider range of neurologic conditions and with older populations. 56 The duration and frequency needed for the virtual CITs to have maximal benefit should be studied.55,57–60 As the role of telehealth continues to evolve, studies must be done to better understand their efficacy and adaptability as they are delivered in various modes virtually. For example, therapists need valid tools to determine which patients would benefit from virtual reality and augmented reality instead of manual therapy. 61 The development of evidence-based policy should take into consideration the increased use of virtual CITs. Similar to the development of virtual oncology integrative centers, 62 there may a role in the creation of virtual neurology integrative centers.
Conclusion
Virtual-based CITs will inevitably be part of the treatment plan for many neurological disorders. The adaptation will likely be faster than expected especially for patients who postponed traditional medical appointments during the pandemic. Ensuring accessibility for all populations and having a framework for such technologies is an unmet need. Providers treating patients with neurologic conditions will require knowledge of which CITs are evidence-based. Additional studies exploring adherence and the dosing needed to impact treatment outcomes are important areas for further investigation.
Acknowledgements
The authors thank Lisena Hasanaj for her help with data entry for both data sets. We also thank all the neurologists who participated in the teleneurology study and those who referred patients to the Neuro-COVID-19 study.
Footnotes
Contributorship: MTM contributed to conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, supervision, validation, writing—original draft, review, and editing. NAB contributed to conceptualization, data curation, formal analysis, investigation, and writing—original draft, review, and editing. SF contributed to data curation, formal analysis, writing—original draft, review, and editing. MC contributed to writing—original draft, review, and editing. AS contributed to writing—original draft, review, and editing. QH contributed to writing—original draft, review, and editing. KM contributed to writing—original draft, review, and editing. MS contributed to writing—original draft, review, and editing. DV contributed to writing—original draft, review, and editing. LY contributed to writing—original draft, review, and editing. F-YAF contributed to data curation and writing—review, and editing. JMB contributed to data curation and writing—review, and editing. LJB contributed to conceptualization and writing—review and editing. SLG contributed to writing—review, and editing. ST contributed to Conceptualization, data curation, formal analysis, investigation, methodology, and writing—original draft, review, and editing.
Declaration of conflicting interests: The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: M.T. Minen is an NIH mHealth scholar with funding from NCCIH to conduct app-based migraine research. M.T. Minen contributed to developing intellectual property being used in this study that is co-owned by NYU and IRODY. If the research is successful, NYU and IRODY may benefit from the outcome. N.A. Busis serves as alternate CPT advisor and has received personal compensation for speaking engagements from the American Academy of Neurology. SF reports no disclosures relevant to the manuscript; S. Friedman reports no disclosures relevant to the manuscript; J.M. Bhatt reports no disclosures relevant to the manuscript; M. Campbell, Q. Hossain, K. Maisha, A. Sahu, M. Soviero, D. Verma, and L. Yao reports no disclosures relevant to the manuscript; F.A. Foo reports no disclosures relevant to the manuscript. L.J. Balcer is editor-in-chief for the Journal of Neuro-Ophthalmology; S.L. Galetta reports no disclosures relevant to the manuscript; S.P. Thawani reports no disclosures relevant to the manuscript.
Ethical approval: Both primary research studies and the sub-analyses reported herein were approved by the New York University Grossman School of Medicine Internal Review Board and were conducted by faculty and research staff in the NYU Department of Neurology. Verbal consent was obtained from all subjects in the reported studies.
Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Center for Complementary and Integrative Health (grant number K23AT009706).
Guarantor: MTM.
ORCID iDs: Maya Campbell https://orcid.org/0000-0003-3760-8741
Mia Soviero https://orcid.org/0000-0002-7050-8251
References
- 1.McGinley MP, Ontaneda D, Wang Z, et al. Teleneurology as a solution for outpatient care during the COVID-19 pandemic. Telemed e-Health 2020; 26: 1537–1539. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wells RE, Baute V, Wahbeh H. Complementary and integrative medicine for neurologic conditions. Med Clin North Am 2017; 101: 881–893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Patel P, Minen MT. Complementary and integrative health treatments for migraine. J Neuroophthalmol 2019; 39: 360–369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Koonin LM, Hoots B, Tsang CA, et al. Trends in the use of telehealth during the emergence of the COVID-19 pandemic—United States, January–March 2020. Morb Mortal Weekly Rep 2020; 69: 1595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Al Kasab S, Almallouhi E, Holmstedt CA. Optimizing the use of teleneurology during the COVID-19 pandemic. Telemed e-Health 2020; 26: 1197–1198. [DOI] [PubMed] [Google Scholar]
- 6.Almallouhi E, Al Kasab S, Harvey JB, et al. Teleneurology network to improve access to neurologists for patients in rural areas: A real-world experience. Telemedicine and e-Health 2020; 26: 108–111. [DOI] [PubMed] [Google Scholar]
- 7.Tso JV, Farinpour R, Chui HCet al. et al. A multidisciplinary model of dementia care in an underserved retirement community, made possible by telemedicine. Front Neurol 2016; 7: 225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ma R, Hou Y, Zhang Y, et al. The efficacy of tai chi and stretching exercises based on a smartphone application for patients with Parkinson’s disease: A protocol for a randomized controlled trial. Front Neurol 2021; 12: 731606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mullur RS, Kaur Cheema SP, Alano REet al. et al. Tele-integrative Medicine to support rehabilitative care. Phys Med Rehabil Clin N Am 2021; 32: 393–403. [DOI] [PubMed] [Google Scholar]
- 10.Narayanan S, Lopez G, Powers-James C, et al. Integrative oncology consultations delivered via telehealth in 2020 and in-person in 2019: Paradigm shift during the COVID-19 world pandemic. Integr Cancer Ther 2021; 20: 1534735421999101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Schulz-Heik RJ, Meyer H, Mahoney L, et al. Results from a clinical yoga program for veterans: Yoga via telehealth provides comparable satisfaction and health improvements to in-person yoga. BMC Complement Altern Med 2017; 17: 198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Story KM, Flanagan ME, Brown HAet al. et al. Veterans hospital administration telehealth utilization for recreation and creative arts therapies: A brief report. Telemed J E Health 2021; 28: 752–757. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Thawani S, Minen M, Stainman R, et al. Neurologists’ evaluations of experience and effectiveness of teleneurology encounters. Telemed J E Health In Press. [DOI] [PubMed] [Google Scholar]
- 14.Stovner L, Hagen K, Jensen R, et al. The global burden of headache: A global documentation of headache prevalence and disability worldwide. Cephalalgia 2007; 27: 193–210. [DOI] [PubMed] [Google Scholar]
- 15.Nuyen J, Schellevis FG, Satariano WA, et al. Comorbidity was associated with neurologic and psychiatric diseases: A general practice-based controlled study. J Clin Epidemiol 2006; 59: 1274–1284. [DOI] [PubMed] [Google Scholar]
- 16.Thachil A, Mohan R, Bhugra D. The evidence base of complementary and alternative therapies in depression. J Affect Disord 2007; 97: 23–35. [DOI] [PubMed] [Google Scholar]
- 17.Bayliss M, Batenhorst A. The HIT-6: A user’s guide. Lincoln, RI: Quality Metric, 2002. [Google Scholar]
- 18.Houts CR, Wirth R, McGinley JS, et al. Content validity of HIT–6 as a measure of headache impact in people with migraine: A narrative review. Headache 2020; 60: 28–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Gershon R, Lai J, Bode R. Quality of life item banks for adults with neurological disorders: Item development and calibrations based upon clinical and general population testing. Qual Life Res Epub 2011; 21: 475–486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Winberg C, Kylberg M, Pettersson C, et al. Feeling controlled or being in control? Apps for self-management among older people with neurological disability. Disabil Rehabil Assist Technol 2019; 16(6): 603–608. [DOI] [PubMed] [Google Scholar]
- 21.World Health Organization. WHO Global report on traditional and complementary medicine 2019. Luxembourg: World Health Organization, 2019. [Google Scholar]
- 22.Pal A, Squitti R, Picozza M, et al. Zinc and COVID-19: Basis of current clinical trials. Biol Trace Elem Res 2020; 199(8): 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Amin FM, Aristeidou S, Baraldi C, et al. The association between migraine and physical exercise. J Headache Pain 2018; 19: 83. doi: 10.1186/s10194-018-0902-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Irby MB, Bond DS, Lipton RBet al. et al. Aerobic exercise for reducing migraine burden: Mechanisms, markers, and models of change processes. Headache 2016; 56: 357–369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kroll LS, Hammarlund CS, Linde Met al. et al. The effects of aerobic exercise for persons with migraine and co-existing tension-type headache and neck pain. A randomized, controlled, clinical trial. Cephalalgia 2018; 38: 1805–1816. [DOI] [PubMed] [Google Scholar]
- 26.Lemmens J, De Pauw J, Van Soom T, et al. The effect of aerobic exercise on the number of migraine days, duration and pain intensity in migraine: A systematic literature review and meta-analysis. J Headache Pain 2019; 20: 16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Varkey E, Cider Ã, Carlsson Jet al. et al. Exercise as migraine prophylaxis: A randomized study using relaxation and topiramate as controls. Cephalalgia 2011; 31: 1428–1438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Bergen JL, Toole T, Elliott Iii RGet al. et al. Aerobic exercise intervention improves aerobic capacity and movement initiation in Parkinson's disease patients. NeuroRehabilitation 2002; 17: 161–168. [PubMed] [Google Scholar]
- 29.Motl RW, Pilutti LA. The benefits of exercise training in multiple sclerosis. Nat Rev Neurol 2012; 8: 487–497. [DOI] [PubMed] [Google Scholar]
- 30.Song D, Doris S. Effects of a moderate-intensity aerobic exercise programme on the cognitive function and quality of life of community-dwelling elderly people with mild cognitive impairment: A randomised controlled trial. Int J Nurs Stud 2019; 93: 97–105. [DOI] [PubMed] [Google Scholar]
- 31.Minen MT, Azarchi S, Sobolev R, et al. Factors related to migraine patients’ decisions to initiate behavioral migraine treatment following a headache specialist's recommendation: A prospective observational study. Pain Med 2018. doi: 10.1093/pm/pny028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Minen M, Shome A, Halpern A, et al. A migraine management training program for primary care providers: An overview of a survey and pilot study findings, lessons learned, and considerations for further research. Headache 2016; 19(11): 2274–2283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Minen MT, Sahyoun G, Gopal A, et al. A pilot randomized controlled trial to assess the impact of motivational interviewing on initiating behavioral therapy for migraine. Headache 2020; 60: 441–456. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Ernst MM, O'Brien HL, Powers SW. Cognitive-behavioral therapy: How medical providers can increase patient and family openness and access to evidence-based multimodal therapy for pediatric migraine. Headache 2015; 55: 1382–1396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Andrasik F. Behavioral treatment of headaches: Extending the reach. Neurol Sci 2012; 33: 127–130. [DOI] [PubMed] [Google Scholar]
- 36.Pandita S, Won AS. Clinical applications of virtual reality in patient-centered care. In: Jihyun Kim and Hayeon Song (eds) Technology and health. Elsevier, 2020, pp.129–148. [Google Scholar]
- 37.Botella C, Quero S, Baños RMet al. et al. Virtual reality and psychotherapy. In: Riva G, Botella C, Légeron P et al. (eds) Cybertherapy. Amsterdam: IOS Press, 2004, pp.37–54. [PubMed] [Google Scholar]
- 38.Glanz K, Rizzo AS, Graap K. Virtual reality for psychotherapy: Current reality and future possibilities. Psychother Theor Res Pract Train 2003; 40: 55. [Google Scholar]
- 39.Montesano A, Medina JC, Paz C, et al. Does virtual reality increase the efficacy of psychotherapy for young adults with mild-to-moderate depression? A study protocol for A multicenter randomized clinical trial. Trials 2021; 22: 916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Huberty J, Green J, Glissmann Cet al. et al. Efficacy of the mindfulness meditation mobile app “calm” to reduce stress among college students: Randomized controlled trial. JMIR mHealth uHealth 2019; 7: e14273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Schueller SM, Neary M, O'Loughlin Ket al. et al. Discovery of and interest in health apps among those with mental health needs: Survey and focus group study. J Med Internet Res 2018; 20: e10141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Wang X, Markert C, Sasangohar F. Investigating popular mental health mobile application downloads and activity during the COVID-19 pandemic. Hum Factors 2021: 0018720821998110. [DOI] [PubMed] [Google Scholar]
- 43.Farris SR, Grazzi L, Holley M, et al. Online mindfulness may target psychological distress and mental health during COVID-19. Glob Adv Health Med 2021; 10: 216495612110024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Minen MT, Stieglitz EJ. Wearables for neurologic conditions: Considerations for our patients and research limitations. Neurol Clin Pract 2020; 11(4): e537–e543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Minen MT, Jalloh A, Ortega Eet al. et al. User design and experience preferences in a novel smartphone application for migraine management: A think aloud study of the RELAXaHEAD application. Pain Med 2019; 20: 369–377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Christensen H, Batterham PJ, Gosling JA, et al. Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight Study): A randomised controlled trial. Lancet Psychiatry 2016; 3: 333–341. [DOI] [PubMed] [Google Scholar]
- 47.How sleepio works. Sleepio. 2020. https://www.sleepio.com/#howSleepioWorks. (accessed May/June 2020).
- 48.Minen MT, Corner S, Berk T, et al. Heartrate variability biofeedback for migraine using a smartphone application and sensor: A randomized controlled trial. Gen Hosp Psychiatry 2021; 69: 41–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Stubberud A, Linde M. Digital technology and mobile health in behavioral migraine therapy: A narrative review. Curr Pain Headache Rep 2018; 22: 66–018-0718-0. [DOI] [PubMed] [Google Scholar]
- 50.Brito CF. Demonstrating experimenter and participant bias. In: Stowell JR, Addison WE. (eds) Activities for teaching statistics and research methods. Washington, DC: American Psychological Association, 2017, pp.94–97. [Google Scholar]
- 51.Paudyal V, Sun S, Hussain Ret al. et al. Complementary and alternative medicines use in COVID-19: A global perspective on practice, policy and research. Res Social Adm Pharm 2022; 18: 2524–2528. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Sirois FM, Salamonsen A, Kristoffersen AE. Reasons for continuing use of complementary and alternative medicine (CAM) in students: A consumer commitment model. BMC Complement Altern Med 2016; 16: 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Connolly SL, Kuhn E, Possemato Ket al. et al. Digital clinics and mobile technology implementation for mental health care. Curr Psychiatry Rep 2021; 23: 38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Lagan S, Emerson MR, King D, et al. Mental health app evaluation: Updating the American psychiatric association's framework through a stakeholder-engaged workshop. Psychiatr Serv 2021; 72: 1–4. [DOI] [PubMed] [Google Scholar]
- 55.Portella CFS, Ghelman R, Abdala CVMet al. et al. Evidence map on the contributions of traditional, complementary and integrative medicines for health care in times of COVID-19. Integr Med Res 2020; 9: 100473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Mikolasek M, Berg J, Witt CMet al. et al. Effectiveness of mindfulness- and relaxation-based eHealth interventions for patients with medical conditions: A systematic review and synthesis. Int J Behav Med 2018; 25: 1–16. [DOI] [PubMed] [Google Scholar]
- 57.Ng MM, Firth J, Minen Met al. et al. User engagement in mental health apps: A review of measurement, reporting, and validity. Psychiatr Serv 2019; 70: 538–544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Minen MT, Adhikari S, Padikkala J, et al. Smartphone–delivered progressive muscle relaxation for the treatment of migraine in primary care: A randomized controlled trial. Headache 2020; 60: 2232–2246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Minen MT, Morio K, Schaubhut KBet al. et al. Focus group findings on the migraine patient experience during research studies and ideas for future investigations. Cephalalgia 2020; 40: 712–734. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Minen MT, Schaubhut KB, Morio K. Smartphone based behavioral therapy for pain in multiple sclerosis (MS) patients: A feasibility acceptability randomized controlled study for the treatment of comorbid migraine and MS pain. Mult Scler Relat Disord 2020; 46: 102489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Cerritelli F, Chiera M, Abbro M, et al. The challenges and perspectives of the integration between virtual and augmented reality and manual therapies. Front Neurol 2021; 12: 700211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Huston A. Development of a virtual integrative oncology center. Oncol Issue 2022; 37: 38–45. [Google Scholar]