Skip to main content
Healthcare logoLink to Healthcare
. 2023 Jul 17;11(14):2042. doi: 10.3390/healthcare11142042

Acupuncture Improves Sleep Disorders and Depression among Patients with Parkinson’s Disease: A Meta-Analysis

Wei-Ti Hsu 1,2, Chieh-Min Hsu 2, Shao-Chi Hung 2, Shih-Ya Hung 3,4,*
Editor: Jorge P Machado
PMCID: PMC10379076  PMID: 37510483

Abstract

Parkinson’s disease (PD) is associated with a range of non-motor symptoms that lack effective treatments. Acupuncture is a popular alternative therapy for PD patients that has been shown to improve motor symptoms. However, the efficacy of acupuncture in treating non-motor symptoms has remained controversial. The goal of our study was to systematically assess the existing evidence for acupuncture’s efficacy in treating PD non-motor symptoms of sleep disorders, depression, anxiety, and fatigue. We conducted a meta-analysis of clinical trials by searching Pubmed, Embase, CINAHL, and Web of Science as electronic databases to evaluate acupuncture treatment for PD non-motor symptoms. Thirteen clinical trials met our inclusion criteria, and their methodological quality was assessed using the modified Jadad scale, indicating a moderate overall quality. Our results showed that acupuncture improved PD-related sleep disorders and depression but had no effect on anxiety and fatigue. Our meta-analysis suggests that acupuncture can be used as a complementary treatment for sleep disturbances and depression in PD patients and may exhibit a dual therapeutic effect on motor and non-motor symptoms. However, further well-designed clinical trials with larger sample sizes are needed to confirm these findings. Overall, our study highlights the potential of acupuncture as a viable complementary therapy for the treatment of PD non-motor symptoms of sleep disorders and depression, which can improve the quality of life of PD patients.

Keywords: acupuncture, depression, non-motor symptoms, Parkinson’s disease, sleep disorders

1. Introduction

Parkinson’s disease (PD) is a common chronic and progressive neurodegenerative disorder that affects motor function but also leads to a range of non-motor symptoms [1]. Pathological hallmarks of PD are associated with early prominent death of dopaminergic neurons in the substantia nigra pars compacta (SNpc) for an unknown reason resulting in dopamine deficiency within the striatum and leading to classical parkinsonian motor symptoms [2,3]. The motor symptoms of PD are characterized by bradykinesia, rigidity, tremor, and postural instability; non-motor symptoms are characterized by depression, anxiety, cognitive impairment, sleep disturbances, and others [2]. Non-motor symptoms are common in patients with PD and can appear before motor features and progress in severity and diversity as the disease evolves [4]. While current treatments such as levodopa (as dopamine replacement therapy), dopamine agonists, and deep brain stimulation exert good control for PD motor symptoms, they do not effectively address non-motor symptoms. Therefore, developing new treatments for non-motor symptoms remains a priority in PD research.

Acupuncture is a traditional Chinese medicine technique that has been used for the treatment of neurodegenerative diseases such as Alzheimer’s disease and PD [5]. Electroacupuncture, a form of acupuncture that has been increasingly popular since the 1970s, is preferred among researchers due to its ease of standardization [6]. In PD patients, acupuncture is among the top three most popular alternative therapies [7]. Acupuncture has been reported to have therapeutic effects on both motor and non-motor symptoms. For motor symptoms, a clinical trial has shown that bee venom acupuncture or acupuncture treatments can significantly improve motor symptoms in idiopathic PD patients [8]. Electroacupuncture treatment has also been found to improve rigidity, balance, and gait in PD patients [9,10]. Additionally, a recent multicenter randomized controlled trial demonstrated that electroacupuncture combined with conventional pharmacological treatment significantly enhances motor function in PD patients [11]. The neural mechanism underlying the effect of acupuncture on the motor function of PD patients has been investigated using functional magnetic resonance imaging (fMRI), which shows that acupuncture stimulation at GB34 acupoint can activate the putamen and primary motor cortex, improving motor function [12]. Our animal studies also support the therapeutic potential of electroacupuncture in PD, demonstrating that electroacupuncture at GB34 and LR3 acupoints promotes motor function recovery and reduces dopaminergic neuron degeneration via Akt-BDNF pathway and autophagy activation in the substantia nigra and striatum, respectively [6,13]. These findings suggest that acupuncture may have a promising role in the treatment of PD motor symptoms through modulation of neuronal activity in specific brain regions.

PD patients frequently experience non-motor symptoms. A study of 402 PD patients published in 2021 found non-motor symptoms present in 99.7% of them, with higher PD severity associated with a greater prevalence of non-motor symptoms [14]. Among non-motor symptoms, sleep disturbances are the most common, affecting 60% to 90% of patients with various sleep disorders, such as insomnia, sleep-disordered breathing disorders, and excessive daytime sleepiness [15]. Rates of depression, anxiety, and fatigue in PD patients are highly variable across studies, with some finding prevalence rates as low as 2.7% and others finding rates exceeding 90% [16,17,18]. While acupuncture is a popular alternative therapy for PD patients that has been shown to improve motor symptoms, its efficacy in treating non-motor symptoms, such as sleep disorders, depression, anxiety, and fatigue, remains controversial. Some studies suggest that acupuncture can improve sleep efficiency, depression, and anxiety in PD patients. For example, Li et al. (2022) showed that acupuncture led to increased sleep efficiency in a dose-dependent manner compared to sham acupuncture in PD patients [19]. However, other studies have produced inconclusive results. For instance, a clinical trial found that acupuncture for six weeks was not effective in improving sleep quality and excessive daytime somnolence compared with sham acupuncture in PD patients [20]. A meta-analysis of 27 randomized controlled trials suggests that acupuncture treatment could ameliorate the symptoms of depression, quality of life, cognition, total mentation, behavior and mood, and activities of daily living in PD patients [21]. Moreover, a randomized, double-blinded clinical trial found that real acupuncture for eight weeks improves anxiety in PD patients at the end of an 8-week follow-up period [22]. Additionally, a randomized clinical trial found that real and sham acupuncture have equal efficacy in improving PD-related fatigue [23]. The report suggests that the treatment’s benefit of acupuncture may be due to placebo or other non-specific effects.

Acupuncture is a popular complementary therapy for PD patients. While it has been shown to improve motor symptoms, its effect on non-motor symptoms remains limited and inconsistent. Given the lack of effective treatments for PD non-motor symptoms and the limited understanding of their underlying neuroanatomical and neuropharmacological bases, it is essential to evaluate the current evidence for using acupuncture to manage these symptoms. To address this gap, we conducted a meta-analysis of published clinical trials to evaluate the efficacy of acupuncture in improving non-motor symptoms in PD patients. The primary endpoint of our study is the effect of acupuncture on sleep quality, while the secondary endpoints are its impact on depression, anxiety, and fatigue. By providing a comprehensive summary of the existing evidence, our study aims to inform clinical practice and improve the quality of life for PD patients with non-motor symptoms. Additionally, our study may provide insights into whether acupuncture has dual treatment benefits for both motor and non-motor symptoms in PD patients.

2. Materials and Methods

This study is a systematic review and meta-analysis based on a protocol (PROSPERO ID: CRD42022354083) and followed the Cochrane Handbook for Systematic Reviews of Interventions [24]. Institutional Review Board (IRB) approval was not required since all the data analyzed were extracted from public literature.

2.1. Search Strategy

We searched the electronic databases of PubMed, Embase, CINAHL, and Web of Science for clinical trials on acupuncture for non-motor symptoms in patients with PD from the inception date to 21 June 2023, in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [25]. Two authors (Hsu CH and Hung SC) independently searched for potential literature using a combination of keywords such as “Parkinson’s disease”, “Parkinsonism”, “acupuncture”, and “electroacupuncture”. Literature search strings for our meta-analysis in various databases are shown in the Supplementary Materials (Table S1). Additionally, we searched for relevant review articles to identify further studies.

2.2. Inclusion and Exclusion Criteria

We screened the titles and abstracts of all the identified literature and included studies that met the following criteria: (1) human-controlled trials; (2) participants diagnosed with Parkinson’s disease or Parkinsonism; (3) intervention group receiving acupuncture or electroacupuncture; (4) outcome assessment included non-motor symptoms of Parkinson’s disease; and (5) control group with sham acupuncture or no acupuncture. We excluded studies that did not meet the inclusion criteria, such as review articles, protocols, conference papers, case reports, letters, and editorials, and those that combined acupuncture with other complementary and alternative treatments, such as exercise and aromatherapy. Two authors (Hsu WT and Hsu CH) assessed the full texts of selected literature for meta-analysis, and the advising professor, Hung SY, resolved any disagreements.

2.3. Data Extraction Process

To extract relevant clinical information and research-related data, two authors (Hsu WT and Hsu CH) independently collected the following details from the selected studies: (1) first author, publication year, country, and study design; (2) intervention type and participant age; (3) the number of participants randomized to each trial arm; (4) participant population and average disease duration; (5) diagnostic criteria for non-motor symptoms; (6) outcome of non-motor symptoms, including treatment duration and rating scales for sleep, depression, anxiety, and fatigue, along with statistical data such as sample size, mean, and standard deviation. In case of any conflicts during the data extraction process, the advising professor Hung SY was consulted to resolve them.

2.4. Quality Assessment of the Included Studies

The methodological quality of all included studies was independently assessed by two authors (Hsu WT and Hsu CH) using the modified Jadad scale [26,27]. This scale includes eight items to evaluate randomization, blinding, withdrawals, dropouts, inclusion and exclusion criteria, adverse effects, and statistical analysis. The total score for each study ranges from 0 to 8, with a score of less than 3 indicating low quality, 4–6 indicating moderate quality, and a score of 7 or 8 indicating high quality. In case of any disagreements during the quality assessment, the advising professor Hung SY was consulted to resolve them.

2.5. Statistical Analysis Methods

Comprehensive Meta-Analysis (CMA version 3) was used to process all meta-analyses. For continuous outcomes such as rating scales for sleep, depression, anxiety, and fatigue, we used the standardized mean difference (SMD) or mean difference (MD) with 95% confidence intervals (CI) to analyze effect sizes (ESs) due to different units and rating scales used in various studies. An ES analysis with a p-value of less than 0.05 was considered statistically significant. We used the random-effect model to estimate the pooled effect size, and the I-square (I2) statistics assessed heterogeneity. Subgroup meta-analysis was used to investigate the potential sources of substantial heterogeneity between studies (I2 > 50%) or different rating scales [24]. We conducted a subgroup meta-analysis to investigate the effect of different interventions such as acupuncture, bee venom, or electroacupuncture. We also performed a subgroup meta-analysis to investigate whether different control groups, such as sham acupuncture or no acupuncture, affected the outcomes’ effect.

3. Results

3.1. Identification and Selection of Studies

Initially, a total of 1821 articles were identified through database searches, including 463 from Pubmed, 803 from Embases, 155 from CINAHL, and 400 from Web of Science. After removing 905 duplicate articles, 916 articles underwent title and abstract screening. Out of these, 886 articles were excluded due to their lack of relevance, resulting in 30 articles that met the inclusion criteria. One of the 30 articles was excluded due to a lack of full text, leaving 29 eligible articles. Sixteen articles were then excluded for the following reasons: combined with exercise (2 articles), no control group (5 articles), conference abstract (6 articles), comment/editorial (2 articles), and insufficient data (1 article). Finally, 13 articles were included in the meta-analysis [8,19,20,22,23,28,29,30,31,32,33,34,35]. Figure 1 depicts the screening process in a flow diagram.

Figure 1.

Figure 1

Search flow diagram according to PRISMA guideline.

3.2. Study Characteristics and Patient Populations

The 13 studies included in this meta-analysis had a total of 630 participants, and their characteristics are presented in Table 1. All studies were published between 2012 and 2022, and the geographical distribution of studies was as follows: two studies from Korea [8,32], six from China [19,22,28,30,34,35], two from Taiwan [29,33], one from the USA [20], one from Brazil [31], and one from Singapore [23]. Of the 13 studies, 9 studies used acupuncture or bee venom as the main intervention, while the remaining 4 studies used electroacupuncture [28,30,34,35]. Four studies used sham acupuncture as the control group, and eight studies had no acupuncture treatment as the control. For treatment combination, one study compared three different interventions of acupuncture combined with bee venom, sham acupuncture, and no acupuncture [32]. Eleven of the studies were randomized controlled trials [8,19,20,22,23,28,30,31,32,34,35], and the other two were clinical trials [29,33]. The sample sizes ranged from 16 to 89 participants, with a mean age range of 55 to 75.4 years. Various scales were used to assess non-motor symptoms, including ESS (Epworth Sleepiness Scale); PDSS (Parkinson’s Disease Sleep Scale), PDSS-2 (Parkinson’s Disease Sleep Scale-2), PSQI (Pittsburgh Sleep Quality Index) for sleep disorder level, BDI (Beck’s Depression Inventory), BDI-II (Beck’s Depression Inventory-II), GDS (Geriatric Depression Scale), HADS-D (Hospital Anxiety and Depression Scale-Depression), HAM-D (Hamilton Depression Rating Scale), SDS (Self-Rating Depression Scale) for depression level, BAI (Beck Anxiety Inventory), HAM-A (Hamilton Anxiety Rating Scale), HADS-A (Hospital Anxiety and Depression Scale-Anxiety) for anxiety level, MFI-GF (Multidimensional Fatigue Inventory-General Fatigue), and MFIS (Modified Fatigue Impact Scale) for fatigue level. The intervention period of each study ranged from 30 days to 18 weeks.

Table 1.

Characteristics of studies included in the meta-analysis.

Study Country Study Design Comparison Subjects
(N)
Age
Mean ± SD
Diagnostic Criteria for Non-Motor Symptoms Treatment Duration Population
Cho et al., 2012 [8] Korea Randomized controlled trial Acupuncture
Bee venom
No acupuncture
13
13
9
55.0 (52.0, 66.0) *
57.0 (49.0, 69.0) *
57.0 (48.0, 68.0) *
BDI, PDQL 8 weeks Idiopathic PD
Xia et al., 2012 [28] China Randomized controlled trial Electroacupuncture
No acupuncture
30
30
72 ± 7
72 ± 8
HAM-D, BDNF 3 months PD with depression
Chen et al., 2015 [29] Taiwan Clinical trial Acupuncture
No acupuncture
20
20
72.1 ± 8.5
75.4 ± 12.2
BAI, BDI-II, WHOQOL 18 weeks PD
Wang et al., 2015 [30] China Randomized controlled trial Electroacupuncture
No acupuncture
28
20
62.1 ± 8.7
59.1 ± 12.4
NMSQ, MoCA, MMSE, HAM-D, HAM-A, PSQI, PDQ-39 2 months PD
Kluger et al., 2016 [20] USA Randomized controlled trial Acupuncture
Sham
45
44
64.4 ± 10.3
63.0 ± 13.0
MFIS, PDSS, ESS, HADS-A, HADS-D, PDQ-39 6 weeks PD
Aroxa et al., 2017 [31] Brazil Randomized controlled trial Acupuncture
No acupuncture
11
11
65 ± 10
56 ± 12
PDSS, MMSE 8 weeks Idiopathic PD
Cho et al., 2018 [32] Korea Randomized controlled trial Acupuncture + Bee venom
Sham
Conventional treatment
24
24
15
64.42 ± 8.24
61.33 ± 8.20
64.07 ± 6.33
BDI, PDQL 12 weeks Idiopathic PD
Kong et al., 2018 [23] Singapore Randomized controlled trial Acupuncture
Sham
19
17
66.4 ± 6.5
62.9 ± 9.7
ESS, GDS, MFI-GF, PDQ-39 5 weeks PD
Yu et al., 2019 [33] Taiwan Clinical trial Acupuncture
No acupuncture
9
7
60.7 ± 6.3
70.4 ± 8.2
PDSS-2, BDI-II, MMSE, KPPS, VAS, PDQ-39 8 weeks Idiopathic PD
Xu et al., 2020 [34] China Randomized controlled trial Electroacupuncture
No acupuncture
33
37
61.73 ± 10.28
61.95 ± 9.77
PDSS, SDS 8 weeks PD
Fan et al., 2022 [22] China Randomized controlled trial Acupuncture
Sham
32
32
61.03 ± 9.80
62.66 ± 6.94
HAM-A, PDQ-39 8 weeks Idiopathic PD
Li et al., 2022 [19] China Randomized controlled trial Acupuncture
Sham
30
27
63 ± 6.73
59 ± 9.28
PDSS-2, ESS 30 days PD
Nazarova et al., 2022 [35] China Randomized controlled trial Electroacupuncture
No acupuncture
15
15
70.1 ± 6.2
66.9 ± 7.8
PDSS, NMSS, BSFS, PAC-QOL 8 weeks PD

* Data are expressed by median (lower quartile, upper quartile). BAI, Beck Anxiety Inventory; BDI, Beck’s Depression Inventory; BDI-II, Beck’s Depression Inventory-II; BDNF, Brain-Derived Neurotrophic Factor; BSFS, Bristol Stool Form Scale; ESS, Epworth Sleepiness Scale; GDS, Geriatric Depression Scale; HADS-A, Hospital Anxiety and Depression Scale-Anxiety; HADS-D, Hospital Anxiety and Depression Scale-Depression; HAM-A, Hamilton Anxiety Rating Scale; HAM-D, Hamilton Depression Rating Scale; KPPS, King’s Parkinson’s Disease Pain Scale; MFI-GF, Multidimensional Fatigue Inventory-General Fatigue; MFIS, Modified Fatigue Impact Scale; MMSE, Mini-Mental State Examination; MoCA, Montreal Cognitive Assessment; NMSQ, Non-Motor Symptoms Questionnaire; NMSS, Non-Motor Symptoms Scale; PAC-QOL, Patient Assessment of Constipation Quality of Life questionnaire; PD, Parkinson’s disease; PDQ-39, Parkinson’s Disease Questionnaire; PDQL, Parkinson’s Disease Quality of Life Questionnaire; PDSS, Parkinson’s Disease Sleep Scale; PDSS-2, Parkinson’s Disease Sleep Scale-2; PSQI, Pittsburgh Sleep Quality Index; SDS, Self-Rating Depression Scale; WHOQOL, World Health Organization Quality of Life; VAS, Visual Analogue Scales.

3.3. Quality Assessment of Included Studies and Adverse Events

The 13 studies included in this meta-analysis underwent quality assessment using the modified Jadad scores, and the results are presented in Table 2. Among the 13 articles, 5 were rated as high quality [20,22,23,32,34], 5 had moderate quality [8,19,30,31,35], and 3 had low quality [28,29,33]. The studies with low-quality ratings had unclear reporting on randomization and blinding procedures, whereas studies with high-quality ratings implemented randomized methods and used sham acupuncture as a control to achieve double blinding. The overall quality of the literature was moderate, with an average score of 5.31. We also utilized the revised Cochrane risk-of-bias tool (RoB 2.0) to evaluate the risk of bias and quality of the included studies in the Supplementary Material (Figure S1). Furthermore, we conducted a comprehensive “Grading of Recommendations Assessment, Development, and Evaluation (GRADE)” assessment to evaluate the quality of evidence for our primary outcomes, as presented in the Supplementary Materials (Table S2). The assessment revealed that the level of certainty for sleep disorder outcomes was classified as low due to concerns regarding bias and inconsistent estimates. On the other hand, the level of certainty for depression outcomes was moderate, indicating consistent evidence in favor of acupuncture treatment and precise outcomes. Certainties for anxiety and fatigue outcomes were either very low or low, primarily due to limitations such as small sample sizes, imprecise outcomes, and potential bias. In addition, we have provided a comprehensive list of adverse events associated with acupuncture and electroacupuncture treatment in the Supplementary Materials (Table S3). Our findings indicate that both acupuncture and electroacupuncture are considered safe for the treatment of PD.

Table 2.

Quality of the included studies by Modified Jadad scores.

Study Was the Study Described as Randomized?
(Yes: 1; No: 0)
Was the Method of Randomization Appropriate?
(Yes: 1; No: −1; Not Described: 0)
Was the Study Described as Blinding?
(Yes: 1; No: 0)
Was the Method of Blinding Appropriate?
(Yes: 1; No: −1; Not Described: 0)
Was There a Description of Withdrawals and Dropouts?
(Yes: 1; No: 0)
Was There a Clear Description of the Inclusion and Exclusion Criteria?
(Yes: 1; No: 0)
Was the Method Used to Assess Adverse Effects Described?
(Yes: 1; No: 0)
Was the Methods of Statistical Analysis Described?
(Yes: 1; No: 0)
Total Scores
Cho et al., 2012 [8] 1 0 0 0 1 1 1 1 5
Xia et al., 2012 [28] 1 −1 0 0 1 1 0 1 3
Chen et al., 2015 [29] 0 0 0 0 0 1 1 1 3
Wang et al., 2015 [30] 1 0 0 0 1 1 0 1 4
Kluger et al., 2016 [20] 1 1 1 1 1 1 1 1 8
Aroxa et al., 2017 [31] 1 0 0 0 1 1 0 1 4
Cho et al., 2018 [32] 1 1 1 1 1 1 1 1 8
Kong et al., 2018 [23] 1 1 1 1 1 1 1 1 8
Yu et al., 2019 [33] 0 0 0 0 0 1 0 1 2
Xu et al., 2020 [34] 1 1 1 0 1 1 1 1 7
Fan et al., 2022 [22] 1 1 1 1 1 1 1 1 8
Li et al., 2022 [19] 1 1 0 0 0 1 0 1 4
Nazarova et al., 2022 [35] 1 1 0 0 0 1 1 1 5

The total score for each article ranged from 0 to 8; a score of 7 or 8 was considered to be of high quality, 4–6 of moderate quality, and 1–3 of low quality.

3.4. The Primary Outcome of Acupuncture in Sleep Disorders Improvement

The results of the analysis focused on the effectiveness of acupuncture in improving sleep disorders, which was the primary outcome, are presented in Figure 2. In total, eight studies involving 368 participants were included in the meta-analysis, and a significant difference was found between the acupuncture and control groups, despite substantial heterogeneity being observed (SMD = 0.549; 95% CI: 0.181 to 0.916; p = 0.003; I2 = 64%; Figure 2A). This indicates that acupuncture intervention can improve sleep disorders in PD patients. For the heterogeneity, a subgroup analysis was conducted based on the type of acupuncture intervention. As shown in Figure 2B, acupuncture showed a limited effect on improving sleep disorders (SMD = 0.565; 95% CI: −0.040 to 1.171; p = 0.067; I2 = 76%), while electroacupuncture showed a significant improvement (SMD = 0.540, 95% CI: 0.159 to 0.921, p = 0.005; I2 = 22%). The results show that electroacupuncture was more effective than acupuncture in improving sleep disorders in PD patients (Figure 2B). For further analysis, we compared the acupuncture techniques, including the acupoints and treatment protocols, as shown in the Supplementary Material (Table S4). Interestingly, our findings reveal an intriguing pattern: the GB20 (Fengchi) acupoint was consistently utilized in three out of the four electroacupuncture studies examined (Table S4). Figure 2C presents the subgroup analysis of the effect of acupuncture on sleep disorders in PD patients according to different control groups, namely sham acupuncture or no acupuncture. The results show that both acupuncture and electroacupuncture significantly improved sleep disorders in PD patients when compared to no acupuncture (SMD = 0.524; 95% CI: 0.229 to 0.818, p = 0.000; I2 = 0%). However, when compared to sham acupuncture, acupuncture only produced a limited effect on sleep disorders (SMD = 0.640, 95% CI: −0.278 to 1.559; p = 0.172; I2 = 88%). These findings suggest that acupuncture or electroacupuncture is effective in improving sleep disorders in PD patients when compared to no acupuncture, and that sham acupuncture may have a placebo effect on sleep disorders. Another analysis was conducted to assess the effect of acupuncture on sleep quality using different scales, namely PDSS+PDSS-2 or ESS. The results of six studies that used PDSS or PDSS-2 show a significant difference with substantial heterogeneity between the acupuncture and control groups (SMD = 0.695, 95% CI: 0.250 to 1.140; p = 0.002; I2 = 66%) (Figure 2D). The results of three studies that used ESS also show a significant difference with no substantial heterogeneity between the acupuncture and control groups (MD = 2.136, 95% CI: 0.635 to 3.637; p = 0.005; I2 = 39%) (Figure 2E). Overall, these findings demonstrate that acupuncture or electroacupuncture can effectively improve sleep disorders in PD patients when evaluated by the PDSS, PDSS-2, or ESS scales, and the type of acupuncture intervention and control group may affect the magnitude of the effect.

Figure 2.

Figure 2

Meta-analysis of acupuncture’s effectiveness in improving sleep disorders in PD patients. (A) Forest plot showing the primary outcome of acupuncture’s effectiveness on sleep disorders. (B) Subgroup analysis of the effect of acupuncture intervention on sleep disorders based on the type of acupuncture (acupuncture or electroacupuncture). (C) Subgroup analysis of the effect of acupuncture intervention on sleep disorders based on different control groups (sham acupuncture or no acupuncture) (D) Subgroup analysis of the effect of acupuncture on sleep disorders using the scales of PDSS+PDSS-2. (E) Subgroup analysis of the effect of acupuncture on sleep disorders using the ESS scale [19,20,23,30,31,33,34,35].

3.5. The Secondary Outcome of Acupuncture in Depression Improvement

Acupuncture’s effect on depression improvement was investigated in this study’s secondary outcomes. Nine studies with a total of 457 participants were analyzed, and the results indicated a significant difference with no substantial heterogeneity between acupuncture and the control group, suggesting that acupuncture significantly improved depression (SMD = 0.242; 95% CI: 0.055 to 0.430; p = 0.011; I2 = 0%) (Figure 3A). A further analysis was conducted on the effect of different control groups (no acupuncture or sham), and it was found that acupuncture significantly improved depression in PD patients compared to no acupuncture (SMD = 0.311; 95% CI: 0.076 to 0.545; p = 0.009; I2 = 0%). Nevertheless, compared to sham acupuncture, acupuncture did not improve depression in PD patients (SMD = 0.121; 95% CI: −0.192 to 0.435; p = 0.448; I2 = 0%). These findings suggest that acupuncture, acupuncture/bee venom, or electroacupuncture may have a small effect on improving depression in PD patients compared to no acupuncture, and sham acupuncture may have a placebo effect on depression.

Figure 3.

Figure 3

Meta-analysis of acupuncture’s effectiveness in improving depression in PD patients. (A) Forest plot showing the second outcome of acupuncture’s effectiveness on depression. (B) Subgroup analysis of the effect of acupuncture intervention on depression based on different control groups (sham acupuncture or no acupuncture) [8,20,23,28,29,30,32,33,34].

3.6. The Secondary Outcomes of Acupuncture in Anxiety and Fatigue Improvement

In terms of acupuncture’s effect on anxiety and fatigue improvement, the analysis of four studies with a total of 241 participants with anxiety and two studies with a total of 125 participants with fatigue revealed no significant effect compared to the control group (anxiety: SMD = 0.095; 95% CI = −0.159 to 0.348; p = 0.465; I2 = 0%; fatigue: SMD = 0.273; 95% CI = −0.080 to 0.626; p = 0.129; I2 = 0%). Therefore, acupuncture did not show any improvements in anxiety and fatigue in PD patients (Figure 4A,B).

Figure 4.

Figure 4

Forest plot showing the secondary outcomes of acupuncture in anxiety and fatigue improvement in PD patients. (A) Effects of acupuncture on anxiety improvement. (B) Effects of acupuncture on fatigue improvement [20,22,23,29,30].

4. Discussion

This meta-analysis aimed to assess the effectiveness of acupuncture as a treatment for non-motor symptoms of Parkinson’s disease (PD). The study began by conducting a comprehensive search of various databases, yielding 1821 articles for screening. After eliminating articles that did not meet the inclusion criteria, 13 studies were selected for analysis, consisting of 630 PD patients aged between 55 and 75.4 years. Non-motor symptoms of sleep disorders, depression, anxiety, and fatigue were evaluated using various scales, with sleep disorders as the primary outcome and depression, anxiety, and fatigue as the secondary outcomes. The modified Jadad scores rated the overall quality of the literature as moderate. Results from this meta-analysis revealed that acupuncture intervention significantly improved sleep disorders in PD patients compared to control groups. Additionally, electroacupuncture was found to be more effective than traditional acupuncture, while sham acupuncture showed a potential placebo effect. Acupuncture was found to have a small effect on depression, while showing no significant improvements in anxiety and fatigue in PD patients compared to the control group. The differential effectiveness of acupuncture on sleep and depression, as compared to anxiety and fatigue, may be attributed to the specific utilization of electroacupuncture for PD-related sleep and depression, while its application for anxiety and fatigue was not explored. It is important to note that the analysis included a limited number of studies, with only four and two studies available for analyzing anxiety and fatigue, respectively, whereas eight and nine studies were included for investigating sleep disorders and depression, respectively. Moreover, a study by Wang et al. (2015) offers evidence supporting the mechanism behind electroacupuncture’s impact on sleep quality and depression, which involves an increase in norepinephrine levels and anti-neuroinflammation by reducing the elevation of nitric oxide levels [30].

Sleep disorders are a common non-motor symptom of PD, with their frequency increasing as the disease progresses [15]. Sleep disorders can have a negative impact on patients’ quality of life, mood, daytime function, and sleep quality [15]. Depression is also prevalent in PD patients, with an incidence of around 30% [36]. For patients experiencing obstructive sleep apnea (OSA), palate surgery has shown potential benefits in reducing the apnea and hypopnea index, daytime sleepiness, and associated mood-related comorbidities [37]. Surgical techniques such as lateral pharyngoplasty (LP) and uvulopalatopharyngoplasty (UPPP) have demonstrated effectiveness in treating OSA in adults [38]. A recent meta-analysis found that combining acupuncture with medication may be more effective in improving PD-related insomnia and depression than medication alone [21]. The report found that eight weeks may be the optimal course for improving PD-related insomnia [21]. Based on our research findings, electroacupuncture has shown superior efficacy in improving sleep disorders among PD patients. Taking into account the detailed summary of acupoints and treatment protocols from each study (Table S4), we propose a specific treatment protocol involving electroacupuncture targeting the GB20 (Fengchi) acupoint. This protocol suggests using continuous waves at a frequency of 100 Hz for a duration of 30 mins. We recommend administering this treatment protocol 2 to 4 times per week for a period of 8 weeks. However, further clinical trials are necessary to validate the efficacy of our electroacupuncture protocol.

As for anxiety, Fan et al. (2022) reported that real acupuncture for 8 weeks does not improve PD-related anxiety at the end of treatment as compared with sham acupuncture [22]. However, real acupuncture shows an improvement in anxiety during the 8-week follow-up period [22]. Our meta-analysis also showed that acupuncture did not have a significant effect on anxiety at the end of treatment as compared to no acupuncture and sham. Additionally, Kong et al. (2018) reported that both real and sham acupuncture improve PD-related fatigue [23]. However, our meta-analysis showed that acupuncture did not have a significant effect on fatigue compared to the control group. This may be due to our meta-analysis only including four and two studies for anxiety and fatigue, respectively. In conclusion, our results support the use of acupuncture to improve PD-related sleep disorders and depression, but further research is necessary to investigate the potential interplay between acupuncture, sham acupuncture, and PD medication.

Our study has the following limitations: (1) Limited number of studies: The meta-analysis only included a limited number of studies, comprising eight studies for the primary outcome of sleep disorders, and nine, four, and two studies for the secondary outcomes of depression, anxiety, and fatigue, respectively. This relatively small pool of studies may constrain the generalizability of our findings; for instance, important factors such as age and gender, which can influence the clinical course of PD. However, the results of our meta-regression analysis revealed that age and gender did not demonstrate statistically significant impacts on the outcomes of acupuncture in PD-related sleep disorders and depression. (2) Lack of blinding: Most of the studies included in the meta-analysis did not use blinding, which may introduce bias and affect the validity of the findings. (3) Lack of long-term follow-up: Most of the studies included in the meta-analysis had a short follow-up period, ranging from 4 to 12 weeks. Therefore, it is unclear whether the improvements in sleep disorders, depression, anxiety, and fatigue are sustained over a longer period. Factors such as the age at disease onset, disease severity and duration, PD subtype, and medical treatments can influence PD-related sleep disorders, depression, anxiety, and fatigue [39,40]. However, the lack of direct comparisons between these PD-related factors hinders our ability to assess the specific effects of acupuncture on these outcomes in the present study. Therefore, conducting additional well-designed clinical trials that carefully consider these PD-related factors is essential to validate and strengthen our findings.

In summary, our meta-analysis has demonstrated that acupuncture can be an effective treatment option for non-motor symptoms of sleep disorders and depression in PD patients. However, the evidence for PD-related anxiety and fatigue is currently limited, and further high-quality studies are needed to confirm the findings. PD is a neurodegenerative disorder with no known cure; various therapies and medications can improve its symptoms. Acupuncture is therapeutically effective for motor symptoms and provides neuroprotection by preventing the death of dopaminergic neurons. It is important to note that non-motor symptoms tend to worsen in severity and diversity as PD progresses. Therefore, PD patients experiencing anxiety and fatigue may consider acupuncture as a potential intervention to prevent further deterioration of their motor condition. Acupuncture is a commonly used alternative therapy for PD patients, and our findings suggest that it offers dual benefits for both motor and non-motor symptoms. Consequently, healthcare professionals may consider acupuncture as a viable treatment option for PD patients. Furthermore, our study results can provide valuable guidance for the clinical application of acupuncture in treating PD.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare11142042/s1, Figure S1: RoB-2 evaluation of included studies; Table S1: Literature search strings for our meta-analysis in various databases; Table S2: Grading of Recommendations Assessment, Development, and Evaluation (GRADE) evidence profile for the included studies; Table S3: Adverse events associated with acupuncture and electroacupuncture in each study; Table S4: A detailed summary of the acupoints and treatment protocol in each study.

Author Contributions

W.-T.H. and S.-Y.H. designed this study, supervised the research, and reviewed the manuscript. W.-T.H., C.-M.H. and S.-C.H. performed the article screening, data extraction, and quality assessment. W.-T.H. and S.-Y.H. contributed to data analysis and wrote the manuscript. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Patient consent was waived because this study is a meta-analysis of published data.

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding authors upon reasonable request.

Conflicts of Interest

The authors have no financial disclosures or conflicts of interest to declare.

Funding Statement

This work was supported by grants from the Ministry of Science and Technology of Taiwan (MOST 111-2320-B-039-044-MY3) and China Medical University Hospital (DMR-110-145).

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Jankovic J., Tan E.K. Parkinson’s disease: Etiopathogenesis and treatment. J. Neurol. Neurosurg. Psychiatry. 2020;91:795–808. doi: 10.1136/jnnp-2019-322338. [DOI] [PubMed] [Google Scholar]
  • 2.Kalia L.V., Lang A.E. Parkinson’s disease. Lancet. 2015;386:896–912. doi: 10.1016/S0140-6736(14)61393-3. [DOI] [PubMed] [Google Scholar]
  • 3.Prasad E.M., Hung S.Y. Current Therapies in Clinical Trials of Parkinson’s Disease: A 2021 Update. Pharmaceuticals. 2021;14:717. doi: 10.3390/ph14080717. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Schapira A.H.V., Chaudhuri K.R., Jenner P. Non-motor features of Parkinson disease. Nat. Rev. Neurosci. 2017;18:435–450. doi: 10.1038/nrn.2017.62. [DOI] [PubMed] [Google Scholar]
  • 5.Guo X., Ma T. Effects of Acupuncture on Neurological Disease in Clinical- and Animal-Based Research. Front. Integr. Neurosci. 2019;13:47. doi: 10.3389/fnint.2019.00047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lin J.G., Chen C.J., Yang H.B., Chen Y.H., Hung S.Y. Electroacupuncture Promotes Recovery of Motor Function and Reduces Dopaminergic Neuron Degeneration in Rodent Models of Parkinson’s Disease. Int. J. Mol. Sci. 2017;18:1846. doi: 10.3390/ijms18091846. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Dong J., Cui Y., Li S., Le W. Current Pharmaceutical Treatments and Alternative Therapies of Parkinson’s Disease. Curr. Neuropharmacol. 2016;14:339–355. doi: 10.2174/1570159X14666151120123025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Cho S.Y., Shim S.R., Rhee H.Y., Park H.J., Jung W.S., Moon S.K., Park J.M., Ko C.N., Cho K.H., Park S.U. Effectiveness of acupuncture and bee venom acupuncture in idiopathic Parkinson’s disease. Park. Relat. Disord. 2012;18:948–952. doi: 10.1016/j.parkreldis.2012.04.030. [DOI] [PubMed] [Google Scholar]
  • 9.Toosizadeh N., Lei H., Schwenk M., Sherman S.J., Sternberg E., Mohler J., Najafi B. Does integrative medicine enhance balance in aging adults? Proof of concept for the benefit of electroacupuncture therapy in Parkinson’s disease. Gerontology. 2015;61:3–14. doi: 10.1159/000363442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Lei H., Toosizadeh N., Schwenk M., Sherman S., Karp S., Sternberg E., Najafi B. A Pilot Clinical Trial to Objectively Assess the Efficacy of Electroacupuncture on Gait in Patients with Parkinson’s Disease Using Body Worn Sensors. PLoS ONE. 2016;11:e0155613. doi: 10.1371/journal.pone.0155613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Li K., Xu S., Wang R., Zou X., Liu H., Fan C., Li J., Li G., Wu Y., Ma X., et al. Electroacupuncture for motor dysfunction and constipation in patients with Parkinson’s disease: A randomised controlled multi-centre trial. EClinicalMedicine. 2023;56:101814. doi: 10.1016/j.eclinm.2022.101814. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Chae Y., Lee H., Kim H., Kim C.H., Chang D.I., Kim K.M., Park H.J. Parsing brain activity associated with acupuncture treatment in Parkinson’s diseases. Mov. Disord. 2009;24:1794–1802. doi: 10.1002/mds.22673. [DOI] [PubMed] [Google Scholar]
  • 13.Hsu W.T., Chen Y.H., Yang H.B., Lin J.G., Hung S.Y. Electroacupuncture Improves Motor Symptoms of Parkinson’s Disease and Promotes Neuronal Autophagy Activity in Mouse Brain. Am. J. Chin. Med. 2020;48:1651–1669. doi: 10.1142/S0192415X20500822. [DOI] [PubMed] [Google Scholar]
  • 14.Rodriguez-Blazquez C., Schrag A., Rizos A., Chaudhuri K.R., Martinez-Martin P., Weintraub D. Prevalence of Non-Motor Symptoms and Non-Motor Fluctuations in Parkinson’s Disease Using the MDS-NMS. Mov. Disord. Clin. Pract. 2021;8:231–239. doi: 10.1002/mdc3.13122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Schutz L., Sixel-Doring F., Hermann W. Management of Sleep Disturbances in Parkinson’s Disease. J. Parkinsons Dis. 2022;12:2029–2058. doi: 10.3233/JPD-212749. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Reijnders J.S., Ehrt U., Weber W.E., Aarsland D., Leentjens A.F. A systematic review of prevalence studies of depression in Parkinson’s disease. Mov. Disord. 2008;23:183–189, quiz 313. doi: 10.1002/mds.21803. [DOI] [PubMed] [Google Scholar]
  • 17.Broen M.P., Narayen N.E., Kuijf M.L., Dissanayaka N.N., Leentjens A.F. Prevalence of anxiety in Parkinson’s disease: A systematic review and meta-analysis. Mov. Disord. 2016;31:1125–1133. doi: 10.1002/mds.26643. [DOI] [PubMed] [Google Scholar]
  • 18.Niimi Y., Shima S., Mizutani Y., Ueda A., Ito S., Mutoh T. Fatigue evaluated using the 16-item Parkinson Fatigue Scale (PFS-16) predicts Parkinson’s disease prognosis. Fujita Med. J. 2019;5:45–48. doi: 10.20407/fmj.2018-014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Li L., Jin X., Cong W., Du T., Zhang W. Acupuncture in the Treatment of Parkinson’s Disease with Sleep Disorders and Dose Response. Biomed. Res. Int. 2022;2022:7403627. doi: 10.1155/2022/7403627. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
  • 20.Kluger B.M., Rakowski D., Christian M., Cedar D., Wong B., Crawford J., Uveges K., Berk J., Abaca E., Corbin L., et al. Randomized, Controlled Trial of Acupuncture for Fatigue in Parkinson’s Disease. Mov. Disord. 2016;31:1027–1032. doi: 10.1002/mds.26597. [DOI] [PubMed] [Google Scholar]
  • 21.Li Q., Wu C., Wang X., Li Z., Hao X., Zhao L., Li M., Zhu M. Effect of acupuncture for non-motor symptoms in patients with Parkinson’s disease: A systematic review and meta-analysis. Front. Aging Neurosci. 2022;14:995850. doi: 10.3389/fnagi.2022.995850. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Fan J.Q., Lu W.J., Tan W.Q., Liu X., Wang Y.T., Wang N.B., Zhuang L.X. Effectiveness of Acupuncture for Anxiety Among Patients with Parkinson Disease: A Randomized Clinical Trial. JAMA Netw. Open. 2022;5:e2232133. doi: 10.1001/jamanetworkopen.2022.32133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kong K.H., Ng H.L., Li W., Ng D.W., Tan S.I., Tay K.Y., Au W.L., Tan L.C.S. Acupuncture in the treatment of fatigue in Parkinson’s disease: A pilot, randomized, controlled, study. Brain Behav. 2018;8:e00897. doi: 10.1002/brb3.897. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Higgins J.P.T., Cochrane Collaboration . Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. Wiley-Blackwell; Hoboken, NJ, USA: 2020. [Google Scholar]
  • 25.Moher D., Liberati A., Tetzlaff J., Altman D.G., Group P. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ. 2009;339:b2535. doi: 10.1136/bmj.b2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Jadad A.R., Moore R.A., Carroll D., Jenkinson C., Reynolds D.J., Gavaghan D.J., McQuay H.J. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin. Trials. 1996;17:1–12. doi: 10.1016/0197-2456(95)00134-4. [DOI] [PubMed] [Google Scholar]
  • 27.Oremus M., Wolfson C., Perrault A., Demers L., Momoli F., Moride Y. Interrater reliability of the modified Jadad quality scale for systematic reviews of Alzheimer’s disease drug trials. Dement. Geriatr. Cogn. Disord. 2001;12:232–236. doi: 10.1159/000051263. [DOI] [PubMed] [Google Scholar]
  • 28.Xia Y., Wang H.D., Ding Y., Kang B., Liu W.G. Parkinson’s disease combined with depression treated with electroacupuncture and medication and its effect on serum BDNF. Zhongguo Zhen Jiu. 2012;32:1071–1074. [PubMed] [Google Scholar]
  • 29.Chen F.P., Chang C.M., Shiu J.H., Chiu J.H., Wu T.P., Yang J.L., Kung Y.Y., Chen F.J., Chern C.M., Hwang S.J. A clinical study of integrating acupuncture and Western medicine in treating patients with Parkinson’s disease. Am. J. Chin. Med. 2015;43:407–423. doi: 10.1142/S0192415X15500263. [DOI] [PubMed] [Google Scholar]
  • 30.Wang F., Sun L., Zhang X.Z., Jia J., Liu Z., Huang X.Y., Yu S.Y., Zuo L.J., Cao C.J., Wang X.M., et al. Effect and Potential Mechanism of Electroacupuncture Add-On Treatment in Patients with Parkinson’s Disease. Evid. Based Complement. Alternat. Med. 2015;2015:692795. doi: 10.1155/2015/692795. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Aroxa F.H., Gondim I.T., Santos E.L., Coriolano M.D., Asano A.G., Asano N.M. Acupuncture as Adjuvant Therapy for Sleep Disorders in Parkinson’s Disease. J. Acupunct. Meridian. Stud. 2017;10:33–38. doi: 10.1016/j.jams.2016.12.007. [DOI] [PubMed] [Google Scholar]
  • 32.Cho S.Y., Lee Y.E., Doo K.H., Lee J.H., Jung W.S., Moon S.K., Park J.M., Ko C.N., Kim H., Rhee H.Y., et al. Efficacy of Combined Treatment with Acupuncture and Bee Venom Acupuncture as an Adjunctive Treatment for Parkinson’s Disease. J. Altern. Complement. Med. 2018;24:25–32. doi: 10.1089/acm.2016.0250. [DOI] [PubMed] [Google Scholar]
  • 33.Yu S.W., Lin S.H., Tsai C.C., Chaudhuri K.R., Huang Y.C., Chen Y.S., Yeh B.Y., Wu Y.R., Wang J.J. Acupuncture Effect and Mechanism for Treating Pain in Patients with Parkinson’s Disease. Front. Neurol. 2019;10:1114. doi: 10.3389/fneur.2019.01114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Xu Y., Cai X., Qu S., Zhang J., Zhang Z., Yao Z., Huang Y., Zhong Z. Madopar combined with acupuncture improves motor and non-motor symptoms in Parkinson’s disease patients: A multicenter randomized controlled trial. Eur. J. Integr. Med. 2020;34:101049. doi: 10.1016/j.eujim.2019.101049. [DOI] [Google Scholar]
  • 35.Nazarova L., Liu H., Xie H., Wang L., Ding H., An H., Huang D. Targeting gut-brain axis through scalp-abdominal electroacupuncture in Parkinson’s disease. Brain Res. 2022;1790:147956. doi: 10.1016/j.brainres.2022.147956. [DOI] [PubMed] [Google Scholar]
  • 36.Goodarzi Z., Mrklas K.J., Roberts D.J., Jette N., Pringsheim T., Holroyd-Leduc J. Detecting depression in Parkinson disease: A systematic review and meta-analysis. Neurology. 2016;87:426–437. doi: 10.1212/WNL.0000000000002898. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Maniaci A., Ferlito S., Lechien J.R., Di Luca M., Iannella G., Cammaroto G., Cannavicci A., Pollicina I., Stilo G., Di Mauro P., et al. Anxiety, depression and sleepiness in OSA patients treated with barbed reposition pharyngoplasty: A prospective study. Eur. Arch. Otorhinolaryngol. 2022;279:4189–4198. doi: 10.1007/s00405-022-07369-9. [DOI] [PubMed] [Google Scholar]
  • 38.Maniaci A., Di Luca M., Lechien J.R., Iannella G., Grillo C., Grillo C.M., Merlino F., Calvo-Henriquez C., De Vito A., Magliulo G., et al. Lateral pharyngoplasty vs. traditional uvulopalatopharyngoplasty for patients with OSA: Systematic review and meta-analysis. Sleep Breath. 2022;26:1539–1550. doi: 10.1007/s11325-021-02520-y. [DOI] [PubMed] [Google Scholar]
  • 39.Marsh L. Depression and Parkinson’s disease: Current knowledge. Curr. Neurol. Neurosci. Rep. 2013;13:409. doi: 10.1007/s11910-013-0409-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Siciliano M., Trojano L., Santangelo G., De Micco R., Tedeschi G., Tessitore A. Fatigue in Parkinson’s disease: A systematic review and meta-analysis. Mov. Disord. 2018;33:1712–1723. doi: 10.1002/mds.27461. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding authors upon reasonable request.


Articles from Healthcare are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES