Skip to main content
Chinese Medical Journal logoLink to Chinese Medical Journal
. 2016 Aug 5;129(15):1789–1794. doi: 10.4103/0366-6999.186640

Needle Sensation and Personality Factors Influence Therapeutic Effect of Acupuncture for Treating Bell's Palsy: A Secondary Analysis of a Multicenter Randomized Controlled Trial

Chen-Yan Zhang 1,2,#, Sha-Bei Xu 3,#, Bo Huang 3, Peng Du 4, Gui-Bin Zhang 5, Xiang Luo 3, Guang-Ying Huang 6, Min-Jie Xie 3, Zong-Kui Zhou 1,2, Wei Wang 3,7,
PMCID: PMC4976565  PMID: 27453226

Abstract

Background:

It has not been solved what kind of needle sensation might influence outcomes of acupuncture treatment. Effects of personality factors on the therapeutic effect of acupuncture have not been investigated. This study aimed to find the effects of the traits of personality on the objective outcome when different acupuncture techniques were used in treating patients with Bell's palsy.

Methods:

We performed a secondary analysis of a prospective multicenter randomized controlled trial of acupuncture for Bell's palsy. Patients were randomly assigned to the de qi and control groups, respectively. The primary outcome was facial nerve function at month 6. The intensity of each needle sensation was rated by a visual analog scale. Psychosocial factors were assessed by the pretreatment mediator questionnaire; 16 Personality Factor Questionnaire (16PF) was used for assessing personality factors and digit cancellation test for assessing attention.

Results:

After 6 months, patients in the de qi group had better facial function (adjusted odds ratio [OR]: 4.16, 95% confidence interval [CI]: 2.23–7.78). Path analysis showed that intensity of needle sensation of fullness had direct effect on House-Brackmann (HB) score at month 6. In de qi group, the low HB score on day 1 (OR: 0.13, 95% CI: 0.03–0.45) and the low Social Boldness score (OR: 0.63, 95% CI: 0.41–0.97) in 16PF were associated with better facial function. In control group, low HB score on day 1 (OR: 0.25, 95% CI: 0.13–0.50), low Vigilance score (OR: 0.66, 95% CI: 0.50–0.88), and high Tension score (OR: 1.41, 95% CI: 1.12–1.77) in 16PF were related to better facial function.

Conclusions:

The needle sensation of fullness could predict better facial function and personality traits might influence outcomes of acupuncture treatment. Both of them should be considered seriously in acupuncture treatment and research.

Keywords: 16 Personality Factor Questionnaire, Bell's Palsy, De Qi, Needle Sensation

INTRODUCTION

There is growing evidence from randomized controlled trials (RCTs) and meta-analyses that acupuncture had clinically significant effects (efficacy over placebo controls).[1,2,3,4,5] Recently, we have completed an RCT using acupuncture to treat Bell's palsy. The results have proved that acupuncture may also have clinically significant effects on objective functional outcome.[6] According to RCTs with subjective outcomes, compared with waiting list controls or “treatment as usual”, both placebo acupuncture and real acupuncture might play important roles.[7] The difference between acupuncture and no acupuncture in effectiveness is often much greater than the difference between acupuncture and so-called “placebo acupuncture”. Thus, psychosocial factors other than needle placement might be relevant to subjective outcomes of acupuncture. In particular, patients’ beliefs about acupuncture could predict treatment outcomes in acupuncture for pain to a significant extent.[8]

According to the traditional Chinese acupuncture theory, two critical principles that are of the same importance in ensuring the effectiveness of acupuncture are “zhi shen” and “de qi”. The one principle called “zhi shen”is gaining full control over the spirits of the patients and the acupuncturists.[9,10,11] The other one is named “de qi”, a composite of unique sensations induced by needle insertion into the acupoint which has been widely investigated in recent years.[12] To ensure the effectiveness of acupuncture, during the whole acupuncture process including before needling, performing needling, and after needling, the acupuncturists were required to attend closely to the spiritual state of both acupuncturists and patients. The acupuncturists administrated the insertion until de qi was achieved by their patients. However, this important concept “zhi shen” in traditional Chinese acupuncture theory is hardly mentioned in western literature and emphasized in clinical practice in Western countries. What's more, among various kinds of needle sensations, what kind of needle sensation can predict outcomes of acupuncture treatment also remains undetermined. Thus, we analyzed the data on psychosocial factors from the above mentioned RCT to examine whether some quantifiable psychosocial measurements could improve the therapeutic effects of acupuncture treatment. Through rating different kinds of needle sensations by a visual analog scale, this study attempted to explore the relationship between each needle sensation and therapeutic effect of acupuncture.

METHODS

Data source

The study was approved by the Ethics Committee of Tongji Medical College, Huazhong University of Science and Technology, and was conducted in accordance with the provisions of the Declaration of Helsinki (1975, amended 1983) and Good Clinical Practice guidelines. Written informed consent was obtained from each participant.

We analyzed data from a RCT designed to compare efficacy of acupuncture with either strong or weak stimulation among patients with Bell's palsy.[6] The patients were included as the following criteria: (1) must be unilateral facial nerve weakness without an identifiable cause within 168 h after the onset of symptoms; (2) aged from 18 to 65 years; and (3) have not received any treatment before randomization. We excluded the patients who were illiterate, had facial paralysis caused by herpes zoster, had recurrent facial paralysis, had noticeable asymmetry of the face before the onset of illness (which may affect evaluation), or had a history of peptic ulcer disease, severe hypertension, uncontrolled diabetes, liver and kidney dysfunction, mental illness, or serious systemic diseases that might affect the treatment. The pregnant women were also excluded.

Our trial was guided by the CONSORT statement. The flowchart of this study is shown in Figure 1 and other study information is shown in Supplementary Material 1 (468.6KB, tif) . Details of this study have been previously published.[6]

Figure 1.

Figure 1

The flowchart of this study.

SUPPLEMENTARY MATERIAL 1

Pretreatment mediator questionnaire

Outcome assessment

The primary outcome was facial nerve function measured by the criteria of the House-Brackmann (HB) score.[13] The endpoint was Grade 1 on the HB score (complete recovery) at month 6. The HB scale is based on a six-grade score: Grade 1 indicates normal function and Grade 6 indicates complete paralysis. Patients were asked to show four standard facial expressions: at rest, raised eyebrows, eyes tightly closed, and showing teeth, which were recorded by a digital camcorder. All digital data were assessed and graded independently by three neurologists of Tongji Hospital; the neurologists were unaware of the study-group assignments and the stage of assessment.

Baseline psychosocial factors

We considered that several baseline psychological factors might be potentially correlated with the HB score at the end of treatment, including participants’ gender, age, education status, occupation, personality traits, attention, and the score of the pretreatment mediator questionnaire (PMQ). On the right day of randomization, all patients were asked to fill in PMQ designed for assessing pretreatment mediators including prior belief in acupuncture, experience of acupuncture treatment, and influence of people around the patients before acupuncture treatment, which consists of five related questions [Supplementary Material 2 (2.2MB, tif) ]. Patients’ personality traits were assessed by the Cattell's 16 Personality Factor Questionnaire (16PF).[14] The digit cancellation test was conducted to measure the patients’ attention at baseline.[15]

Supplementary Material 2

Inline graphicCONSORT 2010 checklist of information to include when reporting a randomized trial

Statistical analysis

All tests were two-tailed and the differences were considered to be statistically significant when P < 0.05. Data extraction and statistical analyses were conducted using SAS version 9.2 (SAS Institute Inc., Cary, NC, USA) and the R Statistical Environment, package “grplasso”. For each group, we used the least absolute shrinkage and selection operator (LASSO) algorithm for variable selection and refit the model using a standard logistic regression. Candidate variables of the model included center, gender, age (divided by 10 years), education status, occupation, side of palsy, time between onset of palsy and start of treatment (divided by 72 h), the HB score on day 1, attention (1: correctness ratio ≤97%, 2: >97% correctness ratio ≤99%, 3: correctness ratio >99%), and the scores of PMQ and 16PF.

To examine the association of feeling factors with HB score at month 6, we used multivariable logistic regression analysis after controlling for all confounding variables, including gender, age, treatment, interval between the onset of palsy and the start of treatment, and HB score on day 1. HB scores of patients at month 6 were grouped into two categories in our logistic regression: 1 for normal function and 0 for others. To prevent the model from multicollinearity and overfitting, 10-fold cross-validation with minimax concave penalty (MCP)-penalized method was used for variable selection (R: package “ncvreg”).

After variable selection, path analysis was used to test the causal relations among the variables specialized in the model. It allowed for the simultaneous conduction of multiple linear regression analyses and could determine and illustrate whether the data were consistent with the researcher's casual hypothesis. In our previous research, variables such as treatment, HB score on day 1, and Vigilance and Tension scores in 16PF may influence the value of HB score at month 6. All these variables were selected as the path analytic model's exogenous variables. Besides, all the feelings which selected by the cross-validation process and HB score at month 6 were selected as the path analytic model's endogenous variables. Path coefficients were computed via two multiple regression analyses based on the hypothesized model. Note the dependent (endogenous) variable HB score at month 6 was a binary variable for logistic regression but a continuous variable for path analysis (raw data: score 1–6).

RESULTS

Totally, 316 subjects with complete variable records were analyzed and the patients were divided into two groups: de qi group (n = 159) and control group (n = 157). After 6 months, more patients had complete recovery in de qi group (89.8%) than control group (70.8%) (adjusted for age, gender, treatment center, interval between onset of palsy and start of treatment, HB score on day 1; adjusted odds ratio [OR]: 4.16, 95% confidence interval [CI]: 2.23–7.78).

When the LASSO algorithm was applied to determine whether the patient had a complete recovery, we found several factors [Table 1]. In de qi group, low HB score on day 1 (OR: 0.13, 95% CI: 0.03–0.45) and low Social Boldness score (OR: 0.63, 95% CI: 0.41–0.97) in 16PF were associated with the better facial function. In control group, low HB score on day 1 (OR: 0.25, 95% CI: 0.13–0.50) and low Vigilance score (OR: 0.66, 95% CI: 0.50–0.88) and high Tension score (OR: 1.41, 95% CI: 1.12–1.77) in 16PF were associated with better facial function.

Table 1.

Analyses of factors associated with complete recovery for Bell's palsy

Groups Factors Coefficient OR 95% CI P
De qi HB score on day 1 −2.08 0.13 0.03–0.45 <0.01
Social Boldness score in 16PF −0.46 0.63 0.41–0.97 0.04
Control HB score on day 1 −1.38 0.25 0.13–0.50 <0.01
Vigilance score in 16PF −0.41 0.66 0.50–0.88 <0.01
Tension score in 16PF 0.34 1.41 1.12–1.77 <0.01

CI: Confidence interval; OR: Odds ratio; 16PF: 16 Personality Factor Questionnaire; HB: House-Brackmann.

Of the 316 patients who completed the 6-month follow-up visit, 262 (82.9%) rated de qi on the visual analog scale and the other 54 (17.1%) stated that they could not understand or differentiate between the 8 elements of needle sensations and, thus, did not complete the scale. Of these 54 patients, 24 were in the de qi group and 30 were in the control group.

It was found that in both groups, the score of experience and belief in acupuncture questionnaire, gender, age, education status, occupation, and attention had no prominent effects on objective outcome after 6 months.

For logistic regression, the binomial deviance was chosen as cross-validation error. To minimize the cross-validation error, only two variables were entered in the model [Figure 2]. They were needle sensation of fullness and HB score on day 1. However, it has revealed that only the needle sensation of fullness was associated with HB score at month 6. Then, they both selected as the path analytic model's endogenous variables. Path coefficients were calculated via two multiple regression analyses based on the hypothesized model. The results are presented in Table 2.

Figure 2.

Figure 2

10-fold cross-validation with minimax concave penalty-penalized method for variable selection. Two variables were entered in the model.

Table 2.

Path coefficients via two multiple regression analyses based on the hypothesized model

Outcome variables R2 Predictor variables β P
HB score at month 6 0.40 HB score on day 1 0.27 <0.01
Fullness −0.55 <0.01
Vigilance score in 16PF 0.19 <0.01
Tension score in 16PF −0.12 0.02
Needle sensation of fullness 0.33 Treatment 0.58 <0.01

Predictor variables with a significant level <0.05 were retained in the final model. The path coefficients were Standardized coefficients. OR: Odds ratio; 16PF: 16 Personality Factor Questionnaire; HB: House-Brackmann.

According to the model [Figure 3], the path coefficients showed that HB score on day 1, needle sensation of fullness, Vigilance score in 16PF, and Tension score in 16PF had direct effects on HB score at month 6. If HB score on day 1 raised 1 unit, the HB score at month 6 would increase 0.27 unit. Inversely, if the score of needle sensation of fullness raised 1 unit, the HB score at month 6 would decrease 0.55 unit. Meanwhile, if the Vigilance score in 16PF raised 1 unit, the HB score at month 6 would increase 0.19 unit, and if the Tension score in 16PF raised 1 unit, the HB score at month 6 would decrease 0.12 unit. Furthermore, the treatment has a direct effect on needle sensation of fullness and an indirect effect on HB score at month 6 via the needle sensation of fullness. The de qi (treatment) group's score of needle sensation of fullness was 0.58, more than the control group, and the de qi group's HB score at month 6 was 0.32, less than the control group.

Figure 3.

Figure 3

Path analysis for HB score at month 6. HB score on day 1, needle sensation of fullness, Vigilance score in 16PF, and Tension score in 16PF had direct effects on HB score at 6 months. Meanwhile, treatment had a direct effect on needle sensation of fullness and an indirect effect on HB score at month 6 via the needle sensation of fullness. HB: House-Brackmann; 16PF: 16 Personality Factor Questionnaire.

DISCUSSION

The findings to date suggested that a number of psychosocial factors, in particular, patients’ beliefs about acupuncture, predict treatment outcomes in acupuncture for pain to a significant extent.[8] As for objective outcomes in acupuncture treatment, there is almost no report in literature exploring in this regard. Our findings suggested that different personality traits played the different roles on the objective outcome when using acupuncture treating patients with Bell's palsy. The score of experience and belief in acupuncture questionnaire, gender, age, education status, occupation, and attention had no prominent effects on objective outcome after 6 months. After 6 months, patients in the de qi group had a better facial function (adjusted OR: 4.16, 95% CI: 2.23–7.78). In control group, recovery of facial nerve function was generally attributed to spontaneous recovery and prednisone. Moreover, in de qi group, it is attributed to acupuncture, in addition to spontaneous recovery and prednisone. We found that low Social Boldness score in 16PF was associated with better facial nerve function in de qi group, which was distinguished from the control group. According to Cattell's 16PF, the patients with low Social Boldness score in 16PF tend to be shy and hesitant, showed more obedience to their acupuncturists. Therefore, low Social Boldness score in 16PF might strengthen therapeutic effects of acupuncture with de qi-related techniques. That was contrary to common belief that introversion usually led to more physical health problems. “De qi”, an internal compound sensation of soreness, tingling, fullness, aching, cool, warmth, heaviness, and a radiating sensation at and around acupoints, is elicited by manipulation of the needles (rotated as well as being moved upward and downward). The explanation is most likely that the patients with low Social Boldness score would be more easily to believe the words of the acupuncturists and pay more attention to their body and their sensations elicited by needles, thereby gaining more benefit from de qi acupuncture treatment. This interesting phenomenon calls for further investigations, which ought to shed light on the underlying mechanism of acupuncture.

As expected, low HB score on day 1 was associated with better recovery in both groups, such that those with worse facial nerve function at baseline would have worse facial nerve function at month 6. However, it was found that low Vigilance score in 16PF was associated with better outcome in the control group. In contrast to the patients with high Vigilance score who were tense and frustrated, those with low Vigilance score were more relaxed and tranquil, they could concentrate their attention to the whole acupuncture process and response to their acupuncturists’ instructions optimistically. It is implied that people who were trusting, unsuspecting, and accepting might have better therapeutic effects mainly from spontaneous recovery and medication. What's more, people with low Apprehension score got better therapeutic effects. It might be that they were more inclined to worry about their states as to ask for assistance and be more confident in acupuncturists and their therapeutic schedules.

It has been corroborated by systematic reviews that acupuncture is an effective treatment in a wide variety of diseases. Nevertheless, few studies have investigated the relationship between different kinds of needle sensations and outcomes of acupuncture. We found that the intensity of needle sensation fullness might predict outcomes in Bell's palsy, which suggested that the intensity of different needle sensations should be paid more attention in the future practice and research.

The previous studies found that high expectation for acupuncture might be positive to outcome of pain,[16,17,18] and it was more significant in patients receiving verum acupuncture than in patients receiving minimal acupuncture or validated sham acupuncture.[17,18] However, our study did not find similar results when outcome was objective. That was, positive pretreatment mediators might not have effects on objective outcome during acupuncture treatment. To the best of our knowledge, no RCTs have been conducted to investigate the effects of personality traits and attention on the objective functional outcome of acupuncture treatment. We found that some certain personality traits could strengthen the therapeutic effect of acupuncture and attention might not be a significant predictor of outcome after acupuncture treatment.

Our study also had several limitations. First, personality traits are so complex that we were unable to fully assess one's personality traits with only one questionnaire. In fact, there are many assessments can help. However, we finally chose the 16PF because it was easier to administrate and less expensive. Second, the insufficient sample size could have influenced our results.

In conclusion, among various kinds of needle sensations, only the needle sensation of fullness could predict better facial function. The needle sensation of fullness claims more of our attention in acupuncture practice and research. Personality traits may have different effects on the objective outcome when different acupuncture techniques are used to treat patients with Bell's palsy. Among patients treated with the strong stimulation (de qi) acupuncture, low Social Boldness score in 16PF may strengthen the therapeutic effect of acupuncture. In acupuncture treatment and research, personality traits should be considered seriously. Fostering such positive patient attitudes (e.g., realistic and ethical) might be one way in which clinicians could further improve their effectiveness. Acupuncture treatment is not simply needle placement.

Supplementary information is linked to the online version of the paper on the Chinese Medical Journal website.

Financial support and sponsorship

This work was supported by the grants from the National Science Fund for Distinguished Young Scholars (No. 30725019), the National Natural Science Foundation of China (No. 81030021), and the National Basic Research Program of China (No. 2006CB504502, No. 2011CB504403, and No. 2011CB505200).

Conflicts of interest

There are no conflicts of interest.

Acknowledgments

We would like to thank Dr. Ge-Tu Zhaori for helpful discussion.

Footnotes

Edited by: Xin Chen

REFERENCES

  • 1.Linde K, Allais G, Brinkhaus B, Manheimer E, Vickers A, White AR. Acupuncture for tension-type headache. Cochrane Database Syst Rev. 2009;(1):CD007587. doi: 10.1002/14651858.CD007587. doi: 10.1002/14651858.CD007587. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Linde K, Allais G, Brinkhaus B, Manheimer E, Vickers A, White AR. Acupuncture for migraine prophylaxis. Cochrane Database Syst Rev. 2009;(1):CD001218. doi: 10.1002/14651858.CD001218.pub2. doi: 10.1002/14651858.CD001218.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Trigkilidas D. Acupuncture therapy for chronic lower back pain: A systematic review. Ann R Coll Surg Engl. 2010;92:595–8. doi: 10.1308/003588410X12699663904196. doi: 10.1308/003588410X12699663904196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lee A, Fan LT. Stimulation of the wrist acupuncture point P6 for preventing postoperative nausea and vomiting. Cochrane Database Syst Rev. 2009;(2):CD003281. doi: 10.1002/14651858.CD003281.pub3. doi: 10.1002/14651858.CD003281.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.La Touche R, Goddard G, De-la-Hoz JL, Wang K, Paris-Alemany A, Angulo-Díaz-Parreño S, et al. Acupuncture in the treatment of pain in temporomandibular disorders: A systematic review and meta-analysis of randomized controlled trials. Clin J Pain. 2010;26:541–50. doi: 10.1097/AJP.0b013e3181e2697e. doi: 10.1097/AJP.0b013e3181e2697e. [DOI] [PubMed] [Google Scholar]
  • 6.Xu SB, Huang B, Zhang CY, Du P, Yuan Q, Bi GJ, et al. Effectiveness of strengthened stimulation during acupuncture for the treatment of Bell palsy: A randomized controlled trial. CMAJ. 2013;185:473–9. doi: 10.1503/cmaj.121108. doi: 10.1503/cmaj.121108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Brinkhaus B, Witt CM, Jena S, Linde K, Streng A, Wagenpfeil S, et al. Acupuncture in patients with chronic low back pain: A randomized controlled trial. Arch Intern Med. 2006;166:450–7. doi: 10.1001/archinte.166.4.450. doi: 10.1001/archinte.166.4.450. [DOI] [PubMed] [Google Scholar]
  • 8.Bishop FL, Lewith GT. A review of psychosocial predictors of treatment outcomes: What factors might determine the clinical success of acupuncture for pain. J Acupunct Meridian Stud. 2008;1:1–12. doi: 10.1016/S2005-2901(09)60001-7. doi: 10.1016/S2005-2901(09)60001-7. [DOI] [PubMed] [Google Scholar]
  • 9.Bai X, Baron RB. Oxford: Butterworth-Heinemann; 2001. Acupuncture: Visible Holism; p. 119. [Google Scholar]
  • 10.Liu T. Acupuncture: What underlies needle administration. Evid Based Complement Alternat Med. 2009;6:185–93. doi: 10.1093/ecam/nen002. doi: 10.1093/ecam/nen002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Clavey S. Edinburgh: Elsevier Health Sciences; 2003. Fluid Physiology and Pathology in Traditional Chinese Medicine; pp. 448–50. [Google Scholar]
  • 12.Tian DS, Xiong J, Pan Q, Liu F, Wang L, Xu SB, et al. De qi, a threshold of the stimulus intensity, elicits the specific response of acupoints and intrinsic change of human brain to acupuncture. Evid Based Complement Alternat Med 2014. 2014:914878. doi: 10.1155/2014/914878. doi: 10.1155/2014/914878. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.House JW, Brackmann DE. Facial nerve grading system. Otolaryngol Head Neck Surg. 1985;93:146–7. doi: 10.1177/019459988509300202. doi: 10.1288/00005537-198308000-00016. [DOI] [PubMed] [Google Scholar]
  • 14.Dai ZH, Zhu BL. Shanghai: East China Normal University Press; 1988. The Handbook of Cattell 16PF. Revised Edition. [Chinese] [Google Scholar]
  • 15.Della Sala S, Laiacona M, Spinnler H, Ubezio C. A cancellation test: Its reliability in assessing attentional deficits in Alzheimer's disease. Psychol Med. 1992;22:885–901. doi: 10.1017/s0033291700038460. doi: 10.1017/S0033291700038460. [DOI] [PubMed] [Google Scholar]
  • 16.Kalauokalani D, Cherkin DC, Sherman KJ, Koepsell TD, Deyo RA. Lessons from a trial of acupuncture and massage for low back pain: Patient expectations and treatment effects. Spine (Phila Pa 1976) 2001;26:1418–24. doi: 10.1097/00007632-200107010-00005. doi: 10.1097/00007632-200107010-00005. [DOI] [PubMed] [Google Scholar]
  • 17.Linde K, Witt CM, Streng A, Weidenhammer W, Wagenpfeil S, Brinkhaus B, et al. The impact of patient expectations on outcomes in four randomized controlled trials of acupuncture in patients with chronic pain. Pain. 2007;128:264–71. doi: 10.1016/j.pain.2006.12.006. doi: 10.1016/j.pain.2006.12.006. [DOI] [PubMed] [Google Scholar]
  • 18.Wasan AD, Kong J, Pham LD, Kaptchuk TJ, Edwards R, Gollub RL. The impact of placebo, psychopathology, and expectations on the response to acupuncture needling in patients with chronic low back pain. J Pain. 2010;11:555–63. doi: 10.1016/j.jpain.2009.09.013. doi: 10.1016/j.jpain.2009.09.013. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

SUPPLEMENTARY MATERIAL 1

Pretreatment mediator questionnaire

Supplementary Material 2

Inline graphicCONSORT 2010 checklist of information to include when reporting a randomized trial


Articles from Chinese Medical Journal are provided here courtesy of Wolters Kluwer Health

RESOURCES