Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2015 Oct 7;10(10):e0139206. doi: 10.1371/journal.pone.0139206

Substance P and Chronic Pain in Patients with Chronic Inflammation of Connective Tissue

Barbara Lisowska 1,#, Aleksander Lisowski 2,#, Katarzyna Siewruk 3,*,#
Editor: Fulvio d'Acquisto4
PMCID: PMC4622041  PMID: 26444559

Abstract

Objective

Evidence suggests that substance P (SP) is involved in chronic joint inflammation, such as the pathogenesis of rheumatoid arthritis and osteoarthritis. The goal of the research was to evaluate the correlation between chronic pain and changes in the SP level in patients with chronic inflammation of the connective tissue.

Methods

Patients with osteoarthritis and rheumatoid arthritis were enrolled in this study. The relationship between chronic pain intensity and the serum SP concentration was evaluated in these groups of patients with osteoarthritis and rheumatoid arthritis.

Results

The results showed a positive correlation between the serum SP concentrations and chronic pain intensity.

Conclusions

1. The SP serum concentration was significantly different between the groups of patients with OA and RA. 2. There was a positive correlation between the serum SP concentration and chronic pain intensity in OA and RA patients.

Introduction

Von Euler and Gaddun discovered substance P (SP) in 1931 [1]. SP is a well-known neuropeptide that is widely distributed in both the central (CNS) and periphery (PNS) nervous systems.

The induction and transmission of nociceptive signals causes the release of SP from sensory fibres in the spinal cord [2].

Substance P is also released from many cells of the immune system, such as macrophages, lymphocytes and dendritic cells. There are data on the activity of SP and its involvement in the inflammatory response [3], [4], together with other peripheral cells, including bone cells [5].

Rheumatoid arthritis (RA) is a systemic autoimmune disease associated with chronic inflammation of the connective tissue.

Substantial recent evidence suggests that SP and its receptors are involved in joint inflammation and are associated with some aspects of the pathophysiology of RA [6], [7]. Chronic pain is associated with arthritis and the involvement of substance P through the NK–1 receptor. Studies on NK–1 have shown a positive correlation between the size and severity of joint destructive changes and the pain and density of NK–1 receptors in inflamed tissues [8], [9].

Considering this aim, we evaluated the intensity of pain and the serum SP concentrations in patients with chronic inflammatory connective tissues. Chronic inflammation is a common symptom in osteoarthritis (OA) and RA.

Patients and Methods

Patients with OA or RA were randomly enrolled in the study.

Osteoarthritis was diagnosed according to the symptoms and results of X-ray joint examination.

Patients with RA were fully diagnosed according to the criteria of the American Rheumatism Association [10].

All patients were regularly taking non-steroidal anti-inflammatory drugs (NSAIDs).

The exclusion criteria were as follows:

  • Weight: BMI > 30

  • Severe liver or kidney disease

  • The presence of other inflammatory diseases

For all patients with RA, the disease activity was assessed using both subjective and objective methods. The total painful and swollen joint numbers, according to the 28-joint index were assessed using subjective grading. The sedimentation according to the Westergren procedure (mm/h) was assessed as the objective grade. The DAS 28 (Disease Activity Score) according to four variables was estimated using the DAS 28 formula with DAS 28 Calculator v1.1-beta (Alfons & Michiel).

The intensity of pain was evaluated using a numeric pain scale (NPS) from 0 to 5, where 0 corresponded to no pain, 1 –slight, 2 –moderate, 3 –intensive 4 –severe and 5 –worst imaginable pain. The patients performed the evaluation.

The concentration of SP was measured in all collected serum samples. The 4–5 ml venous blood samples were collected into the serum test tubes, delivered to an analytical laboratory and centrifuged (2000 rpm/10 min). The sera were placed into 200 μl test tubes and stored at -70°C. The SP concentration was measured using the Substance P Immunoassay Test (R&D System) in accordance with the instructions from the manufacturer. The minimum detectable level for this assay was 8.0 pg/ml.

The immunological and laboratory tests were conducted at the Department of Immunopathology and the Diagnostic Laboratory at the Institute of Rheumatology in Warsaw.

Statistics

STATISTICA v.10 was used to perform all statistical analysis. Because the NPS values are quality variables, nonparametric tests were used. Differences between the variables for the factors were analysed using the Mann-Whitney U test. The correlation analyses were performed using the Spearman rank correlation test. To identify interdependencies, further tests were performed to find a regression function, the power of which was checked by the Snedecor F test. P values < 0.05 were considered significant.

Factor analysis was performed to find patterns among the measured variables. Factor loadings > 0.70 were considered. The factor analyses were performed with Varimax, using Kaiser normalisation as a rotation method.

The Medical Ethics Committee of Institute of Rheumatology in Warsaw approved the protocol. The experiments were conducted according to the principles expressed in the Declaration of Helsinki.

Written informed consent was obtained from all patients.

Results

Seventy patients suffering from chronic pain due to OA or RA were classified.

These patients were divided into two groups according to their primary disease (OA–Osteoarthritis or RA–Rheumatoid Arthritis). In OA group were 23 patients and RA group included 47 patients. OA patients had a mean ±SD age 63±12 years while RA patients had a mean ±SD age 55±11 years. In RA patients the disease lasted a mean ±SD 17±7.18 years and the disease activity according to DAS28 was a mean ±SD 5.2±1.16.

In both groups, there were more women than men. There was a significant difference (P < 0.005) in the patients’ mean age between the groups.

Correlation between SP and NPS in the OA and RA groups

The preoperative cardiopulmonary status of all patients was almost the same. All patients were ASAII according to the physical status classification system of the American Society of Anaesthesiologists.

The mean SP serum concentration, standard deviation, limit values and pain severity in both groups are shown in Table 1. A statistically significant difference between the OA and RA groups was only found for SP (P = 0.016, Table 1).

Table 1. Serum concentration of substance P and severity of chronic pain in both groups of patients.

Parameter/group OA RA P-value
Mean ±SD Min Max Mean ±SD Min Max
SP, pg/ml 327±290 46 1000 563±425 50 1500 0.016
NPS, points 3.0±0.8 2 4 3.1±0.8 2 4 0.582

There was a correlation between SP and NPS (rs = 0.531; P < 0.05), but it was stronger for the OA group (rs = 0.725; P < 0.05) than for the RA group (rs = 0.423; P < 0.05).

Relationship between NPS and SP in the OA group

Based on a correlation analysis and positional relationship between the SP and NPS points, a logarithmic function was found only for the OA group patients (Fig 1). The value of the determination coefficient indicates that 63.97% of the SP concentration alters the perceived chronic pain according to NPS. In the range of low concentrations of P, up to 200 pg/ml, there was a dynamic increase in the value of perceived pain NPS, in the range of 2 to 3 points.

Fig 1. The relationship between NPS and the serum concentration of substance P (SP) for OA patients.

Fig 1

For an SP concentration of 200 pg/ml, a turning point can be observed with a change in the dynamics of an appreciable increase in pain, which is expressed on a point scale. With respect to the changes in the SP concentration from 200 pg/ml to 1200 pg/ml, the pain felt by patients changed by only one point, increasing in value from 3 to 4 points.

Correlation between SP, NPS, DAS, age and disease duration in the RA group

A positive correlation between DAS and NPS (0.612), SP and NPS (0.426), SP and DAS (0.365), and age and RA disease years for the group of RA patients is shown in Table 2. Based on the positive correlation between the independent variables of DAS and SP, the two variables contain similar information, but the value of the correlation coefficient between DAS and NPS (0.612) is higher than that between SP and NPS (0.429), indicating that the DAS disease activity has a larger positive influence on the severity of chronic pain compared with the SP concentration.

Table 2. The results of analysis of correlation on the Spearman rank test between SP, chronic pain in NPS, DAS, age and time of disease in years.

Parameter  Age RA years DAS NPS SP
Age 1.000
RA years 0.302 a 1.000
DAS 0.017 0.000 1.000
NPS -0.125 -0.127 0.612 a 1.000
SP -0.155 0.067 0.365 a 0.426 a 1.000

a–correlation with P <0.05.

Factor analysis performed on the RA group yielded two factors with eigenvalues > 1, explaining 66% of the total variation between the measured variables (Table 3). The DAS, NPS, and SP were grouped together with the larger weighting on DAS and NPS. There was also an interrelationship between age and disease duration in years.

Table 3. Factor analyses on SP, NPS, DAS, age and RA years’ disease.

Variable Factor
1 2
Age 0.784
RA years 0.787
DAS 0.843
NPS 0.849
SP 0.744

For logarithmic values of SP and all values of DAS, the regression analysis showed that ln (SP) and DAS have a statistically significant effect on the severity of chronic pain, with a critical significance level of P = 0.049. In this full analysis, it appeared that the constant does not have a statistically significant effect (P = 0.808); therefore, it was removed from a regression function. The final results of the regression analysis without a constant are presented in Table 4. The results showed a high statistical impact of DAS and the logarithmic values of SP ln (SP) on NPS for P < 0.001 and P = 0.002.

Table 4. Results of the regression analysis for chronic pain intensity according to NPS depending on the disease activity score (DAS) and the logarithmic concentration of substance P–ln (SP) for the group of patients with RA after removing the intercept.

Parameter β Standard error of β b Standard error of b t(43) P-value
DAS 0.604 0.117 0.364 0.070 5.151 <0.001
Ln(SP) 0.387 0.117 0.208 0.063 3.298 0.002

Regression summary for the dependent variable NPS: correlation coefficient R = 0.9847, determination coefficient R2 = 0.9696, adjusted correlation coefficient R2 = 0.9682, values of the Fisher-Snedecor test F(2, 44) = 701.97, critical level P-value P < 0.001, standard error of estimate: 0.5776.

According to the given values of the regression coefficient, the following regression function was formed.

NPSRA=0.36DAS+0.21ln(SP)

The value of an improved determination coefficient indicates that in 96.82% of this group of RA patients, both DAS and ln (SP) exert an influence on chronic pain severity. A graphical interpretation of the function of this surface is shown in Fig 2. The resulting graph shows that the chronic pain intensity was higher with an increasing concentration of substance P and increasing disease activity. Similar observations were made in the group of patients with OA with respect to an increasing SP concentration but not disease activity. For example, patients with SP concentrations greater than 350 pg/ml described the intensity of perceptible chronic pain as lower by an average of 0.5 points on the NPS scale.

Fig 2. Interaction between the serum concentration of substance P (SP) and the disease activity (DAS) and intensity of pain (NPS) for patients with RA.

Fig 2

This trend is extended over the entire range of disease activity (DAS), which is clearly visible in Fig 2, where the curve changes its curvature along the edge of DAS. The dynamic of the changes in NPS was higher for DAS than it was for SP, as evidenced by the plane angles of the respective Cartesian axes. The patients with lower activity in RA complained of lower pain ≤ 2 points, irrespective of the SP concentration (up to 1600 pg/ml), whereas the patients with high disease activity experienced more severe pain, even at a low SP serum concentration. The critical area of the pain intensity NPS above 3 points (severe pain) referred to patients with an SP concentration ranging from 1400 to 1600 pg/ml and an approximate DAS level of 4. This critical area was also achieved for patients with lower SP concentrations of 200 pg/ml when the disease activity was greater than 4 points. Disease activity, which was described using the DAS scale, had a greater impact on the dynamics of chronic pain than did the SP concentration in patients with RA.

Discussion

The results obtained have indicated a high serum concentration of SP in all of the patients enrolled in this study. This finding suggests a connection with both the chronic inflammatory state and chronic pain, which was defined as pain lasting more than three months.

From the outcome of the investigation one can conclude that in the patients with OA, a high serum SP level can be treated as evidence supporting the role of inflammation in the pathogenesis of osteoarthritis. In addition the significantly higher serum SP level was demonstrated in RA patients compared with OA patients. The most likely explanation of the results is the connection between the long-lasting advanced auto immunological disease and systemic chronic inflammation.

Similarly, Grimholm et al. showed a correlation between high SP serum levels and long-lasting RA [11] whereas researchers have found high SP serum levels in RA patients [12], [13]. Based on the current literature, O'Connor and Baerwald described the inflammatory diseases in which SP participates and the contribution of the neuroendocrine system in the development of disease activity in RA patients.

Lambert et al. observed the direct pro inflammatory effect of SP on rheumatoid fibroblast-like synoviocytes (FLS) via NK–1 [14]. It has been shown that FLS are located in the synovial intimal lining and play a key role in cartilage destruction by producing cytokines. Furthermore, the action of SP may cause vasodilatation by the induction vascular cell adhesion molecule–1 (VCAM–1). The indirect pro inflammatory effect of SP is related to the regulation of pro inflammatory cytokines together with prostaglandin PGE2 released from inflammatory cells [15].

At the same time high SP levels and high NK–1 receptor expression were observed in the synovial fluid obtained from RA patients [16], [17], [18]. According to Lotz and Partsch, the addition of substance P into the synovial cell culture caused the release of many various factors, including prostaglandin E and collagenosis [19], [20]. Levine et al. showed the contribution of SP to the severity of adjuvant-induced arthritis with strong pain [21], [22]. Moreover, Matucci-Cerini et al. found a high concentration of SP in the synovial fluid of RA patients [23]. Straub and Cutolo also presented the action of SP as a pro inflammatory agent that is responsible for stimulating the release of pro inflammatory cytokines (IL–1, IL–2, and TNF) from various cells [24]. All of these studies concerned the participation of SP in RA development.

It is worth emphasising that this study also focused on patients with OA because there are few studies about the contribution of SP in the pathogenesis of osteoarthritis. Our results seem to confirm the essential role of SP in the inflammatory component of OA.

Patients with obesity were excluded from our study. Several clinical studies demonstrated the role of SP in the development of obesity, which is defined as a type of chronic and systemic inflammatory disease [25], [26], [27].

In our patients, the mean severity of chronic pain was classified as intensive (3 points), and there was no statistically significant difference between the evaluated groups of patients.

The positive correlation between the serum SP level and chronic pain intensity was found in both groups, but this correlation was clearly stronger in OA patients.

The obtained results for the value of the determination coefficient indicate that the pain intensity was dependent on the serum SP levels in 64% of the patients with OA. The remaining 36% of the cases could be accounted for by factors such as the nerve dysfunction associated with a long-lasting inflammatory state. Therefore, the presented results confirm the participation of SP in modulating the pain in both groups of patients with inflammatory diseases.

Referring to the group of patients with RA, a high correlation between disease activity and pain intensity has been shown. Disease activity, as determined using the DAS28 scale, appeared to have a greater impact on the intensity of chronic pain than did the SP concentration in patients with RA. These findings show that smaller values of DAS28, even at very high SP concentrations, correspond to less pain, whereas higher values of DAS28 are related to stronger pain, even at lower SP concentrations. This relationship is confirmed by clinical examination because pain is the major complaint of RA patients with high disease activity. In their studies, Garip and Eser assessed the connection among fatigue, disease activity, pain and functional status in RA patients [28], [29]. They confirmed the strong association between fatigue and the severity of pain, disease activity (DAS28) and the functional status. However, they did not assess these items in relation to the SP level.

In this study, we present the first evidence of a link among the DAS28, pain and SP.

In healthy tissues, SP has the unique feature of being released from only C type fibres with strong stimuli. In contrast, in inflamed tissues, which have many more receptors on neurons due to the inflammatory processes, the nocicepive impulse may be spontaneously trigged without external stimulation [30]. Therefore, in this situation, the release of SP may be enhanced in the inflamed tissue. Furthermore, the synovium of RA patients is characterised by a low density of sympathetic nerve fibres with an increased SP density on sensory nerve fibres compared with OA patients [31].

Confirming the correlation between chronic/acute pain and the SP serum concentration in our study should be an aim of further research on the use of the NK–1 antagonist as a component of new drugs for pain therapy. The hypothesis concerning the analgesic properties of the SP antagonist has yet to be proven.

Conclusions

  1. The SP serum concentration was significantly different between the groups of patients with OA and RA.

  2. There was a positive correlation between the serum SP concentration and chronic pain intensity in OA and RA patients.

Acknowledgments

The authors are extremely grateful to professor Ewa Kontny for consultations on immunological problems.

Data Availability

All data are available in the paper.

Funding Statement

The authors received no specific funding for this work.

References

  • 1. O'Connor TM, O'Connell J, O'Brien DI, Goode T, Bredin CP, Shanahan F. The role of substance P in inflammatory disease. J Cell Physiol 2004; 201: 167–180. [DOI] [PubMed] [Google Scholar]
  • 2. Pezet S, Malcangio M, McMahon SB. BDNF: a neuromodulator in nociceptive pathways? Brain Res Brain Res Rev 2002; 40: 240–249. [DOI] [PubMed] [Google Scholar]
  • 3. Zhang Y, Berger A, Milne CD, Paige CJ. Tachykinins in the immune system. Curr Drug Targets 2006; 7: 1011–1020. [DOI] [PubMed] [Google Scholar]
  • 4. Lisowska B. Role and significance of substance P. Geriatria Polska 2007; 3: 63–67. [Google Scholar]
  • 5. Goto T, Tanaka T. Tachykinins and tachykinin receptors in bone. Microsc Res Tech 2002; 58: 91–97. [DOI] [PubMed] [Google Scholar]
  • 6. O'Shaughnessy MC, Vetsika EK, Inglis JJ, et al. The effect of substance P on nitric oxide release in a rheumatoid arthritis model. Inflamm Res 2006; 55: 236–240. [DOI] [PubMed] [Google Scholar]
  • 7. Keeble JE, Brain SD. A role for substance P in arthritis? Neurosci Lett 2004; 361: 176–179. [DOI] [PubMed] [Google Scholar]
  • 8. Saxler G, Löer F, von Knoch M, et al. von Knoch F, Hanesch U. [Localization of the neurokinin 1 receptor in hip joints of patients with painful osteoarthritis]. Z Orthop Ihre Grenzgeb 2005; 143: 424–430. [DOI] [PubMed] [Google Scholar]
  • 9. Saxler G, Löer F, Skumavc M, Pförtner J, Hanesch U. Localization of SP- and CGRP-immunopositive nerve fibers in the hip joint of patients with painful osteoarthritis and of patients with painless failed total hip arthroplasties. Eur J Pain 2007; 11:67–74. [DOI] [PubMed] [Google Scholar]
  • 10. Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS, et al. The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum. 1988; 31:315–324. [DOI] [PubMed] [Google Scholar]
  • 11. Grimsholm O, Rantapää-Dahlqvist S, Forsgren S. Levels of gastrin-releasing peptide and substance P in synovial fluid and serum correlate with levels of cytokines in rheumatoid arthritis. Arthritis Res Ther 2005; 7: R416–R426. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. O'Connor TM, O'Connell J, O'Brien DI, Goode T, Bredin CP, Shanahan F. The role of substance P in inflammatory disease. J Cell Physiol 2004; 201: 167–180. [DOI] [PubMed] [Google Scholar]
  • 13. Baerwald C, Burmester G, Krause A. Interactions of autonomic nervous, neuroendocrine, and immune systems in rheumatoid arthritis. Rheum Dis Clin North Am 2000; 26: 841–857. [DOI] [PubMed] [Google Scholar]
  • 14. Lambert N, Lescoulié PL, Yassine-Diab B, Enault G, Mazières B, De Préval C, et al. Substance P enhances cytokine-induced vascular cell adhesion molecule–1 (VCAM–1) expression on cultured rheumatoid fibroblast-like synoviocytes. Clin Exp Immunol 1998; 113: 269–275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Khan MM, Douglas SD, Benton TD. Substance P-neurokinin–1 receptor interaction upregulates monocyte tissue factor. J Neuroimmunol 2012; 242: 1–8. 10.1016/j.jneuroim.2011.10.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Hernanz A, Medina S, de Miguel E, Martín-Mola E. Effect of calcitonin gene-related peptide, neuropeptide Y, substance P, and vasoactive intestinal peptide on interleukin-1beta, interleukin–6 and tumor necrosis factor-alpha production by peripheral whole blood cells from rheumatoid arthritis and osteoarthritis patients. Regul Pept 2003. 15; 115:19–24. [DOI] [PubMed] [Google Scholar]
  • 17. Hernanz A, De Miguel E, Romera N, Perez-Ayala C, Gijon J, Arnalich F. Calcitonin gene-related peptide II, substance P and vasoactive intestinal peptide in plasma and synovial fluid from patients with inflammatory joint disease. Br J Rheumatol 1993; 32: 31–35. [DOI] [PubMed] [Google Scholar]
  • 18. Marshall KW, Chiu B, Inman RD. Substance P and arthritis: analysis of plasma and synovial fluid levels. Arthritis Rheum 1990; 33: 87–90. [DOI] [PubMed] [Google Scholar]
  • 19. Lotz M, Carson DA, Vaughan JH. Substance P activation of rheumatoid synoviocytes: neural pathway in pathogenesis of arthritis. Science 1987; 235: 893–895. [DOI] [PubMed] [Google Scholar]
  • 20. Partsch G, Matucci-Cerinic M, Marabini S, Jantsch S, Pignone A, Cagnoni M. Collagenase synthesis of rheumatoid arthritis synoviocytes: dose-dependent stimulation by substance P and capsaicin. Scand J Rheumatol 1991; 20: 98–103. [DOI] [PubMed] [Google Scholar]
  • 21. Levine JD, Clark R, Devor M, Helms C, Moskowitz MA, Basbaum AI. Intraneuronal substance P contributes to the severity of experimental arthritis. Science 1984; 226: 547–549. [DOI] [PubMed] [Google Scholar]
  • 22. Levine JD, Moskowitz MA, Basbaum AI. The contribution of neurogenic inflammation in experimental arthritis. J Immunol 1985; 135: 843s–847s. [PubMed] [Google Scholar]
  • 23. Matucci-Cerini M, Marabini S, Partsch G, Cagnoni M. High levels of substance P in rheumatoid arthritis synovial fluid. Lack of substance P production by synoviocytes in vitro. Clin Exp Rheumatol 1991; 9: 440–441. [PubMed] [Google Scholar]
  • 24. Straub RH, Cutolo M. Involvement of the hypothalamic-pituitary-adrenal/gonadal axis and the peripheral nervous system in rheumatoid arthritis: viewpoint based on a systemic pathogenetic role. Arthritis Rheum 2001; 44: 493–507. [DOI] [PubMed] [Google Scholar]
  • 25. Karagiannides I, Stavrakis D, Bakirtzi K, Kokkotou E, Pirtskhalava T, Nayeb-Hashemi H, et al. Substance P (SP)-neurokinin–1 receptor (NK-1R) alters adipose tissue responses to high-fat diet and insulin action. Endocrinology 2011; 152: 2197–2205. 10.1210/en.2010-1345 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Rocha VZ, Folco EJ. Inflammatory concepts of obesity. Int J Inflam 2011; 529061 10.4061/2011/529061 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Xu H, Barnes GT, Yang Q, Tan G, Yang D, Chou CJ, et al. Chronic inflammation in fat plays a crucial role in the development of obesity-related insulin resistance. J Clin Invest 2003; 112:1821–1830. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Garip Y, Eser F, Aktekin LA, Bodur H. Fatigue in rheumatoid arthritis: association with severity of pain, disease activity and functional status. Acta Reumatol Port 2011; 36: 364–369. [PubMed] [Google Scholar]
  • 29. Eser F, Garip Y, Bodur H. Extra articular manifestations in Turkish patients with rheumatoid arthritis: impact of EAMs on the health-related quality of life in terms of disease activity, functional status, severity of pain, and social and emotional functioning. Rheumatol Int 2012; 32: 1521–1525. 10.1007/s00296-011-1822-1 [DOI] [PubMed] [Google Scholar]
  • 30. Basbaum A. Pain physiology: basic science. Can J Anesth 2002; 49: R1. [Google Scholar]
  • 31. Weidler C, Holzer C, Harbuz M, Hofbauer R, Angele P, Schölmerich J, et al. Low density of sympathetic nerve fibers and increased density of brain derived neurotrophic factor positive cells in RA synovium. Ann Rheum Dis 2005; 64: 13–20. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

All data are available in the paper.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES