Skip to main content
Journal of Clinical Medicine logoLink to Journal of Clinical Medicine
. 2023 Jun 23;12(13):4231. doi: 10.3390/jcm12134231

Predictive Model for the Non-Invasive Diagnosis of Endometriosis Based on Clinical Parameters

Lutz Konrad 1,*, Lea M Fruhmann Berger 1, Veronica Maier 1, Fabian Horné 1, Laura M Neuheisel 1, Elisa V Laucks 1, Muhammad A Riaz 1, Frank Oehmke 1, Ivo Meinhold-Heerlein 1, Felix Zeppernick 1
Editor: Ishai Levin1
PMCID: PMC10342998  PMID: 37445265

Abstract

Objectives: Are other pain symptoms in addition to dysmenorrhea, dyspareunia, dyschezia, dysuria, and chronic pelvic pain correlated to endometriosis and suitable for a clinical prediction model? Methods: We conducted a prospective study from 2016 to 2022, including a total of 269 women with numerous pain symptoms and other parameters. All women filled out two questionnaires and were examined by palpation and transvaginal ultrasound (TVUS). In cases of suspected deep endometriosis, magnetic resonance imaging (MRI) was performed. After the operation, endometriosis was diagnosed by histological examination. Results: All in all, 30 significant parameters and 6 significant numeric rating scale (NRS) scores associated with endometriosis could be identified: 7 pain adjectives, 8 endometriosis-associated pain symptoms, 5 pain localizations, 6 parameters from the PainDETECT, consumption of analgesics, and allergies. Furthermore, longer pain duration (before, during, and after menstruation) was observed in women with endometriosis compared to women without endometriosis (34.0% vs. 12.3%, respectively). Although no specific pain for endometriosis could be identified for all women, a subgroup with endometriosis reported radiating pain to the thighs/legs in contrast to a lower number of women without endometriosis (33.9% vs. 15.2%, respectively). Furthermore, a subgroup of women with endometriosis suffered from dysuria compared to patients without endometriosis (32.2% vs. 4.3%, respectively). Remarkably, the numbers of significant parameters were significantly higher in women with endometriosis compared to women without endometriosis (14.10 ± 4.2 vs. 7.75 ± 5.8, respectively). A decision tree was developed, resulting in 0.904 sensitivity, 0.750 specificity, 0.874 positive predictive values (PPV), 0.802 negative predictive values (NPV), 28.235 odds ratio (OR), and 4.423 relative risks (RR). The PPV of 0.874 is comparable to the positive prediction of endometriosis by the clinicians of 0.86 (177/205). Conclusions: The presented predictive model will enable a non-invasive diagnosis of endometriosis and can also be used by both patients and clinicians for surveillance of the disease before and after surgery. In cases of positivety, as evaluated by the questionnaire, patients can then seek advice again. Similarly, patients without an operation but with medical therapy can be monitored with the questionnaire.

Keywords: endometriosis, pelvic pain, neuropathic pain, PainDETECT, prediction model, pre-operative diagnosis, questionnaire

1. Introduction

Endometriosis is characterized by the implantation and growth of endometrial glands and stroma outside the uterine cavity [1], with pain and infertility as the main symptoms of patients [2]. Pain is an unpleasant sensory and emotional experience associated with actual or potential tissue damage or described in terms of such damage [3].

Dysmenorrhea, chronic pelvic pain (CPP), chronic non-menstrual pelvic pain, and dyspareunia are the most consistently reported pain types [2], with dysmenorrhea as the most frequent pain symptom and the highest pain perception among women with endometriosis [4,5]. Women with proven endometriosis reported the highest chronic/cyclic pain and significantly greater dyspareunia, dysmenorrhea, and dyschezia compared to women with other gynecologic pathologies or a normal pelvis [6]. Pelvic pain associated with primary dysmenorrhea typically occurs with the onset of menstruation and lasts for 8–72 h [2]. Data are inconsistent regarding a link of pain characteristics to the location or staging of endometriosis [2,6]; however, the total number of ectopic endometrial implants seems to be nevertheless associated with the intensity of dysmenorrhea [7].

A higher likelihood of suffering from endometriosis was found with an increased number of symptoms present (5-fold for one symptom; 85-fold ≥ 7 symptoms) [8]. A large study based upon the endometriosis health profile (EHP)-30 questionnaire revealed more menstrual pain (~4-fold), abdominal pain unrelated to menses (~6.5-fold), defecation pain (~6-fold), irregular bleeding (~4-fold), and bowel irritation such as constipation/diarrhea (~4,6-fold) in women with endometriosis compared to healthy women [9]. Another questionnaire study identified dysmenorrhea, dyspareunia, dysuria, lower back pain, pelvic pain other than during menses, rectal pain, and pain at ovulation or intercourse as significantly associated with endometriosis [10]. Furthermore, a positive correlation was found between dysmenorrhea and chronic pelvic pain (CPP), between dysmenorrhea and dyspareunia, and between constipation and dysuria. A study with patient-reported outcomes (n = 107) using a 36-item checklist for the symptoms identified very high pain values: dysmenorrhea (94.4%), dyspareunia (70.1%), infertility (63.6%), dyschezia (44.9%), and dysuria (22.4%) in endometriosis patients [11]. However, the use or nonuse of contraceptives was not reported. An online survey with several distinct questionnaires identified menstrual pain severity and duration, bloating, nausea, and widespread pain sites as significant predictors of endometriosis [12].

No single pain parameter reached significance as a prognostic factor, but a constellation of endometriosis-related symptoms seems to be a strong predictor of the disease [2].

The use of the short-form McGill questionnaire showed cramping as a significant pain parameter, resulting in a sensitivity of 0.92, a specificity of 0.33, a PPV of 0.40, and an NPV of 0.89 [13]. However, other significant pain parameters, such as throbbing, gnawing, and dragging pain to the legs were not found [14]. A questionnaire based upon 8 modules and 47 questions retained four significant variables, namely CPP, dyspareunia ≥ 3, painful defecation, and acne, with a final predictive logistic model for endometriosis with high sensitivity (0.902) and specificity (0.750) [15].

Up to 50% of women who experience infertility have endometriosis [16,17]. The population of infertile women with endometriosis is heterogenous, and diverse phenotypes can be observed in the clinical setting. The causes of infertility due to endometriosis are multiple and include reduced ovarian reserve, pain during sex resulting in reduced frequencies of intercourse, but also adenomyosis, uterine fibroids, and especially deep infiltrating endometriosis (DIE) [16,17]. A recent review stressed the importance of surgery in the case of DIE to improve fertility outcomes [17].

In recent years, neuropathic pain associated with endometriosis has also come into focus and has been found to have a high frequency of 40% [18]. Neuropathic pain is characterized by burning pain, evoked pain, abnormal temporal summation, hyperalgesia, and allodynia and does not, or only to a small extent respond to common analgesics [19,20]. The distinction between neuropathic pain and nociceptive pain might be challenging; however, both contribute to chronic pain [19].

Up to date, the preoperative use of questionnaires and predictive models in the diagnosis of all types of endometriosis is scarce. Thus, we investigated endometriosis-associated pain with two questionnaires and identified 30 significant parameters and 6 significant NRS scores. A decision tree model resulted in high predictive values, suggesting that a questionnaire might be an attractive tool for the preoperative diagnosis of all types of endometriosis.

2. Material and Methods

A questionnaire (in German) was developed to identify general features and determine different aspects of pain (Figure S1): (i) general features such as body mass index (BMI), age, cycle length, endometriosis in relatives, allergies, fertility/parity, etc. (ii) “classical” descriptions of pain such as dysmenorrhea, dyschezia, dysuria, chronic pelvic pain, constipation, and fertility, mostly in combination with the intensity of the pain (NRS 0–10); (iii) different pain descriptors such as cramping, tearing, pulling, stinging, pulsatile, touch-sensitivity, burning, pressing, diffuse, heat, flashing, and [iv] the PainDETECT questionnaire for the investigation of neuropathic pain [21,22]. The PainDETECT questionnaire can be accessed at www.pfizerpcoa.com in different languages, including English (last access: 12 December 2022).

Many of the pain descriptors used in the present study were derived from data collected in a previous study with a structured questionnaire [23]. The extended and reorganized questionnaire of the present study was based upon an extensive literature review for pain descriptors for endometriosis, the experiences of clinicians, and more importantly, the experiences of women suffering from pelvic pain and endometriosis.

Pain areas were identified from the markings of patients on an anatomical figure given in the PainDETECT questionnaire and summarized for statistical analysis into the lower abdomen, lumbar spine, thighs/lower extremities, hips/groins, upper abdomen, vagina/mons pubis, and gluteal region. Pain intensities were measured on an NRS 11-point scale from 0 to 10, with 0 indicating no pain and 10 indicating the worst pain. Allergies included the following items: analgesics, antibiotics, band-aids, nickel and other contact agents, hay fever, food, and one gap where the patients could fill in other problems with allergies.

The questionnaires were handed out to the patients before the clinical evaluation. Health professionals and/or medical students helped the patients fill out both questionnaires. The completed questionnaires, clinical examinations, surgical findings, and histological diagnoses were collected by the researchers for data analysis. The data were anonymized and tabulated in Excel.

The prospective study was conducted at the University Hospital in Giessen, Germany. The study protocol was approved by the local ethics committee (No. 95/09, July 2009), and informed consent was obtained from all patients. We used the following inclusion criteria: all women with pelvic and infertility problems and all women who have been transferred to our endometriosis center by established doctors. We used the following exclusion criteria: patients suffering from cancer, pregnant women, women with a pelvic laparoscopy at least 6 months before visiting our center, women with bladder infections, and women suffering from nutcracker syndrome.

All women were examined by physical examination, palpation, and TVUS to exclude endometriosis. In cases of suspected deep endometriosis, an MRI was performed. Only patients suffering from pain, especially dysmenorrhea, failed medical therapy, or infertility were operated on and subsequently histologically examined. Deep infiltrating endometriosis was classified intraoperatively by the ENZIAN score [24].

Statistics

The validity of the questionnaire was tested with scale reliability testing using Cronbach’s alpha, which resulted in a 0.736, indicating good reliability. Furthermore, content validity testing using the scale content validity index/average (S-CVI/Ave) with 8 raters resulted in a score of 0.926, which is above the threshold value of 0.78 for 6–8 raters [25].

The decision tree was created with XLSTAT for Excel using the classification and regression tree (CART) method with the following settings: all qualitative and quantitative significant parameters were identified except for fertility because of too many nulliparous patients; maximal tree depth of 9 complexity parameter (CP) of 0.0001; and for missing data, the means were used. To overcome the problem of overfitting the data, we examined each branch and reduced or replaced it when necessary. Simpler branches that yielded results similar to those replaced were favored by the experts and investigated further.

Each parameter was evaluated with 2 × 2 contingency tables and Fisher’s exact test to calculate NPV, PPV, sensitivity, specificity, OR, and RR. Furthermore, the outcome of the decision tree was examined for NPV, PPV, sensitivity, specificity, etc. For NRS scales, the means ± SDs were calculated and evaluated with the non-parametric test of Mann–Whitney. The calculation of cut-offs was done with a receiver operating characteristics (ROC) curve and area under the curve (AUC) with a 95% confidence interval. p values ≤ 0.05 were considered statistically significant.

3. Results

In our questionnaire, 49 main items and 5 NRS scores were asked, and in PainDETECT, 13 items and 7 NRS scores were asked. On average, it took the patients ~15–20 min to fill out both questionnaires. We present only an extract with the most interesting items because some questions were not answered sufficiently or the patients could not remember them adequately. This study included a total of 690 women with several pelvic problems, mostly period pain. 434 women were excluded from the study because of contraception and inadequate questionnaire data, leaving a total of 269 patients for evaluation (Table 1). The patients using contraception have been evaluated separately, and the results will be published elsewhere.

Table 1.

Demographics of patients with and without endometriosis.

No EM
N = 92
MD EM
N = 177
MD p Value
Age (yrs), mean (SD) 35.1 (8.8) 0 34.3 (6.7) 0 0.485
BMI, mean (SD) 24.2 (4.9) 1 24.2 (5.3) 0 0.921
Age Menarche, mean (SD) 13.1 (1.5) 2 13.0 (1.5) 2 0.698
Smoker (%) 24 (26.1) 0 52 (29.4) 0 0.669
Allergies (%) 43 (46.7) 0 106 (60.6) 2 0.038
Cycle duration in days (SD) 27.5 (5.1) 4 27.4 (5.5) 8 0.689
Menstruation duration in days (SD) 5.2 (1.9) 3 6.1 (4.0) 2 0.119
Irregular Cycle 28 (31.5) 3 55 (32.4) 7 1.0
Abnormal Menses 29 (34.1) 7 61 (36.7) 11 0.781
Use of analgesics (%) 47 (51.1) 0 143 (80.8) 0 0.0001
Analgesics before menses (%) 5 (13.2) 0 9 (7.4) 0 0.274
Analgesics during menses (%) 27 (71.0) 0 69 (56.6) 0 0.113
Analgesics before/during menses (%) 6 (15.8%) 0 42 (34.4%) 0 0.029
Analgesics before/during/after menses (%) 0 (0%) 0 2 (1.6%) 0 0.7
Neg Pos Neg Pos
Nulliparous 39 0 54 0
Fertility (%) 11 (20.8) 42 (79.2) 61 (49.6) 62 (50.4) 0.0004
Abortion (%) 40 (70.5) 13 (24.5) 87 (70.7) 36 (29.3) 0.714

EM, endometriosis; MD, missing data; BMI, body mass index; yrs, years; SD, standard deviation; Neg, negative; Pos, positive; p values calculated by Fisher’s exact test (smoker, allergies, irregular cycle, fertility, abortion) or Mann-Whitney (all the others) where appropriate.

The diagnosis of endometriosis by histological examination was possible in 99% (175/177) of women with endometriosis; in two women, the operation showed lesions that could not be excised. Endometriosis could not be confirmed in 28 operated-on cases. In total, we found 11 ovarian, 7 ovarian/superficial, 33 ovarian/deep infiltrating, 31 superficial, 25 superficial/deep infiltrating, 51 deep infiltrating, and 17 ovarian/superficial/deep infiltrating endometriosis cases. One case presented with ovarian and pneumothorax, and the other with deep infiltrating and paracolic endometriosis lesions.

3.1. General Parameters

No correlations except for allergies could be found for age, BMI, smoking habits, and age at menarche with or without endometriosis (Table 1). A higher percentage of women (~3-fold) with endometriosis compared to women without endometriosis were infertile (33.5% vs. 12.4%), but the number of abortions was not different between both groups (Table 1). However, it should be kept in mind that in both groups, a high proportion of women were nulliparous.

Both groups did not differ significantly with respect to differences in cycle length, cycle regularity, or bleeding strength during menstruation (Table 1). Although women in both groups reported the intake of analgesics mainly during menstruation, a significantly higher proportion of women with endometriosis (80.8% vs. 51.1%, endometriosis (EM) cases vs. controls) used them (Table 1). Remarkably, we identified a higher number of EM cases (34.4%) compared to women without endometriosis (15.8%) who took analgesics for a longer time, from the very beginning of menses and during menses (Table 1).

3.2. Dysmenorrhea

The majority of both patient groups suffered from dysmenorrhea; however, the frequency and severity were significantly different (Table 2). Most of the women with endometriosis experienced dysmenorrhea (172/177 = 97.2%) compared to women without the disease (68/92 = 73.9%; Table 2). A cutoff at NRS ≤ 3 was even better (Table 2). Furthermore, pain severity was significantly higher in women with endometriosis (7.8 ± 2.2) compared to women without endometriosis (5.1 ± 3.8). Remarkably, women without endometriosis experienced significantly shorter pain duration during menstruation (32.8%) and less long pain duration before/during/after menstruation (11.9%) compared to women with endometriosis (during, 17.2%; before/during/after, 39.9%). In summary, more women with endometriosis showed longer pain duration during menstruation compared to women without the disease (Table 2).

Table 2.

“Classical” pain parameters of patients with and without endometriosis.

No EM
N = 92
EM
N = 177
p Value MD
No Yes No Yes
Dysmenorrhea (PP) 24 68 5 172 0.0001 0
PP, NRS ≤ 3 35 57 6 171 0.0001 0
PP, NRS score (SD) 5.1 (3.8) 7.8 (2.2) 0.0001 0
PP before menses (%) 8 (11.9) 12 (7.4) 0.304
PP during menses (%) 22 (32.8) 28 (17.2) 0.013
PP before/during menses (%) 27 (40.3) 58 (35.6) 0.549
PP before/during/after menses (%) 8 (11.9) 65 (39.9) 0.0001
PP after menses (%) 0 (0) 0 (0) 1.0
PP during/after menses (%) 2 (3.0) 5 (3.1) 1.0
PP before/after menses (%) 0 (0) 1 (.6) 1.0
Chronic pelvic pain (CPP) 73 19 95 82 0.0001 0
CPP, NRS score (SD) 1.4 (2.9) 2.9 (3.4) 0.0001 0
Dysuria (painful urination) 88 4 120 57 0.0001 0
Dysuria, NRS score (SD) 0.22 (1.1) 1.63 (2.7) 0.0001 0
Dyschezia (painful defecation) 78 14 94 83 0.0001 0
Dyschezia (NRS ≤ 1) 79 13 94 83 0.0001 0
Dyschezia, NRS score (SD) 0.85 (2.2) 3.03 (3.5) 0.0001 0
Dyspareunia (painful intercourse) 59 26 72 104 0.0001 7/1
Dyspareunia (NRS ≤ 1) 60 25 72 104 0.0001 7/1
Dyspareunia, NRS score (SD) 1.5 (2.6) 3.5 (3.4) 0.0001 7/1
Obstipation 78 14 106 71 0.0001 0
Diarrhea 73 19 114 63 0.0122 0

EM, endometriosis; SD, standard deviation; MD, missing data 7/1 means 7 healthy women and 1 case of endometriosis; p values calculated by Fisher’s exact test or Mann-Whitney (NRS scores) where appropriate.

3.3. CPP and Dysuria (Painful Urination)

A significantly higher number of patients with endometriosis suffered from CPP compared to controls (82/177 = 46.3% vs. 19/72 = 20.7%; Table 2). Pain severity was ~2-fold higher in cases with endometriosis (NRS 2.9 vs. 1.4). Remarkably, a very clear difference could be identified between both groups with respect to dysuria: significantly more women with endometriosis (57/177 = 32.2%) suffered from painful urination compared to a very low number of women without endometriosis (4/92 = 4.3%). Furthermore, pain severity was also clearly different (~7.5-fold) between both groups (1.63 vs. 0.22, EM cases vs. controls, Table 2).

3.4. Dyschezia (Painful Defecation), Obstipation, and Diarrhea

A much larger proportion of women with endometriosis reported pain associated with defecation compared to women without endometriosis (83/177 = 46.9% vs. 14/92 = 15.2%, Table 2). Additionally, a ~3.5-fold higher NRS score for the severity of pain during defecation in cases with endometriosis compared to cases without endometriosis could be identified (Table 2). Similarly, a significantly higher number of women with endometriosis compared to women without the disease experienced obstipation (71/177 = 40.1% vs. 14/92 = 15.2%) and diarrhea (63/177 = 35.6% vs. 19/92 = 20.7%; Table 2).

3.5. Dyspareunia (Painful Intercourse)

The proportion of women with endometriosis reporting pain during intercourse was clearly higher (104/177 = 58.8% vs. 26/92 = 28.3%), and they also suffered from a ~2-fold higher NRS score (3.5 ± 3.4) compared to women without the disease (1.5 ± 2.6). An NRS cutoff of ≤1 slightly improved the discrimination between both groups (Table 2).

3.6. Other Pain Parameters

Cramping, pulling, tearing, stinging, pulsatile burning, and touch sensitivity all showed a significant correlation with endometriosis, with the highest values for cramping, pulling, tearing, and stinging, suggesting that the main pain adjectives for endometriosis might denote primarily mechanical pain (Table 3).

Table 3.

Pain sensations of patients with and without endometriosis.

No EM
N = 92
EM
N = 177
p Value
No Yes No Yes
Cramping 45 47 39 138 0.0001
Tearing 77 15 105 72 0.0001
Pulling 52 40 53 124 0.0001
Stinging 58 34 76 101 0.0020
Pulsatile 81 11 136 41 0.0338
Touch-sensitivity 79 13 128 49 0.0143
Burning 86 6 148 29 0.0225
Pressing 86 6 154 23 0.1459
Diffuse 84 8 152 25 0.2420
Heat 87 5 161 16 0.3469
Flashing 82 10 154 23 0.6979

EM, endometriosis; no missing data found; p values were calculated by Fisher’s exact test.

3.7. PainDETECT and Pain Localization

In order to analyze the correlation of neuropathic pain to endometriosis, we used the PainDETECT questionnaire, originally developed for the detection of neuropathic pain caused by back pain [21,22].

All three pain scores—current pain, strongest pain, and average pain—during the last 4 weeks showed significant associations with endometriosis, both in the proportions of patients as well as pain intensity (Table 4). Pain was localized by a significantly higher proportion of patients with endometriosis in the lower back, lower abdomen, thighs/lower extremities, and hips/groins compared to cases without endometriosis (Table 4). A near-significant trend could also be observed for pain localized in the upper abdomen (p = 0.055, Table 4).

Table 4.

Pain characteristics and localization with the PainDETECT.

No EM
N = 92
EM
N = 177
p Value
Neg Pos Neg Pos
Pain now 68 24 88 89 0.0001
Pain now, NRS (SD) 1.07 (2.2) 2.0 (2.6) 0.0003
Strongest pain/4 wks 37 55 11 166 0.0001
Strongest pain, NRS (SD) 4.3 (4.0) 7.6 (2.7) 0.0001
Average pain 42 50 18 159 0.0001
Average pain, NRS (SD) 2.7 (2.9) 4.9 (2.7) 0.0001
Lower abdomen 40 52 18 159 0.0001
Lumbar spine pain 65 27 60 117 0.0001
Thighs/lower extremities 78 14 117 60 0.001
Hips/groins 85 7 144 33 0.018
Upper abdomen 89 3 159 18 0.055
Vagina/Mons pubis 81 11 152 25 0.708
Gluteal region 88 4 168 9 1.0
Pain course pattern 38 54 10 167 0.0001
  • -

    Persistent pain with slight fluctuations (%)

5
(9.3)
17
(10.2)
1.0
  • -

    Persistent pain with pain attacks (%)

22
(40.7)
50
(29.9)
0.186
  • -

    Pain attacks without pain between them (%)

24
(44.4)
72
(43.1)
0.241
  • -

    Pain attacks with pain between them (%)

3
(5.6)
28
(16.8)
0.0427
Final score (Neuropathic pain)
  • -

    Neg 0–12 (%)

87 (94.6) 136 (76.8) 0.0001
  • -

    Unclear 13–18 (%)

4 (4.3) 33 (18.6) 0.0012
  • -

    Pos 19–38 (%)

1 (1.1) 8 (4.5) 0.1721

Final score, mean (SD)

3.7 (4.8) 8.5 (5.5) 0.0001
  • -

    0 vs. 1–38

42 50 12 165 0.0001
  • -

    0–3 vs. 4–38

55 37 37 140 0.0001

EM, endometriosis; SD, standard deviation; wks, weeks; no missing data; Neg, negative; Pos, positive; p values calculated by Fisher’s exact test or Mann-Whitney (NRS).

Remarkably, the pain course pattern was also different. More women with endometriosis (~3-fold) experienced regular pain attacks with pain between them (16.6%) compared to women without endometriosis (5.8%, Table 4).

The final score of the PainDETECT questionnaire classifies the patients with respect to neuropathic pain. The proportion of women with endometriosis who probably suffered from neuropathic pain (4.2%, final score ≥ 19) was nearly similar to the proportion of women without endometriosis (1.1%), thus suggesting that neuropathic pain is not a major pain parameter associated with endometriosis (Table 4). However, with a cutoff ≤ 3, we identified a significantly higher final score in patients with endometriosis (8.5 ± 5.5) compared to women without endometriosis (3.7 ± 4.8; Table 4).

3.8. Decision Tree and Prediction of Endometriosis

All in all, 30 significant parameters and 5 NRS scores were associated with endometriosis in the present study (Table 1, Table 2, Table 3 and Table 4); however, infertility and abortion were not considered for further analysis due to the very high number of nulliparous women in both groups (Table 1). Similarly, for some parameters such as current pain, mean pain, strongest pain, etc. (Table 1, Table 2, Table 3 and Table 4), no meaningful cutoffs could be determined; therefore, only the presence or absence of these parameters was evaluated in the present study. Women with endometriosis experienced a higher number of significant parameters (14.1 ± 4.2) compared to women without endometriosis (7.8 ± 5.8). A cutoff of ≤8 resulted in fair discrimination between women with and without endometriosis (Table 5). However, because the specificity was only moderate (0.50, Table 5), we decided to construct a decision tree (Figure 1) with high p values and a good distinction between women with and without endometriosis (Table 5). The PPV of 0.874 is comparable to the positive prediction of endometriosis by the clinicians of 0.86 (177/205).

Table 5.

Significant parameters and decision tree analysis.

No EM
N = 92
EM
N = 177
p Value
No Yes No Yes
Significant parameters (SD) 7.8 (5.8) 14.1 (4.2) <0.0001
Cut-off of 8 46 46 12 165 <0.0001
Positive predictive value
(95% CI)
0.782
(0.7203–0.8358)
Negative predictive value
(95% CI)
0.7931
(0.6666–0.8881)
Sensitivity
(95% CI)
0.9322
(0.8843–0.9645)
Specificity
(95% CI)
0.5000
(0.3942–0.6058)
Odds ratio
(95% CI)
13.75
(6.729–28.097)
Relative risk
(95% CI)
3.78
(2.272–6.288)
Decision tree 69 23 17 160 <0.0001
Positive predictive value
(95% CI)
0.8743
(0.8175–0.9187)
Negative predictive value
(95% CI)
0.8023
(0.7028–0.8802)
Sensitivity
(95% CI)
0.904
(0.8508–0.943)
Specificity
(95% CI)
0.75
(0.6485–0.8341)
Odds ratio
(95% CI)
28.235
(14.195–56.163)
Relative risk
(95% CI)
4.423
(2.879–6.795)

EM, endometriosis; SD, standard deviation; p values calculated by Fisher’s exact test or Mann–Whitney, where appropriate.

Figure 1.

Figure 1

The number of significant parameters (SP) with a cutoff of 8.5 could be used as the root of the decision tree. In summary, 11 significant parameters were useful for the prediction. From the PainDETECT questionnaire, we used the final score (FS), the pain course pattern, pain radiating to the legs (legs), and lumbar spine pain (LS). The “classical” endometriosis pain parameters (dysuria, dyschezia, dyspareunia, period pain (PP), and obstipation) gave good discrimination. Furthermore, the duration of period pain during menstruation (PPM) was useful as a parameter.

4. Discussion

In our study on the pain typology of endometriosis, we analyzed a very large number of parameters. Thus, we suggest that no single parameter but instead pain patterns are highly predictive for endometriosis. In contrast to women without endometriosis, women with endometriosis do not have different pain but experience more pain (~2-fold). A subgroup suffered from dysuria; a ~4-fold higher number experienced longer menstrual pain duration; and ~2-fold more patients suffered from pain radiating to the thighs/legs. Remarkably, a very high number of cases described their pain as cramping, tearing, or pulling, which points to the uterus as the main pain contributor. It was somewhat surprising that neuropathic pain was not very common in women with endometriosis compared to women without endometriosis. Based upon the significant parameters, a decision tree was developed, resulting in 0.904 sensitivity, 0.750 specificity, 28.235 OR, and 4.423 RR, suggesting that questionnaires, as used in this study, might be an attractive tool for pre-operative and non-invasive endometriosis diagnosis.

Pain and sub-/infertility are the most troublesome symptoms for women with endometriosis [26]. We identified significantly higher values in women with endometriosis compared to women without endometriosis (49.6% vs. 20.8%, respectively), which was also described by others (11.6% vs. 3.4%, respectively) [27]. Interestingly, sub-/infertility does not seem to be based upon a higher number of abortions in endometriosis cases because we, Sinaii et al. [26] and Ricci et al. [15], did not find differences compared to cases without endometriosis. No associations except for allergies could be identified in our study for age, BMI, smoking, menstruation length, cycle duration, abnormal menses, or irregular cycles, which have been reported with controversial data [15,28,29,30,31].

A significantly higher proportion of women with endometriosis (80.8%) used analgesics for a longer period of time during menses compared to women without endometriosis (51.1%), similar to a previous report [15]. However, they did not differentiate between the use and nonuse of hormonal contraception.

Analysis of dysmenorrhea, CPP, dysuria, dyschezia, dyspareunia, obstipation, and diarrhea resulted in a highly significant association with endometriosis comparable to recent observations [2,11]. All classical endometriosis parameters showed significantly higher NRS scores in women with endometriosis compared to cases without endometriosis. Remarkably, an inverse relationship was identified for the first time in women with endometriosis compared to women without endometriosis for pain duration during menses (32.8% vs. 17.2%, respectively) and pain before/during/after menses (11.9% vs. 39.9%, respectively).

Interestingly, ~7.5-fold more women with endometriosis (32.2%) suffered from dysuria compared to only very few women without endometriosis (4.3%), similar to the study by Ricci et al. [15], but who did not discriminate between use and nonuse of contraception. Another study, but without a control group, also identified dysuria in a high number (22.4%) of endometriosis patients [11]. Due to the highly discriminative nature of dysuria in a subgroup of patients, this parameter was used for our prediction model. Thus, it is important to make sure that pain during urination is not caused by a bladder infection.

Evaluation of pain with adjectives in our study revealed that a significantly larger proportion of women with endometriosis described their pain as cramping, tearing, pulling, stinging, pulsatile, burning, and touch-sensitivity compared to women without endometriosis. Another study also identified cramping as a significant pain parameter for endometriosis [13]. Similarly, more women with (vs. without) endometriosis had menstrual pain/cramping (52.7 vs. 45.2%, respectively) and non-menstrual pelvic pain/cramping (36.7 vs. 14.3%, respectively) [27]. In contrast to our findings, Ballard et al. [14] reported that gnawing and throbbing, but not cramping or pulling, are more often experienced by women with endometriosis, which might be due to the lower number of women (n = 149) analyzed.

The questionnaire PainDETECT to evaluate neuropathic back pain [21,22] was used in the present study. Although we found a slightly higher proportion of women with endometriosis compared to women without endometriosis experiencing neuropathic pain (4.2% vs. 1.1%, respectively), it did not reach statistical significance. In contrast, two other studies revealed higher numbers of neuropathic pain cases in endometriosis patients (40%) [18] and patients with CPP (26%), using PainDETECT and other methods [32]. However, it was recently shown that after hysterectomy with or without ovarian preservation, the reoperation rates were very low (0.4–1.4%) [33], suggesting that the main pain sources are the uterus and the lesions and not neuropathic pain.

The average of the final score of the PainDETECT resulted in significantly higher values in women with endometriosis compared to women without endometriosis (8.5 ± 5.5 vs. 3.7 ± 4.8, respectively). A higher proportion of women with endometriosis experience higher current pain, stronger pain in the last 4 weeks, higher mean pain, pain in the lower abdomen, lumbar spine pain, pain in the hips/groins, and pain in the thighs/lower extremities. The dragging pain in the legs was also reported by Ballard et al. [14] in women with endometriosis. Our analysis of the pain course pattern revealed a ~3-fold higher proportion of women with endometriosis suffering from pain attacks with moderate pain in between compared to women without endometriosis.

Although we found many new parameters formerly not described for endometriosis, we could confirm that no single pain parameter reached significance as a prognostic factor, as recently summarized [2]. We also observed an increased likelihood of endometriosis with an increased number of symptoms present; women with endometriosis experienced on average ~2-fold more significant symptoms compared to women without endometriosis, similarly to Ballard et al. [8]. In another study, four significant variables (CPP, dyspareunia with visual analogue scale (VAS) ≥3, painful defecation, and acne) resulted in a predictive logistic model with high sensitivity (0.902) and specificity (0.750) [15]. However, the use of hormonal contraception was not specified, and the high discrepancy in the percentage (6% vs. 44%) between women with and without endometriosis might confound the study. Similarly, a recent questionnaire also mentioned hormonal contraception only as a parameter beyond many others [34].

The strength of our study is the extensive evaluation of many parameters and the fact that all women underwent physical examination, palpation, TVUS, and MRI in cases of deep infiltrating endometriosis. Although all clinical examinations cannot exclude some positive cases of endometriosis [35], with the questionnaire, we are reasonably sure that the women were not suffering from endometriosis-associated pain, and it is possible to re-analyze these cases with the questionnaire after some time.

In our study, we generated a decision tree for early endometriosis prediction. Remarkably, the number of significant parameters was useful as the root of the tree. The decision tree contains dysuria, dyspareunia, dyschezia, obstipation, period pain, pain course pattern, pain radiating to the legs, pain in the lumbar spine, pain duration during menstruation, and the final score of the PainDETECT. The decision tree is divided into three main axes, suggesting that endometriosis is characterized by distinct pain patterns and not by single pain parameters.

The decision tree analysis resulted in a high sensitivity of 0.904 and a specificity of 0.75, which is comparable with the sensitivity of 0.76 and specificity of 0.75 for bimanual examination, the sensitivity of 0.79 and specificity of 0.94 for TVUS, and the sensitivity of 0.94 and specificity of 0.77 for MRI, as recently summarized [36]. However, one has to keep in mind that TVUS and MRI are not very well suited for the detection of peritoneal endometriosis. In contrast, with our questionnaire, prediction of peritoneal, ovarian, and deep infiltrating endometriosis was possible with a sensitivity of 0.904 and a specificity of 0.75, which is very similar to the sensitivity of 0.94 and specificity of 0.79 postulated for a clinically useful non-invasive test for endometriosis [37].

4.1. Strengths and Weaknesses

In this study, we asked about almost all known pain parameters, so we assume that we have not missed too many. The questionnaire was optimized several times with statistical methods and thus validated. Furthermore, we also asked a sufficiently large number of patients. Up to date, however, the questionnaire has only been used in a clinical setting and only internally, not externally.

4.2. Implications

The presented prediction model will not only enable the pre-operative and non-invasive diagnosis of endometriosis but can also be used by both patients and clinicians for surveillance of the disease before and after an operation. Similarly, patients without operations but with medical therapy can be monitored with the questionnaire. With the questionnaire, it will be possible to divide patients in advance into those who need immediate help and those who only need active monitoring. This could contribute to increased efficiency, saving time and money, and avoiding unnecessary operations.

5. Conclusions

In this study, we have shown that several distinct pain patterns are highly predictive of endometriosis. In contrast to women without endometriosis, women with endometriosis experience more pain, and a very high number of cases describe their pain as cramping, tearing, or pulling, which points to the uterus as the main pain contributor. Surprisingly, neuropathic pain was not very common in women with endometriosis and did not differ significantly from women without endometriosis. The present study clearly demonstrates that the pre-operative diagnosis of endometriosis based upon questionnaires is possible and underscores that we should ‘never underestimate the pain’ [38]. Thus, physicians should always consider endometriosis as a possible cause of severe period pain, which should be treated immediately.

Acknowledgments

We thank Schneider for her enormous help with the patients and database, A. Hackethal and Catharina Luck for help with the questionnaire, S. Kapperer for data collection, Monika Petrov, Lisa Nieberle, and Franziska V. Eisenlohr for proofreading.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12134231/s1.

Author Contributions

L.K., study design, data handling & analysis, statistics, writing; L.M.F.B., data acquisition, and analysis, proof reading; V.M., data acquisition, proof reading; F.H., data acquisition & analysis, proof reading; L.M.N., data acquisition, proofreading; E.V.L., data acquisition, proofreading; M.A.R., data analysis, writing, proofreading; F.O., examination, transvaginal ultrasound; I.M.-H., transvaginal ultrasound, examination, operations, proofreading; F.Z., transvaginal ultrasound, examination, operations, writing, proofreading. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of the Justus Liebig University, Department of Medicine (protocol code 95/09 dated 21 July 2009) for studies involving humans.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data is available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research did not receive any specific grants from funding agencies in the public, commercial, or not-for-profit sectors.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Clement P.B. The pathology of endometriosis: A survey of the many faces of a common disease emphasizing diagnostic pitfalls and unusual and newly appreciated aspects. Adv. Anat. Pathol. 2007;14:241–260. doi: 10.1097/PAP.0b013e3180ca7d7b. [DOI] [PubMed] [Google Scholar]
  • 2.Taylor H.S., Adamson G.D., Diamond M.P., Goldstein S.R., Horne A.W., Missmer S.A., Snabes M.C., Surrey E., Taylor R.N. An evidence-based approach to assessing surgical versus clinical diagnosis of symptomatic endometriosis. Int. J. Gynecol. Obstet. 2018;142:131–142. doi: 10.1002/ijgo.12521. [DOI] [PubMed] [Google Scholar]
  • 3.Tracey I., Woolf C.J., Andrews N.A. Composite pain biomarker signatures for objective assessment and effective treatment. Neuron. 2019;101:783–800. doi: 10.1016/j.neuron.2019.02.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Cramer D.W., Wilson E., Stillman R., Berger M.J., Belisle S., Schiff I., Albrecht B., Gibson M., Stadel B.V., Schoenbaum S.C. The relation of endometriosis to menstrual characteristics, smoking, and exercise. JAMA. 1986;255:1904–1908. [PubMed] [Google Scholar]
  • 5.Cozzolino M., Coccia M.E., Lazzeri G., Basile F., Troiano G. Variables associated with endometriosis-related pain: A pilot study using a visual analogue scale. Rev. Bras. Ginecol. Obstet. 2019;41:170–175. doi: 10.1055/s-0039-1679879. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Schliep K.C., Mumford S.L., Peterson C.M., Chen Z., Johnstone E.B., Sharp H.T., Stanford J.B., Hammoud A.O., Sun L., Buck Luis G.M. Pain typology and incident endometriosis. Hum. Reprod. 2015;30:2427–2438. doi: 10.1093/humrep/dev147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Perper M.M., Nezhat F., Goldstein H., Nezhat C.H., Nezhat C. Dysmenorrhea is related to the number of implants in endometriosis patients. Fertil. Steril. 1995;63:500–503. doi: 10.1016/S0015-0282(16)57416-0. [DOI] [PubMed] [Google Scholar]
  • 8.Ballard K.D., Seaman H.E., de Vries C.S., Wright J.T. Can symptomatology help in the diagnosis of endometriosis? Findings from a national case-control study–Part 1. BJOG. 2008;115:1382–1391. doi: 10.1111/j.1471-0528.2008.01878.x. [DOI] [PubMed] [Google Scholar]
  • 9.Hansen K.E., Kesmodel U.S., Baldursson E.B., Kold M. Visceral syndrome in endometriosis patients. Eur. J. Obstet. Gynecol. Reprod. Biol. 2014;179:198–203. doi: 10.1016/j.ejogrb.2014.05.024. [DOI] [PubMed] [Google Scholar]
  • 10.Markham R., Luscombe G.M., Manconi F., Fraser I.S. A detailed profile of pain in severe endometriosis. JEPPD. 2019;11:85–94. [Google Scholar]
  • 11.Fourquet J., Gao X., Zavala D., Orengo J.C., Abac S., Ruiz A., Laboy J., Flores I. Patients’ report on how endometriosis affects health, work, and daily life. Fertil. Steril. 2010;93:2424–2428. doi: 10.1016/j.fertnstert.2009.09.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Evans S., Mikocka-Walus A., Olive L., Seidman L.C., Druitt M., Payne L.A. Phenotypes of women with and without endometriosis and relationship with functional pain disabilities. Pain. Med. 2021;22:1511–1521. doi: 10.1093/pm/pnaa362. [DOI] [PubMed] [Google Scholar]
  • 13.Droz J., Howard F.M. Use of the short-form McGill pain questionnaire as a diagnostic tool in women with chronic pelvic pain. J. Minim. Invasive Gynecol. 2011;18:211–227. doi: 10.1016/j.jmig.2010.12.009. [DOI] [PubMed] [Google Scholar]
  • 14.Ballard K., Lane H., Hudelist G., Banerjee S., Wright J. Can specific pain symptoms help in the diagnosis of endometriosis? A cohort study of women with chronic pelvic pain. Fertil. Steril. 2010;94:20–27. doi: 10.1016/j.fertnstert.2009.01.164. [DOI] [PubMed] [Google Scholar]
  • 15.Ricci G., Castelpietra E., Romano F., Di Lorenzo G., Zito G., Ronfani L., Biffi S., Monasta L. Case-control study to develop and validate a questionnaire for the secondary prevention of endometriosis. PLoS ONE. 2020;15:e0230828. doi: 10.1371/journal.pone.0230828. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Bonavina G., Taylor H.S. Endometriosis-associated infertility: From pathophysiology to tailored treatrment. Front. Endocrinol. 2022;13:1020827. doi: 10.3389/fendo.2022.1020827. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Daniilidis A., Angioni S., Di Michele S., Dinas K., Gkrozou F., D’Alterio M.N. Deep Endometriosis and infertility: What is the impact of surgery? J. Clin. Med. 2022;11:6727. doi: 10.3390/jcm11226727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Coxon L., Wiech K., Vincent K. Is there a neuropathic-like component to endometriosis-associated pain? Results from a large cohort questionnaire study. Front. Pain Res. 2021;2:743812. doi: 10.3389/fpain.2021.743812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Gierthmühlen J., Baron R. Neuropathic pain. Semin. Neurol. 2016;36:462–468. doi: 10.1055/s-0036-1584950. [DOI] [PubMed] [Google Scholar]
  • 20.Cavalli E., Mammana S., Nicoletti F., Bramanti P., Mazzon E. The neuropathic pain: An overview of the current treatment and future therapeutic approaches. Int. J. Immunopathol. Pharmacol. 2019;33:2058738419838383. doi: 10.1177/2058738419838383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Freynhagen R., Baron R., Gockel U., Tölle T.R. PainDETECT: A new screening questionnaire to identify neuropathic components in patients with back pain. Curr. Med. Res. Opin. 2006;22:1911–1920. doi: 10.1185/030079906X132488. [DOI] [PubMed] [Google Scholar]
  • 22.Freynhagen R., Tölle T.R., Gockel U., Baron R. The painDETECT project–Far more than a screening tool on neuropathic pain. Curr. Med. Res. Opin. 2016;32:1033–1057. doi: 10.1185/03007995.2016.1157460. [DOI] [PubMed] [Google Scholar]
  • 23.Hackethal A., Luck C., von Hobe A.K., Eskef K., Oehmke F., Konrad L. A structured questionnaire improves preoperative assessment of endometriosis patients: A retrospective analysis and prospective trial. Arch. Gynecol. Obstet. 2011;284:1179–1188. doi: 10.1007/s00404-010-1819-0. [DOI] [PubMed] [Google Scholar]
  • 24.Haas D., Chvatal R., Habelsberger A., Wurm P., Schimetta W., Oppelt P. Comparison of revised American Fertility Society and ENZIAN staging: A critical evaluation of classifications of endometriosis on the basis of our patient population. Fertil. Steril. 2011;95:1574–1578. doi: 10.1016/j.fertnstert.2011.01.135. [DOI] [PubMed] [Google Scholar]
  • 25.Lynn M.R. Determination and quantification of content validity. Nurs. Res. 1986;35:382–385. doi: 10.1097/00006199-198611000-00017. [DOI] [PubMed] [Google Scholar]
  • 26.Sinaii N., Plumb K., Cotton L., Lambert A., Kennedy S., Zondervan K., Stratton P. Differences in characteristics among 1,000 women with endometriosis based on extent of disease. Fertil. Steril. 2008;89:538–545. doi: 10.1016/j.fertnstert.2007.03.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Fuldeore M.J., Soliman A.M. Prevalence and symptomatic burden of diagnosed endometriosis in the United States: National estimates from a cross-sectional survey of 59,411 women. Gynecol. Obstet. Investig. 2017;82:453–461. doi: 10.1159/000452660. [DOI] [PubMed] [Google Scholar]
  • 28.Bravi F., Parazzini F., Cipriani S., Chiaffarino F., Ricci E., Chiantera V., Viganó P., La Vecchia C. Tobacco smoking and risk of endometriosis: A systematic review and meta-analysis. BMJ Open. 2014;4:e006325. doi: 10.1136/bmjopen-2014-006325. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Saha R., Kuja-Halkola R., Tornvall P., Marions L. Reproductive and lifestyle factors associated with endometriosis in a large cross-sectional population sample. J. Womens Health. 2017;26:152–158. doi: 10.1089/jwh.2016.5795. [DOI] [PubMed] [Google Scholar]
  • 30.Parasar P., Ozcan P., Terry K.L. Endometriosis: Epidemiology, diagnosis and clinical management. Curr. Obstet. Gynecol. Rep. 2017;6:34–41. doi: 10.1007/s13669-017-0187-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Hemmert R., Schliep K.C., Willis S., Peterson C.M., Louis G.B., Allen-Brady K., Simonsen S.E., Stanford J.B., Byun J., Smith K.R. Modifiable life style factors and risk for incident endometriosis. Paediatr. Perinat. Epidemiol. 2019;33:19–25. doi: 10.1111/ppe.12516. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Whitaker L.H.R., Reid J., Choa A., McFee S., Seretny M., Wilson J., Elton R.A., Vincent K., Horne A.W. An exploratory study into objective and reported characteristics of neuropathic pain in women with chronic pelvic pain. PLoS ONE. 2016;11:e0151950. doi: 10.1371/journal.pone.0151950. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Bougie O., McClintock C., Pudwell J., Brogly S.B., Velez M.P. Long-term follow-up of endometriosis surgery in Ontario: A population-based cohort study. Am. J. Obstet. Gynecol. 2021;270:270.e1–270.e19. doi: 10.1016/j.ajog.2021.04.237. [DOI] [PubMed] [Google Scholar]
  • 34.Chapron C., Lafay-Pillet M.C., Santulli P., Bourdon M., Maignien C., Gaudet-Chardonnet A., Maitrot-Mantelet L., Borghese B., Marcellin L. A new validated screening method for endometriosis diagnosis based on patient questionnaires. EClin. Med. 2022;44:101263. doi: 10.1016/j.eclinm.2021.101263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Keckstein J., Hoopmann M., Merz E., Grab D., Weichert J., Helmy-Bader S., Wölfler M., Bajka M., Mechsner S., Schäfer S., et al. Expert opinion on the use of transvaginal sonography for presurgical staging and classification of endometriosis. Arch. Gynecol. Obstet. 2023;307:5–19. doi: 10.1007/s00404-022-06766-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Tavcar J., Loring M., Movilla P.R., Clark N.V. Diagnosing endometriosis before laparoscopy: Radiologic tools to evaluate the disease. Curr. Opin. Obstet. Gynecol. 2020;32:292–297. doi: 10.1097/GCO.0000000000000638. [DOI] [PubMed] [Google Scholar]
  • 37.Nisenblat V., Bossuyt P.M.M., Shaikh R., Farquhar C., Jordan V., Scheffers C.S., Mol B.W.J., Hohnson N., Hull M.L. Blood biomarkers for the non-invasive diagnosis of endometriosis. Cochrane Database Syst. Rev. 2016;2016:CD012179. doi: 10.1002/14651858.CD012179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Zannoni L., Del Forno S., Paradisi R., Seracchioli R. Endometriosis in adolescence: Practical rules for an earlier diagnosis. Pediatr. Ann. 2016;45:e332–e335. doi: 10.3928/19382359-20160727-03. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The data is available from the corresponding author upon request.


Articles from Journal of Clinical Medicine are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES