Abstract
Statistical significance is used to analyse research findings and is together with biased free trials the cornerstone of evidence based medicine. However traditional statistics are based on the assumption that the population investigated is homogeneous without smaller hidden subgroups.
The clinical, inflammatory, immunological, biochemical, histochemical and genetic-epigenetic heterogeneity of similar looking endometriosis lesions is a challenge for research and for diagnosis and treatment of endometriosis. The conclusions obtained by statistical testing of the entire group are not necessarily valid for subgroups. The importance is illustrated by the fact that a treatment with a beneficial effect in 80% of women but with exactly the same but opposite effect, worsening the disease in 20%, remains statistically highly significant.
Since traditional statistics are unable to detect hidden subgroups, new approaches are mandatory. For diagnosis and treatment it is suggested to visualise individual data and to pay specific attention to the extremes of an analysis. For research it is important to integrate clinical, biochemical and histochemical data with molecular biological pathways and genetic-epigenetic analysis of the lesions.
Keywords: endometriosis, heterogeneity, evidence based medicine, medical treatment, statistics
Statistics and evidence in non-homogeneous populations
Evidence based medicine (Djulbegovic and Guyatt, 2017) requires that diagnosis and treatment are based on the best evidence available and on statistical significance. However, traditional statistics to demonstrate specificity and sensitivity of a diagnostic test and efficacy of a treatment are based on the assumption that the population investigated is homogeneous without hidden subgroups. Conclusions and significances are valid only when this condition is met (Connor, 2015; Reinhart, 2015). Homogeneity of the population with a disease is assumed in most studies until subgroups with a different behaviour are discovered. Figure 1 illustrates how easily statistical significances can hide an obvious sub-group.
A treatment with a 10% decrease in 24 women in symptoms, and a 10% increase in 6 women. This opposite effect in 20% of women, is obvious when individual data are plotted. However, this is hidden with means and SD while the t-test remains highly significant, whether performed as a paired or unpaired test for a normal distribution or a Mann-Whitney test for a non-normal distribution. Visualisation of data with Box and whiskers plots could lead us to suspect that something is wrong. That traditional statistical tests do not detect hidden subgroups is well known (Farland et al., 2016). Moreover, the difficulty to detect hidden subgroups increases when the prevalence of a different behaviour or the differences in effect are less.
In most publications on endometriosis, a traditional statistical analysis is used to evaluate endometriosis data or the evaluation of the efficacy of a therapy. This is questionable since the basic assumptions of a homogeneous and normally distributed population are rarely met given the heterogeneity of endometriosis lesions (Farland et al., 2016).
Endometriosis is a heterogeneous disease
Endometriosis is macroscopically a heterogeneous disease varying from subtle to typical, cystic and deep lesions. More important is that macroscopically similar looking lesions can cause very different symptoms and can have a different behaviour. Pain symptoms poorly correlate with the severity of lesions. Deep endometriosis is associated with severe pain in most women, but occasionally some lesions do not cause pain. During pregnancy, most endometriosis lesions will decidualize and regress (Koninckx et al., 2018), but occasionally deep lesions progress and cause bowel perforations (Setubal et al., 2014). Only some deep endometriosis lesions have cancer-associated driver mutations (Lac et al., 2019). The inflammatory reaction around macroscopically similar lesions is variable. The associated changes in plasma and in peritoneal fluid are highly variable and characterised by large standard deviations. The aromatase activity and progesterone resistance in the lesions vary from inexistent to very pronounced (Bulun et al., 2015; Koninckx et al., 2019). Although most endometriosis lesions require estrogens to grow, occasionally lesions can develop in the absence of significant estrogen concentrations in blood as observed in men and in rare cases of deep endometriosis nodules developing more than 10 years after menopause in the absence of estrogen intake (Asencio et al., 2018). The clinical effect or progestogen therapy on endometriosis associated pain varies from pronounced to no effect (Vercellini et al., 2018).
We recently proposed the genetic-epigenetic theory (Koninckx et al., 2019) which can explain the variability of similar looking lesions in symptoms and in biochemical changes in lesions and in plasma. This theory also explains the occurrence of endometriosis in the absence of endometrium, the clonal and the hereditary aspect of endometriosis lesions and all known associated observations.
We are born with a variable set of genetic and epigenetic incidents, some transmitted from our parents at conception, and some occurring during pregnancy. After birth additional genetic-epigenetic incidents occur. They can be caused by accidents during cell division, by environmental toxicity, by oxidative stress or by radiation. Taking into account the redundancy of intracellular pathways (Leonard and Lin, 2000; Stoney et al., 2018), we suggested that endometriosis lesions start to develop when the cumulative set of incidents reach a certain threshold. The further growth and development of each lesion is determined by their specific set of incidents and their environment such as the peritoneal cavity, and the inflammatory and immunologic reaction. In addition, the estrogen stimulated growth, and the subsequent shedding and bleeding in endometriosis lesions constitute a repetitive tissue trauma and repair (ReTIAR). This causes an inflammatory reaction, and an oxidative stress, which might favourise additional genetic-epigenetic incidents in the lesion (Suda et al., 2018). The role of local cell-cell interactions and the effect of critical mass and immunology are not yet understood. Clinically, the genetic-epigenetic theory thus postulates that the set of genetic and epigenetic incidents at birth explains the hereditary predisposition to develop endometriosis, and many of the associated differences such as biochemical changes in the endometrium, the infertility, the changes in pregnancy and the immunologic changes.
The clinical consequence of heterogeneity is individualisation of therapy
In the absence of markers to diagnose the different types of endometriosis lesions, the indications of heterogeneity of similar looking lesions are strong enough to rethink our management of women with endometriosis. The absence of data that permit to predict the natural history of a lesion, hampers decisions of treatment in younger women. Early surgery might prevent the subsequent growth, but risks to surgically treat a transient finding with no long-term benefit. That the well-known delay in diagnosis can be problematic in growing lesions, emphasises early diagnosis and strict follow-up. Also, prevention of progression should comprise the prevention of growth and the prevention of additional genetic or epigenetic incidents, by reducing environmental pollution and by reducingthe oxidative stress caused by repetitive (abundant retrograde) menstruation and by bleedings in the lesions. The role of anti-oxidants and food intake is unclear but might be considered.
The realisation that medical treatment can have a variable effect (Koninckx, et al., 2018; Vercellini et al., 2018) and does not stop growth in all lesions, suggest a strict follow-up with monitoring of growth when given for many years. Treatment should be reconsidered when associated with growth or incomplete pain relief. However, it is unclear whether ultrasound or other non-invasive methods permit to monitor growth and how women with a moderate pain reduction only should be judged. Anyway it cannot be taken for granted that oral contraception will prevent progression in all women. It seems logical that lesions with a marked progesterone resistance will rather be stimulated than inhibited by oral contraceptives.
Individualisation of surgery today is based on past experience and common sense (Koninckx et al., 2017). We do not know when complete excision of deep endometriosis is required and when a less aggressive excision is sufficient. For cystic ovarian and bowel endometriosis, surgery balances completeness of surgery, organ damage and recurrence rates. It is accepted that non-growing deep endometriosis lesion without clinical symptoms should not be treated. It is not clear whether surgery should be performed before proceeding to IVF in these women. The risks of progression during pregnancy and the risk of stimulating growth by puncture during IVF pick-up are unpredictable.
Age is another important variable and after menopause the ovarian cancer risk strongly suggest surgery in symptomatic endometriosis. In order to tailor surgery we should know whether the peripheral cells of a lesion are abnormal endometriotic cells requiring a complete excision (Garcia-Solares et al., 2018) or whether these cells are a reversible metaplasia induced by the endometriotic cells, making a less aggressive excision sufficient. The same applies to the treatment of cystic ovarian endometriosis which balances between completeness of surgery, ovarian damage and recurrence rates.
Research should be adapted to a heterogeneous disease
The knowledge that endometriosis is heterogeneous should stimulate to look more carefully at individual data and at the effects of therapy over time. Visualisation of different populations might be useful also for clinical symptoms and biochemical data, as progesterone resistance or aromatase activity which seem a continuum from very little to very strong. The statistical analyses as developed for redundant pathways (Stoney et al., 2018) and Bayesian statistics which are more intuitive, could be more appropriate for heterogeneous populations.The need for a disease stratification of endometriosis beyond macroscopical inspection requires the integrative analysis of genomic, epigenomic and phenotypic data. This suggests a focus shift from larger series, to more complete data. However, the combination of clinical and biochemical data in plasma and in the lesions together with molecular biological pathways requires the co-operation between groups with very different expertises (Becker et al., 2014). In addition, the multivariate analysis might require prohibitively large groups.
As clinicians, we know that historically many discoveries in medicine were made by investigating accidents of nature such as androgen resistance. Applied to endometriosis, this suggests that the investigation of rare events and of outliers should become more important. Examples are endometriosis lesions growing in the absence of circulating estrogens after menopause (Asencio et al., 2018), deep endometriosis lesions progressing during pregnancy (Setubal et al., 2014) deep endometriosis lesions without pain, and the ‘strange’ endometriosis lesions occasionally seen during surgery. The latter comprise fast progressing lesions, highly proliferative deep endometriosis lesions, and cystic ovarian endometriosis with abundant ‘endometrium like’ tissue. For medical therapy it is suggested to investigate the extreme responses which varies from strong to no response.
Conclusions
In conclusion, the clinical, inflammatory, immunological, biochemical, histochemical and genetic-epigenetic heterogeneity of similar looking endometriosis lesions is a challenge for research, diagnosis and treatment of endometriosis. Traditional statistics which are based on homogeneous populations to calculate significances are inappropriate to detect hidden subgroups as recognised before (Farland et al., 2016).
As clinicians we suggest focussing investigation on the extremes and to exploit the clinically rare cases which might be informative as ‘accidents of nature’. This requires that the investigation of unpredictable rare events is organised through collaboration between surgeons and research groups of varying expertise.
Heterogeneity of endometriosis should also be reflected in publications with more Scatchard plots of individual data and their changes over time, instead of the limited information provided by means, standard deviations and P values.
Acknowledgements
We thank Sun-Wei Guo, Shanghai China for fruitful discussions on statistics.
Footnotes
Funding: No funding.
References
- 1.Baumgartner RN, Heymsfield SB, Roche AF. Human body composition and the epidemiology of chronic disease. Obes Res. 1995;3:73–95. doi: 10.1002/j.1550-8528.1995.tb00124.x. [DOI] [PubMed] [Google Scholar]
- 2.Chen WJ, Chung YC. Energy expenditure in patients with hepatocellular carcinoma. Cancer. 1994;73:590–595. doi: 10.1002/1097-0142(19940201)73:3<590::aid-cncr2820730315>3.0.co;2-7. [DOI] [PubMed] [Google Scholar]
- 3.Coutinho SR, Halset EH, Gasbakk S, et al. Compensatory mechanisms activiated with intermittent energy restriction: A randomized control trial. Clin Nutr. 2018;37:815–823. doi: 10.1016/j.clnu.2017.04.002. [DOI] [PubMed] [Google Scholar]
- 4.Demark-Wahnefried W, Peterson BL, Winer EP, et al. Changes in weight, body composition, and factors influencing energy balance among premenopausal breast cancer patients receiving adjuvant chemotherapy. J Clin Oncol. 2001;19:2381–2389. doi: 10.1200/JCO.2001.19.9.2381. [DOI] [PubMed] [Google Scholar]
- 5.Denlinger CS, Ligibel JA, Are M, et al. NCCN guidelines insights: Survivorship, Version 1.2016. J Natl Compr Canc Netw. 2016;14:715–724. doi: 10.6004/jnccn.2016.0073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Douglas CC, Lawrence JC, Bush NC, et al. Ability of the Harris Benedict formula to predict energy requirements differs with weight history and ethnicity. Nutr Res. 2007;27:194–199. doi: 10.1016/j.nutres.2007.01.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ferlay J, Soerjomataram I, Dikshit R, et al. Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2014;136:359–386. doi: 10.1002/ijc.29210. [DOI] [PubMed] [Google Scholar]
- 8.Frankenfield DC. Bias and accuracy of resting metabolic rate equations in non-obese and obese adults. Clin Nutr. 2013;32:976–982. doi: 10.1016/j.clnu.2013.03.022. [DOI] [PubMed] [Google Scholar]
- 9.Friesen DE, Baracos VE, Tuszynski JA. Modeling the energetic cost of cancer as a result of altered energy metabolism: implications for cachexia. Theor Biol Med Model. 2015;12:17. doi: 10.1186/s12976-015-0015-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Garcia-Peris P, Lozano MA, Velasco C, et al. Prospective study of resting energy expenditure changes in head and neck cancer patients treated with chemoradiotherapy measured by indirect calorimetry. Nutrition. 2005;21:1107–1112. doi: 10.1016/j.nut.2005.03.006. [DOI] [PubMed] [Google Scholar]
- 11.Gullett NP, Mazurak V, Hebbar G, et al. Nutritional interventions for cancer-induced cachexia. Curr Probl Cancer. 2011;35:58–90. doi: 10.1016/j.currproblcancer.2011.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Hall KD, Sacks G, Chandramohan D, et al. Quantification of the effect of energy imbalance on bodyweight. Lancet. 2011;378(9793):826–837. doi: 10.1016/S0140-6736(11)60812-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Haugen HA, Chan L, Li F. Indirect Calorimetry: A practical guide for clinicians. Nutr Clin Pract. 2007;22:377–388. doi: 10.1177/0115426507022004377. [DOI] [PubMed] [Google Scholar]
- 14.Heydenreich J, Kayser B, Schutz Y. Total energy expenditure, energy intake, and body composition in endurance athletes across the training season: A systematic review. Sports Med Open. 2017;3:8. doi: 10.1186/s40798-017-0076-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Irwin ML, McTiernan A, Baumgartner RN, et al. Changes in body fat and weight after a breast cancer diagnosis: Influence of demographic, prognostic and lifestyle factors. J Clin Oncol. 2005;23:774–782. doi: 10.1200/JCO.2005.04.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Juinot A, Vazeille C, Durand JP, et al. Resting energy expenditure in the risk assessment of anticancer treatments. Clin Nutr. 2018;37:558–565. doi: 10.1016/j.clnu.2017.01.007. [DOI] [PubMed] [Google Scholar]
- 17.Johnson G, Sallé A, Lorimier G, et al. Cancer cachexia: Measured and predicted resting energy expenditures for nutritional needs evaluation. Nutrition. 2008;24:443–450. doi: 10.1016/j.nut.2008.01.013. [DOI] [PubMed] [Google Scholar]
- 18.Lam YY, Ravussin E. Indirect calorimetry: an indispensable tool to understand and predict obesity. Eur J Clin Nutr. 2017;71:318–322. doi: 10.1038/ejcn.2016.220. [DOI] [PubMed] [Google Scholar]
- 19.Lauby-Secretan B, Scoccianti C, Loomis D, et al. Body fatness and cancer - Viewpoint of the IARC working group. N Engl J Med. 2016;375:794–798. doi: 10.1056/NEJMsr1606602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Lerebours E, Tilly H, Rimbert A, et al. Change in energy and protein status during chemotherapy in patients with acute leukemia. Cancer. 1988;61:2412–2417. doi: 10.1002/1097-0142(19880615)61:12<2412::aid-cncr2820611203>3.0.co;2-r. [DOI] [PubMed] [Google Scholar]
- 21.Mayne ST, Playdon MC, Rock CL. Diet, nutrition, and cancer: past, present and future. Nat Rev Clin Onc. 2016;13:504–515. doi: 10.1038/nrclinonc.2016.24. [DOI] [PubMed] [Google Scholar]
- 22.Mehta NM, Smallwood CD, Joosten KF. Accuracy of simplified equation for energy expenditure based on bedside volumetric carbon dioxide elimination measurement-a two-center study. Clin Nutr. 2015;34:151–155. doi: 10.1016/j.clnu.2014.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Müller MJ, Bosy-Westphal A, Later W, et al. Functional Body Composition: Insights into the regulation of energy metabolism and some clinical applications. Eur J Clin Nutr. 2009;63:1045–1056. doi: 10.1038/ejcn.2009.55. [DOI] [PubMed] [Google Scholar]
- 24.Nguyen T, Batterham M, Edwards C. Comparison of resting energy expenditure between cancer subjects and healthy controls: a meta-analysis. Nutr Cancer. 2016;68:374–387. doi: 10.1080/01635581.2016.1153667. [DOI] [PubMed] [Google Scholar]
- 25.Nicolini A, Ferrari P, Masoni MC, et al. Malnutrition, anorexia and cachexia in cancer patients: A mini-review on pathogenesis and treatment. Biomed Pharmacother. 2013;67:807–817. doi: 10.1016/j.biopha.2013.08.005. [DOI] [PubMed] [Google Scholar]
- 26.Pirat A, Tucker AM, Taylor KA, et al. Coparison of measured versus predicted energy requirements in critically ill cancer patients. Respir Care. 2009;54:487–494. [PubMed] [Google Scholar]
- 27.Purcell SA, Eliott SA, Baracos VE, et al. Key determinants of energy expenditure in cancer and implications for clinical practice. Eur J Clin Nutr. 2016;70:1230–1238. doi: 10.1038/ejcn.2016.96. [DOI] [PubMed] [Google Scholar]
- 28.Reeves M, Battistutta D, Capra S, et al. Resting energy expenditure in patients with solid tumors undergoing anticancer therapy. J Nutr. 2006;22:609–615. doi: 10.1016/j.nut.2006.03.006. [DOI] [PubMed] [Google Scholar]
- 29.Rock CL, Doyle C, Demark-Wahnefried W, et al. Nutrition and physical activity guidelines for cancer survivors. CA Cancer J Clin. 2012;62:243–274. doi: 10.3322/caac.21142. [DOI] [PubMed] [Google Scholar]
- 30.Russell DM, Shike M, Marliss EB, et al. Effects of total perenteral nutrition and chemotherapy on the metabolic derangements in small cell lung cancer. Cancer research. 1984;44:1706–1711. [PubMed] [Google Scholar]
- 31.Rusu RA, Sîrbu D, Curseu D, et al. Chemotherapy-related infectious complications in patients with hematologic malignancies. J Res Med Sci. 2018;23:68. doi: 10.4103/jrms.JRMS_960_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Schoffelen PFM. Measurement of human energy expenditure: Biological variability and technical validity Datawyse - Universitaire Pers Maastricht, 2017. [Google Scholar]
- 33.Sheng JY, Sharma D, Jerome G, et al. Obese breast cancer patients and survivors: Management considerations. Oncology. 2018;32:410–417. [PMC free article] [PubMed] [Google Scholar]
- 34. Tan SY, Turner J, Kerin-Ayres K, et al. Health concerns of cancer survivors after primary anti-cancer treatment Support Care Cancer 2019. [Epub ahead of print] [DOI] [PubMed] [Google Scholar]
- 35.Tonorezos ES, Jones LW. Energy balance and metabolism after cancer treatment. Semin Oncol. 2013;40:745–756. doi: 10.1053/j.seminoncol.2013.09.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Torre LA, Siegel RL, Ward EM, et al. Global Cancer Incidence and Mortality Rates and Trends - An update. Cancer Epidemiol Biomarkers Prev. 2016;25:16–27. doi: 10.1158/1055-9965.EPI-15-0578. [DOI] [PubMed] [Google Scholar]
- 37.Tsai S. Importance of lean body mass in the oncologic patient. Nutr Clin Pract. 2012;27:593–598. doi: 10.1177/0884533612457949. [DOI] [PubMed] [Google Scholar]
- 38.Vineis P, Wild CP. Global cancer patterns: causes and prevention. Lancet. 2014;383:549–557. doi: 10.1016/S0140-6736(13)62224-2. [DOI] [PubMed] [Google Scholar]
- 39.Vyas D, Laput G, Vyas A. Chemotherapy-enhanced inflammation may lead to the failure of therapy and metastasis. Onco Targets Ther. 2014;7:1015–1023. doi: 10.2147/OTT.S60114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Westerterp KR. Exercise, energy expenditure and energy balance, as measured with doubly labelled water. Proc Nutr Soc. 2018;77:4–10. doi: 10.1017/S0029665117001148. [DOI] [PubMed] [Google Scholar]