Abstract
STUDY QUESTION:
Do recent changes in European Society of Human Reproduction and Embryology (ESHRE) clinical guidelines result in more comprehensive diagnosis of women with endometriosis?
SUMMARY ANSWER:
The latest shift in clinical guidelines results in diagnosis of more women with endometriosis but current ESHRE diagnostic criteria do not capture a sizable percentage of women with the disease.
WHAT IS KNOWN ALREADY:
Historically, laparoscopy was the gold standard for diagnosing endometriosis, a complex gynecological condition marked by a heterogeneous set of symptoms that vary widely among women. More recently, changes in clinical guidelines have shifted to incorporate imaging-based approaches such as transvaginal sonography and magnetic resonance imaging.
STUDY DESIGN, SIZE, DURATION:
Retrospective, observational cohort study of women aged 15–49 years diagnosed with endometriosis in the United States (US) between January 1, 2013, and December 31, 2023.
PARTICIPANTS/MATERIALS, SETTING, METHODS:
Data sources include US insurance claims data from the Merative™ MarketScan® Commercial Database (CCAE), Merative™ MarketScan® Multi-State Medicaid Database (MDCD), Optum® de-identified Electronic Health Record dataset (Optum® EHR), and electronic health record (EHR) data from a large academic medical center in New York City (CUIMC EHR). To examine the potential impact of expanding clinical criteria for the diagnosis of endometriosis, we validated and compared five cohort definitions based on different sets of diagnostic guidelines involving combinations of surgical confirmation, diagnostic imaging, guideline-recognized symptoms, and other symptoms commonly reported among women with endometriosis. We performed pairwise comparisons between cohorts and applied Bonferroni corrections to account for multiple comparisons.
MAIN RESULTS AND THE ROLE OF CHANCE:
We identified 491,048 women with a diagnosis of endometriosis across the CCAE, MDCD, Optum EHR, and CUIMC EHR datasets. Each cohort definition demonstrated strong positive predictive value (0.84–0.96), yet only 15–20% of cases were identified by all 5 cohort definitions. Women diagnosed with endometriosis based on imaging and symptoms were three years younger, on average, than women with a diagnosis based on surgical confirmation (mean age = 35 years [SD = 9] vs 38 years [SD = 8]; p<0.001). Women in cohorts based only on symptoms were two years younger than those based on surgery (36 years [SD = 8] vs 38 years [SD = 8]; p<0.001). More than one-fourth of cases presented with endometriosis-related symptoms but lacked surgical or imaging-related documentation required by ESHRE guideline criteria. Pain was reported among nearly all women with endometriosis. Abdominal pain and pain in the pelvis were the most prevalent (ranging from 69% to 90% of women in each cohort). Among approximately 2–5% of all endometriosis cases (14,795 total), women presented with pelvic and/or abdominal pain but none of the other symptoms noted in clinical guidelines.
LIMITATIONS, REASONS FOR CAUTION:
Our study has potential biases associated with documentation practices and secondary data use of insurance claims and EHR data. Further, the phenotyping algorithms used rely on clinical codes that do not necessarily capture all ESHRE diagnostic criteria for endometriosis and may not be generalizable to women with atypical presentation of endometriosis.
WIDER IMPLICATIONS OF THE FINDINGS:
High positive predictive value among all five cohort definitions despite poor overlap among cases identified illustrates both the heterogeneous presentation of the disease and importance of expanding diagnostic criteria. For example, cohorts derived from updated guidelines identified younger patients at time of diagnosis. Women diagnosed based on imaging had higher rates of emergency room visits while patients diagnosed via laparoscopy had a larger number of hospitalizations. The substantial number of cases with pelvic and/or abdominal pain but none of the other symptoms noted in clinical guidelines underscores the continued need for improved access to timely and appropriate care, particularly among those with non-classical symptoms, different care-seeking patterns, or lack of available surgical intervention.
Keywords: endometriosis, clinical guidelines, diagnosis, laparoscopy, imaging
INTRODUCTION
Endometriosis is a chronic gynecological condition characterized by the growth of endometrial tissue outside of the uterus.1,2 Marked by a heterogeneous set of symptoms that vary widely among women, the complex disorder can impact a range of body systems and often involves chronic pain, dysmenorrhea, dyspareunia, dysuria, and fatigue. Half of women with infertility are diagnosed with endometriosis.1,2 Given the enigmatic nature of the disease and high likelihood for underdiagnosis, estimates of prevalence can vary widely. Nonetheless, the statistic most often cited is that 10% of women have endometriosis.3
Historically, laparoscopy was the gold standard for diagnosing endometriosis.4 While effective in confirming the presence of the disease, laparoscopy poses potential risks and is not always preferred by patients. The correlation between the extent of surgical findings and severity of symptoms also remains complex, underscoring the need for a comprehensive diagnostic strategy. Additionally, there is growing concern that emphasis on laparoscopy contributes to delays and underdiagnosis, particularly in cases where surgical intervention is not feasible or not covered by insurance. Notably, the average delay between disease onset and formal diagnosis of endometriosis is considered to be between four and eleven years.5–7
In 2022 the European Society of Human Reproduction and Embryology (ESHRE) shifted its clinical guidelines regarding endometriosis toward a more multimodal approach to diagnosis, emphasizing assessment of indicative symptoms and the use of diagnostic imaging such as transvaginal sonography (TVS) and magnetic resonance imaging (MRI) as a complement to laparoscopic confirmation.8,9 The shift in clinical guidelines acknowledges high variability in diagnosing endometriosis and aims to enhance accuracy and expedite diagnosis.
Given the potential for reducing delayed and underdiagnosis, the rise of new guidelines also suggests prior characterizations may not accurately reflect the full composition, care patterns, and spectrum of experiences associated with endometriosis, especially prior to receipt of a formal diagnosis. It is not yet clear how the expansion of diagnostic criteria will impact the composition of women diagnosed with the disorder. Moreover, these new guidelines may still not reflect the breadth of symptoms commonly experienced by women with endometriosis. Importantly, it is critical to investigate how such changes and considerations are likely to influence future observational health research given the impact on both clinical practice and documentation of care.
In this study, we sought to examine differences among women diagnosed with endometriosis, including their clinical histories and demographics. Specifically, we compared five cohort definitions based on different sets of diagnostic criteria involving combinations of surgical confirmation, diagnostic imaging, guideline-recognized symptoms, and other symptoms commonly reported among women with endometriosis.
MATERIALS AND METHODS
Study design, setting, and population
We performed a retrospective, observational cohort study of women in the United States (US) aged 15–49 years with a diagnosis date of endometriosis between January 1, 2013 and December 31, 2023. This study was approved by the institutional review board of Columbia University Irving Medical Center (Protocol AAAO7805) and reporting follows the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline.
Data sources
Our data sources included US insurance claims from the Merative™ MarketScan® Commercial Database (CCAE) and Merative™ MarketScan® Multi-State Medicaid (MDCD) databases as well as administrative and electronic health record (EHR) data from Optum® de-identified EHR (Optum® EHR) and Columbia University Irving Medical Center (CUIMC) databases. To standardize the data, each de-identified dataset was transformed to the Observational Health Data Sciences and Informatics (OHDSI) Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM).10,11
The CCAE dataset includes health insurance claims across the care continuum (i.e., inpatient, outpatient, outpatient pharmacy, and carve-out behavioral healthcare) as well as enrollment data from large employers and health plans across the US who provide private healthcare coverage for more than 170 million employees, their spouses, and dependents. This administrative claims database includes a variety of fee-for-service, preferred provider organizations, and capitated health plans.
The MDCD dataset reflects the healthcare service use of more than 35 million individuals covered by Medicaid programs in numerous geographically dispersed states. The database contains the pooled healthcare experience of Medicaid enrollees, covered under fee-for-service and managed care plans. It includes records of inpatient services, inpatient admissions, outpatient services, and prescription drug claims, as well as information on long-term care.
The Optum® EHR dataset contains clinical, claims, and other administrative data on more than 111 million patients from more than 111,000 sites of care spanning dozens of healthcare provider organizations across the US. Data are obtained from inpatient and ambulatory EHRs, practice management systems, and other internal systems. Data elements include demographics, prescribed and administered medications, immunizations, allergies, laboratory results, vital signs and other observable measurements, clinical and inpatient stay administrative data and coded diagnoses and procedures.
The CUIMC EHR dataset comprises 6.7 million patients with data collection starting in 1985. CUIMC is a quaternary care center in the northeast U.S. with primary care practices in northern Manhattan and surrounding areas. The CUIMC database currently holds information about patient demographics, conditions, symptoms and other observations, laboratory and vital sign measurements, medications, medical devices, and both inpatient and outpatient encounters.
Cohort definitions
Based on a combination of coded diagnoses, observations, procedures, and measurements, we constructed five different cohorts — (i) women who received a diagnosis of endometriosis based on surgical confirmation (Cohort A); (ii) women who received a diagnosis of endometriosis based on a combination of diagnostic imaging and presentation of guideline-recognized endometriosis symptoms (Cohort B); (iii) women who received a diagnosis of endometriosis and presented with guideline-recognized endometriosis symptoms, regardless of whether diagnostic imaging was performed (Cohort C); (iv) women who received a diagnosis of endometriosis and presented with guideline-recognized endometriosis symptoms and/or pelvic pain (Cohort D); and (v) women who received a diagnosis of endometriosis and presented with guideline-recognized endometriosis symptoms, pelvic pain, and/or abdominal pain (Cohort E). For each cohort, we restricted our analysis to participants with at least one year of continuous observation prior to cohort entry to ensure we capture incident events. Each cohort definition was translated into a phenotype,12 a computable algorithm incorporating temporal logic, to query the CCAE, MDCD, Optum® EHR and CUIMC databases.
Women with endometriosis diagnosis based on surgery
For Cohort A, women with an endometriosis-related surgical procedure (e.g., laparoscopic surgery), we required an accompanying endometriosis diagnosis within 30 days of the procedure. For this group, aligning with previous guidelines, the date of cohort entry was the date of surgery.
Women with endometriosis diagnosis based on imaging and guideline-recognized symptoms
Based on the updated diagnosis guidelines, our definition for Cohort B, women with an endometriosis diagnosis based on imaging required the occurrence of (i) at least one medical imaging code (e.g., transvaginal ultrasound); (ii) at least two endometriosis diagnosis codes on the date of or following imaging; (iii) at least one code for dysmenorrhea, dyspareunia, or dysuria prior to diagnosis; and (iv) at least one other code for an endometriosis-related symptom prior to diagnosis, including additional symptoms such as constipation and cough to account for episodes of dyschezia and cyclical cough, respectively, which are known indications of endometriosis. Due to data limitations, more granular symptom descriptors were not available in the source data. Additionally, cyclical scar swelling and pain was the only symptom from the updated guidelines without an associated code in the source data and thus not included in the phenotype. For this group, the date of cohort entry was the date of diagnosis.
Women with endometriosis diagnosis based only on symptoms
For women who received a diagnosis of endometriosis and presented with endometriosis-related symptoms, we created three cohorts by successively expanding the number of potential symptoms included. For Cohort C, we required the occurrence of (i) at least two endometriosis diagnosis codes; (ii) at least one code for dysmenorrhea, dyspareunia, or dysuria prior to diagnosis; and (iii) at least one other code for an endometriosis-related symptom recognized in the clinical guidelines prior to diagnosis. For Cohort D, we required the same criteria as Cohort C but included pelvic pain. Cohort E builds upon Cohort D further by including abdominal pain.
We chose to include Cohorts D and E in our analysis based on patient-reported outcomes compiled via the Phendo mobile app (https://citizenendo.org/phendo/). Phendo is a research-oriented app that has 17,000+ users across the world who submit information about their experiences with endometriosis. Approximately 60% of Phendo users report experiencing chronic pelvic pain and/or abdominal pain.
To validate and compare the relative performance of our five endometriosis cohort definitions, two physicians specializing in gynecology (MNA, SG) independently conducted a detailed chart review of CUIMC EHRs for a sample of patients. Full details regarding phenotype evaluation are provided in Supplementary Materials. In summary, all five cohort definitions achieved high levels of positive predictive value (PPV range: 0.84–0.96) but there was poor concordance among the patients identified in each cohort. Complete agreement among all five cohort definitions was only found among 16% of cases (Fleiss’ kappa = 0.13).
Outcomes and variables
The primary outcomes of interest were the age at diagnosis, the number and proportion of patients shared among and unique to each cohort, and the prevalence of conditions, medications, and procedures documented prior to receipt of an endometriosis diagnosis. We standardized medications based on their anatomical therapeutic chemical (ATC) level three classification. Secondary outcomes included measures of healthcare utilization including the number of clinical encounters and emergency department visits and/or inpatient hospitalizations occurring before diagnosis. Among participants identified by multiple cohort definitions, we also assessed differences in their date of entry to each cohort.
Statistical analysis
We calculated descriptive statistics using count, percentage, mean, median, standard deviation, and interquartile range (IQR). We performed pairwise comparisons of proportion between cohorts using Chi-squared tests, then applied Bonferroni corrections to account for multiple comparisons. To compare means, we used z-tests. We conducted statistical analyses using the R programming environment, version 4.2.3 (R Foundation for Statistical Computing, Vienna, Austria).
RESULTS
Participant Characteristics
During the review period, we identified 491,048 women with a diagnosis of endometriosis across the CCAE (N=236,594), MDCD (N=70,426), Optum® EHR (N=181,743), and CUIMC EHR (N=2,285) datasets (Figure S1). Across the four databases, participants ranged in age from 15–19 years old in 2–3% of cases, 20–24 years in 5–9%, 25–29 years in 10–14%, 30–34 years in 15–19%, 35–39 years in 20–22%, 40–44 years in 20–25%, and 45–49 years old in 14–23% of cases (Table 1, Tables S1–S3). Women were identified as 1% Asian, 7–8% Black or African American, and 37–40% white depending on the data source; 52–55% were of unknown race and 3% were of Hispanic or Latina ethnicity. The CCAE dataset did not provide race or ethnicity data.
Table 1.
Participant Characteristics, Optum EHR Dataset
| Characteristic | Cohort A (N = 100,697) |
Cohort B (N=48,241) |
Cohort C (N = 128,879) |
Cohort D (N = 133,819) |
Cohort E (N = 139,368) |
|---|---|---|---|---|---|
| Age Group | |||||
| 15–19 years | 1,290 (1.3%) | 1,169 (2.4%) | 2,827 (2.2%) | 2,937 (2.2%) | 3,023 (2.2%) |
| 20–24 years | 5,051 (5.0%) | 4,242 (8.8%) | 9,568 (7.4%) | 10,024 (7.5%) | 10,362 (7.4%) |
| 25–29 years | 9,785 (9.7%) | 7,239 (15%) | 16,600 (13%) | 17,397 (13%) | 18,028 (13%) |
| 30–34 years | 15,720 (16%) | 9,504 (20%) | 23,381 (18%) | 24,276 (18%) | 25,120 (18%) |
| 35–39 years | 20,619 (20%) | 10,006 (21%) | 27,294 (21%) | 28,391 (21%) | 29,546 (21%) |
| 40–44 years | 24,973 (25%) | 9,376 (19%) | 27,549 (21%) | 28,459 (21%) | 29,784 (21%) |
| 45–49 years | 23,259 (23%) | 6,705 (14%) | 21,660 (17%) | 22,335 (17%) | 23,505 (17%) |
| Race | |||||
| Asian | 1,976 (2.0%) | 866 (1.8%) | 2,155 (1.7%) | 2,246 (1.7%) | 2,370 (1.7%) |
| Black / African American | 11,231 (11%) | 5,726 (12%) | 14,875 (12%) | 15,308 (11%) | 15,866 (11%) |
| White | 81,420 (81%) | 38,597 (80%) | 103,353 (80%) | 107,365 (80%) | 111,729 (80%) |
| Unknown | 6,070 (6.0%) | 3,052 (6.3%) | 8,496 (6.6%) | 8,900 (6.7%) | 9,403 (6.7%) |
| Ethnicity | |||||
| Hispanic / Latina | 6,460 (6.4%) | 3,403 (7.1%) | 8,520 (6.6%) | 8,810 (6.6%) | 9,114 (6.5%) |
| Not Hispanic / Latina | 87,584 (87%) | 41,713 (86%) | 111,929 (87%) | 116,076 (87%) | 120,767 (87%) |
| Unknown | 6,653 (6.6%) | 3,125 (6.5%) | 8,430 (6.5%) | 8,933 (6.7%) | 9,487 (6.8%) |
Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort C: Guideline-recognized symptoms only phenotype; Cohort D: Guideline-recognized symptoms and/or pelvic pain phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. EHR: electronic health record.
Cohort Characteristics
In total, phenotyping approaches identified 278,971 women with endometriosis in Cohort A, 157,959 in Cohort B, 363,049 in Cohort C, 373,201 in Cohort D, and 377,036 in Cohort E (Figure S1). A sizable proportion of women (15–20% of endometriosis cases) were identified across all 5 cohorts regardless of phenotype definition (Figure 1, Table S4). More than one-fourth (26–30%) were represented in symptom-only Cohorts C-E but not in Cohorts A and B (Table S4). We also note that 2–4.6% of cases (14,795 women total) showed only pelvic and/or abdominal pain but not other symptoms noted in clinical guidelines (Table S4). Largely, our findings are consistent across each dataset. In the interest of brevity, remaining findings presented in the main text are from our largest EHR dataset (Optum® EHR). Additional tables and figures, including those based on data from other sources, are provided as Supplemental Materials (Tables S1–S11, Figures S2–S22).
Figure 1a-d. Patient Set Overlap Among Study Cohorts in Optum EHR Dataset.
a) UpSet plot illustrating intersections among patients identified across all cohorts. b) Venn diagram of patients in Cohorts A, B, and C. c) Venn diagram of patients in Cohorts A, D, and E. d) Venn diagram of patients in Cohorts C, D, and E. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort C: Guideline-recognized symptoms only phenotype; Cohort D: Guideline-recognized symptoms and/or pelvic pain phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviations: EHR, Electronic Health Record.
Timing of Diagnosis by Cohort
Age at Diagnosis
Women with a diagnosis of endometriosis based on surgical confirmation (Cohort A) were older at time of diagnosis (mean age = 38 years, SD = 8) compared to women diagnosed based on imaging and symptoms (Cohort B mean age = 35, SD = 9; p<0.001, Figure 2b). We found a similar trend when comparing age at diagnosis between Cohort A and Cohorts C-E (mean age = 36, average SD = 8) with a mean age difference of 2 years (p<0.001 for all comparisons). This pattern was consistent across all four data sources (Figure 2, Figures S5–S7).
Figure 2a-d. Age at Diagnosis of Endometriosis in the Optum EHR Dataset.
On average, women in Cohort A were diagnosed with endometriosis at an older age than women in Cohorts B-E (mean age difference Cohort A vs Cohorts C-E = 2 years; p<0.001 for all comparisons). a) Age at diagnosis among patients in Cohorts A and B. b) Age at diagnosis among patients in Cohorts A and C. c) Age at diagnosis among patients in Cohorts A and D. d) Age at diagnosis among patients in Cohorts A and E. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort C: Guideline-recognized symptoms only phenotype; Cohort D: Guideline-recognized symptoms and/or pelvic pain phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviations: EHR, Electronic Health Record.
Delay in Diagnosis
Among women identified with endometriosis, we also compared their date of entry into Cohort A with date of entry into Cohorts B-E (Figure 3, Figures S8–S10). For most women, there was little to no difference in date of cohort entry between Cohort A and Cohort B (median difference = 0 days; IQR = 0–45 days). Similarly, we found almost no difference between entry into Cohort A and Cohorts C-E (median difference = 0 days for all, IQR = 0–15 days for Cohort C, 0–14 days for Cohort D, and 0–13 days for Cohort E).
Figure 3a-d. Differences in Cohort Entry Dates in the Optum EHR Dataset.
Among most women identified by more than one phenotype definition, there was little to no difference in date of cohort entry (e.g., median difference in entry date between Cohort A and B = 0 days, interquartile range [IQR] = 0–45 days). a) Differences in cohort entry dates among patients identified by both cohort definitions A and B. b) Differences in cohort entry dates among patients identified by both cohort definitions A and C. c) Differences in cohort entry dates among patients identified by both cohort definitions A and D. d) Differences in cohort entry dates among patients identified by cohort definitions A and E. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort C: Guideline-recognized symptoms only phenotype; Cohort D: Guideline-recognized symptoms and/or pelvic pain phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviations: EHR, Electronic Health Record.
Clinical Histories by Cohort
Conditions and Symptoms
The top 25 conditions with the greatest prevalence difference between Cohort A and Cohort B and between Cohort A and Cohort E are shown in Figure 4a–b (see Figures S11–S14 for comparisons between Cohort A and Cohorts C and D). The most common symptom experienced by women prior to receipt of an endometriosis diagnosis was pain. Pain was reported among 91% of women in Cohort A and 100% of women in Cohorts B-E. Among all five cohorts, localized pain was most frequently reported as abdominal pain and pain in the pelvis with prevalence ranging from 69% to 70% of women in Cohort A compared to 83% to 90% in Cohorts B-E.
Figure 4a-b. Condition Concepts in the Optum EHR Dataset with the Largest Differences in Prevalence Between Endometriosis Cohorts Based on Surgical Diagnosis (Cohort A) and Imaging and/or Symptoms-based Diagnosis (Cohorts B and E).
Compared to Cohort A, localized pain (e.g., abdominal, pelvic, genitourinary), dysmenorrhea, and dysuria were consistently more common in Cohorts B and E. Lesions, masses, and neoplasms (e.g., abdominal, pelvic, uterine) were more common in Cohort A. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviation: EHR: electronic health record.
Genitourinary pain (43% vs 68–69%), pain in female genitalia (43% vs 67–68%), and pain of uterus (42% vs 67–68%) were also more commonly reported among patients identified based on imaging and/or symptom presentation (Cohorts B-E). We also found that urinary tract pain was documented more than twice as much among women in Cohorts B-E (36–45% of women) as Cohort A (18%). Condition codes for infectious disease of genitourinary system (30% in Cohort A, 49% in Cohort B, 39–41% in Cohorts C-E) and urinary tract infectious disease (22% in Cohort A, 39% in Cohort B, 31–32% in Cohorts C-E) were also more frequently reported in cohorts based on imaging and/or symptoms.
Similarly, we found substantial documentation of dysuria (17% in Cohort A, 37%–44% in Cohorts B through E) and dysmenorrhea (42% of patients in Cohort A, 67%–68% in Cohorts B-E) in these cohorts. Dyspareunia was recorded in nearly one-sixth to one-fourth of cases (16% in Cohort A, 24–27% in Cohorts B-E) and fatigue in one-sixth to one-fifth of cases (15% in Cohort A, 18–22% in Cohorts B-E). The non-specific diagnosis of acute inflammatory disease was also more common among these cohorts (42% vs 49–57%) as were conditions not traditionally associated with endometriosis such as inflammatory disorder of the respiratory system (46% vs 53–61%) and acute respiratory disease (41% vs 48–56%).
In contrast, we found more frequent documentation of lesions, masses, and neoplasms in Cohort A compared to Cohorts B-E. For example, lesions of the genitalia (prevalence range: 73–90%), ovary (46–59%), and uterus (50–68%), abdominal mass (61–78%), mass of urogenital structure (61–78%), pelvic mass (60–77%), and mass of uterus (33–49%) were more commonly identified among women diagnosed by surgical confirmation (Cohort A) than the other phenotype definitions (Cohorts B-E). We also noted significant differences between neoplasms of the abdomen (33–49%), female genital organs (31–47%), intra-abdominal organs (32–49%), uterus (29–44%), and pelvis (31–48%). Reporting of peritoneal adhesions was twice as common in Cohort A (32%) compared to Cohorts B-E (16–18%).
Medications
The top 25 medications with the greatest prevalence difference between Cohort A and Cohorts B through E are shown in Figure 5 and Figures S15–S18. Among treatments recommended by the ESHRE guidelines for endometriosis-related symptoms, women in Cohorts B-E were significantly more likely to receive hormones and related agents (44% in Cohort A, 61% in Cohort B, 50–51% in Cohorts C-E), including hormonal contraceptives for systemic use (50% in Cohort A, 67% in Cohort B, 56–57% in Cohorts C-E), compared to women in Cohort A. We also found that opioids had high levels of utilization among all cohorts but were most common among women in Cohort A (96% in Cohort A, 82% in Cohort B, 77–78% in Cohorts C-E). The use of antiemetics and antinauseants (71–93%), antipruritics (68–88%), antacids (62–89%), and corticosteroids (70–87%) were also high overall and highest in Cohort A. Antidiarrheal microorganisms (67–90%), other antidiarrheals (57–87%), and urologicals (62–88%) were also most prevalent among women in Cohort A.
Figure 5a-b. Medication Concepts in the Optum EHR Dataset with the Largest Differences in Prevalence Between Endometriosis Cohorts Based on Surgical Diagnosis (Cohort A) and Imaging and/or Symptoms-based Diagnosis (Cohorts B and E).
Nonsteroidal anti-inflammatory and antirheumatics, other analgesics, corticosteroids, and drugs for gastrointestinal disorders were more common in Cohort A. Hormones, antidepressants, anxiolytics, and antibacterials were more common in Cohorts B and E. *Denotes medications included among ESHRE treatment endometriosis guidelines. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviation: EHR: electronic health record.
Procedures
Notably, routine gynecologic examination was only recorded in slightly more than one-third of patients (34% in Cohort A, 44% in Cohort B, and 35–36% in Cohorts C-E). The top procedures with the greatest prevalence difference between cohorts are illustrated in Figure 6 and Figures S19–S22. We found that women with a diagnosis of endometriosis based on surgical confirmation (Cohort A) were more likely to have received laparoscopy with fulguration or excision of lesions of the lower abdomen (38% vs 15–21%), laparoscopy with total hysterectomy for uterus 250g or less (30% vs 7–9%), and surgical hysteroscopy with biopsy of endometrium (12% vs 7–8%). We also note that surgical pathology with microscopic evaluation was performed more than twice as often in Cohort A (48% in Cohort A, 16% in Cohort B, and 21% in Cohorts C-E).
Figure 6a-b. Procedure Concepts in the Optum EHR Dataset with the Largest Differences in Prevalence Between Endometriosis Cohorts Based on Surgical Diagnosis (Cohort A) and Imaging and/or Symptoms-based Diagnosis (Cohorts B and E).
Among differences found, women with a diagnosis of endometriosis based on surgical confirmation (Cohort A) were more likely to have received laparoscopy with total hysterectomy or surgical pathology with microscopic evaluation. Cohort A: Surgical confirmation phenotype; Cohort B: Imaging and guideline-recognized symptoms phenotype; Cohort E: Guideline-recognized symptoms, pelvic pain, and/or abdominal pain phenotype. Abbreviation: EHR: electronic health record.
Transvaginal ultrasound was performed the most among procedures conducted, especially among patients in Cohort B (60% in Cohort A, 84% in Cohort B, and 53–55% in Cohorts C-E). Non-obstetric pelvic ultrasound was conducted for slightly more than one-half of patients in Cohort B but only roughly one-third in other cohorts (39% in Cohort A, 56% in Cohort B, and 37% in Cohorts C-E). We found that abdominal ultrasound was performed infrequently though most often among patients in Cohort B (5% in Cohort A, 9% in Cohort B, 6% in Cohorts C-E). Therapeutic, prophylactic, or diagnostic intravenous injection was also more common in Cohort B than all other cohorts (40% vs 31–32%).
Healthcare Utilization
Before receiving an endometriosis diagnosis, nearly all participants in each cohort had at least one outpatient visit (Tables S8–S11). Compared to women diagnosed with endometriosis based on surgical confirmation, more women diagnosed based on imaging and symptom presentation had emergency room (ER) visits (41% of women in Cohort B vs 30% in Cohort A, p<0.001). They also used the ER with greater frequency prior to diagnosis (mean number of ER visits = 1.4, SD = 4.3 in Cohort B vs mean of 0.8 ER visits, SD=3.2 in Cohort A; p<0.001). While nearly half of women (45%) in Cohort A had at least one hospitalization prior to diagnosis (mean of 0.6 visits, SD=1.1), this was the case for only one-fourth (26%) in Cohort B (mean of 0.4 visits, SD=1.8). Similar trends held when comparing Cohorts C-E to Cohort A and across all datasets. Notably, women in the MDCD dataset had consistently higher levels of healthcare utilization overall.
DISCUSSION
Our study of four large national insurance claims and EHR databases characterized differences in clinical histories and demographics for nearly half a million women diagnosed with endometriosis in the US. Findings from our analysis suggest that the latest shift in clinical guidelines results in more comprehensive diagnosis of women with the disease, but updated ESHRE diagnostic criteria still do not capture a sizable percentage of women with endometriosis. Most notably, despite using phenotypes with high levels of precision (PPV), only 15–20% of all endometriosis cases were shared among all five cohorts. This illustrates both the heterogeneous presentation of the disease as well as the importance of expanding the criteria used for diagnosis.
Our analysis focuses on comparison of cohorts based on five complementary phenotype definitions, two of which operationalize the original and updated diagnostic criteria delineated in the ESHRE clinical guidelines (Cohorts A and B, respectively). Importantly, the most recent ESHRE guideline asserts that, while imaging via ultrasound or MRI are recommended in a diagnostic work-up, a negative finding does not necessarily rule out endometriosis as a potential diagnosis.9,14–18 In light of this, we took a data-driven approach that identified a substantial cohort of patients whose literal pain would have been ignored by either cohort definition. This manifested as three additional symptom-only cohorts based on phenotype definitions that first built upon the current guideline by incorporating only ESHRE-recognized symptoms (Cohort C) with successive expansion to include either one or both of the two most commonly reported symptoms of endometriosis – pelvic pain and/or abdominal pain (Cohorts D and E, respectively).
Importantly, cohorts derived from the newer guidelines and its expanded iterations identified patients who were younger at the time of diagnosis. Given that the disease is suspected to be congenital and prior studies suggest a diagnostic delay of four to eleven years from first symptom onset, this finding is not inconsiderable. While the new guidelines were only released a short time ago, this also nonetheless illustrates substantial room for improvement. Further demonstrating this is our comparison of differences in the timing of cohort entry. We found little-to-no difference in entry date between symptom cohorts, with some indication that entry to the surgical cohort skewed slightly toward later dates, representing a diagnostic delay. Additionally, the racial and ethnic makeups of patients identified under the new guidelines were largely unchanged, though notably women who identified as African American or Black routinely represented a quarter of patients in each cohort segment in the Medicaid dataset while only comprising 15% of the US population of women.
In light of its heterogenous presentation, flexible guidelines are especially necessary to prevent under- and delayed diagnosis and any potential disparities that may have arisen in the past by maintaining surgical confirmation as a strict requirement.13 Given the complexity of endometriosis, it is also paramount that as additional evidence is generated, novel insights are further incorporated into clinical practice. This transformation also has important implications for how observational health research is conducted. Changes in clinical documentation will require updating existing approaches to identify cohorts of patients with endometriosis and those cohort definitions, if not rigorously examined, may in turn result in skewed characterizations of women with the disease.
We found substantial differences in the prevalence of conditions, medications, and procedures associated with patients in each cohort. Primarily these significant differences were between Cohort A and all the other cohorts. Nonetheless, despite the similarities in composition of Cohorts B-E, there were still many women not represented under the new guidelines. Our investigation found that nearly one-fourth of cases were consistently identified only when using the symptom-based phenotypes (Cohorts C-E), suggesting that imposing surgery or imaging-related constraints to diagnosis may miss a substantial portion of women with endometriosis. Further, a small but sizable percentage of women (nearly 15,000 cases) presented with only pelvic and/or abdominal pain and none of the other guideline-recognized symptoms.
Among conditions for which there was significant difference between Cohort A and Cohorts B-E, we noted that urinary tract pain was both commonly documented among women in Cohorts B-E and at rates more than twice that of women in Cohort A. Additionally, condition codes for infectious disease of genitourinary system and urinary tract infectious disease were much more frequently reported in Cohorts B-E. While we cannot be certain based on available data, one potential hypothesis is that when women present with urogenital pain, in the absence of surgical, imaging, or laboratory test confirmation, clinicians may first suspect urinary tract infection instead of endometriosis, resulting in diagnostic delay.
Our analysis also revealed differences in patterns of healthcare utilization among women diagnosed with endometriosis. For example, we observed higher rates of ER visits among women in cohorts based on imaging and/or symptom presentation compared to surgical confirmation. These findings underscore the continued need for improved access to timely and appropriate care for women with endometriosis, particularly those with non-classical symptoms, different care-seeking preferences, or those lacking access to surgical intervention.
Limitations
While our study provides valuable insights regarding the clinical characteristics of endometriosis among women in the US, we recognize several limitations that should be acknowledged. First, our retrospective observational study design inherently limits our ability to establish causality. As secondary data sources, insurance claims and EHR data also introduce potential biases and inaccuracies inherent to administrative data coding and documentation practices. Second, while we largely evaluate differences among cohorts within each data source separately to preserve internal consistency, there is non-zero possibility that a woman represented in one data source may also be represented in another and we do not account for potential correlation. Third, while we did not detect any statistically significant differences in race or ethnicity between cohorts, there were a large percentage of women of unknown race or ethnicity. Fourth, our phenotyping algorithms rely on condition, observation, and procedure codes that did not necessarily capture the full spectrum of diagnostic criteria noted in the ESHRE guidelines (i.e., dyschezia, cyclical cough, and cyclical scar swelling and pain). Further, algorithmic performance may also differ across healthcare settings and populations. Fifth, by design, our inclusion criteria for each cohort were based on specific combinations of diagnostic criteria and may limit the generalizability of our findings to all women with endometriosis, particularly among those with atypical presentations. Lastly, each of our phenotypes required diagnosis codes for endometriosis. Our approach likely underestimates the true prevalence of endometriosis, as the condition is known to be underdiagnosed and underreported in clinical practice.
Conclusion
Our study provides novel insights into the complex interplay between diagnostic criteria, clinical characteristics, and healthcare utilization patterns among women diagnosed with endometriosis in the US. By elucidating these relationships, our findings contribute to a deeper understanding of the heterogeneity of endometriosis and underscore the importance of personalized approaches to diagnosis and management. Moving forward, efforts to optimize diagnostic algorithms, expand symptom recognition, and enhance access to comprehensive care are critical to addressing the unmet needs of women affected by this condition.
Supplementary Material
Funding
The research was supported in part by grants from the National Library of Medicine and National Heart, Lung, and Blood Institute at the National Institutes of Health (T15-LM007079 [HRN, AK, AA]; R01HL148248 [MK]; R01LM013043 [NE]) and a Computational and Data Science Fellowship from the Association for Computing Machinery Special Interest Group in High Performance Computing (HRN). Funding sources had no role in study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the article for publication.
Footnotes
Conflict of Interest
EAV, AO, FJD, and PBR are employees of Janssen Research and Development, LLC and shareholders of Johnson & Johnson (J&J) stock. The remaining authors report no conflict of interest.
Data Availability Statement
Merative™ MarketScan® claims databases and Optum® de-identified EHR data set (Optum® EHR) are publicly available for research purposes but require a license and access provided by a third party. The electronic health record and administrative data from Columbia University Irving Medical Center are not available due to restrictions to preserve patient confidentiality.
References
- 1.Chapron C, Marcellin L, Borghese B, Santulli P. Rethinking mechanisms, diagnosis and management of endometriosis. Nat Rev Endocrinol. 2019;15(11):666–682. doi: 10.1038/s41574-019-0245-z [DOI] [PubMed] [Google Scholar]
- 2.International Working Group of AAGL, ESGE, ESHRE and WES, Tomassetti C, Johnson NP, et al. An International Terminology for Endometriosis, 2021. Facts Views Vis Obgyn. 2021;13(4):295–304. doi: 10.52054/FVVO.13.4.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Zondervan KT, Becker CM, Missmer SA. Endometriosis. New England Journal of Medicine. 2020;382(13):1244–1256. doi: 10.1056/NEJMra1810764 [DOI] [PubMed] [Google Scholar]
- 4.Dunselman G, Vermeulen N, Becker C, et al. ESHRE guideline: management of women with endometriosis. Human reproduction. 2014;29(3):400–412. [DOI] [PubMed] [Google Scholar]
- 5.Nnoaham KE, Hummelshoj L, Webster P, et al. Impact of endometriosis on quality of life and work productivity: a multicenter study across ten countries. Fertility and sterility. 2011;96(2):366–373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Agarwal SK, Chapron C, Giudice LC, et al. Clinical diagnosis of endometriosis: a call to action. American journal of obstetrics and gynecology. 2019;220(4):354–e1. [DOI] [PubMed] [Google Scholar]
- 7.Moradi M, Parker M, Sneddon A, Lopez V, Ellwood D. Impact of endometriosis on women’s lives: a qualitative study. BMC women’s health. 2014;14(1):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Becker CM, Bokor A, Heikinheimo O, Vermeulen N. ESHRE guideline: endometriosis. Published online 2022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Nisenblat V, Bossuyt PM, Farquhar C, Johnson N, Hull ML. Imaging modalities for the non-invasive diagnosis of endometriosis. Cochrane Database of Systematic Reviews. 2016;(2). doi: 10.1002/14651858.CD009591.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hripcsak G, Duke JD, Shah NH, et al. Observational Health Data Sciences and Informatics (OHDSI): Opportunities for Observational Researchers. Stud Health Technol Inform. 2015;216:574–578. [PMC free article] [PubMed] [Google Scholar]
- 11.Reich C, Ostropolets A, Ryan P, et al. OHDSI Standardized Vocabularies—a large-scale centralized reference ontology for international data harmonization. Journal of the American Medical Informatics Association. 2024;31(3):583–590. doi: 10.1093/jamia/ocad247 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Hripcsak G, Albers DJ. Next-generation phenotyping of electronic health records. Journal of the American Medical Informatics Association. 2013;20(1):117–121. doi: 10.1136/amiajnl-2012-001145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bougie O, Nwosu I, Warshafsky C. Revisiting the impact of race/ethnicity in endometriosis. Reproduction and Fertility. 2022;3(2):R34–R41. doi: 10.1530/RAF-21-0106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bazot M, Lafont C, Rouzier R, Roseau G, Thomassin-Naggara I, Daraï E. Diagnostic accuracy of physical examination, transvaginal sonography, rectal endoscopic sonography, and magnetic resonance imaging to diagnose deep infiltrating endometriosis. Fertility and Sterility. 2009;92(6):1825–1833. doi: 10.1016/j.fertnstert.2008.09.005 [DOI] [PubMed] [Google Scholar]
- 15.Manganaro L, Fierro F, Tomei A, et al. Feasibility of 3.0 T pelvic MR imaging in the evaluation of endometriosis. European Journal of Radiology. 2012;81(6):1381–1387. doi: 10.1016/j.ejrad.2011.03.049 [DOI] [PubMed] [Google Scholar]
- 16.Guerriero S, Saba L, Ajossa S, et al. Three-dimensional ultrasonography in the diagnosis of deep endometriosis. Human Reproduction. 2014;29(6):1189–1198. doi: 10.1093/humrep/deu054 [DOI] [PubMed] [Google Scholar]
- 17.Thomeer MG, Steensma AB, van Santbrink EJ, et al. Can magnetic resonance imaging at 3.0-Tesla reliably detect patients with endometriosis? Initial results. Journal of Obstetrics and Gynaecology Research. 2014;40(4):1051–1058. doi: 10.1111/jog.12290 [DOI] [PubMed] [Google Scholar]
- 18.Moura APC, Ribeiro HSAA, Bernardo WM, et al. Accuracy of transvaginal sonography versus magnetic resonance imaging in the diagnosis of rectosigmoid endometriosis: Systematic review and meta-analysis. PLoS One. 2019;14(4):e0214842. doi: 10.1371/journal.pone.0214842 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Newton KM, Peissig PL, Kho AN, et al. Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. Journal of the American Medical Informatics Association. 2013;20(e1):e147–e154. doi: 10.1136/amiajnl-2012-000896 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Pacheco JA, Rasmussen LV, Wiley K, et al. Evaluation of the portability of computable phenotypes with natural language processing in the eMERGE network. Sci Rep. 2023;13(1):1971. doi: 10.1038/s41598-023-27481-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Cohen J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement. 1960;20(1):37–46. doi: 10.1177/001316446002000104 [DOI] [Google Scholar]
- 22.McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–282. [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Merative™ MarketScan® claims databases and Optum® de-identified EHR data set (Optum® EHR) are publicly available for research purposes but require a license and access provided by a third party. The electronic health record and administrative data from Columbia University Irving Medical Center are not available due to restrictions to preserve patient confidentiality.






