Skip to main content
Frontiers in Endocrinology logoLink to Frontiers in Endocrinology
. 2024 Aug 16;15:1428597. doi: 10.3389/fendo.2024.1428597

Are natural estrogens used in contraception at lower risk of venous thromboembolism than synthetic ones? A systematic literature review and meta-analysis

Jonathan Douxfils 1,2,3,*, Lucie Raskin 2, Marie Didembourg 1,2, Nathalie Donis 1, Jean-Michel Dogné 2, Laure Morimont 1,2, Charlotte Beaudart 2
PMCID: PMC11362054  PMID: 39220361

Abstract

Background

Venous thromboembolism (VTE) poses a significant global health challenge, notably exacerbated by the use of combined oral contraceptives (COCs). Evidence mainly focuses on the type of progestogen used in COCs to establish the increased risk of VTE with less data assessed on the type of estrogen used. This meta-analysis aims to assess the risk of VTE associated with COCs containing synthetic estrogens like ethinylestradiol (EE) versus natural estrogens like estradiol (E2).

Methods

A systematic review and meta-analysis was conducted following the 2020 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Literature searches were performed in December 2023 in MEDLINE and EMBASE to identify clinical studies comparing the VTE risk between COCs containing synthetic versus natural estrogens. Studies were selected through rigorous screening, and data extraction followed standardized protocols, with statistical analyses employing a random effects model.

Results

The search yielded five relevant studies, involving over 560,000 women/time, demonstrating a significant 33% reduction in VTE risk among users of natural estrogen-based COCs compared to synthetic estrogen-based COCs (OR 0.67, 95% CI 0.51–0.87). Stratification analyses using adjusted hazard ratios (HR) of the main observationnal studies showed a 49% reduced VTE risk of E2-based pills compared to EE in association with levonorgestrel.

Discussion and conclusion

Despite the longstanding use of EE-based COCs, emerging evidence supports a lower thrombotic risk associated with natural estrogens. This meta-analysis substantiates the lower VTE risk associated with natural estrogen-based COCs compared to synthetic alternatives, advocating for a re-evaluation of contraceptive guidelines to prioritize patient safety and reduce thrombotic risks.

Keywords: meta-analysis, combined oral contraceptive, estradiol, ethinylestradiol, venous thromboembolism

Introduction

Venous thromboembolism (VTE) represents a significant health concern worldwide, characterized by the formation of blood clots in the veins, which can lead to potentially fatal conditions such as deep vein thrombosis (DVT) and pulmonary embolism (PE) (1). Among the various risk factors identified for VTE, the use of combined hormonal contraceptives (CHCs) has been a subject of extensive research and debate within the medical community (2). CHCs, which typically contain a combination of an estrogen and a progestogen, are among the most effective and widely used methods for preventing pregnancy (3). However, their association with an increased risk of VTE has prompted a revaluation of their safety profile (4). The conclusion of these previous evaluations revealed that the dose of ethinylestradiol (EE) and the associated progestogen were the determinants of this increased risk of VTE (5).

Epidemiological studies have played a pivotal role in quantifying the risk of VTE associated with CHCs use (6, 7). The incidence of VTE among women of reproductive age not using CHCs is estimated to be about 2 per 10,000 woman-years (2, 4). In contrast, women using CHCs containing EE have been shown to experience a 3- to 6-fold increase in the risk of developing VTE, translating to an incidence rate of approximately 5–12 per 10,000 woman-years, depending on the type of progestogen and the dose of estrogen (2, 4). In Europe and in the United States, this may translate into additional 20,000 cases of VTE each year in this young and usually healthy population. These findings have been consistent across various studies, including those requested by regulatory agencies such as the U.S. Food and Drug Administration (FDA) (8)and the European Medicines Agency (EMA) (4, 913), which have issued warnings and guidelines regarding the use of CHCs and their associated risk of VTE (14).

The risk of VTE with CHCs use is further influenced by several factors, including individual risk factors such as age, smoking, obesity, and a personal or family history of VTE (1416). While some of these individual risk factors are difficult to mitigate, the prescription of safer CHC has emerged as the preferred option among clinical practice (14). Therefore, combined oral contraceptives (COCs) using an association of EE with levonorgestrel or norgestimate has been perceived as the safer choice for first-line contraception (14). Nevertheless, recent evidence tends to confirm a previous observation that the type of estrogen is also a critical factor in the risk of VTE associated with COCs (16, 17). Indeed, EE, a synthetic estrogen, is the most used estrogen component in CHCs since the 60s and despite its doses have been lowered over the years to reduce the risk of VTE, its replacement as the estrogenic component of pills has only been proposed in the late 2000s. Consequently, most epidemiological studies, collecting data over several years, are reporting and comparing the safety of pills containing the same main driver of the VTE risk, i.e. EE (4, 68).

Estradiol (E2)-based COCs and the recent association of estetrol (E4) with drospirenone (DRSP) are considered to offer a more physiological approach, potentially translating to a lower risk of VTE. Preliminary studies and pharmacological data suggest that E2 and E4, two natural estrogens, may exert a less pronounced effect on coagulation factors and the hemostatic system compared to ethinylestradiol, supporting a potentially lower risk of VTE (1822). However, the evidence comparing the VTE risk between ethinylestradiol-containing COCs and those using natural estrogens is still evolving, with some studies suggesting a reduced risk while others report no significant difference (13, 2325). To better understand these results, it is important to note that all post authorization safety studies (PASS) uses EE-based pills comparators and therefore, although a point estimate may show a reduced VTE risk tendency, these are not statistically significant due to a lack of power inherent to the design of these studies. Given the significant health implications of VTE and the widespread use of CHCs, a thorough understanding of the risk associated with different type of estrogen is paramount.

This meta-analysis aims to critically assess the existing literature and provide a comprehensive comparison of the risk of VTE associated with synthetic estrogens versus natural estrogens. By synthesizing data from various observational studies comparing ethinylestradiol with natural estrogens, this analysis seeks to clarify the relative safety profiles of these CHCs and guide clinical practice in contraceptive choice. We aim to offer evidence-based recommendations that can inform healthcare providers and users about the safest contraceptive options in terms of VTE risk.

Materials and methods

This systematic review was conducted in accordance with the 2020 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) as well as PRISMA-Search for literature searches (26). In this context, a protocol for the systematic review/meta-analysis has been registered in Open Science Framework (ID https://osf.io/n9dav/). The protocol has been amended in April 2024 to include additional stratification analyses.

Literature search

The electronic databases MEDLINE (via Ovid) and EMBASE were searched in December 2023 for any epidemiology clinical study reporting risk of VTE associated with synthetic estrogens versus natural estrogens. The search strategy employed in the two databases is available in Appendix 1 . Additionally, a manual search within the bibliography of relevant papers was performed in order to complete the bibliographic search. Experts in the field were contacted to provide any missing references. Finally, previous systematic reviews and meta-analyses on a similar topic were also searched for backward/forward referencing.

Study selection

The search results from the electronic sources and hand searching were imported into Covidence software for data management. Covidence is a web-based collaboration software platform that streamlines the production of systematic and other literature reviews. During the initial screening phase, three reviewers (J.D., C.B, L.R.) independently assessed the title and abstract of each obtained reference to eliminate articles irrelevant to the systematic review. Rigorous inclusion criteria were applied, as outlined in Table 1 . In the subsequent step, the three reviewers individually examined the full text of each article that had not been excluded in the initial stage, selecting studies that fulfilled the inclusion criteria. Any discrepancies in article selection were resolved through discussion and consensus.

Table 1.

Inclusion criteria.

PICO(S) criteria
Patients Women, 18 years and older
Intervention Natural estrogens: Estradiol, Oestradiol, Estradiol Valerate, Oestradiol Valerate, Estetrol, Oestetrol
Comparator Synthetic estrogens: Ethinylestradiol or Ethinyloestradiol + any progestative (e.g. levonorgestrel, norgesterel, desogestrel, gestodene, drospirenone, etc.).
Outcome Risk of thrombosis
Any type of venous thrombosis (suspected, confirmed, idiopathic)
Study design Longitudinal observational studies: prospective or retrospective cohort studies
Case-control studies

Data extraction

Data extraction and analysis followed a clearly defined process. First, all included papers were summarized using a standardized data extraction form. This extraction form was pretested by two reviewers with three studies. Relevant insights of these studies were used to adjust the standard data extractions form. The following data were then extracted by one reviewer (J.D.) and double checked by a second reviewer (C.B.): 1) study characteristics including first author, year of publication, sample size and characteristics (age, BMI, ethnicity, comorbidity, duration of estrogens use); 2) intervention characteristics including type of estrogen (natural vs synthetic), composition, route of administration; 3) outcomes including type of thrombo-embolic events, diagnostic methods, raw prevalence data, or effect sizes (Odds Ratio (OR) or Hazard Ratio (HR) raw or adjusted). Authors were contacted in case of missing or incomplete data.

Quality appraisal

Quality of the cohort and case-control was measured using the Newcastle Ottawa Scale (NOS) for cohort studies or nonrandomized studies.

Statistical analyses

The risk of VTE associated with synthetic estrogens versus natural estrogens in each individual studies were pooled together using a random effect model meta-analysis. This specific model was used because heterogeneity was a priori expected. Peto odds ratio and their respective 95% Confidence Intervals (CI) were reported as effect size, to account for the low incidence of events, as recommended by the Cochrane Handbook for Systematic Reviews of intervention (27). When adjusted HR were provided by authors, pooled HR were computed with random effect model. In the global meta-analysis model, all E2-based COCs (E2-NOMAC, E2-dienogest (DNG)) were pooled together and compared to all EE-based COCs pooled together (EE-levornogestrel (LNG) or other COCs – (oCOC), i.e. COC containing EE and progestogens other than LNG). Subgroup analyses were further performed according to the type of EE-based COCs (E2-based COCs versus EE/LNG and E2-based COCs vs oCOC) and according to the regulatory status of the study (i.e. imposed PASS (13, 23),). Finally, a comparison of risk between EE-based COCs (EE/LNG vs oCOC) was also performed as explanatory analysis. To allow statistical comparisons between studies, all events were reported as event per person-time for prospective studies or even per number of participants for case-control studies. Only confirmed VTE were considered as events. For studies reporting the outcomes for multiple follow-up time periods, the outcomes reported for the longest follow-up time period were used in the general model. Results were examined for heterogeneity using Cochran’s Q statistic and the I² statistic. A leave-one-out sensitivity analysis was performed to evaluate the stability of the results when one study is removed at a time. Due to the limited number of studies included in the model, publication bias could not be assessed. For all results, a two-sided p value of 0.05 or less was considered as significant. All analyses were performed using R Software and appropriate packages (meta, metafor).

Assessing the strength of evidence: GRADE

For all associations determined by meta-analyses, the level of evidence was evaluated using the GRADE (Grading of Recommendations, Assessments, Development and Evaluation) assessment. Due to the observational nature of the data, the evidence score started at moderate level of evidence and was downgraded by one (i.e. low level of evidence), two or three levels (i.e. very low level of evidence) if one of the following pre-specified criteria was present: 1) Study quality (i.e. low study quality for more than 75% of the included studies); 2) Inconsistency (i.e. unexplained substantial significant heterogeneity); 3) Indirectness (i.e. presence of factors that limit the generalizability of the results); 4) Imprecision (i.e. large 95% IC), 5) Publication bias.

Results

The search strategy initially identified 457 records (139 from Medline and 318 from Embase), with 375 records remaining after removing duplicates. Upon screening the titles and abstracts of these records, 11 were considered potentially eligible. Following a thorough evaluation of the full texts of these articles, 7 were excluded (5 duplicates (2832), 1 because of the lack of a control population (33) and 1 being a sub-analysis of another study already included (34) – for this study [i.e. INAS-SCORE study], E2/DNG and EE/LNG data were extracted from Bauerfeind et al. (23) while data on oCOC were extracted from Dinger et al. (34) as there were not reported in Bauerfeind et al.) Thus, a total of 4 studies met the eligibility criteria and were included in this systematic review (13, 2325). Manual searches and expert solicitations allowed us to identify 1 additional study (35). Ultimately, a total of 5 studies were deemed relevant for inclusion in this systematic literature review. The flowchart of the study selection process is presented in Figure 1 .

Figure 1.

Figure 1

PRISMA flowchart.

Study characteristics

Characteristics of included studies are presented in Table 2 . Three cohort studies and 2 case-control studies, published between 2013 and 2024, included a sample size comprised between 639 and 310,373 women. Four included studies had an excellent methodological quality with three studies rated 9/9 stars on the NOS scale and one study rated 7/9 stars on the NOS scale (13, 2325). One study cannot be assessed due to insufficient information (abstract from congress with oral presentation) (35).

Table 2.

Characteristics of the included studies.

Author, year Study design Sample size Population characteristics: mean age, mean BMI, % smokers, % of family history of VTE Name of COC Event/person time – Event/number of participant a Funding Study quality (NOS scale)
Lidegaard, 2013 (35) Prospective study Women on E2-based COC: n=5,202
Women on synthetic estrogens: n=305,171
NR E2-based COC: E2-DNG
Synthetic estrogens: EE-LNG
E2-based COC:
- 5/5,202
Synthetic estrogens:
- 186/305,171
NR Not assessed
Reed, 2021 (13) Prospective study E2-based COC:
- n=44,559
Synthetic estrogens:
- n=49,754
mean age: 30.1
mean BMI: 23.3
21% of smokers
2.4% of family history of VTE
E2-based COC:
- E2-NOMAC
Synthetic estrogens:
- EE-LNG
E2-based COC:
- 12/48,846
Synthetic estrogens:
- 25/62,337
Merck Sharp and Dohme, a subsidiary of Merck & Co., Inc., Kenilworth, NJ, USA, and Theramex Ireland Limited, Dublin, Ireland 9/9 stars
Schink, 2022 (25) Case-control study Women on E2-based COC:
- n=35
Synthetic estrogens:
- n=2,512
VTE cases:
mean age 17.6
20.6% obese
4.12% of smokers
10.6% of family history of VTE
Controls:
mean age 17.6
6.67% obese
2.54% of smokers
1.43% of family history of VTE
E2-based COC:
- E2-DNG
Synthetic estrogens:
- EE-LNG
E2-based COC:
- 6/101
Synthetic estrogens:
- 1,139/12,338
Funded by the Federal Institute for Drugs and Medical Devices (Bundesinstitut f̈r Arzneimittel und Medizinprodukte, BfArM) 9/9 stars
Heikinheimo, 2022 (24) Nested Case-control study E2-based COC:
- n=129
Synthetic estrogens:
- n=510
mean age
- not reported
mean BMI
- not reported
% of smokers
- not reported
% of family history of VTE
- not reported
E2-based COC:
- E2/DNG
- E2/NOMAC
Synthetic estrogens:
- EE/DSG
- EE/GSD
- EE/DRSP
- EE/norelgestromin
- EE/etonogestrel
E2-based COC:
- 25/129
Synthetic estrogens:
- 158/510
Erkko Foundation; Yrjö Jahnsson foundation
(ET); Avohoidon tutkimussäätiö &
Helsinki University Library
7/9 stars
Bauerfeind, 2024 (23) Prospective study E2-based COC:
- n=11,616
Synthetic estrogens:
- n=58,693
mean age 27.1
mean BMI 24.2
23% of smokers
3.1% of family history of VTE
E2-based COC:
- E2-DNG
Synthetic estrogens:
- EE-LNG
- oCOC
E2-based COC:
- 11/17,932
Synthetic estrogens:
- 99/107,586
Unconditional grant from Bayer AG, Germany 9/9 stars
a

Event/person time reported for prospective studies – Event/number of participants reported for case-control studies.

b

Only confirmed VTE were considered as events.

NR, Not Reported; COC, Combined Oral Contraceptives; BMI, Body Mass Index.

Meta-analytical model

Crude analyses

The global random-effect model meta-analysis, including five studies and 560,152 women/time, revealed an ORpeto of 0.67 (95%CI 0.51, 0.87), highlighting a significant 33% reduction in VTE risk among users of E2-based COCs compared to those using EE-based COCs ( Figure 2 ). The model was free of heterogeneity (I²=0%, p=0.46). The leave-one-out analysis revealed an effect size ranging from 0.63 (95%CI 0.48, 0.82) when omitting Lidegaard et al. to 0.74 (95%CI 0.53, 1.03) when omitting Heikinheimo et al. The observed association was considered with a moderate level of evidence ( Table 3 ). When stratifying analyses by type of EE-based COC, no significant association was found when comparing E2-based COC versus EE/LNG (ORpeto of 0.80 (95%CI 0.54, 1.17), I²=6%, p=0.36, moderate level of evidence). A significant reduction of VTE risk was found for E2-based COC versus oCOC (ORpeto of 0.60 (95% CI 0.45, 0.81), I²=0%, p=0.68, moderate level of evidence). No significant difference of VTE risk was observed when comparing EE/LNG vs oCOC (ORpeto 1.32, 95%CI 0.79, 2.21, I²=76%, p=0.02, low level of evidence).

Figure 2.

Figure 2

Forest plot of the studies included in this meta-analysis assessing the risk of VTE associated with natural estrogens (estradiol and estradiol valerate) versus synthetic estrogens (ethinylestradiol). CI, confidence interval; E2, estradiol; EE, ethinylestradiol; OR, odds ratio.

Table 3.

GRADE assessment per meta-analytical model.

Type of analysis Number of studies, sample size Random effect model (crude Peto OR, [95%CI]) Heterogeneity test (I², p for Q statistics) b GRADE assessment a
Risk of bias Inconsistency Indirectness Imprecision Publication bias Level of Evidence
E2-based COC vs EE-based COC k=4
n E2-based= 72,210
n oCOC= 487,942
0.67 [0.51;0.87] I² 0%, p=0.46 Not serious Not serious Not serious Not serious Not serious Moderate
E2-based vs oCOC k=4
n E2-based= 67,008
n oCOC= 97,082
0.60 [0.45;0.81] I² 0%, p=0.68 Not serious Not serious Not serious Not serious Not serious Moderate
E2-based vs EE/LNG k=4
n E2-based= 72,081
n oCOC= 390,860
0.80 ([0.54;1.17] I² 6%, p=0.36 Not serious Not serious Not serious Not serious Not serious Moderate
EE/LNG vs oCOC k=3
n EE/LNG= 85,689
n oCOC=96,572
1.32 [0.79;2.21] I² 76%, p=0.02 Not serious Serious Not serious Not serious Not serious Low
Additional analyses in studies providing adjusted HR
Type of analysis Number of studies, sample size Random effect model (crude Peto OR, [95%CI]) Random effect model (Adjusted HR, [95%CI]) c Heterogeneity test (I², p for Q statistics) b GRADE assessment a
Risk of bias Inconsistency Indirectness Imprecision Publication bias Level of Evidence
E2-based vs EE/LNG in studies with adjustment for confounding factors k=3
n E2-based=
66,811 (E2/DNG)
66,834 (E2/NOMAC)
n EE/LNG= 85,689
E2/DNG
0.64 [0.41;1.00]
E2/NOMAC
0.74 [0.48;1.15]
E2/DNG
0.49 [0.29;0.85]
E2/NOMAC
0.68 [0.37;1.25]
E2/DNG:
I²=0%, p=0.79
E2/NOMAC:
I²=37%, p=0.20
Not serious Not serious Not serious Not serious Not serious Moderate
Studies from ZEG
E2-based vs EE/LNG
k=2
n EE/LNG= 66,778
n oCOC=83,177
0.64 [0.40;1.02] 0.51 [0.29;0.90) I²=0%, p=0.66 Not serious Not serious Not serious Serious Not serious Low
a

GRADE assessment: 1) Study quality was considered as serious if low study quality was reported for more than 75% of the included studies, 2) Inconsistency was considered as serious in case of unexplained substantial significant heterogeneity, 3) Indirectness was considered serious if presence of factors that limit the generalizability of the results, 4) Imprecision was considered serious if k<3 or large 95% Confidence Intervals, 5) Publication bias: due to the low number of included studies (k=5 in the global meta-analytical model), a proper evaluation of publication bias could not be performed. However, because of the quality of the manual search performed for this systematic review and meta-analysis, any missing of evidence was considered as very unlikely and no serious publication bias was considered in the GRADE assessment.

b

I2 is reported for adjusted HR when available, otherwise it is reported for crude Peto OR.

c

Potential confounders considered in analyses: Reed et al.: age, body mass index, family history of VTE and current duration of HC use; Schink et al.: age at cohort entry, cardiovascular diseases, coagulation disorders and other blood diseases, diabetes or use of antidiabetics or insulin; migraine with aura, Varicose veins of lower extremitie, obesity, Paresis, hospitalization, surgery, fractures or trauma, Current use of ASA, antiplatelets, antithrombotics or DOACs, Current use of NSAIDs, current use of glucocorticoids or other corticoids, Current use of antidepressants or antipsychotics; Bauerfeind et al.: age, body mass index (BMI), duration of current hormonal contraceptive use and family history of VTE; for ATE, it included age, BMI, smoking, treated hypertension and a family history of fatal ATE.

Adjusted analyses

Adjusted HR were available for 3 studies comparing E2-based COC with EE-LNG (13, 23, 25). One study (25), reported two groups with E2-based COC (i.e. E2/NOMAC and E2/DNG) and therefore analyses where run separately to avoid inclusion of the EE-LNG arm twice in the analysis. The adjusted HR ranged from 0.49 (95%CI 0.29–0.85 I²=0%, p=0.79, with E2/DNG in the study of Schink et al.) to 0.68 (95%CI 0.37–1.25, I²=37%, p=0.20 with E2/NOMAC in the study of Schink et al.). Pooled HR from imposed EMA PASS yielded a statistically significant reduction of the HR (HR of 0.51 (95%CI 0.29–0.90), I²=0%, p=0.66). The corresponding crude OR were 0.64 (95%CI 0.41–1.00, I²=0%, p=0.98), 0.74 (95%CI 0.48–1.15, I²=26%, p=0.26) and 0.64 (95%CI 0.40–1.02, I²=0%, p=0.87). Detailed Forest plots of all analyses are available in Appendix 2 .

Discussion

This systematic review and meta-analysis aimed to address evolving concerns regarding the safety profile of COCs, particularly focusing on the thrombotic risk associated with their estrogen components. Despite reductions in EE dosage and the introduction of new progestins, the thrombotic risk associated with COCs remained a public health safety concern since the 60s (2). This led to the marketing of E2-containing COCs, which were presumed to have a more favorable impact on coagulation profiles due to their lesser effect on the synthesis of hepatic proteins (22, 36). Our analysis, incorporating data from five observational studies involving over 560,000 women, showed a significant 33% reduction in VTE risk among users of E2-based COCs compared to those using EE-based COCs ( Figure 2 ).

The association of EE with LNG has been regarded as the safest option for COCs for over two decades at least, underpinned by a comprehensive foundation of clinical experience, epidemiological evidence, and pharmacological understanding (2). The preference for this combination stems from several critical factors that underscore its safety and efficacy (14). EE/LNG combination has been consistently associated with a lower risk of VTE compared to COCs that include newer progestogens such as desogestrel (DSG), gestodene (GSD), or DRSP. This assertion is supported by numerous epidemiological studies and systematic reviews, highlighting a reduced relative risk of VTE, which has been a pivotal factor in its widespread acceptance and use (6, 7, 3740). The safety profile of levonorgestrel, as one of the earliest progestogens used in COCs, is therefore well-documented and extensively studied, offering a rich data set on its long-term safety, efficacy, and tolerability. This extensive history of usage has facilitated a deep understanding of the potential risks and benefits associated with its use, contributing to its reputation as a reliable contraceptive option.

Importantly, EE/LNG COCs have also shown to exert a lesser impact on coagulation factors and the hemostatic system compared to combinations containing EE in association with other progestogens (41, 42). This reduced influence on coagulation pathways plays a significant role in the lower observed risk of thrombotic events, further solidifying its status as a safer option in COC containing EE as estrogenic component (42). Additionally, public health agencies and regulatory bodies, including the EMA, have conducted thorough evaluations of the thrombotic risks associated with different types of COCs. These assessments have consistently identified the EE/LNG combination as having a favorable benefit-risk profile, particularly in relation to thrombotic risks (4, 8).

Although the lowest, the absolute risk of VTE with EE/LNG remains associated with >2-fold increased risk compared to non-use of COC (6). As nicely estimated by epidemiological studies, reducing from EE 50 mcg to 20–30 mcg permits to decrease the risk of VTE of LNG-containing COCs from >6-fold to ± 2-fold (6). Nevertheless and importantly, not only the dose of EE is important but also the dose and the type of the associated progestin drives the risk (5). Of note, when used at the dose of 50 mcg, EE was associated with LNG at the dose of 125 mcg while it was 100 mcg and 150 mcg for EE 20 mcg and 30 mcg, respectively. The association is therefore of importance when considering the overall impact on coagulation since it implies an equilibrium between the pharmacodynamic properties of both the estrogen and the progestin present in the preparation (2). Such mechanistical explanation also permits to understand why some progestin like dienogest expresses an important risk once associated with EE (43) while it is lower with E2 (11).

Previous biological data suggested a similar to lower risk of VTE associated with natural estrogens like E2 or E4. Extensive evaluations of the coagulation cascade have been undertaken with these natural estrogens compared to the synthetic alternative. Most biomarkers which were sensitive toward changes induced by CHCs revealed the natural estrogens were less prone to induce changes compared to ethinylestradiol containing pills, including the reference EE/LNG (2, 17, 18, 20, 22, 36). More specifically, a specific biomarker which is able to capture and integrate most of the coagulation changes induced by estrogenic components (44) shows a distinctive effect of natural estrogens compared to EE containing COCs (45). Namely, the normalized activated protein C sensitivity ratio (nAPCsr) was able to demonstrate that EE-based COCs exhibit higher APC resistance compared to natural estrogens like E2 or E4 (46). Our group and others previously suggest that E2 and E4 compounds may offer a similar to even lower risk of cardiovascular events, including VTE, when compared to EE. This evidence aligns with the findings of this meta-analysis and supports the reduced VTE risk associated with natural estrogen based COCs.

Our meta-analysis suggests that contraceptives based on E2 may be associated with a reduced risk of VTE compared to those containing EE/LNG. The unadjusted OR of 0.80 does not reach statistical significance, indicating only a modest trend toward risk reduction. However, this trend becomes statistically significant in the context of adjusted HRs, which range from 0.49 to 0.68 across various sensitivity analyses. This significant reduction is exemplified by data from two methodologically similar ZEG studies, which demonstrate a 49% decrease in VTE risk (adjusted HR 0.51, 95% CI 0.29–0.90). These studies collectively represent over 150,000 women-years of data (13, 23).

Crucially, these findings highlight the substantial impact of confounding factors on VTE risk assessments in populations using natural estrogen-based contraceptives. The consistently lower adjusted HRs compared to their corresponding crude ORs suggest that any observed non-significant reduction with crude ORs must be interpreted with caution. These unadjusted measures likely conceal the true extent of the protective effects offered by natural estrogens compared to EE/LNG, due to insufficient adjustment for known confounding variables. This analysis underscores the importance of considering adjusted measures when evaluating the VTE risk associated with different hormonal contraceptives.

The studies included in this meta-analysis exhibit significant differences in design, sample size, population characteristics, and outcomes. Lidegaard (37) and Bauerfeind (23) are large prospective studies with sample sizes exceeding 70,000 women, while Schink (25) and Heikinheimo (24) are smaller case-control studies, providing more detailed demographic insights. Among all the studies, only the study of Lidegaard shows an opposite trend. This study has not been published and peer-reviewed yet, and no information was available on the included population and the adjustment of potential confounders. The NOS scale was also not possible to determine. Beside this study, the trend observed in all other studies was similar, supporting our findings. Funding sources range from pharmaceutical companies (Reed, Bauerfeind (13, 23)), private foundation (Heikinheimo (24)) to governmental bodies (Schink (25)), influencing the study’s perceived biases. Quality assessments using the NOS scale show high ratings (9/9 stars) for Reed (13), Schink (25), and Bauerfeind (23), indicating robust methodologies.

As a limited number of studies met our inclusion criteria, we decided to investigate whether our data fits with the effect size observed with well-documented previous investigations. In the 3 studies included in our meta-analytical model having compared different EE preparations, we investigate the OR of oCOC versus EE-LNG. We observed a trend toward a lower risk with EE/LNG which is not statistically significant probably due to the lower size of this subcomparison. However, the ±30% increased risk observed with oCOC is in line with the literature reporting comparison between EE/LNG and oCOC (47). Oedingen et al. reported a risk ratio comprised between 1.18 (EE20/GSD) and 1.46 (EE30–40/DSG) in their systematic review and meta-analysis aiming to compare EE/LNG versus oCOC (47). This comforts our observation that, despite the low number of studies included in our meta-analysis, the estimates are in line with previous studies strengthening our observation that E2-based COC demonstrated lower risk of VTE than EE-based COCs.

One limitation of this study is the generalization to other natural estrogens since we only were able to retrieve studies comparing E2 with EE-based pill. No direct comparisons are available to date with E4/DRSP. However, even if no direct comparison between E4 and EE has been made in a large observational study, the incidence of VTE observed with E4/DRSP during the phase-3 clinical program was 3.7/10,000 women-year, largely below the ones reported these last years in PASS evaluating EE-based COCs ( Table 3 ). Other recent randomized trials were in line with these higher incidences for EE containing pills, transdermal patch, or vaginal ring (4850). Another limitation resides in the fact that only a limited number of studies met our inclusion criteria. Nevertheless, the five studies included a total of over 500,000 patients, and their results consistently supported our conclusion. Additionally, fewer patients were included in the E2 arms compared to the EE arms, reflecting the real-life usage of COC. Nonetheless, further research is needed to strengthen our findings.

It thus becomes more and more evident that the choice of estrogen in COCs is a critical determinant of cardiovascular safety, challenging current prescribing practices and inviting a re-evaluation of guidelines to prioritize patient safety. The potential for natural estrogens like E2 and E4 to offer safer alternatives, without compromising contraceptive effectiveness, necessitates a paradigm shift in contraceptive prescribing practices.

Conclusions

In conclusion, the evidence from our systematic review, supported by several previous and independent evaluation of the haemostatic impact of COCs, advocates for a re-evaluation of first-line therapy in contraception toward safer alternatives, prioritizing the use of natural estrogens. This shift not only addresses the immediate concern of reducing VTE risk but also aligns with a broader commitment to enhancing women’s health outcomes by ensuring access to safe, effective contraceptive options. As we move forward, integrating these insights into clinical practice will be crucial, guiding the selection of COCs based on a holistic understanding of their safety profile, particularly regarding thrombotic risk.

Funding Statement

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below https://osf.io/n9dav/.

Author contributions

JD: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. LR: Data curation, Formal analysis, Methodology, Validation, Writing – review & editing. MD: Formal analysis, Writing – review & editing. ND: Formal analysis, Writing – review & editing. J-MD: Funding acquisition, Resources, Validation, Writing – review & editing. LM: Formal analysis, Writing – review & editing. CB: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.

Conflict of interest

Authors JD, MD, ND, and LM were employed by company Qualiblood sa.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fendo.2024.1428597/full#supplementary-material

DataSheet1.docx (220.1KB, docx)

References

  • 1. Di Nisio M, van Es N, Buller HR. Deep vein thrombosis and pulmonary embolism. Lancet. (2016) 388:3060–73. doi:  10.1016/S0140-6736(16)30514-1 [DOI] [PubMed] [Google Scholar]
  • 2. Morimont L, Haguet H, Dogne JM, Gaspard U, Douxfils J. Combined oral contraceptives and venous thromboembolism: review and perspective to mitigate the risk. Front Endocrinol (Lausanne). (2021) 12:769187. doi:  10.3389/fendo.2021.769187 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Gerard C, Arnal JF, Jost M, Douxfils J, Lenfant F, Fontaine C, et al. Profile of estetrol, a promising native estrogen for oral contraception and the relief of climacteric symptoms of menopause. Expert Rev Clin Pharmacol. (2022) 15:121–37. doi:  10.1080/17512433.2022.2054413 [DOI] [PubMed] [Google Scholar]
  • 4. European Medicines Agency . Assessment report for combined hormonal contraceptives containing medicinal products — Procedure number: EMEA/H/A-31/1356. Pharmacovigilance Risk Assessment Committee; (2014). Available at: https://www.ema.europa.eu/en/documents/referral/combined-hormonal-contraceptives-article-31-referral-prac-assessment-report_en.pdf. [Google Scholar]
  • 5. Douxfils J, Morimont L, Bouvy C. Oral contraceptives and venous thromboembolism: focus on testing that may enable prediction and assessment of the risk. Semin Thromb hemostasis. (2020) 46:872–86. doi:  10.1055/s-0040-1714140 [DOI] [PubMed] [Google Scholar]
  • 6. de Bastos M, Stegeman BH, Rosendaal FR, Van Hylckama Vlieg A, Helmerhorst FM, Stijnen T, et al. Combined oral contraceptives: venous thrombosis. Cochrane Database Syst Rev 2014. (2014), CD010813. doi:  10.1002/14651858.CD010813.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Dragoman MV, Tepper NK, Fu R, Curtis KM, Chou R, Gaffield ME. A systematic review and meta-analysis of venous thrombosis risk among users of combined oral contraception. Int J Gynaecol Obstet. (2018) 141:287–94. doi:  10.1002/ijgo.12455 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Food and Drug Administration . Combined Hormonal Contraceptives (CHCs) and the Risk of Cardiovascular Disease Endpoints - CHC-CVD final report 111022v2. (2011). Available at: https://www.fda.gov/media/82335/download. [Google Scholar]
  • 9. Dinger J, Bardenheuer K, Heinemann K. Cardiovascular and general safety of a 24-day regimen of drospirenone-containing combined oral contraceptives: final results from the International Active Surveillance Study of Women Taking Oral Contraceptives. Contraception. (2014) 89:253–63. doi:  10.1016/j.contraception.2014.01.023 [DOI] [PubMed] [Google Scholar]
  • 10. Dinger J, Mohner S, Heinemann K. Cardiovascular risks associated with the use of drospirenone-containing combined oral contraceptives. Contraception. (2016) 93:378–85. doi:  10.1016/j.contraception.2016.01.012 [DOI] [PubMed] [Google Scholar]
  • 11. Dinger J, Do Minh T, Heinemann K. Impact of estrogen type on cardiovascular safety of combined oral contraceptives. Contraception. (2016) 94:328–39. doi:  10.1016/j.contraception.2016.06.010 [DOI] [PubMed] [Google Scholar]
  • 12. Dinger JC, Heinemann LA, Kuhl-Habich D. The safety of a drospirenone-containing oral contraceptive: final results from the European Active Surveillance Study on oral contraceptives based on 142,475 women-years of observation. Contraception. (2007) 75:344–54. doi:  10.1016/j.contraception.2006.12.019 [DOI] [PubMed] [Google Scholar]
  • 13. Reed S, Koro C, DiBello J, Becker K, Bauerfeind A, Franke C, et al. Prospective controlled cohort study on the safety of a monophasic oral contraceptive containing nomegestrol acetate (2.5mg) and 17beta-oestradiol (1.5mg) (PRO-E2 study): risk of venous and arterial thromboembolism. Eur J Contracept Reprod Health Care. (2021) 26:439–46. doi:  10.1080/13625187.2021.1987410 [DOI] [PubMed] [Google Scholar]
  • 14. The Faculty of Sexual and Reproductive Healthcare . FSRH Guideline - Combined Hormonal Contraception (amended October 2023). (2019). Available at: https://www.fsrh.org/Public/Documents/fsrh-guideline-combined-hormonal-contraception.aspx. [Google Scholar]
  • 15. Lo Faro V, Johansson T, Johansson A. The risk of venous thromboembolism in oral contraceptive users: the role of genetic factors-a prospective cohort study of 240,000 women in the UK Biobank. Am J Obstet Gynecol. (2024) 230:360 e1–360 e13. doi:  10.1016/j.ajog.2023.09.012 [DOI] [PubMed] [Google Scholar]
  • 16. Douxfils J, Morimont L, Creinin MD, Gaspard U, Foidart JM. Hormonal therapies and venous thrombosis: considerations for prevention and management-a reappraisal. Res Pract Thromb Haemost. (2023) 7:100155. doi:  10.1016/j.rpth.2023.100155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Morimont L, Creinin MD, Gaspard U, Foidart JM, Douxfils J. Hormonal therapies and venous thrombosis: Estrogen matters! Res Pract Thromb Haemost. (2023) 7:100021. doi:  10.1016/j.rpth.2022.100021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Douxfils J, Klipping C, Duijkers I, Kinet V, Mawet M, Maillard C, et al. Evaluation of the effect of a new oral contraceptive containing estetrol and drospirenone on hemostasis parameters. Contraception. (2020) 102:396–402. doi:  10.1016/j.contraception.2020.08.015 [DOI] [PubMed] [Google Scholar]
  • 19. Morimont L, Jost M, Gaspard U, Foidart JM, Dogne JM, Douxfils J. Low thrombin generation in users of a contraceptive containing estetrol and drospirenone. J Clin Endocrinol Metab. (2022) 108:135–43. doi:  10.1210/clinem/dgac511 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Gaussem P, Alhenc-Gelas M, Thomas JL, Bachelot-Loza C, Remones V, Ali FD, et al. Haemostatic effects of a new combined oral contraceptive, nomegestrol acetate/17beta-estradiol, compared with those of levonorgestrel/ethinyl estradiol. A double-blind, randomised study. Thromb haemostasis. (2011) 105:560–7. doi: 10.1160/TH10-05-0327 [DOI] [PubMed] [Google Scholar]
  • 21. Klipping C, Duijkers I, Mawet M, Maillard C, Bastidas A, Jost M, et al. Endocrine and metabolic effects of an oral contraceptive containing estetrol and drospirenone. Contraception. (2021) 103:213–21. doi:  10.1016/j.contraception.2021.01.001 [DOI] [PubMed] [Google Scholar]
  • 22. Klipping C, Duijkers I, Parke S, Mellinger U, Serrani M, Junge W. Hemostatic effects of a novel estradiol-based oral contraceptive: an open-label, randomized, crossover study of estradiol valerate/dienogest versus ethinylestradiol/levonorgestrel. Drugs R&D. (2011) 11:159–70. doi:  10.2165/11591200-000000000-00000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Bauerfeind A, von Stockum S, Boehnke T, Heinemann K. Venous thromboembolic risk of estradiol valerate-dienogest compared with ethinyl estradiol-levonorgestrel combined oral contraceptives. Obstet Gynecol. (2024) 143:431–4. doi:  10.1097/AOG.0000000000005509 [DOI] [PubMed] [Google Scholar]
  • 24. Heikinheimo O, Toffol E, Partonen T, But A, Latvala A, Haukka J. Systemic hormonal contraception and risk of venous thromboembolism. Acta Obstet Gynecol Scand. (2022) 101:846–55. doi:  10.1111/aogs.14384 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Schink T, Princk C, Braitmaier M, Haug U. Use of combined oral contraceptives and risk of venous thromboembolism in young women: a nested case-control analysis using German claims data. BJOG. (2022) 129:2107–16. doi:  10.1111/1471-0528.17268 [DOI] [PubMed] [Google Scholar]
  • 26. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj. (2021) 372:n71. doi:  10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Deeks JJ, Higgins JP, Altman DG, ,Cochrane Statistical Methods Group . Chapter 10: Analysing data and undertaking meta-analyses. Version 6.4 (updated August 2023). In: Higgins JP, Thomas J, Chandler J, Cumpston M, LI T, Page MJ, et al., editors. Cochrane handbook for systematic reviews of interventions (2023). Available at: www.training.cochrane.org/handbook. [Google Scholar]
  • 28. Bardenheuer K, Heinemann K, Dinger J. FCS29.3.Final results from the INAS-score study – VTE and ATE Risk in users of different combined oral contraceptives. (2015). [Google Scholar]
  • 29. Heinemann K, Moehner S, Reed S, do Minh T. FCS501 | Cardiovascular safety of different combined oral contraceptives – final INAS score study results. (2018). [Google Scholar]
  • 30. Heinemann K, Dinger J, Minh TD, Franke C. Cardiovascular safety among users of different combined oral contraceptives — final results from the INAS-SCORE study. Contraception. (2017) 96:292–3. doi:  10.1016/j.contraception.2017.07.114 [DOI] [Google Scholar]
  • 31. von Stockum S, Becker K, Bauerfeind A, Franke C, Fruzzetti F, Calaf J, et al. NOMAC-E2 compares to LNG combined oral contraceptives in women over forty: real-world PRO-E2 study. Gynecol Endocrinol. (2023) 39:2166032. doi:  10.1080/09513590.2023.2166032 [DOI] [PubMed] [Google Scholar]
  • 32. Bardenheuer K, Heinemann K, Do Minh T, Franke C. Cardiovascular safety in users of different combined oral contraceptives—final results from the INAS-score study. Pharmacoepidemiol Drug Safety. (2015) 24:1–587. doi: 10.1002/pds [DOI] [Google Scholar]
  • 33. Gourbil M, Grandvuillemin A, Beyens MN, Massy N, Gras V, D'Amico A, et al. Thromboembolic events in women exposed to hormonal contraception or cyproterone acetate in 2012: a cross-sectional observational study in 30 French public hospitals. Drug Saf. (2014) 37:269–82. doi:  10.1007/s40264-014-0149-8 [DOI] [PubMed] [Google Scholar]
  • 34. Dinger J, Möhner S, Heinemann K. Combined oral contraceptives containing dienogest and estradiol valerate may carry a lower risk of venous and arterial thromboembolism compared to conventional preparations: Results from the extended INAS-SCORE study. Front Women’s Health 5. (2020). doi:  10.15761/FWH [DOI] [Google Scholar]
  • 35. Lidegaard Ø, Skovlund CW, Nielsen LH. FC3-19 Thrombotic diseases in users of estradiol/dienogest oral contraceptives: a historical national follow-up study 2009 – 2011. (2013). [Google Scholar]
  • 36. Agren UM, Anttila M, Maenpaa-Liukko K, Rantala ML, Rautiainen H, Sommer WF, et al. Effects of a monophasic combined oral contraceptive containing nomegestrol acetate and 17beta-oestradiol compared with one containing levonorgestrel and ethinylestradiol on haemostasis, lipids and carbohydrate metabolism. Eur J Contracept Reprod Health Care. (2011) 16:444–57. doi:  10.3109/13625187.2011.604450 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Lidegaard O, Nielsen LH, Skovlund CW, Skjeldestad FE, Lokkegaard E. Risk of venous thromboembolism from use of oral contraceptives containing different progestogens and oestrogen doses: Danish cohort study, 2001-9. Bmj. (2011) 343:d6423. doi:  10.1136/bmj.d6423 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Spitzer WO, Lewis MA, Heinemann LA, Thorogood M, MacRae KD. Third generation oral contraceptives and risk of venous thromboembolic disorders: an international case-control study. Transnational Research Group on Oral Contraceptives and the Health of Young Women. Bmj. (1996) 312:83–8. doi:  10.1136/bmj.312.7023.83 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Vinogradova Y, Coupland C, Hippisley-Cox J. Use of combined oral contraceptives and risk of venous thromboembolism: nested case-control studies using the QResearch and CPRD databases. Bmj. (2015) 350:h2135. doi:  10.1136/bmj.h2135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. van Hylckama Vlieg A, Helmerhorst FM, Vandenbroucke JP, Doggen CJ, Rosendaal FR. The venous thrombotic risk of oral contraceptives, effects of oestrogen dose and progestogen type: results of the MEGA case-control study. Bmj. (2009) 339:b2921. doi:  10.1136/bmj.b2921 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Morimont L, Dogne JM, Douxfils J. Letter to the Editors-in-Chief in response to the article of Abou-Ismail, et al. entitled "Estrogen and thrombosis: A bench to bedside review" (Thrombosis Research 192 (2020) 40-51). Thromb Res. (2020) 193:221–3. doi:  10.1016/j.thromres.2020.08.006 [DOI] [PubMed] [Google Scholar]
  • 42. Lete I, Chabbert-Buffet N, Jamin C, Lello S, Lobo P, Nappi RE, et al. Haemostatic and metabolic impact of estradiol pills and drospirenone-containing ethinylestradiol pills vs. levonorgestrel-containing ethinylestradiol pills: A literature review. . Eur J Contracept Reprod Health Care. (2015) 20:329–43. doi:  10.3109/13625187.2015.1050091 [DOI] [PubMed] [Google Scholar]
  • 43. Dinger J. COCs containing dienogest and 30 µg ethinylestradiol may carry a higher VTE risk compared to corresponding preparations with levonorgestrel: A meta-analysis of four large cohort studies. Front Women’s Health. (2020) 5. doi:  10.15761/FWH [DOI] [Google Scholar]
  • 44. Douxfils J, Morimont L, Delvigne AS, Devel P, Masereel B, Haguet H, et al. Validation and standardization of the ETP-based activated protein C resistance test for the clinical investigation of steroid contraceptives in women: an unmet clinical and regulatory need. Clin Chem Lab medicine: CCLM / FESCC. (2020) 58:294–305. doi:  10.1515/cclm-2019-0471 [DOI] [PubMed] [Google Scholar]
  • 45. Douxfils J, Foidart JM, Gaspard U, Chatel G, Taziaux M, Jost M, et al. Response to paper by Binkowska et al. Risk of venous thromboembolism during the use of oral estrogen-progestogen hormone therapies in light of most recent research findings. Commentary: Oestradiol is not the holy grail in the quest for the ideal oestrogen therapy. Prz Menopauzalny. (2023) 22:117–9. doi:  10.5114/pm.2023.128815 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Gemzell-Danielsson K, Apter D, Zatik J, Weyers S, Piltonen T, Suturina L, et al. Estetrol-Drospirenone combination oral contraceptive: a clinical study of contraceptive efficacy, bleeding pattern and safety in Europe and Russia. BJOG. (2022) 129:63–71. doi:  10.1111/1471-0528.16840 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Oedingen C, Scholz S, Razum O. Systematic review and meta-analysis of the association of combined oral contraceptives on the risk of venous thromboembolism: The role of the progestogen type and estrogen dose. Thromb Res. (2018) 165:68–78. doi:  10.1016/j.thromres.2018.03.005 [DOI] [PubMed] [Google Scholar]
  • 48. Archer DF, Nakajima ST, Sawyer AT, Wentworth J, Trupin S, Koltun WD, et al. Norethindrone acetate 1.0 milligram and ethinyl estradiol 10 micrograms as an ultra low-dose oral contraceptive. Obstet Gynecol. (2013) 122:601–7. doi:  10.1097/AOG.0b013e3182a1741c [DOI] [PubMed] [Google Scholar]
  • 49. Gemzell-Danielsson K, Sitruk-Ware R, Creinin MD, Thomas M, Barnhart KT, Creasy G, et al. Segesterone acetate/ethinyl estradiol 12-month contraceptive vaginal system safety evaluation. Contraception. (2019) 99:323–8. doi:  10.1016/j.contraception.2019.02.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Nelson AL, Kaunitz AM, Kroll R, Simon JA, Poindexter AN, Castano PM, et al. Efficacy, safety, and tolerability of a levonorgestrel/ethinyl estradiol transdermal delivery system: Phase 3 clinical trial results. Contraception. (2021) 103:137–43. doi:  10.1016/j.contraception.2020.11.011 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

DataSheet1.docx (220.1KB, docx)

Data Availability Statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below https://osf.io/n9dav/.


Articles from Frontiers in Endocrinology are provided here courtesy of Frontiers Media SA

RESOURCES