Abstract
Objective
To document the efficacy and safety of etonogestrel subdermal contraceptive implants, levonorgestrel (LNG) intrauterine systems (IUS), and copper (Cu) intrauterine devices (IUDs) for birth control when extended beyond prescription limits.
Data sources
A systematic search of MEDLINE, Embase, and Global Health electronic databases.
Study selection
The search identified articles published between January 2000 and June 2023 on long-acting reversible contraceptive (LARC) methods and extended duration of use. Publications on LNG subdermal implants or the “frameless” IUD (not marketed in Canada), case reports, case series, animal studies, and publications not written in English or French were excluded.
Synthesis
Twenty-five publications were included. No pregnancies were reported during prolonged use of the etonogestrel-releasing implant for 1 or 2 additional years beyond the recommended limits (783 participants and 306 participants, respectively), nor with the use of the TCu380A IUD for years 8 to 11 (682 participants), 8 to 12 (356 participants), and 11 to 16 (228 participants). No pregnancies were reported with the LNG-IUS in 9 studies with follow-up from 6 to 15 years, while 2 pregnancies were reported during year 6 in 2 studies, and 4 pregnancies during year 7 in 3 studies. The risk of expulsion persisted during prolonged use of the TCu380A device and the 52-mg LNG-IUS. Other adverse events were infrequent.
Conclusion
Prolonged use of LARCs is safe and much more effective than short-acting contraceptive methods. Prolonged use of LARCs might be beneficial for individuals requiring contraception especially those with disrupted access to social and health care services or living in more remote areas.
Résumé
Objectif
Documenter l’efficacité et la sécurité des implants contraceptifs sous-cutanés à l’étonogestrel, des systèmes intra-utérins (SIU) au lévonorgestrel (LNG) et des dispositifs intra-utérins (DIU) au cuivre (Cu) pour la contraception lorsqu’ils sont utilisés au-delà des limites de la prescription.
Sources de l’information
Une recension systématique dans les bases de données électroniques MEDLINE, Embase et Global Health.
Sélection des études
La recension a permis de cerner des articles publiés entre janvier 2000 et juin 2023 sur les méthodes de contraception réversibles à longue durée d’action (CRLDA) et la durée prolongée de leur utilisation. Les publications sur les implants sous-cutanés au LNG et les DIU « sans cadre » (qui ne sont pas commercialisés au Canada), les rapports de cas, les séries de cas, les études sur des animaux et les publications qui n’étaient pas rédigées en français ou en anglais ont été exclus.
Synthèse
Vingt-cinq publications ont été incluses. Aucune grossesse n’a été rapportée durant l’utilisation prolongée de l’implant à libération d’étonogestrel pendant 1 ou 2 années de plus que les limites recommandées (783 participantes et 306 participantes respectivement) ou au cours de l’utilisation du DIU TCu380A pendant les années 8 à 11 (682 participantes), 8 à 12 (356 participantes) et 11 à 16 (228 participantes). Aucune grossesse n’a été signalée avec le SIU-LNG dans 9 études dans lesquelles le suivi durait de 6 à 15 ans, tandis que 2 grossesses ont été rapportées durant l’année 6 dans 2 études, et 4 grossesses durant l’année 7 dans 3 études. Le risque d’expulsion a persisté durant l’utilisation prolongée du dispositif TCu380A et du SIU-LNG de 52 mg. Les autres événements indésirables étaient rares.
Conclusion
L’utilisation prolongée de la CRLDA est sécuritaire et beaucoup plus efficace que les méthodes de contraception à courte durée d’action. L’usage prolongé des méthodes de CRLDA pourrait être bénéfique chez les personnes qui ont besoin de contraception, en particulier chez celles qui ont un accès interrompu aux services sociaux et de santé ou qui vivent dans des régions plus éloignées.
Long-acting reversible contraceptive (LARC) methods, including nonhormonal copper (Cu) intrauterine devices (IUDs), levonorgestrel (LNG)-releasing intrauterine systems (IUS), and etonogestrel (ENG)-releasing subdermal contraceptive implants, are widely used around the world.1 There are no recent Canadian data on LARC use, but a significant increase in IUD use (4.3% to 8.8%) was observed between 2006 and 2016 in sexually active Canadian women aged 15 to 50 years who reported using contraception (P<.001).2 Available LARC methods are approved for limited durations of use: the ENG implant is approved for 3 years3; most Cu-IUDs, for 5 to 10 years4,5; the 19.5-mg LNG-IUS for 5 years6; and the 52-mg LNG-IUS (in Canada, as of February 2024) for up to 8 years.7
Since it might be difficult for patients to access services and health care professionals,8 especially during periods of social disruption such as the COVID-19 pandemic,9 and because trauma might arise during insertion or removal of these devices (vascular or neurologic trauma for subdermal implants,10,11 uterine perforation for IUDs,12,13 etc), it might be desirable to use these devices for longer durations. As mentioned by Ali et al, extending the use of LARCs could reduce the number of insertion and withdrawal procedures, open up new consultation slots to other contraceptive seekers, and save millions of health care dollars.14
The objective of this systematic review was to document the efficacy and safety of ENG contraceptive implants, LNG-IUS, and Cu-IUDs for birth control when their duration of use is extended beyond the limits approved by Health Canada.
METHODS
Two library science experts searched MEDLINE, Embase, and the Global Health electronic database via the Ovid interface for studies published between January 2000 and June 2023, in either French or English, that identified the concepts of LARC and extended duration of use. The search strategy used terms describing the concepts of ENG implants, Cu-IUDs, LNG-IUS, and extended duration of use (Appendix 1, available from CFPlus*). The reference lists of articles selected for extraction and quality assessment were searched for other relevant studies.
Study selection
Eligible study designs were systematic or narrative reviews, randomized controlled trials, cohort studies, case-control studies, descriptive studies, expert opinions, and guidelines. Publications on LNG implants or the “frameless” IUD (not marketed in Canada), case reports, case series, and animal studies were not retained. After excluding duplicates, all titles and abstracts were reviewed by 2 independent reviewers (H.A. and M.B.), and those meeting inclusion criteria were selected and read in their entirety. Any disagreements between the 2 reviewers were resolved by discussion, rechecking of the publication, and consultation with a third party (E.G.), if necessary. The research was documented in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) protocols.15 For each study, its objectives, design, location, population, inclusion and exclusion criteria, recruitment period, ethical aspects and consent, methodology, results, strengths and limitations, discussion points, and authors’ conclusions were documented by 2 data extractors (H.A. and M.B.). The following data were extracted for guidelines: generalities, efficacy, indications and targeted population, contraindications, noncontraceptive benefits, drug interactions, adverse effects, use according to weight or body mass index (BMI), initial assessment, interventions in case of difficulty, replacement, duration of use, and authors’ recommendations.
The quality of selected studies was assessed by 2 independent reviewers (H.A. and M.B.) using the JBI Critical Appraisal Tools,16 the CASP (Critical Appraisal Skills Programme) Systematic Review Checklist,17 and the SANRA (Scale for the Assessment of Narrative Review Articles) tool.18 Guidelines were assessed using the AGREE II (Appraisal of Guidelines for Research and Evaluation II) grid.19
In accordance with article 2.2 of the research ethics board of Laval University, Que, research was exempted from evaluation because it was based exclusively on information that was accessible to the public through a mechanism established by regulation and in the public domain, and because the persons concerned had no reasonable expectation of privacy.20
SYNTHESIS
Results
The search yielded 1488 titles (Figure 1).15 Following exclusions, 22 publications (2 guidelines and 20 scientific articles) were retained. An additional 5 scientific articles were added from 1 author’s (E.G.) bibliographic database. All 27 publications were extracted and assessed for quality. Two articles were rejected because of low quality score: Rocca et al21 (score 17% with CASP Systematic Review Checklist) and Honorato et al22 (score 25% with the JBI checklist for analytical cross-sectional studies). Quality scores were greater than 85% for most of the selected articles and reviews.
Figure 1.
Flowchart for literature search and study selection based on PRISMA guidelines for systematic reviews
Efficacy and safety of the ENG contraceptive implant beyond the approved duration of use (Table 1).14,23-32 No pregnancy occurred in 783 participants who extended implant use for 1 additional year14,25,28 or in 306 participants who extended use for 2 additional years.14,25 Two prospective studies24,25 and 1 cross-sectional study23 demonstrated median serum ENG levels above the theoretical minimum threshold for ovulation inhibition (90 pg/mL)27 after 3, 4,23-25 and 5 years25 of implant use. A weak relationship between serum ENG and time since insertion was demonstrated in 1 study,23 while no association with BMI was found in 3 studies.23-25 The most frequent adverse events in years 4 and 5 were irregular bleeding, reported by 46.2% of users; headache, reported by 31.8% of users; and lower abdominal pain, reported by 17.9% of users.14
Table 1.
Summary of publications on prolonged duration of etonogestrel contraceptive implants: A) Scientific articles and B) guidelines.
| A) SCIENTIFIC ARTICLES | ||||||
|---|---|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | DESIGN | COUNTRY | OBJECTIVES | INCLUDED STUDIES OR DESCRIPTION OF SAMPLE | CHARACTERISTICS OF PARTICIPANTS | RESULTS |
| Morrell et al, 201423 Quality score=50% |
Cross-sectional | USA | To determine whether BMI decreases serum ENG levels in ENG implant users, particularly when implant use reaches 3 y and beyond | Participants using the ENG implant for more than 1 y:
|
Mean age: 28 y (SD 6 y) Median BMI in obese participants: 35 kg/m2 (range 31-56 kg/m2) |
|
| McNicholas et al, 201524 Quality score=100% |
Prospective descriptive study | USA | To evaluate the efficacy of the ENG implant and the 52-mg LNG-IUS beyond the current USA FDA-approved duration (3 and 5 y, respectively) | 237 ENG implant users:
|
Mean age 26.0 y (SD 5.4 y) Nulliparous and multiparous BMI: 16.6 to 53.2 kg/m2:
|
|
| Ali et al 201614 Quality score=90% |
Comparative cohort study | WHO multicentre study: Brazil, Chile, Dominican Republic, Thailand, Turkey, Zimbabwe | To evaluate efficacy, side effects, and reasons for discontinuation following prolonged use of the ENG contraceptive implant for up to 5 y compared to LNG implant and Cu380A | 390 ENG implant users who started prolonged use:
|
Mean age: 27.8 y (SD: 6.1 y; range: 18-43) Nulliparous and multiparous Mean BMI: 23.7 (3.8) kg/m2 |
|
| McNicholas et al, 201725 Quality score=88% |
Prospective descriptive study | USA | To evaluate the efficacy of the ENG implant and the 52-mg LNG-IUS beyond the current FDA-approved duration (3 and 5 y, respectively) | 291 ENG implant users who began the EPIC study:
|
Age: 18-45 y
Nulliparous and multiparous BMI:
|
|
| Goldstuck and Le, 201826 Quality score=38% |
Systematic review | NA | To compare the controlled release of LNG and ENG from LNG-IUS and implants | 1 study on prolonged use of the ENG implant: McNicholas et al, 201725 | NA | |
| Thaxton and Lavelanet, 201928 Quality score=88% |
Systematic review | Brazil, Chile, Dominican Republic, Hungary, Thailand, Turkey, Zimbabwe, USA, and China | To verify the contraceptive efficacy of progestin-only implants beyond currently approved durations of use | Ali et al, 201614; McNicholas et al, 201725; Yao and Du, 2003,29 n=51 (4 y); Zheng et al, 1999,30 n=151 (4 y); Kiriwat et al, 1998,31 n=47 (4 y) | NA | |
| B) GUIDELINES | ||||
|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | ORGANIZATION | COUNTRY | TITLE | SPECIFIC RECOMMENDATIONS AND LEVELS OF EVIDENCE FOR ENG CONTRACEPTIVE IMPLANT USE |
| Dethier et al, 202232 Quality score=86% |
SFP | USA | SFP clinical recommendation: extended use of long-acting reversible contraception |
|
BMI—body mass index, Cu—copper, CYP3A4—cytochrome P450 3A4, ENG—etonogestrel, EPIC—Effectiveness the Prolonged Use of the IUD and Implant, FDA—Food and Drug Administration, IUS—intrauterine system, LNG—levonorgestrel, NA—not applicable, SFP—Society of Family Planning, USA—United States of America, WHO—World Health Organization.
In 2022, the Society of Family Planning (SFP)32 recommended informing patients that the contraceptive efficacy of the 68-mg ENG implant was maintained beyond the 3 to 5 years’ duration currently approved by the US Food and Drug Administration (grade 1A evidence).
Efficacy and safety of the Cu-IUD beyond the approved duration of use (Table 2).32-39 The studies by Rowe et al from 1997 and 2016 reported no pregnancies in patients using the TCu380A IUD during, respectively, 1440 women-years of observation from 8 to 12 years after insertion (n=356) and 1342 women-years of observation from 7.2 to 11 years after insertion (n=682).33,37 Combining data from the 1997 study by Rowe et al33 and a 2005 study from Bahamondes et al (n=228),34 Ti et al38 calculated an overall pregnancy rate of 0.0 per 100 women-years (95% CI 0.0 to 0.8) for years 11 and 12. Sivin35 combined data from the Population Council, the World Health Organization, and Bahamondes et al (2005)34 and reported no pregnancies in 1886 women-years of observations from years 10 through 15.
Table 2.
Summary of publications on prolonged duration of Cu-IUDs: A) Scientific articles and B) guidelines.
| A) SCIENTIFIC ARTICLES | ||||||
|---|---|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | DESIGN | COUNTRY | OBJECTIVE | INCLUDED STUDIES OR DESCRIPTION OF SAMPLE | CHARACTERISTICS OF PARTICIPANTS | RESULTS |
| Rowe et al, 199733 Quality score=90% |
Randomized controlled study | 24 Chinese and non-Chinese centres | To compare the long-term efficacy (8, 10, and 12 y) of Cu-IUDs TCu380A and TCu220C |
|
Mean age: 28.7 y (SD 4.9 y) (range 16-40 y) Multiparous |
At the end of the 12th year:
|
| Bahamondes et al, 200534 Quality score=75% |
Descriptive study | Brazil | To evaluate the performance of TCu380A in participants using this IUD for more than 10 y and aged ≥35 y at the end of the 10th year of use | N = 228
|
Mean (SD) age after 10 y of use: 38.8 (0.4) y Nulliparous and multiparous |
|
| Sivin, 200735 Quality score=100% |
Commentary and expert opinion | NA | To examine the extent of contraceptive need among participants aged ≥40 y, and the extent to which this need can be met when starting to use Cu-IUDs at 25 to 35 y | Bahamondes et al, 200534; study 799914: unpublished data from the comparative trial of the TCu220C and the T380A done by WHO (personal communication with T.M.M. Farley and S. Peregoudov, WHO, August 2004); Rowe et al, 199733; internal documented studies of the Population Council | NA |
|
| Kaneshiro and Aeby, 201036 Quality score=50% |
Narrative review | NA | To describe the long-term safety, efficacy, and acceptability of the TCu-380A Cu-IUD | Rowe et al, 199733; Bahamondes et al, 200534; Sivin, 200735 | NA | See summaries above |
| Rowe et al, 201637 Quality score=91% |
Randomized controlled trial | Brazil, Chile, China, Mongolia, Slovenia, Thailand, Tunisia, Philippines | To compare the efficacy of TCu380A and 52-mg LNG-IUS over 7 y (with extended follow-up of 8 to 11 y) | TCu380A: n=1871 LNG-IUS: n = 1884 |
Mean age: 29.9 y (SD 4.95 y) Mostly multiparous (5 nulliparous in the TCu380A group) |
|
| Ti et al, 202038 Quality score=100% |
Systematic review | NA | To determine the efficacy and safety of IUDs when used beyond the approved duration | Two studies on TCu380A: Rowe et al, 199733 (n=245) (12 y); Bahamondes et al, 200534 (n=228) (up to 16 y) | NA |
|
| B) GUIDELINES | ||||
|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | ORGANIZATION | COUNTRY | TITLE | SPECIFIC RECOMMENDATIONS AND LEVELS OF EVIDENCE FOR CU-IUD USE |
| Wu and Pickle, 201439 Quality score=71% |
SFP | USA | Extended use of the IUD: a literature review and recommendations for clinical practice | Level A recommendations (based on consistent and good-quality patient-oriented evidence):
Level B recommendations (based on inconsistent or limited-quality patient-oriented evidence):
|
| Dethier et al, 202232 Quality score=86% |
SFP | USA | SFP clinical recommendation: extended use of long-acting reversible contraception |
|
Cu—copper, FDA—Food and Drug Administration, IUD—intrauterine device, IUS—intrauterine system, LNG—levonorgestrel, NA—not applicable, PID—pelvic inflammatory disease, SE—standard error, SFP—Society of Family Planning, USA—United States of America, WHO—World Health Organization.
The expulsion rate was 1.3 per 100 women-years for years 11 and 12, and 0.7 per 100 women-years from 7.2 to 11 years, in Rowe et al (1997)33 and Rowe et al (2016),37 respectively. In Bahamondes et al (2005),34 the expulsion rates were 2.1 and 1.1 per 100 women-years in years 11 and 12, and 3 expulsions occurred from years 13 to 16. In comparison, in Rowe et al (2016),37 the cumulative expulsion rate was 3.49 per 100 women-years in the first year after insertion, and 7.30 per 100 women-years after 5 years. Bleeding or pain or both led to IUD discontinuation in 4.6 per 100 women-years between years 10 and 12, and 1.2 per 100 women-years from 7.2 to 11 years, in Rowe et al (1997)33 and Rowe et al (2016),37 respectively. In Bahamondes et al (2005),34 these figures were 1.6, 1.1, 2.5, 3.4, and 0 per 100 women-years at years 11, 12, 13, 14, and 15 to 16, respectively. In Rowe et al (2016),37 the cumulative rates for discontinuation due to heavy bleeding and pain were 2.42 and 1.72 per 100, respectively, 1 year after insertion, and 7.42 and 5.01 per 100, respectively, after 5 years. Other problems were found to be rare or nonexistent.33-35,37
The 2014 and 2022 SFP guidelines32,39 recommended prolonged use of the 380-mm2 Cu-IUD (equivalent to TCu380A) for 12 years, regardless of the patient’s age at insertion. The 2022 SFP guideline32 recommended that the use of all 380-mm2 Cu-IUDs be extended beyond 12 years, and up to 20 years or until menopause, for patients older than 30 years of age at the time of insertion.
Efficacy and safety of the LNG-IUS beyond the approved durations of use (Table 3).24-26,32,37-53 Prolonged use was reported only for 52-mg LNG-IUS. No pregnancies were reported in 9 studies at different durations of use, ranging from year 649,50 to years 6 and 7,40,41 years 6 to 8,44 year 8,51,52 years 9 and 10,53 years 6 to 11,37 and years 6 to 15.49 A total of 2 pregnancies were reported in year 6 in 2 studies24,52 (n=625), and 4 pregnancies were reported in year 7 in 3 studies (n=1228).25,51,52 In a 2020 meta-analysis of 4 studies25,38,41,49 by Ti et al,38 the cumulative pregnancy rate during years 6 and 7 was 0.02 per 100 women-years.
Table 3.
Summary of publications on prolonged duration of LNG-IUS: A) Scientific articles and B) guidelines.
| A) SCIENTIFIC ARTICLES | ||||||
|---|---|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | DESIGN | COUNTRY | OBJECTIVE | INCLUDED STUDIES OR DESCRIPTION OF SAMPLE | CHARACTERISTICS OF PARTICIPANTS | RESULTS |
| Sivin et al, 199140 Quality score=91% |
2-y cohort study after 5-y randomized trial | USA, Brazil, Egypt, Singapore | To describe the events that occurred during the 7-y period following the insertion of either 52-mg LNG-IUS or TCu380A IUD from a trial undertaken by the Population Council | At the beginning of the 7th y of follow-up: 172 participants with a 52-mg LNG-IUS | Age: 18-38 y Multiparous |
|
| Rönnerdag and Odlind, 199941 Quality score=75% |
Prospective descriptive study | Sweden | To evaluate, according to various health parameters, long-term effects of using the 52-mg LNG-IUS for more than 2, 5-y periods |
|
Mean age: 30.3 (SD 4.9) y Multiparous |
|
| Hidalgo et al, 200942 Quality score=88% |
Prospective descriptive study | Brazil | To assess serum LNG and E2 levels and endometrial thickness every 6 mo between 7 and 8.5 y after insertion of 52-mg LNG-IUS | Subsample of 86 participants from a previous study (Diaz et al, 200043) out of 256 participants who received an LNG-IUS: 67 remaining after 7 y of use | Mean age: 33.4 y (SD 0.8 y) Mean BMI at 84 mo: 26.8 (range 18.3-47.3) kg/m2 | Serum LNG levels (mean±SEM):
|
| Seeber et al, 201244 Quality score=100% |
Retrospective descriptive study | Austria | To determine the extent and evolution over time of LNG plasma distribution in patients with LNG-IUS | 113 participants among which 35 used LNG-IUS ≥6 y | Mean age: 42.3 (SD 8.2) (range 18.3-55.4) y; mean BMI: 24.3 (SD 4.3) (range 17.8-38.5) kg/m2 |
|
| McNicholas et al, 201524 Quality score=100% |
Prospective descriptive study | USA | To evaluate the efficacy of the ENG implant and the 52-mg LNG-IUS beyond the current USA FDA-approved duration (3 and 5 y, respectively) | 263 users of 52-mg LNG-IUS (197.7 women-years of use); >1 additional year of use: n=108 | Mean age: 32.2 y (SD 5.9 y) BMI (kg/m2):
|
|
| Rowe et al, 201637 Quality score=96% |
Randomized controlled trial | Brazil, Chile, China, Mongolia, Slovenia, Thailand, Tunisia, Philippines | To compare rates of unintended pregnancy, method continuation, and reasons for withdrawal in participants using the 52-mg LNG-IUS or TCu380A over a 10-y period | Out of 3836 eligible participants: 1884 with LNG-IUS (7903 women-years of observation) | Mean age: 29.8 y (SD 5.12 y) Nulliparous (4 participants) and multiparous |
|
| McNicholas et al, 201725 Quality score=88% |
Prospective descriptive study | USA | To evaluate the efficacy of the ENG implant and the 52-mg LNG-IUS in participants using the method beyond the current USA FDA-approved duration of 3 and 5 y | 496 users of 52-mg LNG-IUS: >12 additional mo: n=347; >24 additional mo: n=160 | Age, y:
BMI (kg/m2):
Nulliparous (29.6%) and multiparous |
|
| Goldstuck and Le, 201826 Quality score=38% |
Systematic review | NA | To compare the controlled release of LNG and ENG from LNG-IUS and implants | Data from studies of Bayer Pharmaceuticals, 201745; Xiao et al, 199046; Goldstuck, 201747; McNicholas et al, 201725; Hidalgo et al, 200942 |
NA |
|
| Creinin et al, 201848 Quality score=64% |
Cohort study (abstract) | USA | To evaluate LNG plasma concentrations for up to 7 y in nonobese and obese participants using a 52-mg LNG-IUS | 40 participants in a planned substudy (19 obese, 21 nonobese) who had samples taken between insertion and 84 mo (7 y) | Age: 16-45 y Mean BMI:
|
|
| Bahamondes et al, 201849 Quality score=100% |
Retrospective descriptive study | Brazil | To evaluate the contraceptive efficacy and clinical performance of a 52-mg LNG-IUS in a cohort of participants who have used the LNG-IUS beyond 60 mo of its approved lifespan (up to 15 y of use) | 776 participants who used the LNG-IUS beyond 60 mo:
|
Mean (SD) age: 32.0 (SD 0.24) y Nulliparous and multiparous |
|
| Westhoff et al, 202050 Quality score=86% |
Prospective descriptive study | USA | To report data supporting contraceptive use of a 52-mg LNG-IUS for ≥6 y | 1751 participants: 612 participants (5 y of use); 321 participants (6 y of use); 703, 402, 191, and 122 participants in the safety population had 5, 6, 7, and 8 y of use, respectively |
Mean (SD) age: 27.3 (SD 5.7) y:
Mean (SD) BMI (kg/m2): 26.9 (SD 6.8) (BMI ≥30: 25.1% and BMI ≥40: 5.3%) Nulliparous (57.7%) and multiparous |
|
| Ti et al, 202038 Quality score=100% |
Systematic review | NA | To determine the efficacy and safety of IUDs when used beyond the approved duration | 4 studies on LNG-IUS (total: 2098 participants): | NA |
|
| Creinin et al, 202251 Quality score=100% |
Prospective descriptive study | USA | To evaluate the efficacy and safety of the 52-mg LNG-IUS over a period of continuous use of up to 8 y | 1714 participants who had a 52-mg LNG-IUS inserted:
|
At the start of year 7:
Nulliparous (58.3%) and multiparous |
|
| Jensen et al, 202252 Quality score=100% |
Prospective descriptive study | USA | To evaluate the efficacy and safety of the 52-mg LNG-IUS during prolonged use (6-8 y) | 501 participants enrolled in the study: 362 (72.3%) started year 6; 243 started year 8; 223 completed year 8 | Mean age: 29.4 (SD 3.1) (range 18-35) y Nulliparous (47.2%) and multiparous BMI 27.9 kg/m2 (SD 6.9) |
|
| Chen et al, 202353 Quality score=100% |
Prospective descriptive study | USA | To evaluate the efficacy and safety of the 52-mg LNG-IUS over a period of continuous use lasting more than 8 y (8-10 y) | 1714 participants who had inserted a 52-mg LNG-IUS:
|
Mean age at the start of year 9: 35.3±6.2 y (74.9% <40 y); nulliparous (56.3%) and multiparous; BMI ≥30 kg/m2: 25.3% |
|
| Jensen et al, 202354 Quality score=100% |
Prospective descriptive study | USA | To estimate in vivo LNG release and systemic exposure to LNG and SHBG for 52-mg LNG-IUS until the end of 8 y of use and to compare with 19.5 mg LNG-IUS and 13.5 mg LNG-IUS during their respective approved periods of use | 501 participants enrolled in the study: 362 (72.3%) started year 6 and 223 (44.5%) completed year 8 | Age: 18-35 y; mean age: 29.4 y (SE=3.1) Nulliparous (47.2%) and multiparous Mean BMI: 27.9 kg/m2 (SE=6.9) |
|
| B) GUIDELINES | ||||
|---|---|---|---|---|
| AUTHORS, YEAR OF PUBLICATION, QUALITY SCORE | ORGANIZATION | COUNTRY | TITLE | SPECIFIC RECOMMENDATIONS AND LEVELS OF EVIDENCE FOR LNG-IUS USE |
| Wu and Pickle, 201439 Quality score=71% |
SFP | USA | Extended use of the IUD: a literature review and recommendations for clinical practice | Level A recommendation (based on consistent and good-quality patient-oriented evidence):
Level B recommendations (based on inconsistent or limited-quality patient-oriented evidence):
|
| Dethier et al, 202232 Quality score=86% |
SFP | USA | SFP clinical recommendation: extended use of long-acting reversible contraception |
|
BMI—body mass index, Cu—copper, CV—coefficient of variance, CYP3A4—cytochrome P450 3A4, E2—estradiol, ENG—etonogestrel, FDA—Food and Drug Administration, FSH—follicle-stimulating hormone, IUD—intrauterine device, IUS—intrauterine system, LNG—levonorgestrel, NA—not applicable, PID—pelvic inflammatory disease, SE—standard error, SEM—standard error of the mean, SFP—Society of Family Planning, SHBG—sex hormone—binding globulin, USA—United States of America.
Expulsions occurred rarely per additional year in several descriptive studies.40,50-53 Rowe et al (2016)37 observed an expulsion rate of 0.7, 1.2, and 0.8 per 100 women-years, in years 6, 7, and from years 8 to 11, respectively. In Bahamondes et al 2018,49 the cumulative rates of discontinuation (per 100 women-years) due to expulsions were 0.3, 0.6, 0, 1.1, and 2.1 for years 5 to 6, 7 to 8, 9 to 10, 11 to 12, and 13 to 14, respectively.
Regarding menstrual-related adverse events, most studies reported discontinuation rates of less than 5% during each additional year of use.37,40,50-53 In Bahamondes et al (2018),49 cumulative rates (per 100 women-years) of discontinuation due to bleeding or pain were 0.2, 2.3, and 0 for years 5 to 6, 7 to 8, and thereafter, respectively. Other adverse events occurred in very low frequencies in all studies.
Prolonged use of the 52-mg LNG-IUS for 7 years39 or 8 years32 is recommended by the SFP, which also states that contraceptive effectiveness with extended use of 52-mg LNG-IUS is independent of BMI,32,39 and that patients taking cytochrome P450 3A4 inducers might be offered extended use of this IUS.32
DISCUSSION
The evidence reported no pregnancies with prolonged ENG implant use for 1 year14,25,28 and 2 years,14,25 with median serum ENG levels remaining high enough to inhibit ovulation during these additional years and not associated with BMI.23-25
For the TCu380A Cu-IUD, 3 large studies observed participants for prolonged use: 1 during years 8 to 11 in 682 women,37 1 during years 8 to 12 in 356 participants,33 and 1 during years 11 to 16 in 228 participants.34 These studies, mainly carried out in multiparous participants who were under 30 years of age at insertion, did not report any pregnancy.
For the 52-mg LNG-IUS, only a minimal number of pregnancies were reported between 6 and 15 years of use in nulliparous and multiparous participants. Although a statistically significant negative correlation was observed between plasma LNG concentrations and duration of use,44 these concentrations26,54 and in vivo release rates for 52-mg LNG-IUS54 after 7 or 8 years of use were similar to or higher than for 19.5-mg and 13.5-mg LNG-IUS at the end of their approved durations of use (5 and 3 years, respectively). Levonorgestrel levels, although lower in individuals with higher BMI or weight, did not appear to affect effectiveness.42,44,48,54
This reassuring evidence indicate that the long-term efficacy of the ENG implant, TCu380A IUDs, and the 52-mg LNG-IUS are comparable to their short-term efficacy and superior to those of short-acting reversible methods.55 Society of Family Planning guidelines32,39 recommend that the ENG implant be used for 5 years, the TCu380A for 12 years, and the 52-mg LNG-IUS for 8 years in all participants. The SFP also recommends that all 380-mm2 Cu-IUDs be used for 12 to 20 years, or until menopause if inserted after the age of 30.
Limitations
Despite the quality of the studies, none compared the efficacy of prolonged use of LARCs with the efficacy of LARCs replaced after each approved duration of use in a randomized trial. Low pregnancy rates might be explained by the fact that most of the participants who were followed in long-term studies might have low fertility and that their fertility declines with age. The selection of participants recruited in long-term studies, often healthy multiparous individuals, might not be representative of the general population and limits the generalizability of the results. Pharmacokinetic data, obtained on very small samples, do not provide a clear understanding of how much of the efficacy of the LNG-IUS is attributable to LNG or to the shape and size of the IUS. Data on the long-term efficacy of the LNG-IUS and the ENG implant according to BMI, or in relation to other medications, are still limited. High upfront cost of LARCs and the individual economic situations of persons interested in these methods might be factors limiting their use. Further studies are needed to clarify these aspects.
Life-table statistics expressed in terms of “women-years” are reported from original studies. However, we acknowledge that these data are relevant to transgender men and other gender-diverse people with a uterus who desire contraception.
Conclusion
The evidence and several guidelines support the extended use of LARCs. Such an extension can be very useful in standard living conditions and in situations of social and health care service disruption, or for populations living in remote areas. With the help of their health care providers, individuals should discuss the benefits versus the risks associated with LARC use beyond the limits currently recommended for birth control.
Supplementary Material
Footnotes
Appendix 1 is available from https://www.cfp.ca. Go to the full text of the article online and click on the CFPlus tab.
Contributors
All authors contributed to conceptualizing and designing the study; to collecting, analyzing, and interpreting the data; and to preparing the manuscript for submission.
Competing interests
None declared
This article has been peer reviewed.
Cet article a fait l’objet d’une révision par des pairs.
References
- 1.Department of Economic and Social Affairs, Population Division . World family planning 2022. Meeting the changing needs for family planning: contraceptive use by age and method. New York, NY: United Nations; 2022. Available from: https://www.un.org/development/desa/pd/sites/www.un.org.development.desa.pd/files/files/documents/2023/Feb/undesa_pd_2022_world-family-planning.pdf. Accessed 2025 Jan 1. [Google Scholar]
- 2.Black A, Rouhani S, Cook J.. Contraceptive use and ten-year trends in Canadian women of reproductive age. J Obstet Gynaecol Can 2019;41(5):711-2. [Google Scholar]
- 3.Drug and Health Product Portal [database] . Regulatory decision summary for Nexplanon. Ottawa, ON: Government of Canada; 2020. Available from: https://dhpp.hpfb-dgpsa.ca/review-documents/resource/RDS00837. Accessed 2024 Jan 21. [Google Scholar]
- 4.Liberté IUDs. Richmond, BC: Medisafe Distribution. Available from: https://medisafecanada.com/products/liberte-iuds. Accessed 2025 Jan 22. [Google Scholar]
- 5.Mona Lisa 10 CuT 380A QL. Montréal, QC: Searchlight Pharma; 2016. Available from: https://www.monalisaiud.ca/hcp/wp-content/uploads/2017/12/NA-MLCuT380AQL-PI-MO1157e-Canada_EN.pdf. Accessed 2025 Jan 22. [Google Scholar]
- 6.Drug and Health Product Portal [database] . Regulatory decision summary for Kyleena. Ottawa, ON: Government of Canada; 2016. Available from: https://dhpp.hpfb-dgpsa.ca/review-documents/resource/RDS00197. Accessed 2024 Jan 21. [Google Scholar]
- 7.Drug and Health Product Portal [database] . Regulatory decision summary for Mirena. Ottawa, ON: Government of Canada; 2024. Available from: https://dhpp.hpfb-dgpsa.ca/review-documents/resource/RDS1718716557847. Accessed 2024 Jan 21. [Google Scholar]
- 8.Linton E, Mawson R, Hodges V, Mitchell CA.. Understanding barriers to using long-acting reversible contraceptives (LARCs) in primary care: a qualitative evidence synthesis. BMJ Sex Reprod Health 2023;49(4):282-92. Epub 2023 Feb 21. [DOI] [PubMed] [Google Scholar]
- 9.VanBenschoten H, Kuganantham H, Larsson EC, Endler M, Thorson A, Gemzell-Danielsson K, et al. Impact of the COVID-19 pandemic on access to and utilisation of services for sexual and reproductive health: a scoping review. BMJ Glob Health 2022;7(10):e009594. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Clermidy H, Fabre D, Hugues JN, Alonso CG, Mitilian D, Mercier O, et al. Management of etonogestrel implant migration into the pulmonary artery. Contraception 2022;113:62-7. Epub 2022 Mar 26. [DOI] [PubMed] [Google Scholar]
- 11.Laumonerie P, Blasco L, Tibbo ME, Leclair O, Kerezoudis P, Chantalat E, et al. Peripheral nerve injury associated with a subdermal contraceptive implant: illustrative cases and systematic review of literature. World Neurosurg 2018;111:317-25. Epub 2018 Jan 5. [DOI] [PubMed] [Google Scholar]
- 12.Reed SD, Zhou X, Ichikawa L, Gatz JL, Peipert JF, Armstrong MA, et al. Intrauterine device-related uterine perforation incidence and risk (APEX-IUD): a large multisite cohort study. Lancet 2022;399(10341):2103-12. Erratum in: Lancet 2022;400(10354):732. [DOI] [PubMed] [Google Scholar]
- 13.Barnett C, Moehner S, Do Minh T, Heinemann K.. Perforation risk and intra-uterine devices: results of the EURAS-IUD 5-year extension study. Eur J Contracep Reprod Health Care 2017;22(6):424-8. Epub 2018 Jan 11. [DOI] [PubMed] [Google Scholar]
- 14.Ali M, Akin A, Bahamondes L, Brache V, Habib N, Landoulsi S, et al. Extended use up to 5 years of the etonogestrel-releasing subdermal contraceptive implant: comparison to levonorgestrel-releasing subdermal implant. Hum Reprod 2016;31(11):2491-8. Epub 2016 Sep 26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Critical appraisal tools. Adelaide, Aust: Joanna Briggs Institute. Available from: https://jbi.global/critical-appraisal-tools. Accessed 2025 Jan 1. [Google Scholar]
- 17.CASP checklists—CASP systemic review checklist. Oxford, UK: Critical Appraisal Skills Programme. Available from: https://casp-uk.net/casp-tools-checklists/systematic-review-checklist. Accessed 2025 Jan 1. [Google Scholar]
- 18.Baethge C, Goldbeck-Wood S, Mertens S.. SANRA—a scale for the quality assessment of narrative review articles. Res Integr Peer Rev 2019;4:5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 2010;182(18):E839-42. Epub 2010 Jul 5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council of Canada . Tri-council policy statement: ethical conduct for research involving humans. Ottawa, ON: Government of Canada; 2022. Available from: https://ethics.gc.ca/eng/documents/tcps2-2022-en.pdf. Accessed 2025 Jan 1. [Google Scholar]
- 21.Rocca ML, Palumbo AR, Visconti F, Di Carlo C.. Safety and benefits of contraceptives implants: a systematic review. Pharmaceuticals (Basel) 2021;14(6):548. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Honorato M, Winkler CE, Fernandez C, Levancini M, Troncoso F, Parra M.. Intrauterine device users experience in a primary care facility in Santiago, Chile. Int J Gynecol Obstet 2012;119(Suppl 3):S581. [Google Scholar]
- 23.Morrell KM, Cremers S, Westhoff C, Davis AR.. Etonogestrel levels in normal-weight, overweight and obese women after 1 year or more of contraceptive implant use. Contraception 2014;90(3):292-3. [DOI] [PubMed] [Google Scholar]
- 24.McNicholas C, Maddipati R, Zhao Q, Swor E, Peipert JF.. Use of the etonogestrel implant and levonorgestrel intrauterine device beyond the U.S. Food and Drug Administration-approved duration. Obstet Gynecol 2015;125(3):599-604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.McNicholas C, Swor E, Wan L, Peipert JF.. Prolonged use of the etonogestrel implant and levonorgestrel intrauterine device: 2 years beyond Food and Drug Administration-approved duration. Am J Obstet Gynecol 2017;216(6):586.e1-586.e6. Epub 2017 Jan 29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Goldstuck ND, Le HP.. Delivery of progestins via the subdermal versus the intrauterine route: comparison of the pharmacology and clinical outcomes. Expert Opin Drug Deliv 2018;15(7):717-27. Epub 2018 Jul 18. [DOI] [PubMed] [Google Scholar]
- 27.Bennink HJ. Introduction: presentation of clinical data on Implanon®. Contraception 1998;58:75S-7S. [Google Scholar]
- 28.Thaxton L, Lavelanet A.. Systematic review of efficacy with extending contraceptive implant duration. Int J Gynaecol Obstet 2019;144(1):2-8. Epub 2018 Nov 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Yao XY, Du MK.. [A randomized study comparing the efficacy and bleeding pattern of Implanon and Norplant hormonal contraceptive implant]. Zhonghua Fu Chan Ke Za Zhi 2003;38(7):419-22. [PubMed] [Google Scholar]
- 30.Zheng SR, Zheng HM, Qian SZ, Sang GW, Kaper RF.. A randomized multicenter study comparing the efficacy and bleeding pattern of a single-rod (Implanon) and a six-capsule (Norplant) hormonal contraceptive implant. Contraception 1999;60(1):1-8. [DOI] [PubMed] [Google Scholar]
- 31.Kiriwat O, Patanayindee A, Koetsawang S, Korver T, Bennink HJ.. A 4-year pilot study on the efficacy and safety of Implanon, a single-rod hormonal contraceptive implant, in healthy women in Thailand. Eur J Contracept Reprod Health Care 1998;3(2):85-91. [DOI] [PubMed] [Google Scholar]
- 32.Dethier D, Qasba N, Kaneshiro B.. Society of Family Planning clinical recommendation: extended use of long-acting reversible contraception. Contraception 2022;113:13-8. Epub 2022 Jun 15. [DOI] [PubMed] [Google Scholar]
- 33.Rowe P, Boccard S, Farley TMM, Peregoudov S.. Long-term reversible contraception. Twelve years of experience with the TCu380A and TCu220C. Contraception 1997;56(6):341-52. [PubMed] [Google Scholar]
- 34.Bahamondes L, Faundes A, Sobreira-Lima B, Lui-Filho JF, Pecci P, Matera S.. TCu 380A IUD: a reversible permanent contraceptive method in women over 35 years of age. Contraception 2005;72(5):337-41. Epub 2005 Jul 18. [DOI] [PubMed] [Google Scholar]
- 35.Sivin I. Utility and drawbacks of continuous use of a copper T IUD for 20 years. Contraception 2007;75(6 Suppl):S70-5. Epub 2007 Apr 16. [DOI] [PubMed] [Google Scholar]
- 36.Kaneshiro B, Aeby T.. Long-term safety, efficacy, and patient acceptability of the intrauterine copper T-380A contraceptive device. Int J Womens Health 2010;2(1):211-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Rowe P, Farley T, Peregoudov A, Piaggio G, Boccard S, Landoulsi S, et al. Safety and efficacy in parous women of a 52-mg levonorgestrel-medicated intrauterine device: a 7-year randomized comparative study with the TCu380A. Contraception 2016;93(6):498-506. Epub 2016 Feb 23. Erratum in: Contraception 2017;94(3):288. Epub 2016 Jun 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Ti AJ, Roe AH, Whitehouse KC, Smith RA, Gaffield ME, Curtis KM.. Effectiveness and safety of extending intrauterine device duration: a systematic review. Am J Obstet Gynecol 2020;223(1):24-35.e3. Epub 2020 Jan 15. [DOI] [PubMed] [Google Scholar]
- 39.Wu JP, Pickle S.. Extended use of the intrauterine device: a literature review and recommendations for clinical practice. Contraception 2014;89(6):495-503. Epub 2014 Feb 26. [DOI] [PubMed] [Google Scholar]
- 40.Sivin I, Stern J, Coutinho E, Mattos CE, el Mahgoub S, Diaz S, et al. Prolonged intrauterine contraception: a seven-year randomized study of the levonorgestrel 20 mcg/day (LNG 20) and the copper T380 Ag IUDs. Contraception 1991;44(5):473-80. [DOI] [PubMed] [Google Scholar]
- 41.Rönnerdag M, Odlind V.. Health effects of long-term use of the intrauterine levonorgestrel-releasing system. A follow-up study over 12 years of continuous use. Acta Obstet Gynecol Scand 1999;78(8):716-21. [PubMed] [Google Scholar]
- 42.Hidalgo MM, Hidalgo-Regina C, Bahamondes MV, Monteiro I, Petta CA, Bahamondes L.. Serum levonorgestrel levels and endometrial thickness during extended use of the levonorgestrel-releasing intrauterine system. Contraception 2009;80(1):84-9. Epub 2009 Feb 27. [DOI] [PubMed] [Google Scholar]
- 43.Diaz J, Bahamondes L, Monteiro I, Petta C, Hildalgo MM, Arce XE.. Acceptability and performance of the levonorgestrel-releasing intrauterine system (Mirena) in Campinas, Brazil. Contraception 2000;62(2):59-61. [DOI] [PubMed] [Google Scholar]
- 44.Seeber B, Ziehr SC, Gschlieβer A, Moser C, Mattle V, Seger C, et al. Quantitative levonorgestrel plasma level measurements in patients with regular and prolonged use of the levonorgestrel-releasing intrauterine system. Contraception 2012;86(4):345-9. Epub 2012 Mar 6. Erratum in: Contraception 2013;88(1):194. [DOI] [PubMed] [Google Scholar]
- 45.Products from A to Z. [Mirena™, Kyleena™, Skyla® (levonorgestrel-releasing intrauterine system).]. Leverkusen, Germany: Bayer AG. Available from: https://www.bayer.com/en/products/products-from-A-to-Z. Accessed 2025 Jan 2. [Google Scholar]
- 46.Xiao BL, Zhou LY, Zhang XL, Jia MC, Luukkainen T, Allonen H.. Pharmacokinetic and pharmacodynamic studies of levonorgestrel-releasing intrauterine device. Contraception 1990;41(4):353-62. [DOI] [PubMed] [Google Scholar]
- 47.Goldstuck ND. Clarification of the role of the Jaydess (Skyla) LNG-IUS 13.5mg and Kyleena LNG-IUS 19.5mg as intrauterine contraceptive systems. Expert Rev Med Devices 2017;14(8):593-9. Epub 2017 Jul 11. [DOI] [PubMed] [Google Scholar]
- 48.Creinin MD, Gangestad A, Kimble TD, Carr B, Olariu A, Westhoff CL.. Plasma levonorgestrel levels in non-obese and obese women using a levonorgestrel 52 mg intrauterine sustem for up to 7 years. Fertil Steril 2018;110(4 Suppl):e46-7. [Google Scholar]
- 49.Bahamondes L, Fernandes A, Bahamondes MV, Juliato CT, Ali M, Monteiro I.. Pregnancy outcomes associated with extended use of the 52-mg 20 μg/day levonorgestrel-releasing intrauterine system beyond 60 months: a chart review of 776 women in Brazil. Contraception 2018;97(3):205-9. Epub 2017 Oct 18. [DOI] [PubMed] [Google Scholar]
- 50.Westhoff CL, Keder LM, Gangestad A, Teal SB, Olariu AI, Creinin MD.. Six-year contraceptive efficacy and continued safety of a levonorgestrel 52 mg intrauterine system. Contraception 2020;101(3):159-61. Epub 2019 Nov 28. [DOI] [PubMed] [Google Scholar]
- 51.Creinin MD, Schreiber CA, Turok DK, Cwiak C, Chen BA, Olariu AI.. Levonorgestrel 52 mg intrauterine system efficacy and safety through 8 years of use. Am J Obstet Gynecol 2022;227(6):871.e1-7. Epub 2022 May 13. [DOI] [PubMed] [Google Scholar]
- 52.Jensen JT, Lukkari-Lax E, Schulze A, Wahdan Y, Serrani M, Kroll R.. Contraceptive efficacy and safety of the 52-mg levonorgestrel intrauterine system for up to 8 years: findings from the Mirena Extension Trial. Am J Obstet Gynecol 2022;227(6):873.e1-12. Epub 2022 Sep 9. [DOI] [PubMed] [Google Scholar]
- 53.Chen BA, Kimble T, Harris LH, Kerns JL, Olariu AI, Creinin MD.. Levonorgestrel 52-mg intrauterine device efficacy and safety after more than 8 years of use. Obstet Gynecol 2023;141(5):1004-6. Epub 2023 Apr 5. [DOI] [PubMed] [Google Scholar]
- 54.Jensen JT, Reinecke I, Post TM, Lukkari-Lax E, Hofmann BM.. Extended use of levonorgestrel-releasing intrauterine system (LNG-IUS) 52 mg: a population pharmacokinetic approach to estimate in vivo levonorgestrel release rates and systemic exposure including comparison with two other LNG-IUSs. Contraception 2023;120:109954. Epub 2023 Jan 9. [DOI] [PubMed] [Google Scholar]
- 55.World Health Organization Department of Reproductive Health and Research, Johns Hopkins Bloomberg School of Public Health/Center for Communication Programs, Knowledge for Health Project . Family planning: a global handbook for providers (2018 update). Baltimore and Geneva: CCP and WHO; 2018. Available from: https://fphandbook.org/sites/default/files/global-handbook-2018-full-web_0.pdf. Accessed 2025 Jan 4. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

