Abstract
The vaginal ring (VR) is a female-initiated drug-delivery platform used for different indications, including HIV pre-exposure prophylaxis (PrEP). We conducted a systematic review of VR acceptability, values and preferences among women in low- and middle-income countries (LMIC) to inform further investment and/or guidance on VR use for HIV prevention. Following PRISMA guidelines, we used structured methods to search, screen, and extract data from randomized controlled trials (RCTs) and observational studies reporting quantitative outcomes of acceptability of the VR for any indication published 1/1970-2/2019 (PROSPERO: CRD42019122220). Of 1,110 records identified, 68 met inclusion criteria. Studies included women 15–50+ years from 25 LMIC for indications including HIV prevention, contraception, abnormal bleeding, and menopause. Overall VR acceptability was high (71–98% across RCTs; 62–100% across observational studies), with 80–100% continuation rates in RCTs and favorable ease of insertion (greater than 85%) and removal 89–99%). Users reported concerns about the VR getting lost in the body (8–43%), although actual expulsions and adverse events were generally infrequent. Most women disclosed use to partners, with some worrying about partner anger/violence. The VR was not felt during intercourse by 70–92% of users and 48–97% of partners. Acceptability improved over time both within studies (as women gained VR experience and worries diminished), and over chronological time (as the device was popularized). Women expressed preferences for accessible, long-acting, partner-approved methods that prevent both HIV and pregnancy, can be used without partner knowledge, and have no impact on sex and few side effects. This review was limited by a lack of standardization of acceptability measures and study heterogeneity. This systematic review suggests that most LMIC women users have a positive view of the VR that increases with familiarity of use; and, that many would consider the VR an acceptable future delivery device for HIV prevention or other indications.
Introduction
The vaginal ring (VR) is a long-acting drug-delivery platform that diffuses drugs embedded in polymeric matrices into the vaginal epithelium [1]. By avoiding gastrointestinal absorption and first-pass hepatic metabolism, VRs provide sustained, therapeutic levels of drugs with lower systemic exposure compared to oral therapies, possibly resulting in fewer side effects [1, 2].
VRs have demonstrated efficacy and are marketed for multiple indications including contraception (NuvaRing®) [3], progesterone-only contraception in nursing mothers (Progering®) [4], management of genitourinary syndrome and vasomotor symptoms of menopause (Estring®, Femring®, and Fertiring®) [5, 6], and polycystic ovarian syndrome [7] among others. More recently, a dapivirine ring for HIV prevention demonstrated moderate efficacy for HIV pre-exposure prophylaxis (PrEP) [8, 9] and is under review by the European Medicines Agency, with upcoming regulatory submissions to the US Food and Drug Administration and South African Health Products Regulatory Authority. Other VRs for HIV PrEP and multi-purpose prevention technologies (MPTs) are at various stages in the development pipeline [8, 10–13]. MPT VRs are particularly promising, as they increase efficiencies for users and health systems by simultaneously addressing multiple sexual and reproductive health needs [14].
Given the high burden of unintended pregnancies and sexually transmitted infections, including HIV, research efforts have focused on the development and implementation of female-initiated drug-delivery methods, such as the VR, particularly for low- and middle-income countries (LMIC). Improving options for female-initiated platforms in sexual and reproductive health is critical to address women’s diverse and dynamic preferences [15]. The addition of one contraceptive method to half or more of a population has been demonstrated to increase overall contraceptive use by 4 to 8% [16]. The correlation between increased platform options and uptake is also hypothesized to apply to HIV PrEP [17].
Acceptability and preference research play a crucial role in the design, evaluation, and implementation of VRs and other sexual and reproductive health products, as well as in the development of associated clinical guidance and policies [18]. To our knowledge, there has not been a review on the acceptability and preferences for VRs as a drug-delivery platform, irrespective of active pharmaceutical ingredient (API). We conducted a systematic review of the evidence base in the published and grey literature to assess the acceptability of the VR and related preferences among women in LMIC to inform further investment and/or guidance on VRs for HIV prevention.
Methods
This systematic review adheres to Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines [19] and the protocol is registered with PROSPERO (ID: CRD42019122220).
Conceptual framework
There is no consensus in the literature regarding the definition and conceptualization of acceptability; however, recent attempts to develop theoretical frameworks for health-care intervention acceptability are facilitating more robust assessments of acceptability and its impacts on health outcomes [20, 21]. These frameworks recognize that acceptability is a multifaceted concept, including attitudes, tolerances, and preferences, and is a key driver of intervention behavior. We operationalized the constructs from the Sekhon acceptability model to identify corresponding outcomes reported in the literature reviewed (Table 1) [21].
Table 1. Sekhon acceptability model constructs and systematic review operationalization.
Construct | Operationalization | Corresponding outcomes |
---|---|---|
Affective attitude | Feelings about the intervention | Acceptability, liking or recommending; finding physical attributes acceptable |
Burden | Perceived effort required to engage in intervention | Ease of use; ease of insertion and removal; cognitive and emotional burden of use |
Ethicality | Intervention fit with an individual’s value system; normative fit | Disclosure of use; use without partner/family knowledge; partner/family approval |
Intervention coherence | Understanding of the intervention | We did not include studies reporting intervention coherence |
Opportunity costs | Extent to which benefits, profits, or values must be given up engaging in the intervention | Impacts on sexual intercourse; vaginal discharge/irritation; expulsions; discomfort; and foreign body sensation |
Perceived effectiveness | Extent to which the intervention is perceived to achieve its purpose | Perceived ability to prevent pregnancy/infectious disease/other VR outcomes; reduced risk of certain cancers |
Self-efficacy | Confidence to perform the behaviors required for the intervention | Ability to support use |
Eligibility criteria
We included RCTs and observational studies in the peer-reviewed and grey literature reporting quantitative VR acceptability and/or preference data, from World Bank classified LMIC published between January 1, 1970 and March 1, 2019, and available in English. We focused this review on quantitative studies due to the relatively complex and poorly defined methods around the integration of qualitative and quantitative data [22]. We excluded qualitative studies, secondary analyses, or studies that only reported effectiveness or API-related side effects or complications. Women of any age were included, as well as their partners if partner-reported acceptability data were reported. We included both hypothetical (i.e. discrete choice experiment with hypothetical products) studies as well as those that used active or placebo VRs with or without comparator products.
Outcome measures
The primary outcome measure was VR acceptability, with acceptability defined as ‘a multi-faceted construct that reflects the extent to which people delivering or receiving a healthcare intervention consider it to be appropriate, based on anticipated or experienced cognitive and emotional responses to the intervention’ [21]. We considered ‘accept,’ ‘satisfy,’ ‘like,’ and ‘would recommend,’ as primary acceptability outcomes, corresponding to the ‘affective attitude’ construct (Table 1). We examined additional acceptability outcome measures corresponding to additional constructs, such as continuation, perceived effectiveness, non-API side effects, comfort, opinion on access, setting, frequency, route of administration, duration, and cost, impact on sex, partner acceptability, and stated preference (or ranking) or discrete choice compared to other options, as outlined in Table 1. In order to investigate the acceptability of the VR platform and not the API, we did not include known API side effects, with the exception of reports of bleeding if they reflected differences in route of administration or dose effects. Next, we extracted data regarding VR continuation, a frequently used proxy for acceptability in RCTs. Finally, we extracted data regarding women's values and preferences, which we defined as the relative importance that women place on benefits and burdens related to the device(s) under investigation. Values and preferences could include perceived effectiveness, route of administration, side effects, access/setting, frequency/duration, cost, comfort, impact on sex, and partner acceptability, among others. We also included fully contextualized or ‘global’ preference assessments of the VR in comparison to other delivery platforms which included stated preference (or ranking) of one device over another or discrete choice experiments.
Search strategy
We searched PubMed, Web of Science, and Embase from January 1, 1970 to March 1, 2019 using medical subject headings (MeSH) and keywords for relevant peer reviewed and grey literature. The complete search strategy can be found in supporting materials (S1 File). We hand-searched bibliographies of manuscripts and grey literature that met eligibility criteria to identify further, relevant references, which were subject to the same screening and selection process. We conducted a web search of VR acceptability to identify additional conference proceedings and reports. Finally, a predetermined list of VR research experts was consulted to identify additional grey literature not found through the above processes.
Data screening and extraction
Two team members independently reviewed the reference list of articles for inclusion (JG and KR) using a three-stage approach, including title, abstract, and full text review. Discrepancies during the screening process were resolved via consensus. A primary reviewer extracted article information (KR, RC, or JP) and a secondary reviewer (KR or RC) checked for accuracy using structured data extraction tables in Microsoft Word to extract article information, descriptive data, methods and study design, and outcomes (S2 and S3 Files).
Risk of bias and heterogeneity
We assessed risk of bias across randomized studies using Cochrane Collaboration methods by one primary and one secondary reviewer (KR and RC) against key criteria [23, 24]. The following judgments were used: low risk, high risk, unclear (i.e. lack of information or uncertainty over bias potential). Risk of bias across non-randomized studies were similarly assessed [25]. Conflicts were resolved via consensus. Studies with no ‘high risk of bias’ ratings were considered low risk of bias; studies with any ‘high risk of bias’ ratings were considered moderate risk of bias; and, two or more ‘high risk of bias’ ratings were considered high risk of bias. No studies were excluded based on risk of bias; however, we did compare acceptability outcomes in low risk versus and high/unclear risk studies.
We considered methodological and clinical heterogeneity by exploring the acceptability of the vaginal ring against both study design (RCT vs observational studies), and different subgroup participant characteristics (e.g. age, parity, etc…), as well as by the purpose of ring use. As data allowed, we presented comparative results on acceptability and preferences for studies that compared vaginal rings to other contraceptive, HIV/ID prevention, and menopausal management technologies.
Data analysis
We tabulated results by study type and indication for VR use. Summary measures included means and percentages for descriptive acceptability outcomes, and odds ratios and risk ratios for comparative outcomes. We conducted a narrative synthesis of included studies, including a summary of the following: 1) VR acceptability outcomes; 2) VR continuation (a common proxy for acceptability); and, 3) related values and preferences. Analysis of acceptability was examined by VR indication (e.g. contraception, HIV prevention, etc.) and participant characteristics (e.g. age, setting, etc.). As data allowed, we compared quantitative results on acceptability and preferences for VRs and other contraceptive, HIV prevention, and menopausal management technologies.
Results
Characteristics of included studies
We screened 1,110 unique citations in the published and grey literature (Fig 1). We excluded 772 citations yielding 338 citations for full text review. Of these, 68 reports from 47 unique studies met eligibility criteria. Most references that were excluded during full text review were conducted in high income countries or did not report acceptability outcomes. Most identified grey literature, including conference abstracts and reports, were duplicates of published literature and excluded.
Twenty-four observational studies and 14 RCTs were included from the peer-reviewed literature; nine additional observational studies and one RCT (the QUATRO study) were identified in the grey literature (Table 2). Eligible studies were conducted in 25 LMICs, with most studies from Asia (n = 17) and sub-Saharan Africa (n = 17). The most common VR indications were contraception (n = 28) and HIV prevention (n = 10). Nearly all studies were conducted among women of reproductive age (with varying definitions across studies; most definitions were 18 to 35 or 18 to 49 years) (n = 34), and postpartum/lactating women of reproductive age (n = 4). Most studies evaluated VR acceptability concurrent to use (n = 20), but some (n = 7) explored acceptability both prospectively (i.e. prior to use) and concurrent to use. Most RCTs had low risk of bias scores (n = 10), but observational studies largely had high or unclear risk of bias (n = 14).
Table 2. Study characteristics.
Characteristic | Randomized Controlled Trials N (%) |
Observational Studies N (%) |
Grey Literaturea N (%) |
Total Studies N (%) |
References |
---|---|---|---|---|---|
Total | 14 (100%) | 24 (100%) | 9 (100%) | 47 (100%) | |
Location | |||||
Asia: China, India, Malaysia, Pakistan, Thailand | 5 (36%) | 10 (42%) | 2 (22%) | 17 (36%) | [26–43] |
Sub-Saharan Africa: Kenya, Malawi, Nigeria, Rwanda, Senegal, South Africa, Tanzania, Uganda, Zambia, Zimbabwe | 7 (50%) | 5 (21%) | 5 (56%) | 17 (36%) | [9, 44–75] |
Americas: Brazil, Chileb, Dominican Republic, Mexico | 2 (14%) | 4 (17%) | 1 (11%) | 7 (15%) | [76–84] |
Other: Egypt, Tunisia, Russia, Ukraine | - | 3 (13%) | 1 (11%) | 4 (9%) | [85–89] |
Cross-regionalc | - | 2 (8%) | - | 2 (4%) | [90–92] |
Indication | |||||
Contraception | 4 (29%) | 20 (83%) | 4 (44%) | 28 (60%) | [26, 27, 29–31, 33–36, 38–43, 50–52, 55, 59, 69, 70, 76–78, 80, 82, 84–92] |
HIV-prevention | 4 (29%) | 2 (8%) | 4 (44%) | 10 (21%) | [9, 45–47, 54, 56, 57, 60–68, 71, 73, 74, 79] |
Multipurpose prevention technology | 2 (14%) | 1 (4%) | 1 (11%) | 4 (9%) | [48, 49, 53, 58, 72, 75, 83] |
Abnormal uterine bleeding | 3 (21%) | - | - | 3 (6%) | [28, 32, 44] |
Chronic pelvic pain | 1 (7%) | - | - | 1 (2%) | [37] |
Menopause symptom management | - | 1 (4%) | - | 1 (2%) | [81] |
Study population | |||||
Women of reproductive age | 14 (100%) | 16 (67%) | 4 (44%) | 34 (72%) | [9, 26, 28–34, 36, 37, 39, 40, 42, 44–47, 51–53, 55–61, 64–68, 72–75, 77, 79, 80, 82–88, 90–92] |
Young women (18 to 21) | - | - | 2 (22%) | 2 (4%) | [67, 68, 71] |
Postmenopausal women | - | 1 (4%) | 1 (11%) | 2 (4%) | [81] |
Postpartum/lactating women of reproductive age | - | 3 (13%) | 1 (11%) | 4 (9%) | [27, 35, 50, 69, 70, 89] |
Not reported | - | 4 (17%) | 2 (22%) | 6 (13%) | [38, 41, 43, 48, 49, 54, 62, 63, 76, 78] |
Timing of acceptability assessment | |||||
Prospective (hypothetical or prior to use) | - | 5 (21%) | 5 (56%) | 10 (21%) | [40, 48, 49, 53, 54, 57, 67, 68, 71, 82, 85, 86, 88, 91] |
Concurrent to use | 7 (50%) | 11 (46%) | 2 (22%) | 20 (43%) | [26, 27, 29, 31, 32, 34–39, 42, 55, 59, 62–64, 77, 79, 80, 83, 92] |
Prospective and concurrent | 4 (29%) | 1 (4%) | 2 (22%) | 7 (15%) | [9, 41, 43–47, 50, 56, 58, 60, 61, 65, 66, 69, 70, 72–75] |
Prospective, concurrent, and retrospective | 1 (7%) | - | - | 1 (2%) | [51, 52] |
Concurrent and retrospective | - | 1 (4%) | - | 1 (2%) | [81] |
Studies reporting continuation/use only | 2 (14%) | 6 (25%) | - | 8 (17%) | [28, 30, 33, 76, 78, 84, 87, 89, 90] |
Risk of Bias | |||||
Low | 9 (64%) | 10 (42%) | 1 (11%) | 20 (43%) | [9, 27, 28, 30, 32, 36, 44–47, 51, 52, 55–58, 60, 61, 65, 66, 72–76, 78, 81, 83–88, 90] |
High | 2 (14%) | 8 (33%) | - | 10 (21%) | [26, 29, 31, 33, 34, 42, 50, 59, 69, 70, 79, 92] |
Unclear | 3 (21%) | 6 (25%) | 8 (89%) | 17 (36%) | [35, 37–41, 43, 48, 49, 53, 54, 62–64, 67, 68, 71, 77, 80, 82, 89, 91] |
a Represents studies exclusively reported in the grey literature; some grey literature, i.e. unpublished manuscripts, were associated with studies already documented in the peer-reviewed literature.
b Chile was classified as an LMIC at the time the study was conducted.
c Cross-regional studies also included sites in the above-listed countries, Colombia, and Cuba.
Acceptability
Affective attitude–overall acceptability
Overall assessments of affective attitude were reported in seven RCTs and nine observational studies that involved actual use of VRs (Table 3). In RCTs, acceptability ranged from 70.8 to 96.7% [32, 44, 58, 64]. One RCT comparing intermittent and continuous users of NuvaRing in Rwanda reported that at baseline <1% of women would recommend the VR; while, at the end of the study, 98% would recommend the VR [52]. Across studies, a smaller proportion of women reported ‘liking’ the VR (52.9 to 62.6%) [58, 79], with a higher proportion of users ‘liking’ the VR with increased duration of use [58, 75]. In observational studies, ‘satisfaction’ was mostly high, with most studies reporting satisfaction greater than 90% [29, 36, 70]. In one observational study, satisfaction was higher among women who completed at least two cycles of use compared to those who discontinued [70]. Five contraceptive observational studies in the past decade reported that 92 to 100% of users would recommend the VR or found it acceptable [29, 36, 38, 42, 70], whereas a smaller proportion of women recommended VRs in studies from the 1980s [77, 80]. VR acceptability findings were supported by conference proceedings [35, 43].
Table 3. Studies reporting vaginal ring overall acceptability and/or continuation outcomes, endline assessment.
First author, year (Trial name) |
n (ring users) (Country) | Indication | Ring attributes | Satisfy (%) | Recommend (%) | Acceptable (%) |
Like (%) |
Continuation by month/cycle (%) |
Risk of biasa |
---|---|---|---|---|---|---|---|---|---|
Randomized Controlled Trials | |||||||||
Hardy; 2007 [79] | 405 (Brazil) | HIV prevention | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | - | - | - | 52.9 | - | H |
Nel; 2016 [64] | 280 (Kenya, Malawi, South Africa, Tanzania) | HIV prevention | Dapivirine, platinum-catalyzed silicone, 56x7.7mm | - | - | 96 | - | - | U |
Kestelyn, Kestelyn; 2018, 2018 [51, 52] |
120 (Rwanda) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | - | 98.3b | - | - | L | |
Mohamed; 2011 [59] | 300 (Egypt) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | - | - | - | - | 3 mo: 87.7 6 mo: 82.7 9 mo: 81.3 12 mo: 79.9 |
H |
Sharma; 2018 [39] | 225 (India) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 95.3 | - | - | - | - | U |
Hashim; 2012 [44] | 48 (Egypt) | Abnormal uterine bleeding | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 70.8 | - | - | - | 3 cycle: 100 | L |
Jain; 2016 [32] | 30 (India) | Abnormal uterine bleeding | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 96.7 | 90 | - | - | 90 | L |
Minnis, Weinrib, van der Straten; 2018, 2018, 2018 [58, 72, 75] (TRIO) |
277 (South Africa, Kenya) | MPT | Placebo, silicone elastomer (dimensions NR) | - | - | - | 65.6c | - | L |
Thurman; 2018 [83] (CONRAD A13-128) |
27 (Dominican Republic) | MPT | G1: TDF G2: TDF+LNG G3: Placebo Hydrophilic polyurethane, 55x5.5mm |
- | - | - | - | G1: 90.9% G2: 100% G3: 100% |
l |
Observational Studies | |||||||||
Barreiros, Guazzelli; 2007, 2009 [76, 78] |
75 (Brazil) | Contraception | NR | - | - | - | - | 82.7 | L |
Buckshee; 1990 [26] | 96 (India) | Contraceptive | LNG, Silastic, 55.6x9.5 mm | - | - | - | - | 52 wks: 44.5 | H |
Chen; 1998 [27] | 197 (China) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | - | - | - | - | 34.6 | U |
Das; 2016 [29] | 50 (India) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 95 | 96 | 92 | - | 88 | H |
Faundes, Hardy; 1981, 1983 [77, 80] | 355 (Brazil and Dominican Republic) | Contraception | LNG + estradiol, Silicone elastomer, 58 mm | - | 62.1 | - | - | - | U |
Gupta; 1986 [31] | 70 (India) | Contraception | Progesterone, Silicone elastomer, 55.6x9.5 mm | - | - | - | - | 3 mo: 55.7 6 mo: 45.7 9 mo: 37.1 (calculated) |
H |
Koetswang; 1990 [90] | 789 in LMIC (Tunisia, Zambia, Russia, India, Thailand, Pakistan, Brazil, Colombia, Cuba) | Contraception | LNG, Silicone elastomer, 55.6x9.5 mm |
- | - | - | - | Africa: 31.9 Asia: 40.1 China: 68.3 Latin America: 42.9 |
L |
Mehta; 1981 [34] | 39 (India) | Contraception | EE + d-norgestrel, polysiloxane, 61x9.5 mm | - | - | - | - | 56.4 | H |
Pandit; 2014 [36] | 252 (India) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 94.2 | 93.2 | - | - | - | L |
RamaRao, RamaRao, Ishaku; 2015, 2015, 2018 [50, 69, 70] |
363 (Kenya, Nigeria, Senegal) | Contraception | Silicone elastomer, 58mm x 8.4mm, 10 mg progesterone daily, administered continuously up to 3 months | 96.8 | 97.9 | - | - | - | H |
Santibenchakul; 2016 [38] | 39 (Thailand) | Contraception | EE, flexible, transparent, colorless, 54x4 mm (NuvaRing) | 71 | 100 | - | - | 6 cycle: 97.4 | U |
Shaaban; 1991 [89] | 103 (Egypt) | Contraception | Progesterone, silicone elastomer, 58.4x8.8 mm | - | - | - | - | 66.59 | U |
Sivin; 1981 [92] | 1,636 (Brazil, Dominican Republic, Nigeria) | Contraception | Progesterone, silicone elastomer, 58x8.4 mm | - | - | - | - | Salvador, Brazil: 48 Campinas, Brazil: 55 Dominican Republic: 36 Nigeria: 38 |
H |
Soni; 2013 [42] | 184 (India) | Contraception | EE + ENG, ethinyl vinyl acetate, 54x4 mm | - | 97 | - | - | 3 mo: 94.6 12 mo: 86.4 |
H |
EE = ethinyl estradiol; TDF = Tenofovir; LNG = levonorgestrel; ENG = etonogestrel; mo = months; G = Group; MPT = multipurpose prevention technology; wks = weeks
a Risk of bias summary assessments. H = high; L = low; U = unclear
b At end of study
c Mean score of liking product (1–5 Likert scale, higher score indicates higher acceptability)– 3.28, converted to 100 point scale.
Affective attitude–other
Other affective attitude outcomes, such as ‘willingness to use’ and ‘the best method’ were generally only reported by one study. In the IPM 011 study for HIV prevention, 69% of women said they were ‘very keen’ to use the VR after first hearing about it; at the final visit, all women said they would be willing to use the VR if it were found to be effective [74]. In two recent RCTs for HIV prevention, 68 to 96% of users would consider or were likely to use the VR in the future [45, 60]; and, a descriptive study among young women in South Africa reported that 44% would hypothetically try the VR as an HIV prevention product [71]. In the placebo TRIO study, most users reported it was acceptable to leave the VR in for one month (71.7%) and during menses (53.9%) [58]. In an RCT for chronic pelvic pain, 80% of VR users reported a composite outcome including compliance, acceptability, and that users would recommend the VR to others [37]. In an observational study of the VR for symptoms of menopause, 100% of women reported a positive experience [81]; and, an observational contraceptive study from the 1980s reported VR users were happy to have selected the VR (70%) and had a positive experience (64%) [77, 80].
Affective attitude–physical attributes
An important component of acceptability relates to physical attributes of the device. Several studies reported how women felt about ring size, appearance, color, and texture. In the TRIO study, two-thirds of women reported the VR looked acceptable [58]. In one RCT and two observational studies, 61.4 to 85.7% of users reported acceptable VR size [58, 70, 81]. In an observational study acceptability of VR color (88.3% baseline, 94.7% follow-up) and texture (53.2% baseline, 86.2% follow-up) increased with the duration of VR use [70]. Among women who did not find the VR acceptable, the proportion stating it was too big (45.7% baseline, 18.1% follow-up) or too soft (36.2% baseline, 9.6% follow-up) decreased with duration of use [70].
Burden–ease of use
Studies reporting data on burden reported ease of VR insertion and removal. In RCTs, greater than 85% of women reported ease of insertion across all time periods [52, 64]; others reported increasing ease of insertion or removal over time [36, 70, 74]. In observational studies, greater than 90% of women reported ease of insertion [29, 42, 70, 77, 80]; and, 89.3 to 98.5% reported ease of removal [42, 58, 70, 77, 80]. In observational studies, 12 to 14.1% of users reported difficult insertion/removal [38, 79].
Burden–cognitive/emotional burden and social harms
Studies measured the cognitive and/or emotional burden of VR use; however, there was no common measure reported across studies. Four RCTs of VR for HIV prevention and one NuvaRing RCT reported that at baseline or early in the study 8 to 43% of VR users had worries or concerns regarding partners not liking the ring or feeling the ring during sex, expulsions, loss in the body, discomfort during sex, or general worries, with concerns decreasing over time in nearly all studies [51, 64, 66, 73, 74] and varying between countries [47, 74]. In one RCT, worries were significantly higher among women who had experienced a partner-related social harm (defined as nonmedical adverse consequences from VR use or trial participation more generally) [66]. One observational study of contraceptive VR use in Brazil and the Dominican Republic reported that 34% of women worried whether the VR was inserted correctly [77, 80].
Ethicality/Fit within value system
While no studies directly measured ethicality, operationalized as how the VR fit within an individual’s value system, several studies examined VR disclosure to partners and families, and partner/family support of VR use. Three RCTs for HIV prevention and NuvaRing reported 64.2 to 99.2% of study participants disclosed VR use to their partner [52, 74, 93]. IPM 011 reported that 59% of study participants would use the VR without telling their partner [74]; and, 62.6% of women in TRIO reported that it was possible to use the VR without partner knowledge [58]. The MTN-020/ASPIRE RCT reported that 12% of partners did not approve of ring use at the end of the study period [45]. An observational study reported that family and others were not likely to know that women used VR (85 to 92.5% across sites in Brazil and the Dominican Republic) [77, 80]; and, a discrete choice experiment reported that the VR could easily be used without family knowledge (80.3%) [58]. However, in an observational study, approximately 90% of users said that their family would support VR use [70]. And, the least common specific VR worry at baseline was it not being liked by their partner (4%) or family (10%) [45]. An unpublished observational study of dapivirine VR reported that 57% of women disclosed their trial participation to their partner, but 34% reported ring removals due to their partner's influence [63]. Grey literature with country-specific results from Nigeria reported participants who said that their partner or family would support VR use were more satisfied with the VR (95%) compared to those whose partners or family would not support VR use (20%; p<0.01) [50, 70].
Opportunity costs–menstrual bleeding
Menstrual bleeding was the most frequently reported VR opportunity cost, with 11 studies (nine of which involved hormonal APIs) reporting on breakthrough bleeding, withdrawal bleeding, duration of menses, and other bleeding outcomes. RCTs largely reported improved bleeding outcomes (breakthrough bleeding, spotting, intended bleeding patterns) [28, 30, 32, 37, 59, 94]; comparable bleeding outcomes between active VRs and comparison products (Pictorial Blood Loss Assessment Chart scores, duration of menses, and intermenstrual and breakthrough bleeding) [28, 32, 64, 94]; or, no instances of abnormal vaginal bleeding [60]. An observational study reported that VR users had less frequent ‘normal bleeding,’ and significantly higher levels of amenorrhea compared to IUD users; however, it is unknown whether amenorrhea was acceptable to users [27]. In two observational studies from the 1980s and 1990s of contraceptive VRs, users reported more bleeding problems compared to combined oral contraceptive (COC) users [77, 80]; and, that resumption of menstruation was delayed in VR users compared to IUD users [89].
Opportunity costs–sexual intercourse
Thirteen studies reported outcomes related to sexual opportunity costs, most commonly reporting on the user or partner feeling the VR during sex. RCTs reported that 82.5 to 92% of users never felt the ring during sex [52, 64]. In three RCTs, many women (47.5 to 74%) reported that their partners did not feel the ring during sex; some (20 to 33%) reported that partners felt the ring during sex, but it wasn’t a problem; a smaller proportion of women (19%) reported that their partners liked the feeling of the ring during sex; 13 to 16% of women didn’t know if their partners felt the VR during sex; and, very few women reported that their partners (0 to 3%) did not like the way the VR felt during sex at least once during the study period [52, 64]. In one RCT for HIV prevention, 82% of women did not mind wearing a VR during sex and the VR was acceptable to 88% of partners [45]. Similarly, observational studies reported that the VR did not cause discomfort during sex [34] and was not felt during intercourse by 70 to 80% of women [29, 36, 70], although this sometimes changed over time [36, 70]. In the TRIO study, the ring felt acceptable to a majority of users (55.9%) and their partners (59.7%) during sex [58]. A range (3 to 40%) of partners or clients felt the VR during sex [29, 34, 38, 70]. In observational studies, the VR did not cause discomfort to partners [31]; most partners did not object to ring use [36]; and, 94% of partners did not object to the ring during sex [42]. There were no changes in sexual desire, sexual pleasure, or sexual activity in observational studies reporting these outcomes [27, 38, 59, 70].
Opportunity costs–discharge
Many studies reported non-API side effects of VR use related to vaginal discharge or vaginitis. All RCTs reported low levels of vaginal discharge and there were no significant differences between VR and comparison groups [28, 30, 32, 37, 52, 64, 74]. In seven additional observational studies for contraception and pelvic organ prolapse, 10 to 33% of women reported increased or excessive vaginal discharge [31, 38, 77, 80], and 2.5 to 3.8% of women reported vaginitis [29, 36, 42].
Opportunity costs–vaginal comfort or discomfort/irritation
Studies also reported outcomes related to comfort and discomfort/irritation. Two RCTs for HIV prevention reported VR ‘comfort,’ with 87 to 97% of women reporting that the VR is ‘usually’ or ‘very’ comfortable [45, 64, 74]. Few VR users (4.2 to 14%) reported vaginal discomfort or irritation across indications [26, 31, 36, 37, 94]. Feeling the VR varied across timepoints (0.6 to 21%) during daily activities in RCTs of HIV prevention [74] and contraception [44].
Opportunity costs–expulsions and slippage
Many studies reported outcomes related to VR expulsions and slippage. RCTs across indications reported expulsions in 0 to 12% of users [30, 32, 37, 44, 52, 95], primarily attributable to sex, urination or defecation [52, 61, 64, 96]. Observational studies also reported low proportions of women experiencing an expulsion across indications ranging from 1 to 10% [70, 81]. In one study, a larger proportion (33 to 50%) of women reported VR slippage at two time points [70], with reports of slipping and expulsions higher among women who discontinued (33 to 75% and 17 to 26%, respectively). In two studies of contraceptive VR from the 1980s in India, up to one-quarter of women experienced expulsions [31, 33].
Perceived effectiveness
No studies assessed perceived effectiveness of the VR platform separately from API effectiveness.
Self-efficacy
No peer-reviewed studies reported a measure of self-efficacy as a component of acceptability. In a currently unpublished study of the dapivirine VR, 31% of participants felt they could optimally support themselves to change the VR on time after 1 month of use [62].
Continuation
Most trials and observational studies reporting continuation outcomes suggest the VR is largely acceptable to women across indications (Table 3) and more recent studies report higher rates of continuation compared to earlier studies. In contraceptive RCTs conducted after 2000, continuation rates ranged from 80 to 100% [30, 32, 44, 59], and in HIV prevention RCTS conducted in the same time period, continuation rates ranged from 85 to 100% [9, 64, 83]. Recent observational studies of contraceptive VR reported higher continuation rates (77 to 97.4%, higher during earlier months of use) [36, 38, 42] than older observational studies (31 to 66%) [26, 27, 34, 90]. Several observational studies reported that 77 to 93% women continued or wanted to continue using the VR after study completion [36, 43, 94]; in one study, this proportion was significantly greater than combined oral contraceptive users (25.5%) (P = 0.001) [44].
Women reported discontinuation due to both medical and personal reasons. Medical reasons for discontinuation included bleeding irregularities/menstrual problems for the contraceptive VR [26, 27, 29, 32, 34], expulsions [26, 27, 29, 34, 89], vaginitis/vaginal problems [26, 27, 38], adverse effects or use problems (not specified) [36, 77, 80, 89]; stress urinary incontinence [29], ring removal >48 hours [27], pelvic inflammatory disease [34], edema and tenderness of legs [34], changes in emotional state [34], ovarian cysts [26], involuntary pregnancy [26], coital problems [29], and other medical reasons not specified [27]. Personal reasons for discontinuation included planning pregnancy [26, 36, 42, 59, 89]; disliking the method [26, 27], perceived ineffectiveness [77, 80], foreign body sensation or discomfort [29], relocation [26, 42]; switching methods [42]; desire for surgical or other long lasting contraceptive method treatment [36]; general ring worries [73]; expense [36]; and, other personal reasons not specified [27, 34, 89].
Values and preferences
Across studies, preference differed depending on available methods, geography, age, and product use experience. Between 1.8 to 52.9% of women chose or preferred the VR over other HIV prevention, contraception, and MPT products, with variation across countries [40, 57, 75, 77, 79, 80, 88, 97]. The TRIO study also reported variation in VR preference by age, with women 25 to 30 years three times more likely to prefer the VR compared to women 17 to 24 years (95%CI: 1.2, 8.2) [75]. Provider counseling also increased VR choice from pre- to post-counseling [40, 85, 88]. Studies that evaluated women's interest in hypothetical products indicated lower preferences for VRs than for other HIV prevention and MPT products, with significant variation by country and age, with adult women having higher preference for VRs [48, 49, 67, 68, 71].
In an African discrete choice experiment, 92% of women preferred dual prevention products for HIV and pregnancy versus products that only prevent HIV or pregnancy, with 20% of participants’ product choice dominated by HIV prevention efficacy and 44% by pregnancy prevention (59% in South Africa, 30% in Kenya, p<0.001) [57]. In a Quatro sub-study, efficacy was the most important product feature in HIV prevention (67%), followed by cost (14%), method of use (<10%), and location product is collected [46]. In the IPM 011 study, women reported they most liked that the VR might someday be used to prevent HIV and, 100% of product naïve women were willing to use the VR, if it was effective. [74].
In one study, most women (80%) preferred partner approval of the VR [74]; in another, women were less likely to try the VR if they thought their partner might not like the method [71]. Between 35 and 59% of women reported that it was important to be able to use a product without partner knowledge [57, 74]; and, 49 to 67% of women said it was important that their partner not feel the VR during sex [51, 64, 74]. However, in a QUATRO sub-study, partner awareness of method during sex was not a significant factor in product choice [46]. In the IMP 011 trial, women users liked that the VR did not interfere with ‘normal, natural’ sex, and least liked that the VR might come out or change the feeling during sex for the male partner [74]. An observational study of the progesterone VR reported that, among women who did not choose the VR for contraception, 17% thought it would be uncomfortable during sex [70].
In the TRIO study, women who chose to use the VR after trying three products reported that frequency of use (13.3%) and previous experience with vaginal insertion (46.7%) were attributes impacting their selection [75]. In another study, women who chose to use the weekly patch or daily COCs reported that they did not choose to use the VR because they were not comfortable inserting the VR (41 to 49%), and the VR was not easy to use (38 to 39%) [98]. In a phase I/II study of the dapivirine VR versus placebo VR for HIV-prevention, 96% of women preferred continuous daily (vs non-daily) VR use [64]. Similarly, in two multisite observational studies of contraceptive choice, three-quarters of women who choose the VR reported convenience and 66 to 72.4% reported monthly use as preferences [40, 98]. Among postpartum women in Africa, women who did not choose a progesterone VR explained that alternative methods were easier to use (26%), that they were uncomfortable with VR insertion (23%), or that the VR required repeat follow-up visits (15%) [70]. In an early observational study in Brazil and the Dominican Republic, 55.6% of users said that ease of use was the most liked characteristic of a contraceptive VR [77, 80]. Reports from the grey literature that were conducted with product naïve end-users about hypothetical HIV prevention and MPT products indicated that the frequency of use and the ability to remove the VR were reported to be major drivers of preference [49] and willingness to use [71].
In the TRIO study, 30% of VR users reported that safety/absence of side effects were an important product attribute [75]. A study of the progesterone VR for postpartum women reported that, among women who did not choose the VR, 20% were worried it could affect their health, but fewer than 5% worried the VR could affect the baby’s health [70]. With hypothetical HIV prevention products among young women in South Africa, VRs with good safety and few side effects contributed to improved opinions about and willingness to try the method [71]. A pre- and post-counseling study reported that product-naïve women perceived that the VR did not have many side effects compared to other contraceptive methods [40].
In a cross-sectional study of contraceptive choice in Russia and Ukraine, 69 to 72% of VR choosers reported physician recommendation was an important choice factor; and 31 to 35% of non-VR choosers said it was because they did not know anybody who uses it (31 to 35%) [98]. Similarly, women chose an alternative method to the VR in Kenya, Nigeria and Senegal because they or someone else had used it before (37%) or they already knew about the method (30%) [70]. Grey literature similarly reported preferences for the VR increase with familiarity, and that non-users were interested in the VR, but experienced misperceptions or concerns.
In the TRIO study, 20% of VR users said the most important product attribute was availability/access [75]. A study of the progesterone VR for postpartum contraception in Kenya, Nigeria, and Senegal reported that, among women who did not choose the VR, 15% did so because the VR required repeat follow-up visits [70].
Discussion
This systematic review investigated VR acceptability and related preferences among women in LMIC to inform further investment and/or guidance on VRs. Overall, VRs were very acceptable to women users across indications, with high rates of satisfaction and willingness to recommend VRs to others. Most women found VRs easy to insert/remove; and, although some women had concerns, these typically decreased, and most women reported acceptability of side effects and product features. Few studies explored differences by participant age or region, limiting our ability to draw conclusions regarding variations in acceptability by these factors.
The current review found that initial and hypothetical opinions regarding the VR were lower, but that acceptability increased as women gained use experience over several months. This experience-effect has also been reported in RCTs of VR acceptability in high-income countries [99]. While VRs are long-acting (1 month to 1 year duration), women need to be comfortable with vaginal insertion and removal; in several studies, self- reported lack of comfort with insertion was a factor associated with not choosing the VR [70, 88]. Previously, vaginal practices such as tampon use have been found to be associated with increased acceptability of vaginal products, possibly due to increased familiarity with touching the vagina and/or vaginal insertion [100]. High-quality training, counseling, and education may enhance uptake and continuation in the face of lack of comfort with vaginal insertion, VR unfamiliarity, and/or initial concerns with the VR [101]. In several studies, higher proportions of women reported preferring the VR after watching informational videos or receiving provider counseling [60, 82]. Peer support has also been noted as influential in helping women air concerns about ring use, overcome fears and learn strategies about ring use and disclosure [102–104].
Acceptability, study continuation, and continued VR use were higher in studies occurring in the 2000s compared to studies from the 1980s and 1990s. This trend may demonstrate growing social acceptance of the VR or knowing others using the VR [40, 70]; physicians' recommendations of VRs [88]; and/or, changes in norms regarding the use of vaginal products [105]. None of the studies in this review directly assessed these broader social and community-level factors, although one noted that the introduction of VRs without education or information campaigns to promote use may have influenced user acceptability [77, 80]. Changes in VR physical attributes may also contribute to temporal differences in acceptability, with early studies typically using larger rings made from different materials compared to more recent studies of the smaller NuvaRing or use of more flexible rings.
Burden and opportunity costs of using VRs were largely acceptable to women. For example, VRs had acceptable bleeding patterns that were considered consistent with or preferable to those of other hormonal contraceptives, possibly due to lower systemic exposure to hormones reducing side effects [1, 2, 106]. Use of VRs during sexual intercourse was generally acceptable; women liked that VRs did not interfere with sex and had minimal impact on libido or sexual activity, although interference with sex was a salient initial concern with this platform, and some ring users removed the ring to avoid ring discovery or partner-related challenges [73, 107]. While women reported concerns and experiences with VR expulsions and slippage, some VRs have been successfully formulated to minimize expulsions and slippage. Issues with foreign body sensation, and/or discomfort, varied widely across studies. Cognitive burden may be a particularly important consideration for new VR users, with concerns decreasing as women gain experience. The nature and severity of VR concerns vary by setting and user experience. Questions remain about differences in VR users across age groups and settings regarding each of the issues mentioned above, as well as the impact of misconceptions (e.g. fears of VR loss in the body).
As efforts to develop single and multipurpose VRs advance, achieving ‘real-world’ use necessitates the consideration of women’s values and preferences [108]. The current review suggests a preference for methods with less frequent dosing [57, 75, 98], a finding supported by qualitative preference data from research on contraceptives [109], as well as data demonstrating a trend of increasing adherence as the dosing interval is decreased [110]. Women reported valuing lighter periods, regular menstruation, and the steady low hormone levels provided by VRs [34, 57, 98]. When asked, women also expressed a preference for MPTs that prevent both HIV and pregnancy, although the strength of this preference varied by country and product experience [57]. While partner approval of products was preferred, so was the ability to use the product without a partner’s knowledge and non-interference with sex. Despite discretion, the VR may provide lower potential for discreet product use because it may be felt by a male partner during sex. It is critical to recognize that platform preferences may not be generalizable within or across age groups and settings, emphasizing the importance of a range of available drug-delivery platforms to align with individual women's values and preferences.
The current review was limited by heterogeneity between studies and a lack of standardization of acceptability outcome measures. We found that dimensions of affective attitude, burden and opportunity costs were frequently examined; however, ethicality, intervention coherence, perceived effectiveness, self-efficacy, and broader values and preferences remain relatively unexplored. We suggest development of generic, standardized acceptability measures mapped to the theoretical framework of acceptability constructs [21], using established methods to develop patient reported outcome instruments [111]. In the current review, we found several acceptability outcomes such as ‘disclose of use to partner or family’ and ‘partner or family approval’ that do not clearly map to the Sekhon acceptability framework, possibly indicating that an additional construct capturing ‘social’ or ‘normative’ acceptability could be important, particularly for potentially stigmatized conditions, such as sexual and reproductive health, mental health, or obesity. Finally, while qualitative acceptability data were not included in the current review, it is possible that more detailed data regarding acceptability constructs, not frequently reported in quantitative data, exist in qualitative studies of vaginal ring acceptability. For example, in a qualitative analysis of vaginal ring acceptability in a trial for HIV prevention, use of the ring appeared to give women a sense of ownership over HIV protection, which would be challenging to capture in a structured questionnaire [102].
While we wanted to investigate VR acceptability across indications, it was challenging to distinguish the influence of the API on reports of adverse events and side effects, discomfort, or satisfaction and acceptability when assessing studies using VRs with active products. We excluded adverse events, side effects, or negative effects known to be related to the API where possible; however, users' reports of satisfaction were likely influenced by their experience of API side effects, efficacy, and other dependent experiences. RCTs generally had a low risk of bias, with most having low reported attrition rates (median: 4.1; range 0–19.3); observational studies had varying risk of bias scores, with primary issues across studies being selection bias, non-consecutive inclusion of participants, and inadequate description of participants to replicate the study. There was no indication that findings differed by risk of bias assessment. Further, most studies did not use acceptability as their primary outcomes, possibly reducing the relevance of the bias assessment and underpowered acceptability outcomes, in some cases. Future acceptability research should 1) utilize theoretical constructs of product acceptability to assess multiple domains, which would allow greater insight into VR features and context contributing to acceptability; 2) use standardized acceptability measures to improve comparability across studies and more meaningfully contribute to the evidence base; 3) disaggregate acceptability by age, parity, or other demographic variables to elucidate VR acceptability by key participant characteristics; and 4) examine and integrate qualitative vaginal ring acceptability data, as well as data from high income countries. We are currently conducting a related systematic review of vaginal ring acceptability in high income countries, which will further elucidate vaginal ring acceptability relevant to all women.
Conclusions
The evidence strongly suggests that most women find VRs acceptable and easy to use, despite reported cognitive/emotional burden, impacts on sexual intercourse, and some issues with expulsions. An experience-effect was seen, with acceptability increasing over time as users gained experience with the method, and continuation was high across studies. Some women value features associated with the VR, including low dosing frequency, positive menstrual bleeding patterns, and the potential for multipurpose technologies. As such, the VR may play an important role in expanding sexual and reproductive health options for women.
Supporting information
Acknowledgments
Co-authors JG, EM, and AS were supported by TIP, a program made possible by the generous support of the American people through the U.S. President’s Emergency Plan for AIDS Relief (https://www.pepfar.gov/) to RTI International under the terms of the Grant No. AID-OAA-A-14-00012. Co-authors KR, KT, and JP were supported by the OPTIONS Consortium, a program made possible by the generous assistance from the American people through the U.S. Agency for International Development (USAID) and the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR). Financial assistance was provided by USAID (https://www.usaid.gov/) to FHI 360, the Wits Reproductive Health and HIV Institute, and AVAC under the terms of Cooperative Agreement No. AID-OAA-A-15-00035. The contents do not necessarily reflect the views of USAID, PEPFAR, or the United States Government. The funders did not play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Abbreviations
- API
Active pharmaceutical ingredient
- COC
Combined oral contraceptive
- LMIC
Low- and middle-income countries
- MeSH
Medical subject headings
- PEPFAR
U.S. President’s Emergency Plan for AIDS Relief
- PrEP
Pre-exposure prophylaxis
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analysis
- RCT
Randomized controlled trial
- USAID
U.S. Agency for International Development
- MPT
Multi-purpose prevention technology
- VR
Vaginal ring
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
Co-authors JG, EM, and AS were supported by TIP, a program made possible by the generous support of the American people through the U.S. President’s Emergency Plan for AIDS Relief (https://www.pepfar.gov/) to RTI International under the terms of the Grant No. AID-OAA-A-14-00012. Co-authors KR, KT, and JP were supported by the OPTIONS Consortium, a program made possible by the generous assistance from the American people through the U.S. Agency for International Development (USAID) and the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR). Financial assistance was provided by USAID (https://www.usaid.gov/) to FHI 360, the Wits Reproductive Health and HIV Institute, and AVAC under the terms of Cooperative Agreement No. AID-OAA-A-15-00035. The contents do not necessarily reflect the views of USAID, PEPFAR, or the United States Government. The funders did not play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Alexander NJ, Baker E, Kaptein M, Karck U, Miller L, Zampaglione E. Why consider vaginal drug administration? Fertil Steril. 2004;82(1):1–12. 10.1016/j.fertnstert.2004.01.025 WOS:000222745600001. [DOI] [PubMed] [Google Scholar]
- 2.van den Heuvel MW, van Bragt AJM, Alnabawy AKM, Kaptein MCJ. Comparison of ethinylestradiol pharmacokinetics in three hormonal contraceptive formulations: the vaginal ring, the transdermal patch and an oral contraceptive. Contraception. 2005;72(3):168–74. 10.1016/j.contraception.2005.03.005 WOS:000231654300002. [DOI] [PubMed] [Google Scholar]
- 3.Roumen FJ, Apter D, Mulders TM, Dieben TO. Efficacy, tolerability and acceptability of a novel contraceptive vaginal ring releasing etonogestrel and ethinyl oestradiol. Human reproduction (Oxford, England). 2001;16(3):469–75. Epub 2001/03/03. 10.1093/humrep/16.3.469 . [DOI] [PubMed] [Google Scholar]
- 4.Massai R, Miranda P, Valdes P, Lavin P, Zepeda A, Casado ME, et al. Preregistration study on the safety and contraceptive efficacy of a progesterone-releasing vaginal ring in Chilean nursing women. Contraception. 1999;60(1):9–14. Epub 1999/11/05. 10.1016/s0010-7824(99)00057-8 . [DOI] [PubMed] [Google Scholar]
- 5.Rahn DD, Carberry C, Sanses TV, Mamik MM, Ward RM, Meriwether KV, et al. Vaginal estrogen for genitourinary syndrome of menopause: a systematic review. Obstetrics and gynecology. 2014;124(6):1147 10.1097/AOG.0000000000000526 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Speroff L. Efficacy and tolerability of a novel estradiol vaginal ring for relief of menopausal symptoms. Obstet Gynecol. 2003;102(4):823–34. Epub 2003/10/11. 10.1016/s0029-7844(03)00764-6 . [DOI] [PubMed] [Google Scholar]
- 7.Battaglia C, Mancini F, Fabbri R, Persico N, Busacchi P, Facchinetti F, et al. Polycystic ovary syndrome and cardiovascular risk in young patients treated with drospirenone-ethinylestradiol or contraceptive vaginal ring. A prospective, randomized, pilot study. Fertil Steril. 2010;94(4):1417–25. Epub 2009/07/14. 10.1016/j.fertnstert.2009.05.044 . [DOI] [PubMed] [Google Scholar]
- 8.Nel A, Kapiga S, Bekker LG, Devlin B, Borremans M, Rosenberg Z. Safety and efficacy of dapivirine vaginal ring for HIV-1 prevention in African women. Topics in Antiviral Medicine. 2016;24(E-1):45. [Google Scholar]
- 9.Baeten JM, Palanee-Phillips T, Brown ER, Schwartz K, Soto-Torres LE, Govender V, et al. Use of a vaginal ring containing dapivirine for HIV-1 prevention in women. New England Journal of Medicine. 2016;375(22):2121–32. 10.1056/NEJMoa1506110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Thurman AR, Clark MR, Hurlburt JA, Doncel GF. Intravaginal rings as delivery systems for microbicides and multipurpose prevention technologies. International journal of women's health. 2013;5:695–708. Epub 2013/11/01. 10.2147/IJWH.S34030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Achilles SL, Hendrix CW, Poloyac SM, Hoesley CJ, Peda M, Gundacker H, et al. , editors. Safety and Pharmacokinetics of Dapivirine and Levonorgestrel Vaginal Rings for Multipurpose Prevention of HIV and Pregnancy. AIDS research and human retroviruses; 2018: MARY ANN LIEBERT, INC 140 HUGUENOT STREET, 3RD FL, NEW ROCHELLE, NY 10801 USA. [Google Scholar]
- 12.Murphy DJ, Desjardins D, Dereuddre-Bosquet N, Brochard P, Perrot L, Pruvost A, et al. Pre-clinical development of a combination microbicide vaginal ring containing dapivirine and darunavir. The Journal of antimicrobial chemotherapy. 2014;69(9):2477–88. Epub 2014/05/28. 10.1093/jac/dku160 . [DOI] [PubMed] [Google Scholar]
- 13.Vincent KL, Moss JA, Marzinke MA, Hendrix CW, Anton PA, Pyles RB, et al. Safety and pharmacokinetics of single, dual, and triple antiretroviral drug formulations delivered by pod-intravaginal rings designed for HIV-1 prevention: A Phase I trial. PLoS medicine. 2018;15(9):e1002655 Epub 2018/09/29. 10.1371/journal.pmed.1002655 https://patents.google.com/patent/WO2016149561A1/en and https://patents.google.com/patent/WO2017161136A1/en. KLV and RBP are paid consultants to ABL, Inc. CWH has received funding for clinical research from ViiV/GSK managed via Johns Hopkins University and was a consultant for 1–2 days in 2017 to ViiV/GSK. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lusti‐Narasimhan M, Merialdi M, Holt B. Multipurpose prevention technologies: maximising positive synergies. BJOG: An International Journal of Obstetrics & Gynaecology. 2014;121(3):251–. [DOI] [PubMed] [Google Scholar]
- 15.Madden T, Secura GM, Nease RF, Politi MC, Peipert JF. The role of contraceptive attributes in women's contraceptive decision making. American journal of obstetrics and gynecology. 2015;213(1):46.e1–.e6. Epub 01/30. 10.1016/j.ajog.2015.01.051 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Ross J, Stover J. Use of modern contraception increases when more methods become available: analysis of evidence from 1982–2009. Global Health: Science and Practice. 2013:ghs1300010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Delany-Moretlwe S, Mullick S, Eakle R, Rees H. Planning for HIV preexposure prophylaxis introduction: lessons learned from contraception. Current opinion in HIV and AIDS. 2016;11(1):87–93. 10.1097/COH.0000000000000221 [DOI] [PubMed] [Google Scholar]
- 18.World Health Organization. WHO handbook for guideline development: World Health Organization; 2014. [Google Scholar]
- 19.Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine. 2009;6(7):e1000097 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mensch BS, van der Straten A, Katzen LL. Acceptability in microbicide and PrEP trials: current status and a reconceptualization. Curr Opin HIV AIDS. 2012;7(6):534–41. Epub 2012/10/04. 10.1097/COH.0b013e3283590632 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88 Epub 2017/01/28. 10.1186/s12913-017-2031-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Tricco AC, Antony J, Soobiah C, Kastner M, MacDonald H, Cogo E, et al. Knowledge synthesis methods for integrating qualitative and quantitative data: a scoping review reveals poor operationalization of the methodological steps. Journal of Clinical Epidemiology. 2016;73:29–35. 10.1016/j.jclinepi.2015.12.011 [DOI] [PubMed] [Google Scholar]
- 23.Higgins J, Sterne J, Savović J, Page M, Hróbjartsson A, Boutron I, et al. A revised tool for assessing risk of bias in randomized trials. The Cochrane database of systematic reviews. 2016;10(Suppl 1):29–31. [Google Scholar]
- 24.Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011;343:d5928 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Bmj. 2016;355:i4919 10.1136/bmj.i4919 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Buckshee K, Kumar S, Saraya L. Contraceptive vaginal ring—a rising star on the contraceptive horizon. Advances in contraception: the official journal of the Society for the Advancement of Contraception. 1990;6(3):177–83. Epub 1990/09/01. 10.1007/bf01849492 . [DOI] [PubMed] [Google Scholar]
- 27.Chen JH, Wu SC, Shao WQ, Zou MH, Hu J, Cong L, et al. The comparative trial of TCu 380A IUD and progesterone-releasing vaginal ring used by lactating women. Contraception. 1998;57(6):371–9. Epub 1998/08/07. 10.1016/s0010-7824(98)00043-2 . [DOI] [PubMed] [Google Scholar]
- 28.Dahiya P, Dalal M, Yadav A, Dahiya K, Jain S, Silan V. Efficacy of combined hormonal vaginal ring in comparison to combined hormonal pills in heavy menstrual bleeding. European journal of obstetrics, gynecology, and reproductive biology. 2016;203:147–51. Epub 2016/06/11. 10.1016/j.ejogrb.2016.05.009 . [DOI] [PubMed] [Google Scholar]
- 29.Das S, Sanyal A, Roy R, Mistri P, Vernekar M, Naskar TK. Combined contraceptive vaginal ring- its acceptability in Indian women. Indian Journal of Public Health Research and Development. 2016;7(1):57–63. 10.5958/0976-5506.2016.00012.7 [DOI] [Google Scholar]
- 30.Fan GS, Ren M, Di W, Su P, Chang Q, Wu S, et al. Efficacy and safety of the contraceptive vaginal ring (NuvaRing) compared with a combined oral contraceptive in Chinese women: a 1-year randomised trial. European Journal of Contraception and Reproductive Health Care. 2016;21(4):303–9. 10.1080/13625187.2016.1186269 [DOI] [PubMed] [Google Scholar]
- 31.Gupta AN, Dhaliwal LK, Gulati K. Clinical performance with contraceptive vaginal rings containing levonorgestrel. The Indian journal of medical research. 1986;84:321–5. Epub 1986/09/01. . [PubMed] [Google Scholar]
- 32.Jain S, Vaid NB, Narang Y, Suneja A, Guleria K. A Randomised Controlled Trial Comparing the Efficacy and Side-Effects of Intravaginal Ring (Nuvaring((R))) With Combined Oral Hormonal Preparation in Dysfunctional Uterine Bleeding. Journal of clinical and diagnostic research: JCDR. 2016;10(3):Qc21–4. Epub 2016/05/03. 10.7860/JCDR/2016/16545.7516 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Madhavan Nair K, Sivakumar B, Prema K, Narasinga Rao BS. Bioavailability of levonorgestrel from intravaginal rings in women of low income groups. Contraception. 1986;33(3):307–22. Epub 1986/03/01. 10.1016/0010-7824(86)90022-3 . [DOI] [PubMed] [Google Scholar]
- 34.Mehta S, Joshi UM, Sankolli GM, Adatia A, Donde UM, Saxena BN. Clinical performance and endocrine profiles with contraceptive vaginal rings containing a combination of estradiol and D-norgestrel. Contraception. 1981;23(3):241–50. Epub 1981/03/01. 10.1016/0010-7824(81)90046-9 . [DOI] [PubMed] [Google Scholar]
- 35.Merkatz R, Roy M, Plagianos M, Hazra A, Vieira CS, Sitruk-Ware R. Reports of acceptability by women using novel contraceptive vaginal rings in diverse settings. European Journal of Contraception and Reproductive Health Care. 2018;23:105–6. 10.1080/13625187.2018.1449823 [DOI] [PubMed] [Google Scholar]
- 36.Pandit SN, Chauhan AR, Anagani M, Reddy S, Birla A, Ray SK. Multicenter Study of Contraceptive Vaginal Ring (NuvaRing((R))) in Normal Daily Practice in Indian Women. Journal of obstetrics and gynaecology of India. 2014;64(6):409–16. Epub 2014/12/10. 10.1007/s13224-014-0559-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Priya K, Rajaram S, Goel N. Comparison of combined hormonal vaginal ring and low dose combined oral hormonal pill for the treatment of idiopathic chronic pelvic pain: a randomised trial. European journal of obstetrics, gynecology, and reproductive biology. 2016;207:141–6. Epub 2016/11/20. 10.1016/j.ejogrb.2016.10.026 . [DOI] [PubMed] [Google Scholar]
- 38.Santibenchakul S, Jaisamrarn U. Acceptability, tolerability, and satisfaction of a contraceptive vaginal ring (the NuvaRing) among Thai women. Asian Biomedicine. 2016;10(3):235–41. 10.5372/1905-7415.1003.485 [DOI] [Google Scholar]
- 39.Sharma R, Kapur A, Fotedar S. Comparison of efficacy, compliance, acceptability and tolerability of hormonal contraceptive vaginal ring (NuvaRing) versus combined oral contraceptives (COCs)—a prospective randomized controlled study in a district level hospital in East Delhi. International Journal of Scientific Research. 2018;7(1). [Google Scholar]
- 40.Sheriar N, Joshi R, Mukherjee B, Pal B, Birla A, Ray SK. Impact of structured counseling on the selection of hormonal contraceptive methods: results of a multi-centric, observational study in India. Journal of obstetrics and gynaecology of India. 2014;64(4):241–50. Epub 2014/08/20. 10.1007/s13224-014-0560-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Siraj HH, Thandayathany V, Tamil A. Nurses and contraceptive vaginal ring: To use or not to use? International Journal of Gynecology and Obstetrics. 2015;131:E385. [Google Scholar]
- 42.Soni A, Garg S, Bangar R. Efficacy, user acceptability, tolerability, and cycle control of a combined contraceptive vaginal ring: the Indian perspective. Journal of obstetrics and gynaecology of India. 2013;63(5):337–41. Epub 2014/01/17. 10.1007/s13224-013-0391-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Vijayaletchumi T, Siraj HH, Azmi MT, Jamil MA. Acceptablity of contraceptive vaginal ring (NuvaRing®) amongst nurses in a Malaysian Teaching Hospital. BJOG: An International Journal of Obstetrics and Gynaecology. 2012;119:147 10.1111/j.1471-0528.2012.03378.x [DOI] [Google Scholar]
- 44.Abu Hashim H, Alsherbini W, Bazeed M. Contraceptive vaginal ring treatment of heavy menstrual bleeding: a randomized controlled trial with norethisterone. Contraception. 2012;85(3):246–52. Epub 2011/11/10. 10.1016/j.contraception.2011.07.012 . [DOI] [PubMed] [Google Scholar]
- 45.Browne E, Mayo AJ, Montgomery E, Torjesen K, Palanee-Philips T, Jeenarain N, et al. Acceptability of and Adherence to the Dapivirine Vaginal Ring for HIV-1 Prevention. Adherence; Miami, FL2019. [Google Scholar]
- 46.Browne E, Montgomery E, Van der Straten A, Boeri M, Mange B, Beksinska M, et al. What Do Women Prefer in a Vaginal HIV Prevention Product? Findings from a Discrete Choice Experiment in Southern Africa. HIV Research for Prevention; Madrid, Spain2018. [Google Scholar]
- 47.Duby Z, Katz AW, Browne EN, Mutero P, Etima J, Zimba CC, et al. Hygiene, Blood Flow, and Vaginal Overload: Why Women Removed an HIV Prevention Vaginal Ring During Menstruation in Malawi, South Africa, Uganda and Zimbabwe. AIDS and behavior. 2019:1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Healthcare I. Summary Booklet: Assessing the Potential of MPTs in South Africa, Uganda, and Nigeria.
- 49.Healthcare I. Assessing the potential of MPTs in South Africa, Uganda and Nigeria. Bill and Melinda Gates Foundation; 2014.
- 50.Progesterone Vaginal Ring: Results of an Acceptability Study in Nigeria [Internet]. Population Council. 2015.
- 51.Kestelyn E, Agaba S, Van Nuil JI, Uwineza M, Umulisa MM, Mwambarangwe L, et al. A randomised trial of a contraceptive vaginal ring in women at risk of HIV infection in Rwanda: Safety of intermittent and continuous use. PloS one. 2018;13(6):e0197572 Epub 2018/06/02. 10.1371/journal.pone.0197572 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kestelyn E, Van Nuil JI, Umulisa MM, Umutoni G, Uwingabire A, Mwambarangwe L, et al. High acceptability of a contraceptive vaginal ring among women in Kigali, Rwanda. PloS one. 2018;13(6):e0199096 Epub 2018/06/19. 10.1371/journal.pone.0199096 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Kuteesa MO, Quaife M, Biraro S, Katumba KR, Seeley J, Kamali A, et al. Acceptability and Predictors of Uptake of Anti-retroviral Pre-exposure Prophylaxis (PrEP) Among Fishing Communities in Uganda: A Cross-Sectional Discrete Choice Experiment Survey. AIDS and behavior. 2019;2019 Feb 8. 10.1007/s10461-019-02418-7 [Epub ahead of print]. Epub 2019/02/09. . [DOI] [PubMed] [Google Scholar]
- 54.Luecke EH, Cheng H, Woeber K, Nakyanzi T, Mudekunye-Mahaka IC, van der Straten A. Stated product formulation preferences for HIV pre-exposure prophylaxis among women in the VOICE-D (MTN-003D) study. Journal of the International AIDS Society. 2016;19(1):20875 Epub 2016/06/02. 10.7448/IAS.19.1.20875 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.McLellan-Lemal E, Gvetadze R, Desai MA, Makanga EM, Pan Y, Haaland RE, et al. Non-adherence among women enrolled in a contraceptive vaginal ring use study in Kisumu, Kenya, 2014–2015. Journal of Global Health Reports. 2018;2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Mensch BS, Richardson BA, Husnik M, Brown ER, Kiweewa FM, Mayo AJ, et al. Vaginal Ring Use in a Phase 3 Microbicide Trial: A Comparison of Objective Measures and Self-reports of Non-adherence in ASPIRE. AIDS and behavior. 2018;2018 Sep 14. 10.1007/s10461-018-2261-8 [Epub ahead of print]. Epub 2018/09/16. . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Minnis AM, Browne EN, Boeri M, Agot K, van der Straten A, Ahmed K, et al. Young Women's Stated Preferences for Biomedical HIV Prevention: Results of a Discrete Choice Experiment in Kenya and South Africa. Journal of acquired immune deficiency syndromes (1999). 2019;80(4):394–403. Epub 2019/01/12. 10.1097/qai.0000000000001945 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Minnis AM, Roberts ST, Agot K, Weinrib R, Ahmed K, Manenzhe K, et al. Young Women's Ratings of Three Placebo Multipurpose Prevention Technologies for HIV and Pregnancy Prevention in a Randomized, Cross-Over Study in Kenya and South Africa. AIDS and behavior. 2018;22(8):2662–73. Epub 2018/03/22. 10.1007/s10461-018-2078-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Mohamed AMM, El-Sherbiny WSM, Mostafa WAI. Combined contraceptive ring versus combined oral contraceptive (30-mu g ethinylestradiol and 3-mg drospirenone). Int J Gynecol Obstet. 2011;114(2):145–8. 10.1016/j.ijgo.2011.03.008 WOS:000293316600013. [DOI] [PubMed] [Google Scholar]
- 60.Montgomery ET, Beksinska M, Mgodi N, Schwartz J, Weinrib R, Browne EN, et al. End‐user preference for and choice of four vaginally delivered HIV prevention methods among young women in South Africa and Zimbabwe: the Quatro Clinical Crossover Study. Journal of the International AIDS Society. 2019;22(5):e25283 10.1002/jia2.25283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Montgomery ET, van der Straten A, Cheng H, Wegner L, Masenga G, von Mollendorf C, et al. Vaginal ring adherence in sub-Saharan Africa: expulsion, removal, and perfect use. AIDS Behav. 2012;16(7):1787–98. Epub 2012/07/14. 10.1007/s10461-012-0248-4 . [DOI] [PubMed] [Google Scholar]
- 62.Nassuuna I, Bayigga J, Masawi S, Onyango M, Kusemererwa S. Empowering trial participants to use the dapivirine vaginal ring: Experience from an open label extension trial in South Western Uganda. AIDS research and human retroviruses. 2018;34:367 10.1089/aid.2018.5000.abstracts [DOI] [Google Scholar]
- 63.Ndagire AK, Onyango M, Bayigga J, Aling E, Kusemererwa S. Examining the relationship between multiple sexual partners and adherence to the dapivirine vaginal ring in a trial in South Western Uganda. AIDS research and human retroviruses. 2018;34:200 10.1089/aid.2018.5000.abstracts [DOI] [Google Scholar]
- 64.Nel A, Bekker LG, Bukusi E, Hellstrm E, Kotze P, Louw C, et al. Safety, Acceptability and Adherence of Dapivirine Vaginal Ring in a Microbicide Clinical Trial Conducted in Multiple Countries in Sub-Saharan Africa. PloS one. 2016;11(3):e0147743 Epub 2016/03/11. 10.1371/journal.pone.0147743 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Nel A, Martins J, Bekker LG, Ramjee G, Masenga G, Rees H, et al. Safety of a silicone elastomer vaginal ring as potential microbicide delivery method in African women: A Phase 1 randomized trial. PloS one. 2018;13(5):e0196904 Epub 2018/05/31. 10.1371/journal.pone.0196904 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Palanee-Phillips T, Roberts ST, Reddy K, Govender V, Naidoo L, Siva S, et al. Impact of Partner-Related Social Harms on Women's Adherence to the Dapivirine Vaginal Ring During a Phase III Trial. Journal of acquired immune deficiency syndromes (1999). 2018;79(5):580–9. Epub 2018/09/22. 10.1097/qai.0000000000001866 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Quaife M. Divergent stated preferences for new antiretroviral-based HIV prevention products across adults, adolescents and female sex workers in South Africa. International Health Economics Congress 2017; Boston, MA2017. [Google Scholar]
- 68.Quaife M, Cabrera M, Eakle R, Vickerman P, Delany-Moretlwe S, Terris-Prestholt F. Divergent stated preferences for new multipurpose prevention products across adults, adolescents and female sex workers in South Africa. AIDS Research and Human Retroviruses. 2016;32:158 10.1089/aid.2016.5000.abstracts [DOI] [Google Scholar]
- 69.RamaRao S, Clark H, Rajamani D, Ishaku S, Mane B, Obare F, et al. Progesterone vaginal ring: Results of a three-country acceptability study. New York: Population Council, 2015. [Google Scholar]
- 70.RamaRao S, Obare F, Ishaku S, Mane B, Clark H, Liambila W, et al. Do Women Find the Progesterone Vaginal Ring Acceptable? Findings from Kenya, Nigeria, and Senegal. Studies in family planning. 2018;49(1):71–86. Epub 2018/02/03. 10.1111/sifp.12046 . [DOI] [PubMed] [Google Scholar]
- 71.Routes2Results. Understanding Consumer Preferences for Prevention Products. 2017.
- 72.van der Straten A, Agot K, Ahmed K, Weinrib R, Browne EN, Manenzhe K, et al. The Tablets, Ring, Injections as Options (TRIO) study: what young African women chose and used for future HIV and pregnancy prevention. Journal of the International AIDS Society. 2018;21(3):e25094 Epub 2018/03/31. 10.1002/jia2.25094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.van der Straten A, Browne EN, Shapley-Quinn MK, Brown ER, Reddy K, Scheckter R, et al. First Impressions Matter: How Initial Worries Influence Adherence to the Dapivirine Vaginal Ring. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.van der Straten A, Montgomery ET, Cheng H, Wegner L, Masenga G, von Mollendorf C, et al. High acceptability of a vaginal ring intended as a microbicide delivery method for HIV prevention in African women. AIDS Behav. 2012;16(7):1775–86. Epub 2012/05/31. 10.1007/s10461-012-0215-0 . [DOI] [PubMed] [Google Scholar]
- 75.Weinrib R, Minnis A, Agot K, Ahmed K, Owino F, Manenzhe K, et al. End-Users' Product Preference Across Three Multipurpose Prevention Technology Delivery Forms: Baseline Results from Young Women in Kenya and South Africa. AIDS Behav. 2018;22(1):133–45. Epub 2017/10/21. 10.1007/s10461-017-1911-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Barreiros FA, Guazzelli CAF, de Araújo FF, Barbosa R. Bleeding patterns of women using extended regimens of the contraceptive vaginal ring. Contraception. 2007;75(3):204–8. 10.1016/j.contraception.2006.10.009 [DOI] [PubMed] [Google Scholar]
- 77.Faundes A, Hardy E, Reyes C, Pastene L, Portes-Carrasco R. Acceptability of the contraceptive vaginal ring by rural and urban population in two Latin American countries. Contraception. 1981;24(4):393–414. Epub 1981/10/01. 10.1016/0010-7824(81)90006-8 . [DOI] [PubMed] [Google Scholar]
- 78.Guazzelli CA, Barreiros FA, Barbosa R, de Araujo FF, Moron AF. Extended regimens of the vaginal contraceptive ring: cycle control. Contraception. 2009;80(5):430–5. Epub 2009/10/20. 10.1016/j.contraception.2009.05.004 . [DOI] [PubMed] [Google Scholar]
- 79.Hardy E, Hebling EM, Sousa MH, Almeida AF, Amaral E. Delivery of microbicides to the vagina: difficulties reported with the use of three devices, adherence to use and preferences. Contraception. 2007;76(2):126–31. Epub 2007/07/28. 10.1016/j.contraception.2007.04.013 . [DOI] [PubMed] [Google Scholar]
- 80.Hardy EE, Reyes Q, Gomez F, Portes-Carrasco R, Faundes A. User's perception of the contraceptive vaginal ring: a field study in Brazil and the Dominican Republic. Studies in family planning. 1983;14(11):284–90. Epub 1983/11/01. . [PubMed] [Google Scholar]
- 81.Nash HA, Brache V, Alvarez-Sanchez F, Jackanicz TM, Harmon TM. Estradiol delivery by vaginal rings: potential for hormone replacement therapy. Maturitas. 1997;26(1):27–33. Epub 1997/01/01. 10.1016/s0378-5122(96)01072-9 . [DOI] [PubMed] [Google Scholar]
- 82.Plascencia-Nieto ES, Lira-Plascencia J, Gonzalez Habib R, Célis-Gonzalez C, Guarneros-Valdovinos R, Rosas-Balam A. The impact of contraceptive counselling in the prescription of combined hormonal contraceptives. European Journal of Contraception and Reproductive Health Care. 2016;21:107–8. 10.3109/13625187.2015.1135897 [DOI] [Google Scholar]
- 83.Thurman AR, Schwartz JL, Brache V, Clark MR, McCormick T, Chandra N, et al. Randomized, placebo controlled phase I trial of safety, pharmacokinetics, pharmacodynamics and acceptability of tenofovir and tenofovir plus levonorgestrel vaginal rings in women. PloS one. 2018;13(6):e0199778 Epub 2018/06/29. 10.1371/journal.pone.0199778 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Weisberg E, Fraser IS, Lacarra M, Mishell DR Jr., Alvarez F, Brache V, et al. Efficacy, bleeding patterns, and side effects of a 1-year contraceptive vaginal ring. Contraception. 1999;59(5):311–8. Epub 1999/09/24. 10.1016/s0010-7824(99)00035-9 . [DOI] [PubMed] [Google Scholar]
- 85.Bitzer J, Cupanik V, Fait T, Gemzell-Danielsson K, Grob P, Oddens BJ, et al. Factors influencing women's selection of combined hormonal contraceptive methods after counselling in 11 countries: Results from a subanalysis of the CHOICE study. European Journal of Contraception and Reproductive Health Care. 2013;18(5):372–80. 10.3109/13625187.2013.819077 WOS:000324618100007. [DOI] [PubMed] [Google Scholar]
- 86.Bitzer J, Gemzell-Danielsson K, Roumen F, Marintcheva-Petrova M, van Bakel B, Oddens BJ. The CHOICE study: effect of counselling on the selection of combined hormonal contraceptive methods in 11 countries. The European journal of contraception & reproductive health care: the official journal of the European Society of Contraception. 2012;17(1):65–78. Epub 2012/01/14. 10.3109/13625187.2011.637586 . [DOI] [PubMed] [Google Scholar]
- 87.Dakhly DMR, Bassiouny YA, Bayoumi YA, Gouda HM, Hassan AA, Hassan MA, et al. Current contraceptive trends among married Egyptian women: a cross-sectional survey. The European journal of contraception & reproductive health care: the official journal of the European Society of Contraception. 2018;23(5):351–6. Epub 2018/10/30. 10.1080/13625187.2018.1532074 . [DOI] [PubMed] [Google Scholar]
- 88.Egarter C, Tirri BF, Bitzer J, Kaminskyy V, Oddens BJ, Prilepskaya V, et al. Women's perceptions and reasons for choosing the pill, patch, or ring in the CHOICE study: a cross-sectional survey of contraceptive method selection after counseling. BMC Womens Health. 2013;13:14 10.1186/1472-6874-13-14 WOS:000316730500001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Shaaban MM. Contraception with progestogens and progesterone during lactation. The Journal of steroid biochemistry and molecular biology. 1991;40(4–6):705–10. Epub 1991/01/01. 10.1016/0960-0760(91)90294-f . [DOI] [PubMed] [Google Scholar]
- 90.Koetsawang S, Ji G, Krishna U, Cuadros A, Dhall GI, Wyss R, et al. Microdose intravaginal levonorgestrel contraception: a multicentre clinical trial. I. Contraceptive efficacy and side effects. World Health Organization. Task Force on Long-Acting Systemic Agents for Fertility Regulation. Contraception. 1990;41(2):105–24. Epub 1990/02/01. 10.1016/0010-7824(90)90141-h . [DOI] [PubMed] [Google Scholar]
- 91.Prilepskaya V, Nazarova N, Letunovskaya A. The role of contraceptive choice among counselled women (according to the project CHOICE in Russia). European Journal of Contraception and Reproductive Health Care. 2012;17:S34–S5. 10.3109/13625187.2012.673962 [DOI] [Google Scholar]
- 92.Sivin I, Mishell DR Jr., Victor A, Diaz S, Alvarez-Sanchez F, Nielsen NC, et al. A multicenter study of levonorgestrel-estradiol contraceptive vaginal rings. I-Use effectiveness. An international comparative trial. Contraception. 1981;24(4):341–58. Epub 1981/10/01. 10.1016/0010-7824(81)90003-2 . [DOI] [PubMed] [Google Scholar]
- 93.Palanee-Phillips T, Roberts S, Montgomery E, Reddy K, Govender V, Naidoo L, et al. Frequency of partner-related social harms and their impact on adherence to the dapivirine vaginal ring during the MTN020/ aspire HIV prevention trial. AIDS Research and Human Retroviruses. 2016;32:94 10.1089/aid.2016.5000.abstracts [DOI] [Google Scholar]
- 94.Abu Hashim H. Medical treatment of idiopathic heavy menstrual bleeding. What is new? An evidence based approach. Archives of Gynecology and Obstetrics. 2013;287(2):251–60. 10.1007/s00404-012-2605-y [DOI] [PubMed] [Google Scholar]
- 95.Thurman A, Schwartz J, Yousefieh N, Anderson S, Marzinke M, Gajer P, et al. Vaginal microbiota and mucosal pharmacokinetics of tenofovir in healthy women using placebo, tenofovir and tenofovir/levonorgestrel vaginal rings. AIDS Research and Human Retroviruses. 2018;34:295 10.1089/aid.2018.5000.abstracts [DOI] [Google Scholar]
- 96.Nel A, van Niekerk N, Kapiga S, Bekker LG, Gama C, Gill K, et al. Safety and Efficacy of a Dapivirine Vaginal Ring for HIV Prevention in Women. New England Journal of Medicine. 2016;375(22):2133–43. 10.1056/NEJMoa1602046 WOS:000389030400005. [DOI] [PubMed] [Google Scholar]
- 97.Bitzer J, Cupanik V, Fait T, Gemzell-Danielsson K, Grob P, Oddens BJ, et al. Factors influencing women's selection of contraceptive methods during counselling. European Journal of Contraception and Reproductive Health Care. 2012;17:S85–S6. 10.3109/13625187.2012.673963 [DOI] [PubMed] [Google Scholar]
- 98.Egarter C, Grimm C, Nouri K, Ahrendt HJ, Bitzer J, Cermak C. Contraceptive counselling and factors affecting women's contraceptive choices: results of the CHOICE study in Austria. Reproductive biomedicine online. 2012;24(7):692–7. Epub 2012/01/31. 10.1016/j.rbmo.2011.12.003 . [DOI] [PubMed] [Google Scholar]
- 99.Novak A, de la Loge C, Abetz L, van der Meulen EA. The combined contraceptive vaginal ring, NuvaRing: an international study of user acceptability. Contraception. 2003;67(3):187–94. Epub 2003/03/06. 10.1016/s0010-7824(02)00514-0 . [DOI] [PubMed] [Google Scholar]
- 100.Tepe M, Mestad R, Secura G, Allsworth JE, Madden T, Peipert JF. Association between tampon use and choosing the contraceptive vaginal ring. Obstetrics and gynecology. 2010;115(4):735–9. Epub 2010/03/24. 10.1097/AOG.0b013e3181d41c4a [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Mack N, Crawford TJ, Guise JM, Chen M, Grey TW, Feldblum PJ, et al. Strategies to improve adherence and continuation of shorter‐term hormonal methods of contraception. Cochrane Database Syst Rev. 2019;(4). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Montgomery ET, van der Straten A, Chitukuta M, Reddy K, Woeber K, Atujuna M, et al. Acceptability and use of a dapivirine vaginal ring in a phase III trial. AIDS (London, England). 2017;31(8):1159–67. Epub 2017/04/26. 10.1097/qad.0000000000001452 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Montgomery ET, Stadler J, Naidoo S, Katz AWK, Laborde N, Garcia M, et al. Reasons for nonadherence to the dapivirine vaginal ring: narrative explanations of objective drug-level results. AIDS (London, England). 2018;32(11):1517–25. Epub 2018/06/30. 10.1097/qad.0000000000001868 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Raine TR, Epstein LB, Harper CC, Brown BA, Boyer CB. Attitudes toward the vaginal ring and transdermal patch among adolescents and young women. Journal of Adolescent Health. 2009;45(3):262–7. 10.1016/j.jadohealth.2009.02.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Latka M. Female-initiated barrier methods for the prevention of STI/HIV: where are we now? Where should we go? Journal of urban health. 2001;78(4):571–80. 10.1093/jurban/78.4.571 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Archer DF, Merkatz RB, Bahamondes L, Westhoff CL, Darney P, Apter D, et al. Efficacy of the 1-year (13-cycle) segesterone acetate and ethinylestradiol contraceptive vaginal system: results of two multicentre, open-label, single-arm, phase 3 trials. The Lancet Global Health. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Shapley-Quinn MK, Manenzhe KN, Agot K, Minnis AM, van der Straten A. "We are not the same": African women's view of multipurpose prevention products in the TRIO clinical study. International journal of women's health. 2019;11:97–107. Epub 2019/02/26. 10.2147/IJWH.S185712 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Brady M, Manning J. Lessons from reproductive health to inform multipurpose prevention technologies: don't reinvent the wheel. Antiviral research. 2013;100 Suppl:S25–31. Epub 2013/11/06. 10.1016/j.antiviral.2013.09.019 . [DOI] [PubMed] [Google Scholar]
- 109.Snow R, Garcia S, Kureshy N, Sadana R, Singh S, Becerra-Valdivia M, et al. Attributes of contraceptive technology: womens preferences in seven countries. 1997. [Google Scholar]
- 110.Kruk ME, Schwalbe N. The relation between intermittent dosing and adherence: preliminary insights. Clinical therapeutics. 2006;28(12):1989–95. 10.1016/j.clinthera.2006.12.011 [DOI] [PubMed] [Google Scholar]
- 111.Rothrock NE, Kaiser K, Cella D. Developing a valid patient‐reported outcome measure. Clin Pharmacol Ther. 2011;90(5):737–42. 10.1038/clpt.2011.195 [DOI] [PMC free article] [PubMed] [Google Scholar]