Abstract
Background
Research has indicated a lack of disease-specific reproductive knowledge among patients with Inflammatory Bowel Disease (IBD) and this has been associated with increased “voluntary childlessness”. Furthermore, a lack of knowledge may contribute to inappropriate medication changes during or after pregnancy. Decision aids have been shown to support decision making in pregnancy as well as in multiple other chronic diseases. A published decision aid for pregnancy in IBD has not been identified, despite the benefit of pre-conception counselling and patient desire for a decision support tool. This study aimed to develop and test the feasibility of a decision aid encompassing reproductive decisions in the setting of IBD.
Methods
The International Patient Decision Aid Standards were implemented in the development of the Pregnancy in IBD Decision Aid (PIDA). A multi-disciplinary steering committee was formed. Patient and clinician focus groups were conducted to explore themes of importance in the reproductive decision-making processes in IBD. A PIDA prototype was designed; patient interviews were conducted to obtain further insight into patient perspectives and to test the prototype for feasibility.
Results
Issues considered of importance to patients and clinicians encountering decisions regarding pregnancy in the setting of IBD included fertility, conception timing, inheritance, medications, infant health, impact of surgery, contraception, nutrition and breastfeeding. Emphasis was placed on the provision of preconception counselling early in the disease course. Decisions relating to conception and medications were chosen as the current focus of PIDA, however content inclusion was broad to support use across preconception, pregnancy and post-partum phases. Favourable and constructive user feedback was received.
Conclusions
The novel development of a decision aid for use in pregnancy and IBD was supported by initial user testing.
Keywords: Inflammatory bowel disease, Pregnancy, Conception, Decision making
Background
Inflammatory Bowel Disease (IBD) includes chronic conditions of the intestines namely Crohn’s disease (CD) and ulcerative colitis (UC). IBD is increasingly diagnosed at younger ages and is usually managed with medications and/or surgery [1]. It is known that the lack of IBD-specific reproductive knowledge among patients has been associated with increased “voluntary childlessness”, with reported rates of 18% and 14% in patients with CD and UC respectively compared with 6.2% in the general population [2, 3]. Furthermore, a lack of patient and clinician knowledge may contribute to inappropriate medication cessation during attempts at conception or pregnancy and increase the risk of flares, despite the expanding data supporting drug safety in pregnancy [4–7]. In particular, there is increasing evidence supporting the safety of biologics. With appropriate information provided to both patients and clinicians, it is anticipated that a greater proportion of patients will receive necessary IBD therapy that has not otherwise been prescribed or adhered to due to misinformation, with resultant optimization of maternal and foetal outcomes [8].
Active IBD during preconception adversely impacts fertility and increases the risk of active disease throughout pregnancy. Thus, it is recommended that patients be in remission before attempting to conceive [9, 10]. Several studies have demonstrated that IBD activity during pregnancy can adversely impact outcomes. For example, a prospective Danish cohort study of women with a history of moderate to severely active IBD reported that disease activity was associated with an increased risk of low birth weight (adjusted odds ratio 2.05; 95% confidence interval: 0.37–11.35) and preterm birth (2.64; 1.14–11.36) [11]. It is also known that active IBD is associated with an increased risk of miscarriage [12, 13].
A significant proportion of women with IBD are of child-bearing age and therefore, a decision aid focusing on reproductive decisions in the context of having IBD has the potential to have significant impact for both patients and clinicians. A Canadian survey study conducted between 2012 and 2014 of women with IBD and clinicians involved in the treatment of patients with IBD confirmed a lack of reproductive knowledge specific to IBD and a desire for more information [14]. While there are existing evidence-based decision aids designed to support decision making in pregnancy in general, as well as in multiple other chronic diseases [15–17], a review of the existing literature has not identified such a resource for pregnancy in IBD. This is despite studies indicating the benefit of pre-conception counselling and patient desire for education and a decision support tool [14, 18–20].
Accordingly, we ascertained issues considered of importance to patients and clinicians encountering decisions regarding pregnancy in the setting of IBD to guide the design of a patient-focused decision aid intended for use in preconception, pregnancy and post-partum phases. Following identification of pertinent issues, an electronic decision aid was created, with the subsequent study aim to evaluate the feasibility of the decision aid using a user-centered approach.
Methods
Overview
The International Patient Decision Aid Standards (IPDAS) guided the development and evaluation of the Pregnancy in IBD Decision Aid (PIDA) [21]. Figure 1 outlines the sequence of events in the design and evaluation of the decision aid as recommended by IPDAS. A steering committee was assembled comprising four IBD specialists (VH, AJW, YL, LD), a general gastroenterologist (DS), an obstetrician (FFH), an obstetric medicine physician (RK), a paediatric gastroenterologist (EW), two patient representatives (KB, VL), a shared decision making expert (DK), an information and knowledge translation specialist (KI) and a perinatal pharmacoepidemiologist (MDV). The steering committee conducted regular meetings by teleconference throughout the development process (SC, TH, NK, KOC).
Three study sites were chosen to conduct user testing: 1. Liverpool Hospital (LH), New South Wales, Australia 2. Pacific Gastroenterology (PG), British Columbia, Canada 3. Mt Sinai Hospital (MSH), Ontario, Canada. Focus groups and interviews were conducted to explore patient and clinician views on decisional needs in relation to pregnancy and IBD and to receive feedback regarding methods in which content could be best delivered. Additional guidance regarding reproductive decisional needs in the setting of IBD was obtained from research conducted by VH [14]. An existing systematic review within the field of pregnancy and IBD [9] was updated to ensure the comprehensive inclusion of content, which was subsequently appraised and organised into themes by the steering committee. An electronic prototype of the decision aid with a focus on (a) desires and ‘ideal’ timing for conception and (b) medication choices during pregnancy was produced and then evaluated by users for feasibility across the three sites.
Phase one: focus groups
Patient and clinician focus groups were conducted at PG to explore issues of concern in pregnancy and IBD. Patient participants were recruited through social media advertising with Crohn’s and Colitis Canada and contacting patients who had previously provided permission to be contacted regarding research opportunities. Clinicians were affiliated with the University of British Columbia across various relevant specialties. Focus groups were moderated by a clinician and recorded and subsequently transcribed for analysis in terms of key themes. In addition, another clinician took fieldnotes to document key discussion items and contextual information. Duration of patient and clinician focus groups were one hour and thirty-five minutes and one hour respectively.
Phase two: review and synthesize evidence
To identify the most up-to-date evidence on the management of IBD during preconception, pregnancy and postpartum, studies published subsequent to the development of the Toronto Consensus Pregnancy Statements [9] were reviewed. The same search string and selection criteria used in the development of the Toronto Consensus Pregnancy Statements were implemented. MEDLINE and EMBASE were searched from Jan 1, 2014 to Apr 29, 2018. The 2016 Toronto Consensus Statements included publications published in MEDLINE from 1946 to Nov 2014 and in EMBASE from 1974 to Nov 2014. The overlap (from January 2014 to Nov 2014) ensured completeness. In addition, ClinicalTrials.gov was systematically searched from inception to April 29, 2018. The search strategy used for this additional search is presented in section of “Appendix 1”. The synthesis of evidence resulting from the systematic search and the Toronto Consensus Pregnancy Statements was conducted by the members of the steering committee and based on their individual areas of expertise.
Phase three: decision aid design and evaluation
Prototype design
Using content resulting from Phase One and Phase Two, a paper version of the PIDA prototype was drafted, which was then converted into a PowerPoint® version to enable incorporation of clickable logic. Subsequently, there was development of an electronic prototype through utilisation of the digital media company, Tactica.1 The current PIDA prototype can accessed at http://ibdpregnancyaid.com/.
The steering committee subsequently provided feedback regarding the design and content of PIDA. An opportunity was offered to formally critique the comprehensibility, usability and accuracy through completion of the Clinician or Patient Feasibility Questionnaire (See section of “Appendix 2a and 2b”). The questionnaire was designed based on tools used in preceding decision aid studies [22–24], with questions pertaining to the time required to review PIDA, perceived readability, content amount, usefulness for the user (if patient user) as well as that anticipated for others, ability to aid with values clarification (if patient user) and accuracy (if clinician user).
Patient feasibility testing
To ensure content saturation, feedback regarding the current PIDA prototype was sought from patients at different reproductive stages (preconception, pregnancy, and post-partum) using individual patient interviews and questionnaires. Participants included women of 18–45 years of age with confirmed diagnosis of IBD who (a) had prior pregnancy history (including those within 12 months of delivery, i.e., post-partum), (b) had no pregnancy history but were interested in considering issues surrounding pregnancy, or (c) were currently pregnant. Women who could not speak or read English sufficiently to complete surveys or use the decision aid and those with known previous adverse pregnancy outcomes were excluded. We aimed to have at least four representative participants from each of the reproductive stages of preconception, pregnancy, and post-partum across the three sites for the focus group (Phase One) and interviews (Phase Three) combined. The rationale for this sample size was based on review of previously published decision aids, which included between 15 and 20 participants in their scoping and design phases [22, 25, 26]. The concept of feasibility testing and the associated questionnaire was based on preceding publications focussing on the development of exemplary decision aids [22, 24]. Acknowledging that the initial patient focus group was limited by both size and pregnancy stage (i.e., all participants preconception), the patient interviews were considered of significant importance in the design of PIDA to ensure that appropriate decisional themes and associated content had been identified and included in PIDA.
Patient interviews were conducted by research coordinators or an IBD fellow at one of the three sites. The participant had the opportunity to review the PIDA prototype in the week preceding their interview using the website link. Basic demographic data was collected for each participant at the interview (age, reproductive status and IBD type (UC or CD)). An interview script was designed a priori and used to guide the interview. A template facilitating note taking during the interview was also designed (See section of “Appendix 3”). Each interview took approximately 30 min. In addition to patient interviews, participants completed a Patient Feasibility Questionnaire (See section of “Appendix 2b”). Interviews were analysed using thematic analysis [27] and questionnaire data using descriptive statistics. The compiled feedback obtained was then used to make further changes to the PIDA prototype.
Results
Phase one: focus groups
Patient focus group
Three patients participated in the focus group, while a further seven who were also interested could not attend on the day due to personal or employment reasons. Median age of participants was 32 years, all with CD and in a preconception stage; one had a history of prior surgery (diverting stoma) for perianal disease and all three were on biologic therapy. Two were currently employed, and the other receiving a disability pension.
The transcript generated from the focus group was analyzed in terms of patient concerns, patient observations as a woman with IBD who is considering pregnancy and patient recommendations for the decision aid and specialist care. Patient concerns regarding conception and pregnancy included (a) the negative impact of active disease on both maternal and fetal/infant health (b) the potential impact of current and past drug therapies on the fetus/infant (c) the ability to care for a child in the setting of being unwell and (d) the ability to conceive, maintain a pregnancy and deliver in the setting of previous abdominal surgery. Recommendations for the design of the decision aid included the ability to facilitate joint decision making (patient and clinician) for decisions surrounding medication management in pregnancy and the promotion of the tool for users at any stage of their reproductive life, including at diagnosis in order for patients to know that pregnancy is an option despite IBD. Exemplary quotes for the expressed concerns and recommendations are shown in section of “Appendix 4a”.
Clinician focus group
In attendance at the focus group were two IBD nurses, an obstetrician, neonatal intensivist, two gastroenterologists (IBD Specialists), gastroenterologist (IBD Specialist with expertise in pregnancy) and two IBD fellows.
The transcript generated from the focus group was analysed by identification of key terms, including clinician perception of patient concerns, clinician concerns regarding pregnancy in the setting of IBD, clinician observations as a health care professional for women with IBD and clinician recommendations for the decision aid. Perceived patient concerns included (a) medications in pregnancy, and in particular the potential for birth defects and impact on immunity, (b) infection risk in infants and safety of infant vaccination (c) plan for flares during pregnancy (d) nutrition, (e) contraception and (f) fertility. Recommendations for design of the decision aid included the ability to provide simplified information to patients at multiple stages (for example, preconception and pregnancy) of their reproductive life. Furthermore, the design of the decision aid was perceived as having a role in facilitating discussion with treating specialists, and hopefully promoting opportunities for discussions regarding pregnancy early on in the disease course that may not otherwise have occurred. Exemplary quotes for the expressed concerns and recommendations are shown in section of “Appendix 4b”.
Phase two: review and synthesize evidence
The literature review identified 306 articles (290 following duplicate removal), with 104 records retained following title and abstract screening. Of the remaining 104 articles, 29 full text articles were included to guide the decision aid content beyond what had been utilised to formulate the Toronto Consensus Pregnancy Statements [11, 28–56].
Phase three: decision aid design and evaluation
Prototype
The decision aid was designed to include a broad range of content, extending from fertility concerns through to post-partum issues and accordingly is considered relevant for users regardless of their reproductive stage. However, the steering committee chose two key decisions based on predominant themes of discussion in the focus groups. Patient interview results also confirmed the perceived importance of the following decisions:
Desires and ideal timing for conception The desire to attempt conception and the ideal timing of such was considered in the design of the information presented. Given recognition of the contribution of fears relating to IBD and pregnancy, including the impact of disease activity on pregnancy, concerns regarding medication use, fear of disease inheritance and concerns surrounding delivery, such topics were given emphasis in the design.
Medication choices during pregnancy The decision as to what to do with IBD related medications during pregnancy was presented. This was supported by the rationale that medication management is essential during pregnancy (to maintain disease control given disease activity has been associated with adverse pregnancy outcomes) and specific medication information needs to be tailored to preconception, pregnancy and postpartum stages. The presentation of information included numerical probabilities, such as that relating to the impact of active disease on adverse pregnancy outcomes. Values regarding medication usage during pregnancy were also assessed prior to and following presentation of the aforementioned information.
Four clinicians and two patient representatives from the steering committee provided formalised feedback, including an Obstetric Physician, an Obstetrician and an adult and a paediatric Gastroenterologist (section of “Appendix 2c”). Feedback indicated adequacy of length, readability, content amount and values assessment, in congruence with the feedback that PIDA is a useful tool. It is noted that the patients from the steering committee were already well educated on pregnancy and their IBD in the context of previous pregnancies and prior physician education, and hence it was reported that the decision aid did not personally impact their understanding and decision making.
Following several iterations, a prototype was agreed upon which was deemed suitable for alpha testing. (See section of “Appendix 5” for exemplary section of prototype) Reading level was assessed using the Flesch Kincaid index [57]. Four representative content sections were chosen from the prototype for testing—disease activity, nutrition, substance abuse and post-partum medications. The obtained reading levels ranged between an average grade level of 13–16, deemed able to be read easily by 18–19 year olds and 21–22-year olds respectively.
Patient feasibility testing
Patient interviews
Thirteen patients across three sites were interviewed, either in person at the institutional site or via telephone. Median age of participants was 31 years (interquartile range (IQR) 30.25–33), six with UC and seven with CD. Three were in preconception, six in pregnant and four in post-partum stages. For nine of these patients, expanded demographic data was available. (See Table 1).
Table 1.
Demographic variable | Frequency of demographic n (%) |
---|---|
Age (median years + IQRa) | 31 (29.5–33.5) |
Ulcerative colitis | 4 (44) |
Crohn’s disease | 5 (56) |
Duration of disease (median years + IQR) | 5.5 (3.5–13) |
Current medications | |
5-aminosalicylates | 3 (33) |
Corticosteroids | 2 (22) |
Immunomodulator (Thiopurine) | 4 (44) |
Biologics | 4 (44) |
Anti-tumour necrosis factor | 4 |
Vedolizumab | 0 |
Ustekinumab | 0 |
Surgical history | |
Yes | 2 (22) |
No | 7 (78) |
Pregnancy stage | |
Preconception | 3 (33) |
Pregnancy | 4 (44) |
Post-partum | 2 (22) |
Currently breastfeeding | |
Yes | 2 (22) |
No | 0 |
Not applicable | 7 (78) |
Prior pregnancies (if pregnant, excludes current) | |
Yes | 5 (56) |
No | 2 (22) |
Marital status | |
Married | 6 (67) |
Common-law | 1 (11) |
Single | 2 (22) |
Highest level of education | |
High school diploma | 2 (22) |
Trade, technical, vocational, business school | 1 (11) |
University undergraduate degree | 3 (33) |
Post graduate degree | 3 (33) |
Total income (CAD/AUS $) | |
20,000–39,990 | 1 (11) |
40,000–69,900 | 1 (11) |
70,000–99,000 | 2 (22) |
100,000+ | 5 (56) |
aIQR: Interquartile
The thematic analysis of the interviews revealed that participants’ most desired content related to medication management during conception, pregnancy and lactation. Additional pregnancy in IBD questions related to other topics such as fertility, inheritance and delivery. Feedback regarding PIDA was predominantly positive, with comments pertaining to adequacy of content coverage, personalization, readability and unbiased information presentation. Suggestions were made for enhancement of design and inclusion of further content. Design related suggestions were the inclusion of visual aids, a summary page and the availability of links to further information, all of which have now been incorporated into the PIDA prototype. Recommendations for content additions which have since been incorporated into the current prototype included statistical representation of inheritance, exercise recommendations, pregnancy related gastrointestinal symptoms and differentiation from IBD symptoms and the timing of recommencement of medications post-partum. Content to be included in subsequent prototype iterations include the impact of IBD on sexual function, expected laboratory changes during pregnancy, and additional post-partum issues including IBD activity and newborn care. The responses to interview questions are summarised and further exemplified in Table 2.
Table 2.
Main concerns The health of fetus/infant Effect of IBDa medications on pregnancy, fetal, and neonatal outcomes and their safety during breastfeeding IBD and Delivery |
Main information needs When is the ideal time to become pregnant when you have IBD? How does my IBD effect my fertility? Will I be able to breastfeed with IBD? Can I have a vaginal delivery? Will I pass IBD or my immune system to my baby? Will any of my IBD drugs pass through to my baby? (during pregnancy & breastfeeding) |
Feedback on PIDA Quantity of information on the slides was not overwhelming Nothing seemed to be missing or too elaborate Information was presented in a neutral light |
Suggested improvements to presentation or content Pictures and diagrams to help visualize information Statistics for example, likelihood of IBD inheritance and flares Summary page and links to further information Suggestions how to improve communication between specialists Sexual function and how it is impacted by IBD Pregnancy related gastrointestinal symptoms vs IBD related symptoms Laboratory changes during pregnancy Safety or recommendations for exercise during pregnancy Analgesia during delivery Any special things for adjusting to home life in the presence of IBD |
aIBD: Inflammatory Bowel Disease
Feasibility questionnaire
Feasibility questionnaires were completed at two of three sites. Scoring indicated that length was considered adequate, with a median time of 15 min (IQR: 10–16.25) for review. Similarly, readability and content amount were both scored as appropriate. Patients reported that the decision aid was useful in terms of obtaining information and decision making and noted that they would recommend to others in their situation. Importantly, it was indicated that PIDA enabled thorough assessment of patient values. Numerically there did not appear to be substantial variation between responses from participants who were pregnant as opposed to preconception or post-partum. Summarised feasibility questionnaire responses are displayed in Table 3.
Table 3.
Question statement | Response (Median) |
---|---|
Time for review of decision aid (minutes + IQRb) | 15 (10–16.25) |
Lengtha (where 3 indicates adequate, 1 short and 5 excessive) |
3 |
Readabilitya (where 3 indicates appropriate, 1 simplified and 5 challenging) |
3 |
Content amounta (where 3 indicates appropriate, 1 limited and 5 excessive) |
3 |
Usefulness for patient understanding and decision makinga (where 3 indicates no impact on understanding and decision making, 1 confusing, and 5 useful) |
5 |
Recommending the decision aid to others in my situationa (where 3 indicates suggested, 1 not recommended and 5 highly recommended) |
5 |
Patient valuesa (where 3 indicates adequate assessment of patient values, 1 inadequate and 5 very well) |
5 |
aLikert scale of 1–5
bIQR: interquartile range
Discussion
There has been increasing recognition of the importance of tailored IBD management during conception, pregnancy and postpartum phases to optimise obstetric and infant outcomes. This has been parallel to the increasing complexity of therapeutic options for IBD. Fortunately, accompanying this is an increasing volume of data providing reassurance for the safety during conception, pregnancy and lactation of most medications prescribed for IBD. However, there remains deficiencies in clinician and patient education regarding the management of IBD during pregnancy. This has been highlighted in previous studies demonstrating high rates of voluntary childlessness, inappropriate medication management and the recognised desire for further education from both interest groups [3, 4, 20, 58].
Accordingly, we have embarked on the development of a personalised decision aid to help meet the aforementioned gap in patient education, which has been further motivated by preceding evidence for the use of decision aids in pregnancy [16]. To guide this process, the IPDAS guidelines have been followed [21]. In addition, the Standards for UNiversal Reporting of patient Decision Aid Evaluations (SUNDAE) checklist was utilised to prepare the reporting of the design process and results [21, 59]. The novelty of PIDA is that it is the first interactive personalized decision aid for pregnancy in IBD. Other available online resources to date are information presenting, or provide checklists, but none are as interactive or personalized to the extent that PIDA has been designed. We feel this advancement in the field will allow more preconception and pregnant women with IBD to obtain core information that they can use to make informed decisions and/or to stimulate discussion with their clinicians.
Reflecting on discussion and feedback occurring during focus groups and individual patient interviews highlighted the consistent theme of the potential for voluntary childlessness, with contributing factors of fear, limitations in existing knowledge and both individual and community misperceptions. Similarly, another persistent theme was that of medication uncertainty across all stages of reproduction (preconception, pregnancy and post-partum). Accordingly, two key decisions were identified (1) the decision regarding the possibility and timing of conception and (2) the decision around the choice of medications in the peri-partum period. Information relevant to both decisions (such as medication safety in conception, pregnancy and lactation; placental transfer and implication for infant vaccinations and importance of disease activity control) were provided in the decision aid. Questions were incorporated to help assist the individual user to clarify their values with regards to medication related decisions. Given the reporting of patient desires for proactive reproductive counselling in their IBD management (e.g., from the time of diagnosis), it is envisioned that the inclusion of values assessment could prompt PIDA users to consider reproductive decisions earlier in their disease course and potentially further assist in addressing voluntary childlessness.
While there was an attempt to obtain a broad patient perspective in the design and preliminary evaluation process for PIDA, note is made of certain demographic biases, related to the intrinsic difficulties with recruitment, especially within the cohort of young patients who often have additional time constraints related to family (particularly given the involvement of young mothers with children) or professional commitments. Furthermore, it is acknowledged that the content included intensely personal issues, with discussion potentially being further challenged in the setting of an outpatient clinic location. Accordingly, there was a limitation of the number of participants able to attend the initial patient focus group and a decision made not to attempt for conduct further focus groups due to recruitment challenges. Further limitations were the homogeneity of disease type (CD) and preconception status of all participants, however there was inclusion of the impact of a previous IBD surgical history. Given the limitation of focus group size and the desire of participants to be involved in the study at a more convenient location (for example from home), feasibility testing included the option of telephone interviews conducted by the research team. In the future, there could be consideration of videoconference as an alternative method to enhance participant involvement and comfort. It is also observed that the majority of participants in patient interviews were of a high socioeconomic background, and thus feedback obtained may not have been reflective of the intended overall target audience for PIDA, including those with limited reading skills. Future consideration of the potential influence of religious and cultural beliefs on pregnancy related perceptions is also necessary to enhance the generalisability of the decision aid.
Subsequent iterations of the current prototype will enable further fulfilment of the requirements in the criteria for judging quality of decision aids as listed in the IPDAS guidelines [60]. In future prototypes, values questions assisting decision making surrounding the desires and timing of conception will be included. It is also intended that there will be the ability to enable the user to search for keywords, while content will also be presented in additional modes other than written text and graphs (for example, audio or video). Medication content will be expanded, in addition to being colour coded according to compatibility of use in conception, pregnancy and lactation. Additional content inclusion such as the impact of IBD on sexual function and the potential effect of IBD during the post-partum period will occur. Evaluation of the decision aid with patient and clinician alpha testing (including the assessment of the impact of PIDA on the quality of the decision-making process, as well as the decision) will guide future iterations. Furthermore, subsequent beta testing (with a randomised controlled trial) is necessary prior to routine use and promotion of the decision aid. Beyond beta testing, adaptation of the decision aid into different electronic technologies, including that of a mobile applications or video representation, could be considered.
Conclusions
Given the efforts employed to systematically develop the decision aid thus far, and the favourable initial user feedback obtained, we anticipate that PIDA will be able to meet an unmet need in the education of patients with IBD who are likely to encounter decisions regarding conception, pregnancy and post-partum timing and management. We envision that there may be the potential for minimisation of voluntary childlessness, as well as optimization of maternal, foetal and infant outcomes related to the enhancement of pregnancy-specific IBD management through the use of PIDA.
Acknowledgements
CM: Project Manager for PIDA development (February–May 2018). KB: Contribution to the design and evaluation of PIDA through Steering Committee Role. VL: Contribution to the design and evaluation of PIDA through Steering Committee Role.
Abbreviations
- IBD
Inflammatory bowel disease
- PIDA
Pregnancy in IBD decision aid
- CD
Crohn’s disease
- UC
Ulcerative colitis
- IPDAS
International Patient Decision Aid Standards
- LH
Liverpool Hospital
- PG
Pacific Gastroenterology
- MSH
Mt Sinai Hospital
- UNSW
University of New South Wales
- UBC
University of British Columbia
- U of T
University of Toronto
- U of A
University of Alberta
- IQR
Interquartile range
- SUNDAE
Standards for UNiversal Reporting of patient Decision Aid Evaluation
Appendix 1
Appendix 2a
Appendix 2b
Appendix 2c
Appendix 3
Appendix 4a
Appendix 4b
Appendix 5
Authors' contributions
AJW: conception and design of the study; acquisition, analysis and interpretation of data and drafting and revising of the manuscript. NK: acquisition and analysis of data and drafting and revising of the manuscript. RC: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. SJC: design of the study; acquisition of data; revising of the manuscript. MADV: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. LAD: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. TH: design of the study; acquisition and analysis of data; revising of the manuscript. KPI: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. RK: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. DK: conception and design of the study; acquisition of data; revising of the manuscript. KO: design of the study; acquisition and analysis of data; drafting and revising of the manuscript. DCS: conception and design of the study; acquisition and analysis of data; drafting and revising of the manuscript. FFT: conception and design of the study; acquisition and analysis of data; revising of the manuscript. EW: conception and design of the study; acquisition and analysis of data; revising of the manuscript. YPL: conception and design of the study; acquisition and analysis of data; revising of the manuscript. VWH: conception and design of the study; acquisition, analysis and interpretation of data and drafting and revising of the manuscript.
Funding
This study was funded in part by Women and Children's Health Research Institute (WCHRI) Clinical/Community Research Integration Support Program (CRISP) (VH); Merck Better Care, Healthy Communities Funding Program (YL); Gastroenterological Society of Australia Rose Amarant Grant (AJW). Funding bodies were not involved in the design of the study; collection, analysis and interpretation of data nor in writing the manuscript.
Availability of data and material
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
The study had ethics approval from the associated institutions: UNSW (Human Research Ethics Committee number: 2019/ETH00254); UBC (Research Ethics Board Number: H17-02354); U of T (Research Ethics Board Number: 18-0215-E); U of A (Pro00071492 Decision Making for Women with IBD). Informed written consent was obtained from participants involved in the study.
Consent to publish
Not applicable.
Competing interests
AJW: Honoraria received from Takeda, Janssen, Pfizer and Abbvie and Honoraria and grant support from Ferring. NK: Grant support received from Janssen and educational support from Ferring. RC, KPI, RK, DK, KO, DCS, FFT: No COI. SJC: Honoraria for Advisory Board participation, speaker fees, educational support and/or research support from Abbvie, BMS, Celltrion, Chiesi, DrFalk, Ferring, Fresenius Kabi, Gilead, Janssen, MSD, Novartis, Pfizer, Takeda. MADV: Canada Research Chair in Medication Adherence, Utilization, and Outcomes. LAD: Honoraria received from Janssen, Abbvie and Pfizer. TH: Advisory boards of Takeda Canada and Johnson Canada and research funding from Pfizer Canada. EW: Honoraria received from Abbvie, Janssen, Nestle. YPL: Honoraria for Advisory Board participation and speaker fees from Janssen, Abbvie, Takeda, Pfizer and Merck. VWH: Honoraria received from Abbvie, Ferring, Janssen, Merck, Pfizer, Roche, Takeda.
Footnotes
Tactica specializes in cross-platform digital media strategy and products for researchers, agencies, and producers. Such products have included numerous health projects, including the HOPE digital platform designed and validated for antenatal and post-partum depression [61].
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Benchimol EI, Fortinsky KJ, Gozdyra P, Van den Heuvel M, Van Limbergen J, Griffiths AM. Epidemiology of pediatric inflammatory bowel disease: a systematic review of international trends. Inflamm Bowel Dis. 2011;17(1):423–439. doi: 10.1002/ibd.21349. [DOI] [PubMed] [Google Scholar]
- 2.Huang VW, Chang HJ, Kroeker KI, Goodman KJ, Hegadoren KM, Dieleman LA, et al. Does the level of reproductive knowledge specific to inflammatory bowel disease predict childlessness among women with inflammatory bowel disease? Can J Gastroenterol Hepatol. 2015;29(2):95–103. doi: 10.1155/2015/715354. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Marri SR, Ahn C, Buchman AL. Voluntary childlessness is increased in women with inflammatory bowel disease. Inflamm Bowel Dis. 2007;13(5):591–599. doi: 10.1002/ibd.20082. [DOI] [PubMed] [Google Scholar]
- 4.Blumenstein I, Herrmann E, Filmann N, Zosel C, Tacke W, Bock H, et al. Female patients suffering from inflammatory bowel diseases are treated less frequently with immunosuppressive medication and have a higher disease activity: a subgroup analysis of a large multi-centre, prospective, internet-based study. J Crohns Colitis. 2011;5(3):203–210. doi: 10.1016/j.crohns.2010.12.012. [DOI] [PubMed] [Google Scholar]
- 5.Selinger CP, Eaden J, Selby W, Jones DB, Katelaris P, Chapman G, et al. Patients' knowledge of pregnancy-related issues in inflammatory bowel disease and validation of a novel assessment tool ('CCPKnow') Aliment Pharmacol Ther. 2012;36(1):57–63. doi: 10.1111/j.1365-2036.2012.05130.x. [DOI] [PubMed] [Google Scholar]
- 6.Mahadevan UMC, Sandler RS, Kane SV, Dubinsky M, Lewis JD, Sandborn WJ, Sands BE. 865 PIANO: a 1000 patient prospective registry of pregnancy outcomes in women with IBD exposed to immunomodulators and biologic therapy. Gastroenterology. 2012;142(5):S-149. doi: 10.1016/S0016-5085(12)60561-7. [DOI] [Google Scholar]
- 7.Gallinger ZR, Rumman A, Nguyen GC. Perceptions and attitudes towards medication adherence during pregnancy in inflammatory bowel disease. J Crohns Colitis. 2016;10(8):892–897. doi: 10.1093/ecco-jcc/jjw052. [DOI] [PubMed] [Google Scholar]
- 8.Selinger CP, Eaden J, Selby W, Jones DB, Katelaris P, Chapman G, et al. Inflammatory bowel disease and pregnancy: lack of knowledge is associated with negative views. J Crohns Colitis. 2013;7(6):e206–e213. doi: 10.1016/j.crohns.2012.09.010. [DOI] [PubMed] [Google Scholar]
- 9.Nguyen GC, Seow CH, Maxwell C, Huang V, Leung Y, Jones J, et al. The Toronto consensus statements for the management of inflammatory bowel disease in pregnancy. Gastroenterology. 2016;150(3):734–57.e1. doi: 10.1053/j.gastro.2015.12.003. [DOI] [PubMed] [Google Scholar]
- 10.Mahadevan U, Robinson C, Bernasko N, Boland B, Chambers C, Dubinsky M, et al. Inflammatory bowel disease in pregnancy clinical care pathway: a report from the american gastroenterological association IBD parenthood project working group. Am J Obstet Gynecol. 2019;220(4):308–323. doi: 10.1016/j.ajog.2019.02.027. [DOI] [PubMed] [Google Scholar]
- 11.Kammerlander H, Nielsen J, Kjeldsen J, Knudsen T, Friedman S, Norgard B. The Effect of disease activity on birth outcomes in a Nationwide Cohort of women with moderate to severe inflammatory bowel disease. Inflamm Bowel Dis. 2017;23(6):1011–1018. doi: 10.1097/MIB.0000000000001102. [DOI] [PubMed] [Google Scholar]
- 12.Ujihara M, Ando T, Ishiguro K, Maeda O, Watanabe O, Hirayama Y, et al. Importance of appropriate pharmaceutical management in pregnant women with ulcerative colitis. BMC Res Notes. 2013;6:210. doi: 10.1186/1756-0500-6-210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bröms G, Granath F, Linder M, Stephansson O, Elmberg M, Kieler H. Birth outcomes in women with inflammatory bowel disease: effects of disease activity and drug exposure. Inflamm Bowel Dis. 2014;20(6):1091–1098. doi: 10.1097/MIB.0000000000000060. [DOI] [PubMed] [Google Scholar]
- 14.Huang V. Thesis: reproductive knowledge specific to inflammatory bowel disease among women with IBD and physicians who treat women with IBD. 2014.
- 15.Stacey D, Legare F, Col NF, Bennett CL, Barry MJ, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2014;1:1CD001431. doi: 10.1002/14651858.CD001431.pub4. [DOI] [PubMed] [Google Scholar]
- 16.Dugas M, Shorten A, Dube E, Wassef M, Bujold E, Chaillet N. Decision aid tools to support women's decision making in pregnancy and birth: a systematic review and meta-analysis. Soc Sci Med. 2012;74(12):1968–1978. doi: 10.1016/j.socscimed.2012.01.041. [DOI] [PubMed] [Google Scholar]
- 17.Patient Decision Aids Inventory. Ottawa Hospital Research Institute and University of Ottawa.
- 18.de Lima A, Zelinkova Z, Mulders AG, van der Woude CJ. Preconception care reduces relapse of inflammatory bowel disease during pregnancy. Clin Gastroenterol Hepatol. 2016;14(9):1285–92.e1. doi: 10.1016/j.cgh.2016.03.018. [DOI] [PubMed] [Google Scholar]
- 19.Sutton RT, Wierstra K, Huang VW. Knowledge translation dataset: an e-health intervention for pregnancy in inflammatory bowel disease. Data Brief. 2019;23:103647. [DOI] [PMC free article] [PubMed]
- 20.Martinez B, Dailey F, Almario CV, Keller MS, Desai M, Dupuy T, et al. Patient understanding of the risks and benefits of biologic therapies in inflammatory bowel disease: insights from a large-scale analysis of social media platforms. Inflamm Bowel Dis. 2017;23(7):1057–1064. doi: 10.1097/MIB.0000000000001110. [DOI] [PubMed] [Google Scholar]
- 21.Elwyn G, O'Connor AM, Bennett C, Newcombe RG, Politi M, Durand MA, et al. Assessing the quality of decision support technologies using the international patient decision aid standards instrument (IPDASi) PLoS ONE. 2009;4(3):e4705. doi: 10.1371/journal.pone.0004705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.McGrath A, Sharpe L, Lah S, Parratt K. Evaluation of a decision aid for women with epilepsy who are considering pregnancy: a randomized controlled trial. Med Decis Making. 2017;37(5):589–599. doi: 10.1177/0272989X17697304. [DOI] [PubMed] [Google Scholar]
- 23.O'Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, et al. A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation. Patient Educ Couns. 1998;33(3):267–279. doi: 10.1016/S0738-3991(98)00026-3. [DOI] [PubMed] [Google Scholar]
- 24.O'Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, et al. Randomized trial of a portable, self-administered decision aid for postmenopausal women considering long-term preventive hormone therapy. Med Decis Making. 1998;18(3):295–303. doi: 10.1177/0272989X9801800307. [DOI] [PubMed] [Google Scholar]
- 25.Prunty M, Sharpe L, Butow P, Fulcher G. The motherhood choice: themes arising in the decision-making process for women with multiple sclerosis. Mult Scler. 2008;14(5):701–704. doi: 10.1177/1352458507086103. [DOI] [PubMed] [Google Scholar]
- 26.Meade T, Sharpe L, Hallab L, Aspanell D, Manolios N. Navigating motherhood choices in the context of rheumatoid arthritis: women's stories. Musculoskeletal Care. 2013;11(2):73–82. doi: 10.1002/msc.1031. [DOI] [PubMed] [Google Scholar]
- 27.Braun V, Clarke V. Thematic analysis. In: Cooper H, Long DL, Panter AT, Rindskopf D, Sher KJ, editors. APA handbook of research methods in psychology, vol 2 research designs: quantitative, qualitative, neuropsychological, and biological. DC: Washington; 2012. pp. 57–71. [Google Scholar]
- 28.Wils P, Bouhnik Y, Michetti P, Flourie B, Brixi H, Bourrier A, et al. Long-term efficacy and safety of ustekinumab in 122 refractory Crohn's disease patients: a multicentre experience. Aliment Pharmacol Ther. 2018;47(5):588–595. doi: 10.1111/apt.14487. [DOI] [PubMed] [Google Scholar]
- 29.Venturin C, Nancey S, Danion P, Uzzan M, Chauvenet M, Bergoin C, et al. Fetal death in utero and miscarriage in a patient with Crohn's disease under therapy with ustekinumab: case-report and review of the literature. BMC Gastroenterol. 2017;17(1):80. doi: 10.1186/s12876-017-0633-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Thomas C, Monteil-Ganiere C, Mirallie S, Hemont C, Dert C, Leger A, et al. A severe neonatal lymphopenia associated with administration of azathioprine to the mother in a context of Crohn's disease. J Crohns Colitis. 2018;12(2):258–261. doi: 10.1093/ecco-jcc/jjx123. [DOI] [PubMed] [Google Scholar]
- 31.Rowan CR, Cullen G, Mulcahy HE, Keegan D, Byrne K, Murphy DJ, et al. Ustekinumab drug levels in maternal and cord blood in a woman with Crohn's disease treated until 33 weeks of gestation. J Crohns Colitis. 2018;12(3):376–378. doi: 10.1093/ecco-jcc/jjx141. [DOI] [PubMed] [Google Scholar]
- 32.Padhan RK, Kedia S, Garg SK, Bopanna S, Mouli VP, Dhingra R, et al. Long-term disease course and pregnancy outcomes in women with inflammatory bowel disease: an Indian cohort study. Dig Dis Sci. 2017;62(8):2054–2062. doi: 10.1007/s10620-016-4353-5. [DOI] [PubMed] [Google Scholar]
- 33.Myklebust-Hansen T, Aamodt G, Haugen M, Brantsaeter AL, Vatn MH, Bengtson MB. Dietary patterns in women with inflammatory bowel disease and risk of adverse pregnancy outcomes: results from The Norwegian Mother and Child Cohort Study (MoBa) Inflamm Bowel Dis. 2017;24(1):12–24. doi: 10.1093/ibd/izx006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Martelli L, Lopez A, Strobel S, Danese S, Roblin X, Baumann C, et al. Adherence to infliximab therapy in inflammatory bowel disease patients in a real-life setting. J Dig Dis. 2017;18(10):566–573. doi: 10.1111/1751-2980.12539. [DOI] [PubMed] [Google Scholar]
- 35.Lee S, Metcalfe A, Raman M, Leung Y, Aghajafari F, Letourneau N, et al. Pregnant women with inflammatory bowel disease are at increased risk of vitamin D insufficiency: a cross-sectional study. J Crohns Colitis. 2018;12(6):702–709. doi: 10.1093/ecco-jcc/jjy030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kanis SL, van der Woude CJ. Endoscopy for inflammatory bowel disease during pregnancy: only when there is a strong indication. Gastroenterology. 2017;153(1):330–331. doi: 10.1053/j.gastro.2016.12.054. [DOI] [PubMed] [Google Scholar]
- 37.Kanis SL, de Lima-Karagiannis A, de Boer NKH, van der Woude CJ. Use of thiopurines during conception and pregnancy is not associated with adverse pregnancy outcomes or health of infants at one year in a prospective study. Clin Gastroenterol Hepatol. 2017;15(8):1232–41 e1. doi: 10.1016/j.cgh.2017.02.041. [DOI] [PubMed] [Google Scholar]
- 38.Kammerlander H, Nielsen J, Knudsen T, Kjeldsen J, Friedman S, Norgard BM. Anti-TNF-alpha use during the third trimester of pregnancy in women with moderate-severe inflammatory bowel disease and the risk of preterm birth and low birth weight. Inflamm Bowel Dis. 2017;23(11):1916–1923. doi: 10.1097/MIB.0000000000001234. [DOI] [PubMed] [Google Scholar]
- 39.Kammerlander H, Nielsen J, Kjeldsen J, Knudsen T, Friedman S, Nørgård B. The effect of disease activity on birth outcomes in a nationwide cohort of women with moderate to severe inflammatory bowel disease. Inflamm Bowel Dis. 2017;23(6):1011–1018. doi: 10.1097/MIB.0000000000001102. [DOI] [PubMed] [Google Scholar]
- 40.Kammerlander H, Nielsen J, Kjeldsen J, Knudsen T, Gradel KO, Friedman S, et al. Fecal calprotectin during pregnancy in women with moderate-severe inflammatory bowel disease. Inflamm Bowel Dis. 2018;24(4):839–848. doi: 10.1093/ibd/izx055. [DOI] [PubMed] [Google Scholar]
- 41.Julsgaard M, Kjeldsen J, Baumgart DC. Vedolizumab safety in pregnancy and newborn outcomes. Gut. 2017;66(10):1866–1867. doi: 10.1136/gutjnl-2016-313444. [DOI] [PubMed] [Google Scholar]
- 42.Julsgaard M, Hvas CL, Gearry RB, Vestergaard T, Fallingborg J, Svenningsen L, et al. Fecal calprotectin is not affected by pregnancy: clinical implications for the management of pregnant patients with inflammatory bowel disease. Inflamm Bowel Dis. 2017;23(7):1240–1246. doi: 10.1097/MIB.0000000000001136. [DOI] [PubMed] [Google Scholar]
- 43.Ito A, Iizuka B, Omori T, Nakamura S, Tokushige K. Relationship between the clinical course of ulcerative colitis during pregnancy and the outcomes of pregnancy: a retrospective evaluation. Intern Med. 2018;57(2):159–164. doi: 10.2169/internalmedicine.8550-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Hoekstra J, van Roon AHC, Bekkering FC, van Tilburg AJP, West RL. Decision making and outcome of pregnancies in female patients with inflammatory bowel disease: findings from a community-based practice. Eur J Gastroenterol Hepatol. 2018;30(7):704–708. doi: 10.1097/MEG.0000000000001117. [DOI] [PubMed] [Google Scholar]
- 45.Gonzalez-Suarez B, Sengupta S, Moss AC. Impact of inflammatory bowel disease activity and thiopurine therapy on birth weight: a meta-analysis. World J Gastroenterol. 2017;23(45):8082–8089. doi: 10.3748/wjg.v23.i45.8082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Fujioka K, Fukushima S, Nishida K, Iijima K, Morioka I. Intraventricular hemorrhage due to coagulopathy after vitamin K administration in a preterm infant with maternal crohn disease. Jpn Clin Med. 2017;8:1–4. doi: 10.1177/1179670717746333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Friedman S. Gestational weight gain: a new factor influencing pregnancy outcomes in women with inflammatory bowel disease. Dig Dis Sci. 2017;62(8):2070–2071. doi: 10.1007/s10620-017-4635-6. [DOI] [PubMed] [Google Scholar]
- 48.de Silva PS, Hansen HH, Wehberg S, Friedman S, Norgard BM. Risk of ectopic pregnancy in women with inflammatory bowel disease: a 22-year nationwide cohort study. Clin Gastroenterol Hepatol. 2018;16(1):83–9 e1. doi: 10.1016/j.cgh.2017.06.054. [DOI] [PubMed] [Google Scholar]
- 49.Esteve-Sole A, Deya-Martinez A, Teixido I, Ricart E, Gompertz M, Torradeflot M, et al. Immunological changes in blood of newborns exposed to anti-TNF-alpha during pregnancy. Front Immunol. 2017;8:1123. doi: 10.3389/fimmu.2017.01123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Di Mitri R, Mocciaro F, Maiorana A, Alio W, Orlando A. Endoscopic rescue treatment in a pregnant ulcerative colitis patient with a severe colonic stricture: a conservative approach to bring the pregnancy to term. Gastrointest Endosc. 2017;86(6):1183–1185. doi: 10.1016/j.gie.2017.05.043. [DOI] [PubMed] [Google Scholar]
- 51.Clowse MEB, Scheuerle AE, Chambers C, Afzali A, Kimball AB, Cush JJ, et al. Pregnancy outcomes after exposure to certolizumab pegol: updated results from a pharmacovigilance safety database. Arthritis Rheumatol. 2018;70(9):1399–1407. doi: 10.1002/art.40508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Chaparro M, Verreth A, Lobaton T, Gravito-Soares E, Julsgaard M, Savarino E, et al. Long-term safety of in utero exposure to anti-TNFalpha drugs for the treatment of inflammatory bowel disease: results from the multicenter European TEDDY study. Am J Gastroenterol. 2018;113(3):396–403. doi: 10.1038/ajg.2017.501. [DOI] [PubMed] [Google Scholar]
- 53.Bengtson MB, Martin CF, Aamodt G, Vatn MH, Mahadevan U. Inadequate gestational weight gain predicts adverse pregnancy outcomes in mothers with inflammatory bowel disease: results from a prospective US pregnancy cohort. Dig Dis Sci. 2017;62(8):2063–2069. doi: 10.1007/s10620-017-4547-5. [DOI] [PubMed] [Google Scholar]
- 54.Bengtson MB, Aamodt G, Mahadevan U, Vatn MH. Inadequate gestational weight gain, the hidden link between maternal IBD and adverse pregnancy outcomes: results from the norwegian mother and child cohort study. Inflamm Bowel Dis. 2017;23(7):1225–1233. doi: 10.1097/MIB.0000000000001123. [DOI] [PubMed] [Google Scholar]
- 55.Beaulieu DB, Ananthakrishnan AN, Martin C, Cohen RD, Kane SV, Mahadevan U. Use of biologic therapy by pregnant women with inflammatory bowel disease does not affect infant response to vaccines. Clin Gastroenterol Hepatol. 2018;16(1):99–105. doi: 10.1016/j.cgh.2017.08.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Clowse ME, Förger F, Hwang C, Thorp J, Dolhain RJ, van Tubergen A, et al. Minimal to no transfer of certolizumab pegol into breast milk: results from CRADLE, a prospective, postmarketing, multicentre, pharmacokinetic study. Ann Rheum Dis. 2017;76(11):1890–1896. doi: 10.1136/annrheumdis-2017-211384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Flesch R. A new readability yardstick. J Appl Psychol. 1948;32(3):221–233. doi: 10.1037/h0057532. [DOI] [PubMed] [Google Scholar]
- 58.Kanazaki R, Smith B, Girgis A, Descallar J, Connor S. Survey of barriers to adherence to international inflammatory bowel disease guidelines: does gastroenterologists’ confidence translate to high adherence?. Int Med J. 2021. [DOI] [PubMed]
- 59.Sepucha KR, Abhyankar P, Hoffman AS, Bekker HL, LeBlanc A, Levin CA, et al. Standards for universal reporting of patient decision aid evaluation studies: the development of SUNDAE checklist. BMJ Qual Saf. 2018;27(5):380–388. doi: 10.1136/bmjqs-2017-006986. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333(7565):417. doi: 10.1136/bmj.38926.629329.AE. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Kingston D, Janes-Kelley S, Tyrrell J, Clark L, Hamza D, Holmes P, et al. An integrated web-based mental health intervention of assessment-referral-care to reduce stress, anxiety, and depression in hospitalized pregnant women with medically high-risk pregnancies: a feasibility study protocol of hospital-based implementation. JMIR Res Protoc. 2015;4(1):e9. doi: 10.2196/resprot.4037. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.