Abstract
Objectives:
Women Veterans have a high prevalence of comorbidities that increase risk of adverse pregnancy outcomes. Screening for pregnancy desires in primary care provider (PCP) visits offers an opportunity to optimize preconception health. This pilot quality improvement initiative sought to assess Veterans Healthcare Administration (VHA) provider preferences on One Key Question® (OKQ®) implementation, identification of Veteran reproductive needs, and the effect of training on documentation in a women’s primary care clinic in Salt Lake City, UT.
Methods:
We hosted OKQ® training sessions for providers and staff, audio-recorded group discussions on implementation barriers and explored themes. Women Veterans presenting for a PCP visit in July 2018 self-completed a paper OKQ® screening tool. We calculated summary statistics on responses. We conducted a pre-post analysis, with respect to training sessions, to measure for changes in family planning documentation during PCP visits.
Results:
Nineteen providers and staff completed training. They acknowledged the importance, but felt the screening tool should be completed by Veterans and not provider-prompted. Forty-two women Veterans completed the screening tool: 21% desired pregnancy in the next year and 26% desired contraceptive information. Chart reviews found a non-significant increase in current contraceptive method documentation between periods (20% vs. 37%; p= 0.08), a decline in documentation of reproductive goals (22% vs. 3%; p=0.02), and no significant change in counseling.
Conclusions:
Veterans identify reproductive needs via the OKQ® screening tool, but provider documentation did not reflect changes in care following training. Further study is necessary to develop an optimal, patient-centered tool and implementation plan to support women Veterans in their reproductive goals.
Introduction
Family planning is important for all women to achieve the families they desire and to mitigate risks of adverse maternal and child outcomes, such as preterm birth.1–6 Nearly half of all pregnancies in the U.S. are unintended, defined as unwanted or mistimed, and women with chronic health conditions are more likely to experience an unplanned pregnancy than healthy women.7,8 The most effective way to prevent unintended pregnancy and allow for time to optimize preconception health is through consistent and correct contraceptive use.7,9 A lack of access to family planning services and incorrect or inconsistent use of contraceptive methods all contribute to unintended pregnancy.10 The Centers for Disease Control (CDC) and the Office of Population Affairs of the U.S. Department of Health and Human Services published Quality Family Planning (QFP) recommendations to highlight opportunities to address these issues.11 These recommendations stress the inclusion of family planning with other preventive services.11 Encouraging primary care providers (PCPs) to discuss pregnancy intentions and support access to effective contraceptive methods is one opportunity to improve QFP in the U.S.
Women Veterans are the fastest growing Veterans Healthcare Administration (VHA)-eligible population and meeting their healthcare needs is a top VHA priority.12,13 Women Veterans have a high prevalence of medical, mental health, and substance use disorders that increase risk of adverse pregnancy outcomes.14 Despite VHA coverage for reproductive care, women Veterans with high-risk health conditions have low rates of contraceptive utilization and infrequently seek preconception counseling to optimize disease control prior to a pregnancy.15–17 A recent survey of women Veterans found low contraceptive knowledge in those who use the VHA.18 Additionally, significant racial and ethnic disparities in both contraceptive knowledge and self-efficacy impact method use.18,19 Many women Veterans only seek specific services at the VHA, such as mental healthcare, resulting in missed opportunities to connect them to preventive reproductive care, if screening does not occur in this setting.12
Evaluating women’s pregnancy intentions and contraceptive use in the primary care setting is feasible and important to avoid unsafe prescribing practices in women at risk for pregnancy.20 Contraceptive counseling in primary care is acceptable to women Veterans and increases effective hormonal contraceptive use.21,22 Despite the topic importance, VHA PCPs may not care for a high volume of women Veterans, lack time when addressing other issues, or may not feel comfortable in family planning discussions.23,24 The VHA employs several nationwide screening tools embedded into the electronic health record (EHR) aimed at providing timely and concise point-of-care services. This is the case for smoking, homelessness and other scenarios; however, family planning screening is lacking. Consequently, family planning-focused care may be overlooked during a routine primary care visit.
No standardized family planning screening tool exists for women Veterans or other high-risk populations. One approach to address the competing challenges experienced in PCP visits and still prioritize family planning screening is the One Key Question® (OKQ®) Initiative developed by the Oregon Foundation of Reproductive Health.25,26 The initiative sought to address diminishing access to contraception in primary care by centering pregnancy intention screening as routine preventive care. The OKQ® screening algorithm starts with “Would you like to become pregnant in the next year?” and prompts counseling based upon responses of “yes”, “no”, “unsure”, or “ok either way.” Depending upon response, the provider will review chronic health conditions and medications, prescribe prenatal vitamins, discuss contraceptive use, and offer or refer for counseling on safe, effective contraceptive methods. The screen has different options for administration, such as a written survey that is patient-facing or verbal screening by a healthcare provider. Responses may be documented through an EHR clinical reminder, note template, or free-text.
Reproductive health experts and medical societies, including the American College of Obstetricians and Gynecologists, have recommended integration of pregnancy intention screening tools, such as the OKQ®, into healthcare systems.10,25,27 While implementation has occurred in certain health systems28, evaluation of the training process or provider/staff preferences for implementation are lacking. One study in a non-VHA setting evaluated the impact of the screening on clinical documentation and found increased contraceptive counseling, but no change in preconception metrics.29 Two other studies compared the OKQ® to other screening tools and found the OKQ® effectively improved patient communication about reproductive health with providers30 and identified women desiring contraceptive counseling for pregnancy avoidance31. As pregnancy intention screening is important in high-risk women Veterans and the OKQ® has not been implemented or evaluated in VHA clinical settings, we undertook this pilot initiative to: 1) implement OKQ® training in a VHA Women’s Primary Care Clinic based on provider feedback, 2) conduct pilot OKQ® screening among women Veterans to assess reproductive needs, and 3) assess whether the OKQ® training impacts family planning counseling and care based on clinical documentation.
Materials and Methods
We completed this pilot initiative under an umbrella Institutional Review Board exemption for quality improvement (QI) projects within the Salt Lake City VA Specialty Care Center of Innovation (COI). The COI was one of 4 regional Centers funded for five years (2014–19) to support physicians from medical specialties in evaluating and diffusing QI projects. The initiative included three primary components. First, we collaborated with the Health Promotion Coordinator at the Utah Department of Health who had completed the required “train the trainer” curriculum by the Oregon Foundation of Reproductive Health, in order to implement the standardized OKQ® educational program.26 We hosted OKQ® training sessions during a Salt Lake VHA primary care meeting that included 11 PCPs and in a Women’s Clinic staff meeting, which included 3 PCPs, 4 nurses and 1 pharmacist. These trainings reviewed the importance of family planning and preconception care, the OKQ® algorithm, guidance on patient-centered counseling, and options for VHA referrals to a reproductive healthcare provider. We asked providers during training to incorporate this information into their patient care and clinical notes, but documentation practices were not mandated, as we desired to assess general practice changes over time and not individual patient care based on survey responses. As provider and staff perspectives on OKQ® training and implementation preferences have not previously been evaluated, we asked attendees to complete a survey on current family planning screening and comfort and preferences for OKQ® implementation. We audio recorded the meetings and reviewed the content for dominant discussion themes on screening barriers and implementation preferences.
Provider and staff feedback during training sessions led to the decision to implement the OKQ® as a Veteran-facing, written screening tool for the 2nd component of the pilot. All 18–45 year old women Veterans who presented to the Salt Lake VHA Women’s Primary Care Clinic for a primary care visit during July 2018 received the screening tool to self-complete in the waiting room. The providers and staff who participated in the training all have a minimum of a half day of office visits in this clinic per week. Participants were informed that the self-completed survey was part of a QI project, did not have any identifying information, and would not be part of their permanent medical record. The rooming nurse collected the OKQ® paper survey and gave it to the provider for review before the provider entered the exam room. The completed, anonymous surveys were collected for data analysis by project staff and not linked to the medical record. No data were collected from any Veteran who did not submit a survey to the nurse.
Finally, we sought to assess the clinical impact and sustainability of the education through retrospective pre- post- chart reviews. We identified all reproductive age women Veterans with a VHA Women’s Primary Care Clinic PCP office visit in a pre-training month (January 2018) and again in the month post OKQ® screening tool administration (August 2018). We excluded those seen for a specialty care visit, such as musculoskeletal or gynecology clinic focused on problem-based care. The lead author conducted an explicit chart review using an abstraction guide aimed at identifying the presence or absence of the following documentation based on the OKQ® training metrics26: a) notation of preconception and contraception counseling, b) referrals for relevant preconception and/or contraception needs, c) consideration of medications or treatment plans to optimize health for those desiring pregnancy, d) recommendations for the use of prenatal vitamins/folic acid, and e) initiation of contraception and method type in the primary care encounter. We calculated descriptive statistics (counts and percentages) and compared pre-and post-training proportions using a chi-square test on MedCalc Statistical Software. We considered p-values of less than 0.05 to be statistically significant.
Results
Healthcare Team Training
Eight providers (57%) completed pre-training surveys. Only one provider reported a practice of routine pregnancy intention assessments in all visits prior to the training. While most providers were interested in integrating routine screening for all women into their practice, two felt screening should not occur during urgent care or problem-based visits. All respondents felt reminders in the EHR would be helpful, but varied on preference for screening processes, such as having the nurse screen the patient or having women fill out a paper survey to give to the nurse prior to the visit.
We audio-recorded the training sessions and prompted participants to discuss barriers and facilitators to use of the OKQ® in routine practice. Three main themes emerged in the discussions:
All participants felt the knowledge of pregnancy risk and training on OKQ® were important for clinical care: “This information can change what I do for a woman or how I prioritize things.” (PCP)
Women’s Clinic staff and providers felt screening needed to occur more in other VHA settings, such as in mental health for women who are not accessing primary care: “We already do this here. When people fall through the cracks it is in other clinics.” (Nurse)
Providers felt overwhelmed by clinical reminders already in the electronic health record and desired the screening to be “Veteran-facing”, so women could bring up the issue when they wanted to discuss it with the provider: “Is there a way for women to do this at home, before their appointments? Then we already know if we need to address it.” (PCP)
Veteran OKQ® Screening
A total of 42 women Veterans completed a paper OKQ® screening tool and many reported reproductive counseling or care needs. Nine women (21%) reported a desire for pregnancy within the next year, but only three of these women were taking folic acid. Two women did not desire pregnancy, but were sexually active with a man and not using any form of contraception. Of the 42 women, eleven (26%) had questions or concerns regarding their contraception that they wanted to discuss with a provider or desire for a more effective method. Two women did not have a partner, but used the survey to ask about options for achieving pregnancy. While we did not specifically ask women what they thought of the screening tool, they were receptive to completing it per the receptionist and nurse feedback, and five wrote positive comments, such as “thank you for asking!!” in the margins.
Retrospective Chart Reviews
We included 41 women Veterans (24% of all clinic visits met inclusion criteria) in the pre-training month and 52 women Veterans (31% of visits) in the post-training month. We found no significant differences in Veteran health characteristics by month. While not statistically significant, a greater proportion of women Veterans saw an advanced practice clinician (APC) in the pre-training than in the post-training (54% vs. 37%) due to changes in clinic staffing. The change in provider type (APC to MD) accounted for a decrease in reproductive plan documentation between the pre- and post-training months (22% vs. 6%; p= 0.02). Although not statistically significant, there was an increase in documentation of current contraceptive method type between periods (20% vs. 37%; p= 0.08). (Table 1)
Table 1.
Pre-training (N=41) | Post-training (N=52) | p-value | |
---|---|---|---|
Median Veteran age (range) | 34 (21–44) | 34 (22–45) | 0.92 |
Medical diagnosis | 24 (59%) | 28 (54%) | 0.63 |
Mental health diagnosis | 34 (83%) | 38 (73%) | 0.16 |
Current tobacco use | 12 (29%) | 9 (17%) | 0.17 |
Prior hysterectomy or sterilization | 5 (12%) | 4 (8%) | 0.52 |
Currently pregnant | 0 (0%) | 3 (6%) | n/a |
Provider type | 0.19 | ||
Attending physician | 7 (17%) | 16 (31%) | |
Advanced Practice Clinician | 22 (54%) | 19 (37%) | |
Resident | 12 (29%) | 17 (33%) | |
Reproductive Documentation | |||
Reproductive plan | 9 (22%) | 3 (6%) | 0.02 |
Contraceptive method | 8 (20%) | 19 (37%) | 0.08 |
Contraceptive counseling | 8 (20%) | 7 (13%) | 0.36 |
Preconception counseling | 3 (7%) | 2 (4%) | 0.78 |
Discussion
This pilot study introduced the OKQ® within a VHA primary care women’s clinic as one option for family planning screening. The healthcare team acknowledged the importance of screening and the potential to integrate it across VHA access points where women Veterans are not as commonly cared for. Women Veterans presenting to PCP visits reported pregnancy desires and contraceptive needs that are important considerations for comprehensive care. Though our sample was small and not powered to detect clinically meaningful changes in documentation, our findings are similar to a previous civilian study which showed the OKQ® tool may improve contraceptive care more so than preconception counseling.29 Unfortunately, outcome evaluations to date are difficult to interpret or replicate until the OKQ® training, implementation, and evaluation process is clarified.
The OKQ® is one family planning screening tool available for PCPs to administer in different ways. In this study, based on provider preferences we used a Veteran-facing, paper-based screening tool. Despite using the screening method most acceptable to PCPs, OKQ® training did not significantly change family planning documentation, even though over half of the Veterans had a medical diagnosis that would be high-risk in the setting of unintended pregnancy. A previous study found higher rates of documented contraceptive counseling in Veterans with prescriptions for teratogenic medications.32 This difference may be a result of pharmacy alerts at the time of teratogen prescription, while medical conditions alone may not prompt providers to counsel on reproductive planning. Additionally, documentation does not consistently capture all components of a clinical visit and family planning discussions could still be occurring in these settings.
Given the importance of this information for clinical decision-making and Veteran desire to discuss family planning, provider prompts need to be further studied. The OKQ® may not be an ideal screening tool for all populations. OKQ® is a feasible screening tool for busy providers to incorporate into practice, and can be patient-centered if used in accordance with the somewhat lengthy training guidelines. However, the question if asked alone is restricted to a narrow timeframe (1 year) and is closed ended. To address these limitations, reproductive health researchers have invested effort into improving options for alternative patient-centered family planning assessments.33 Other approaches for initiating a patient-centered conversation about reproductive intentions include The PATH questions (Parenthood/pregnancy Attitude, Timing, and How important is pregnancy prevention), which ask about timeframes and intentions in an open ended fashion and also address the strength of women’s desire to prevent pregnancy, which can inform patient-centered contraceptive counseling.34 A randomized controlled trial in a civilian setting compared the OKQ® to the Family Planning Quotient (FPQ) decision aid and found they were similar in facilitating communication, although providers noted the FPQ was less helpful than the OKQ®.30 In a different study, the authors compared women’s responses to the OKQ® and the Desire to Avoid Pregnancy (DAP) screen. They reported both tools identify desire to avoid pregnancy and contraceptive needs, but that the OKQ® tool may need more follow-up questions to understand patients’ responses and needs.31
Within the VHA, several efforts are currently underway or being tested to increase delivery of family planning screening and counseling. First, the national VA Office of Women’s Health is developing a clinical reminder for assessment of women’s reproductive intentions and a banner indicating women’s pregnancy and lactation status.35 However, there are several barriers to consistent clinical reminder use in VHA, as described in previous studies.36–40 Overcoming these barriers requires coordination and concurrence across a diverse set of stakeholders, as well as evaluation and restructuring of clinical workflow to divvy responsibilities by staff role.36,39 Given the challenges with changing provider behavior using health record prompts, an alternative strategy for increasing delivery of family planning counseling is to activate and empower patients through patient-facing educational and decision support tools.41 Callegari, et al. have developed and are testing a patient-facing decision support tool (“MyPath”) for use in VA primary care settings to increase delivery of reproductive health counseling and services, improve provider-patient communication, and promote informed, high quality family planning health decisions.35,42 In addition, incorporating structured note templates as part of a point-of-care visit can improve the quality of clinical examination, thereby supporting shared decision making.43 Additional research on each tool is important, as there is likely no ideal option for all women in all settings.
This pilot intervention has several limitations, as it was a preliminary introduction to family planning screening to build future quality improvement interventions. The small sample of Veterans and VHA healthcare team members during the pilot lead to limited generalizability. We did not require all attendees at training sessions to complete the surveys and not all participants voiced their preferences in the audio recording. We did not track the number of surveys handed to women Veterans to assess completion rate or follow-up with Veterans after their visits. We assessed implementation of the education of providers through chart reviews before and after training and survey implementation, but did not review charts during the month of the screening tool distribution to Veterans. We used documentation as a proxy for clinical counseling, which may underreport actual discussions in a visit. Finally, the OKQ® initiative and training are now facilitated through “Power to Decide: the campaign to prevent unintended pregnancy”44 and while the training may by more robust than the materials previously offered through Oregon Foundation for Reproductive Health, they will need evaluation of best practices for implementation.
Conclusion
Integration of family planning screening into routine healthcare visits is important to address the issues of unintended pregnancy and preconception health optimization in high-risk women Veterans, but also help achieve individual reproductive goals. Additional research on best practices and Veteran preferences is essential to develop a standardized screening approach. In the interim, healthcare providers just need to start the conversation and the OKQ® is one option to incorporate family planning discussions into health care goals. Through ongoing Veteran feedback and partnership, the VHA can provide high quality, patient-centered reproductive healthcare.
Acknowledgments
This work was funded, in part, by a VA Innovation Network Spark Investment. Dr. Gawron received salary support from the Salt Lake City VA Specialty Center of Innovation
The authors would like to thank Nickee Palacios for leading VA staff training, Lisa Callegari, MD for assistance with manuscript preparation, and the staff and Veterans at the Salt Lake VA Women’s Clinic.
Footnotes
The authors have no financial disclosures to declare and no conflicts of interest to report
References
- 1.Berg CJ, Mackay AP, Qin C, Callaghan WM. Overview of maternal morbidity during hospitalization for labor and delivery in the United States: 1993–1997 and 2001–2005. Obstet Gynecol. 2009;113:1075–81. [DOI] [PubMed] [Google Scholar]
- 2.Chuang CH, Velott DL, Weisman CS. Exploring knowledge and attitudes related to pregnancy and preconception health in women with chronic medical conditions. Matern Child Health J. 2010;14:713–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Axinn WG, Barber JS, Thornton A. The long-term impact of parents’ childbearing decisions on children’s self-esteem. Demography. 1998;35:435–43. [PubMed] [Google Scholar]
- 4.Barber JS, Axinn WG, Thornton A. Unwanted childbearing, health, and mother-child relationships. J Health Soc Behav 1999;40:231–57. [PubMed] [Google Scholar]
- 5.Hellerstedt WL, Pirie PL, Lando HA, et al. Differences in preconceptional and prenatal behaviors in women with intended and unintended pregnancies. Am J Public Health. 1998;88:663–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kost K, Lindberg L. Pregnancy intentions, maternal behaviors, and infant health: investigating relationships with new measures and propensity score analysis. Demography. 2015;52:83–111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Finer LB, Zolna MR. Declines in Unintended Pregnancy in the United States, 2008–2011. N Engl J Med. 2016;374:843–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chor J, Rankin K, Harwood B, Handler A. Unintended pregnancy and postpartum contraceptive use in women with and without chronic medical disease who experienced a live birth. Contraception. 2011;84:57–63. [DOI] [PubMed] [Google Scholar]
- 9.Harper CC, Rocca CH, Thompson KM, et al. Reductions in pregnancy rates in the USA with long-acting reversible contraception: a cluster randomised trial. Lancet. 2015;386:562–8. [DOI] [PubMed] [Google Scholar]
- 10.American College of Obstetricians and Gynecologists’ Committee on Health Care for Underserved W. Committee Opinion No. 654: Reproductive Life Planning to Reduce Unintended Pregnancy. Obstet Gynecol. 2016;127:e66–9. [DOI] [PubMed] [Google Scholar]
- 11.Gavin L, Moskosky S, Carter M, et al. Providing quality family planning services: Recommendations of CDC and the U.S. Office of Population Affairs. MMWR Recomm Rep. 2014;63:1–54. [PubMed] [Google Scholar]
- 12.Frayne SMPC, Saechao F, Friedman SA, Shaw JG, Romodan Y, Berg E, Lee J, Ananth L, Iqbal S, Hayes PM, Haskell S. Sourcebook: Women Veterans in the Veterans Health Administration. Volume 4. Longitudinal Trends in Sociodemographics, Utilization, Health Profile and Geographic Distribution. Women’s Health Evaluation Initiative, Women’s Health Services, Veterans Health Administration, Department of Veterans Affairs, Washington DC. February 2019. [Google Scholar]
- 13.Women Veterans Population. Office of Public Affairs, 2015. At http://www1.va.gov/womenvet/docs/WomenVeteransPopulationFactSheet.pdf. Accessed November 7, 2016.
- 14.Gawron LM, Redd A, Suo Y, Pettey W, Turok DK, Gundlapalli AV. Long-acting Reversible Contraception Among Homeless Women Veterans With Chronic Health Conditions: A Retrospective Cohort Study. Med Care. 2017;55 Suppl 9 Suppl 2:S111–S20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Callegari LS, Zhao X, Nelson KM, Borrero S. Contraceptive adherence among women Veterans with mental illness and substance use disorder. Contraception. 2015;91:386–92. [DOI] [PubMed] [Google Scholar]
- 16.Goyal V, Mattocks K, Bimla Schwarz E, et al. Contraceptive provision in the VA healthcare system to women who report military sexual trauma. J Womens Health. 2014;23:740–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Katon JG, Hoggatt KJ, Balasubramanian V, et al. Reproductive health diagnoses of women veterans using department of Veterans Affairs health care. Med Care. 2015;53:S63–7. [DOI] [PubMed] [Google Scholar]
- 18.Rosenfeld E, Callegari LS, Sileanu FE, et al. Racial and ethnic disparities in contraceptive knowledge among women veterans in the ECUUN study. Contraception. 2017;96:54–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Callegari LS, Zhao X, Schwarz EB, Rosenfeld E, Mor MK, Borrero S. Racial/ethnic differences in contraceptive preferences, beliefs, and self-efficacy among women veterans. Am J Obstet Gynecol. 2017;216:504 e1–e10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Schwarz EB, Parisi SM, Williams SL, Shevchik GJ, Hess R. Promoting safe prescribing in primary care with a contraceptive vital sign: a cluster-randomized controlled trial. Ann Fam Med. 2012;10:516–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Lee JK, Parisi SM, Akers AY, Borrero S, Schwarz EB. The impact of contraceptive counseling in primary care on contraceptive use. J Gen Intern Med. 2011;26:731–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Callegari LS, Borrero S, Reiber GE, et al. Reproductive Life Planning in Primary Care: A Qualitative Study of Women Veterans’ Perceptions. Womens Health Issues. 2015;25:548–54. [DOI] [PubMed] [Google Scholar]
- 23.Chuang E, Brunner J, Mak S, et al. Challenges with Implementing a Patient-Centered Medical Home Model for Women Veterans. Womens Health Issues. 2017;27:214–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Akers AY, Gold MA, Borrero S, Santucci A, Schwarz EB. Providers’ perspectives on challenges to contraceptive counseling in primary care settings. J Womens Health. 2010;19:1163–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Bellanca HK, Hunter MS. ONE KEY QUESTION(R): Preventive reproductive health is part of high quality primary care. Contraception. 2013;88:3–6. 27, 2017. [DOI] [PubMed] [Google Scholar]
- 26.One Key Question. Oregon Foundation for Reproductive Health 2012. At: https://www.chcs.org/media/OKQ-Webinar-618.pdf. Accessed Aug 8, 2020.
- 27.Allen D, Hunter MS, Wood S, Beeson T. One Key Question((R)): First Things First in Reproductive Health. Matern Child Health J. 2017;21:387–92. [DOI] [PubMed] [Google Scholar]
- 28.Hipp S, Carlson A, McFarlane E, Sentell TL, Hayes D. Insights in Public Health: Improving Reproductive Life Planning in Hawai’i: One Key Question(R). Hawaii J Med Public Health. 2017;76:261–4. [PMC free article] [PubMed] [Google Scholar]
- 29.Stulberg DB, Dahlquist IH, Disterhoft J, Bello JK, Hunter MS. Increase in Contraceptive Counseling by Primary Care Clinicians After Implementation of One Key Question(R) at an Urban Community Health Center. Matern Child Health J. 2019;23:996–1002. [DOI] [PubMed] [Google Scholar]
- 30.Baldwin MK, Overcarsh P, Patel A, Zimmerman L, Edelman A. Pregnancy intention screening tools: a randomized trial to assess perceived helpfulness with communication about reproductive goals. Contracept Reprod Med. 2018;3:21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Stulberg DB, Datta A, White VanGompel E, Schueler K, Rocca CH. One Key Question(R) and the Desire to Avoid Pregnancy Scale: A comparison of two approaches to asking about pregnancy preferences. Contraception. 2020;101:231–6. [DOI] [PubMed] [Google Scholar]
- 32.Schexnayder CD, King S, Emelogu O. Documentation of contraceptive counseling in female veterans of reproductive age. Am J Health Syst Pharm. 2020. August 20;77(Suppl 3):S71–S77. doi: 10.1093/ajhp/zxaa159. [DOI] [PubMed] [Google Scholar]
- 33.Callegari LS, Aiken AR, Dehlendorf C, Cason P, Borrero S. Addressing potential pitfalls of reproductive life planning with patient-centered counseling. Am J Obstet Gynecol. 2017;216:129–34. [DOI] [PubMed] [Google Scholar]
- 34.Patient-Centered Reproductive Goals Counseling. Envision Sexual & Reproductive Health. At: https://www.envisionsrh.com/path-questions. Accessed Jan 16, 2019.
- 35.Callegari LS, Edmonds SW, Borrero S, Ryan GL, Cusack CM, Zephyrin LC. Preconception Care in the Veterans Health Administration. Semin Reprod Med. 2018;36:327–39. [DOI] [PubMed] [Google Scholar]
- 36.Patterson ES, Nguyen AD, Halloran JP, Asch SM. Human factors barriers to the effective use of ten HIV clinical reminders. J Am Med Inform Assoc. 2004;11:50–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005;12:438–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Fung CH, Tsai JS, Lulejian A, et al. An evaluation of the Veterans Health Administration’s clinical reminders system: a national survey of generalists. J Gen Intern Med. 2008;23:392–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mayo-Smith MF, Agrawal A. Factors associated with improved completion of computerized clinical reminders across a large healthcare system. Int J Med Inform. 2007;76:710–6. [DOI] [PubMed] [Google Scholar]
- 40.Patterson ES, Doebbeling BN, Fung CH, Militello L, Anders S, Asch SM. Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods. J Biomed Inform. 2005;38:189–99. [DOI] [PubMed] [Google Scholar]
- 41.Stacey D, Legare F, Col NF, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2014:CD001431. [DOI] [PubMed] [Google Scholar]
- 42.Callegari LS MS, Nelson KM, Arterburn DE, Dehlendorf C, Schwarz EB, Borrero S. Integrating reproductive goals assessment with contraceptive decision support in primary care: A pilot test of the MyPath tool. Contraception. 2019;100:341. [Google Scholar]
- 43.Fielstein EM, Brown SH, McBrine CS, Clark TK, Hardenbrook SP, Speroff T. The effect of standardized, computer-guided templates on quality of VA disability exams. AMIA Annu Symp Proc. 2006:249–53. [PMC free article] [PubMed] [Google Scholar]
- 44.Power to Decide: campaign to prevent unintended pregnancy 2020. At: https://powertodecide.org/. Accessed Aug 13, 2020.