Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Sep 15;17(9):e0274563. doi: 10.1371/journal.pone.0274563

Beyond opioid prescribing: Evaluation of a substance use disorder curriculum for OBGYN residents

Caitlin E Martin 1,2,*, Bhushan Thakkar 1, Lauren Cox 1, Elisabeth Johnson 3, Hendrée E Jones 3, AnnaMarie Connolly 4
Editor: Nadine Harker5
PMCID: PMC9477269  PMID: 36107914

Abstract

Objective

Amidst the current opioid crisis, there is a need for better integration of substance use disorder screening and treatment across specialties. However, there is no consensus regarding how to best instruct OBGYN trainees in the clinical skills related to opioid and other substance use disorders (SUD). Study objectives were (1) to assess the effectiveness a SUD curriculum to improve self-reported competence among OBGYN residents and (2) to explore its effectiveness to improve attending evaluations of residents’ clinical skills as well as its feasibility and acceptability from the resident perspective.

Methods

A pilot 3-session curriculum was developed and adapted to SUD screening and treatment which included readings, didactics, and supervised outpatient clinical experiences for OBGYN post-graduate year 1 (PGY-1) residents rotating through an integrated OBGYN-SUD clinic. Eighteen residents completed pre and post clinical skills self-assessments (SUD screening, counseling, referring, Motivational Interviewing) using an adapted Zwisch Rating Scale (range 1–5). Scores were compared between time points using paired t-tests. Sub-samples also (a) were evaluated by the attending on three relevant Accreditation Council for Graduate Medical Education Milestones (ACGME) milestone sets using the web-based feedback program, myTIPreport (n = 10) and (b) completed a qualitative interview (n = 4).

Results

All PGY-1s (18/18) across three academic years completed the 3-session SUD curriculum. Clinical skill self-assessments improved significantly in all areas [SUD Screening (2.44 (0.98) vs 3.56 (0.62), p = <0.01); Counseling (1.81 (0.71) vs 3.56 (0.51), p = < .01; Referring (2.03 (0.74) vs 3.17 (0.71), p = < .01; Motivational Interviewing (1.94 (1.06) vs 3.33 (0.69), p = < .01)]. Milestone set levels assigned by attending evaluations (n = 10) also improved. Qualitative data (n = 4) revealed high acceptability; all curriculum components were viewed positively, and feedback was provided (e.g., desire for more patient exposures).

Conclusion

A pilot SUD curriculum tailored for OBGYN PGY-1 residents that goes beyond opioid prescribing to encompass SUD management is feasible, acceptable and likely effective at improving SUD core clinical skills.

Introduction

The current overdose crisis has shed light on the great burden of substance use disorders (SUD) across the nation [1]. To effectively combat the overdose crisis, a multimodal approach, supported by an array of stakeholders including policymakers, public health officials, clinical providers, and citizens themselves, is needed [2]. As consideration is given to the roles clinical providers can play, there has been a call for better integration of SUD screening, assessment and treatment across specialties [3]. In response to this call and the rising prevalence of opioid use disorder and its consequences, such as overdose [1], professional societies and health systems nationally have been leading efforts to improve access to training and resources for medical trainees [4]. Of note, however, is that most of these new educational opportunities have focused on opioid prescribing and have not emphasized the development of additional clinical skills related to substance use beyond such prescribing. This gap in training reflects the general response to the opioid crisis which, again, has focused primarily on opioid prescribing guidelines rather than on improving recovery-oriented SUD treatment services despite the importance of such services as outlined in the US Department of Health and Human Services’ Five Point Strategy to Combat Opioid Abuse, Misuse and Overdose [2].

Surgical specialty residents are in an excellent clinical position to positively impact the opioid crisis given their significant roles in both postoperative pain management for patients receiving medication for opioid use disorder and preoperative care planning in collaboration with addiction medicine providers. Additionally, residents are exposed frequently to the complexities that surround inpatient care of people with SUD. Residents in primary care related specialties are also well positioned to apply learned SUD skills to their clinical practice as evaluation and management of chronic diseases other than addiction, such as diabetes and hypertension, are core to their training. Despite this clinical exposure, residency training in SUD prevention, screening, assessment, treatment and recovery is not as robust as warranted [5,6].

While the American College of Obstetricians and Gynecologists (ACOG) has started leading efforts to improve access to SUD training and resources [7] for OBGYN providers in practice [8], such training curricula do not exist specifically for OBGYN residents. Given the increasing prevalence of pregnancies affected by SUD [9,10] and rapid increase in opioid related overdose deaths in women over the past decade [11], OBGYN residents, given their clinical roles as both surgeons and primary care providers, are well positioned to effectively identify women with SUD as well as to care for women who use substances [12]. As such, residents could benefit from clinical training, across inpatient and outpatient settings, on education of SUD treatment that goes beyond opioid prescribing, as has been done for other diseases and conditions [1315]. Such a multidisciplinary and multi-modal approach could better prepare residents to independently care for this unique patient population with complex medical and biopsychosocial needs. Thus, the objectives of this study were (1) to evaluate the effectiveness of a novel pilot SUD curriculum created for PGY-1 OBGYN residents to improve resident self-reported competence in core substance use clinical skills and (2) to explore its ability to improve attending evaluations of residents’ clinical skills according to the benchmarks set forth by the United States’ guiding body for resident education, the Accreditation Council for Graduate Medical Education Milestones (ACGME), as well as its feasibility and acceptability from the resident perspective.

Methods

Study design

This was a prospective cohort study of PGY-1 OBGYN residents who completed a pilot curriculum directed towards competence in key clinical skills related to SUD prevention, screening, assessment, treatment and recovery. A curriculum was developed by a multidisciplinary team, including a psychologist and nurse practitioner with clinical experience in SUD during pregnancy, an OBGYN residency director with expertise in medical education, and an OBGYN resident. The curriculum was based on CREOG (Council on Resident Education in Obstetrics and Gynecology) objectives [16] and adapted to address key areas related to SUD (S1 Appendix). The curriculum was integrated into the Virginia Commonwealth University OBGYN PGY-1 ambulatory rotation starting in academic year 2018–2019. This study was approved by the Virginia Commonwealth University Institutional Review Board (HM20018443) and oral consent was obtained from all participants.

Components of the pilot SUD curriculum

The pilot curriculum included 3 outpatient clinical sessions integrated into a specialized OBGYN clinic caring for women with SUD across the lifecourse, including pregnancy and postpartum. These 3 sessions focused on medical knowledge and clinical skills used to evaluate and manage patients with SUD. Additionally, each clinical session included an Attending-led didactic that focused on an assigned topic. The didactic was conducted in the clinical space for 15–30 minutes prior to first patient arrival (Table 1). Before each clinical session/didactic, residents completed required readings from ACOG committee opinions and the Substance Abuse and Mental Health Services Administration (SAMHSA) Clinical Guidance for the Treatment of Pregnant and Parenting Women with Opioid Use Disorder and their Infants [17]. Questions about the readings were reviewed with the attending during the didactic time.

Table 1. Format of pilot curriculum on substance use disorders for OBGYN residents.

Clinical sessions Assigned topics ACGME* Milestone Sets
(evaluated in myTIPreport)
“Knows How” “Shows How / Does”
1 4 Substance use disorder (SUD) definitions
Pathophysiology of SUD and effects on pregnancy
Patient Care—Office Practice: Care of the patient with non-reproductive medical disorders
Professionalism—Compassion, Integrity, and Respect for others
2 5 SBIRT (Screening, Brief Intervention, Referral, Treatment) for SUD Medical Knowledge—Health Care Maintenance and Disease Prevention
Interpersonal and Communication Skills—Communication with Patients and Families
3 6 SUD co-morbidities: medical, psychiatric, psychosocial and trauma history Medical Knowledge—Gynecology: Perioperative care
Patient Care—Obstetrics: Antepartum care and complications of pregnancy

*ACGME- Accreditation Council for Graduate Medical Education.

Notably, starting in the second year (AY 2019–2020) of the curriculum, residents were scheduled to complete the pilot curriculum plus an additional 3 sessions, encompassing altogether an extended 6-session version of the curriculum. In doing so, sessions 1–3 of the pilot curriculum became termed the “knows-how” sessions based on Miller’s pyramidal four-step hierarchical process [18]. During these “knows-how” sessions, residents were expected to demonstrate their knowledge as they saw patients and coordinated plans of care with the OBGYN-Addiction attending. Then the additional sessions 4–6 were termed “show how/does” sessions, again based on the Miller’s pyramid “performance,” where learners demonstrate, through their performance, that they are capable of using their knowledge while being supervised and observed [18]. While the topics of these “shows how/does” sessions (sessions 4–6) directly aligned with the topics of “knows-how” (sessions 1–3), the goals of these “shows-how/does” sessions were to (a) further strengthen clinical skills related to SUD (e.g., under attending supervision, the residents counsel patients regarding medications for opioid use disorder and provide directed feedback after proctoring residents practice Motivational Interviewing) and (b) practice integrating evidence-based strategies into patient care (e.g., pre-clinic readings included primary literature articles such as the MOTHER trial [19] rather than ACOG practice bulletins). The supervising attending then assessed whether learners were capable of functioning independently in these specific clinical situations.

Study participants

Residents were informed of the new, required curriculum via email from the residency coordinator. The curriculum materials, including its objectives, readings and pre/post assessments, were put on the OBGYN residency’s password protected website. In the first academic year of the curriculum, all PGY-1 residents were scheduled to complete the pilot curriculum in the spring semester. In the curriculum’s second academic year onward, all six PGY-1 residents were scheduled to complete the pilot curriculum (‘knows-how’ sessions 1–3) in the fall semester, followed by the additional sessions (“shows-how/does” sessions 4–6) in the spring semester. Due to shifting of clinical responsibilities in the COVID-19 pandemic, only four out of the possible six residents completed all 6 sessions of the curriculum. These residents (n = 4) also completed both the self-assessments and interviews.

An overview of study participants and study assessments is provided in Fig 1. In brief, before and after the session sets, residents completed clinical skills self-assessments. Subsets of the residents who completed all ‘knows-how’ and “shows-how/does” sessions were also invited to complete a semi-structured qualitative interview and to have their milestone set attending evaluations abstracted. These study assessments are detailed below.

Fig 1. Flow chart describing the study sample of PGY-1 OBGYN residents completing the pilot SUD curriculum and its evaluation assessments.

Fig 1

Primary objective: Curriculum effectiveness—clinical skills resident self-assessments

Before the first session of the pilot SUD curriculum, each resident completed a pre self-assessment on 4 core clinical skills related to SUD (pre-assessment). These core clinical skills were selected based on the Screening, Brief Intervention and Referral to Treatment (SBIRT) [20] model (Table 2). The self-assessment scale used was an adapted version of the Zwisch Rating Scale (range 1–5) [21] which asks the resident to self-report their needed supervision level needed regarding these 4 core clinical skills. After completion of the pilot curriculum (session #3), residents completed a post self-assessment on these same 4 clinical skills (post-assessment #1).

Table 2. Modified self-reported Zwisch rating scale for core clinical skills related to substance use disorders.

Show and Tell
(Observation only)
Active Help
(Direct supervision needed)
Passive Help
(Indirect supervision needed)
Supervision Only
(Supervision only for patient safety)
Expert
(Can supervise others)
1. What level of supervision do you think you need for screening patients for substance use disorders in the outpatient setting?
2. What level of supervision do you think you need for counseling patients on the role substance use plays in their health?
3. What level of supervision do you think you need for supporting and guiding patients using Motivational Interviewing techniques in changing their substance use behaviors?
4. When indicated, what level of supervision do you think you need for referring patients for specialty treatment for their substance use?

Exploratory aim: Curriculum effectiveness—attending milestone evaluations using myTIPreport

For a sub-sample of residents completing the extended 6-session version of the pilot curriculum, (Fig 1), the OBGYN-Addiction attending physician completed milestone set feedback corresponding to each session’s topic and clinical skills (Table 1) using the web-based program, myTIPreport [22,23]. myTIPreport was created as a cloud-based platform to provide “real-time” feedback on ACGME milestones and procedural skills. The ACGME is a private, not-for-profit organization that sets standards for US graduate medical education (residency and fellowship) programs and the institutions that sponsor them, and renders accreditation decisions based on compliance with these standards. ACGME Milestones provide a framework for the assessment of the development of the resident in key dimensions of the elements of physician competence in a specialty or subspecialty. A level was assigned to each milestone set assessed using ACGME milestone guidelines. The same milestone sets were evaluated after the “knows-how” and “shows-how/does” sessions, facilitating level comparisons across time.

Exploratory aim: Curriculum feasibility and acceptability—semi-structured resident interviews

A subset of residents who completed the extended 6-session curriculum were also invited to participate in a semi-structured interview (Fig 1). The interview guide (S2 Appendix) was created to address the objectives of evaluating the feasibility and acceptability of the curriculum from the perspectives of the OBGYN residents. The questions addressed all the components of the curriculum as well as residents’ perceptions of impact of the curriculum on their own clinical skills, self-learning and evidence-based practice. Additional questions focused on residents’ responses on their self-assessments with the Zwisch scale and on suggestions for curriculum changes to further support data meeting the learning objectives. The final part of the interview queried on resident confidence in treating and caring for women with SUD and being an independent provider in the area of SUD. Interviews were conducted by a second year OBGYN resident (LC) and a research assistant (BT) trained in qualitative data collection. The interview setting was a private room for one resident and over videoconference for the other three residents due to COVID-19 restrictions. Interviews were audio-recorded with participant knowledge and consent. Interviews were semi-structured and designed to allow participants to tell their story in their own words. All 4 residents received a $20 gift card.

Analysis

All self-assessments, milestone assessments, and audio-files were de-identified and labeled with a subject ID only. Paired t-tests were used to compare the global clinical skill self-assessment (range 1–5) between the pre and post assessments. Mean milestone set levels from the abstracted milestone set assessments, recorded in myTIPreport, are reported for the group over time. For the qualitative data, interviews were transcribed verbatim into Microsoft word. Data analysis occurred concurrently with data collection. The transcriptions were inductively analyzed using the “editing style” approach. The first step in this process involves “immersing” oneself in the participants’ world to understand and interpret their experiences. This was accomplished by repeatedly re-reading the interviews and making notes in the margins, writing memos, and assigning codes in order to illuminate patterns and relationships that help to bring forth greater understanding of the data. The transcriptions were entered into Atlas.ti version 8 (Atlas.ti GmbH, Berlin, Germany). Coding was conducted by two investigators BT and LC who independently coded each interview. The two investigators adjudicated discrepancies in coding through discussion and modified codes as necessary to incorporate their interpretations with guidance from the principal investigator (CEM). Categories were later derived from the data themselves with input from the codes, and themes were created. Based on the codes, we calculated the frequency of responses. Quotations were selected that best identified responses to each theme.

Results

Primary objective: Curriculum effectiveness—clinical skills resident self-assessments

All 18 PGY-1 OBGYN residents across the three academic years participated in the SUD curriculum. The clinical skills assessment was completed by 18 OBGYN residents. As seen in Table 3, there was a significant improvement in resident self-reported supervision level needed to perform all corresponding clinical skills related to SUD after curriculum completion. As an example, for the core clinical skill where residents counseled patients with SUD, residents reported requiring, on average, direct supervision before the curriculum. After completing the curriculum, residents quantitatively reported improvement in this skill, stating they now required no more than indirect supervision. Similar improvements were observed for the other core clinical skills.

Table 3. Resident clinical skills self-assessments before and after completion of the pilot SUD curriculum (N = 18).

Pre Self-Assessment
Mean (SD)*
Post Self-Assessment
Mean (SD)*
p-value
Screening for substance use disorders 2.44 (0.98) 3.56 (0.62) < 0.01
Counseling patients with substance use disorders 1.81 (0.71) 3.56 (0.51) < 0.01
Use of Motivational Interviewing 2.03 (0.74) 3.17(0.71) <0.01
Referring for addiction specialty treatment 1.94 (1.06) 3.33 (0.69) < 0.01

*Mean and SD values of adapted Zwisch scale responses (range 1–5) for all participants.

Exploratory aim: Curriculum effectiveness—Attending milestone evaluations using myTIPreport

The milestone evaluations were completed by the teacher attending for 10 PGY-1 OBGYN residents. The attending assessments of milestone performance, abstracted from myTIPreport, demonstrated significant improvement across all milestone sets for the resident subset who completed the extended 6-session curriculum. The greatest improvement was seen for the Office Practice and Professionalism milestone sets. Table 4 describes the changes in the milestone sets from completion of the ‘know-how’ to the completion of the ‘shows-how/does’ sessions.

Table 4. Attending evaluations of milestone sets corresponding to SUD curriculum sessions.

ACGME milestone set assessments (as recorded in myTIPreport)
(n = 4)
‘Knows-How’
Level mean (SD)
‘Shows-How / Does”
Level mean (SD)
p-value
Patient Care—Office Practice: Care of the patient with non-reproductive medical disorders 2.15 (0.91) 5.00 (0) < 0.01
Professionalism—Compassion, Integrity, and Respect for others 2.00 (1.25) 4.50 (0.82) < 0.01
Medical Knowledge—Health Care Maintenance and Disease Prevention 1.25 (1.38) 4.25 (1.51) < 0.01
Interpersonal and Communication Skills—Communication with Patients and Families 1.95 (0.44) 3.60 (1.05) < 0.01
Medical Knowledge—Perioperative care 2.95 (0.55) 3.95 (0.60) < 0.01

*ACGME: Accreditation Council for Graduate Medical Education.

Exploratory aim: Curriculum feasibility and acceptability—semi-structured resident interviews

The semi-structured interviews were completed by 4 PGY-1 OBGYN residents. The five major themes observed addressed: 1) Curriculum components positively contributing to improvements in evidence-based practice, self-directed learning and clinical skills development, 2) Insight into SUD clinical skills self-assessment results, 3) Impact of the curriculum experience on self-assessed SUD competence, 4) Opportunities to improve the curriculum, and 5) Barriers to improvement of SUD clinical skills, evidence-based practice and self-directed learning. Table 5 describes the themes and coding framework.

Table 5. Resident interview themes with frequency counts and representative quotations on pilot SUD curriculum feasibility and acceptability (n = 4).

Major themes and sub-themes n = Mentions (Participants) Representative quotations
Curriculum components positively contributing to improvements in SUD evidence-based practice, self-directed learning and clinical skills development 81 (4)
Clinical experiences working with patients with SUD 21 (4) “What helped me the most, the second part was seeing the patients and having that feedback on how I was counseling was very important.”
SUD clinical teaching and didactics 11 (4) “At the beginning of the year it was like taking a full history. And then in the second half of the year, we worked more on like my counseling skills. So we’d pick one aspect of like, Oh, you can counsel on NAS or like, HEP C pregnancy or something.”
SUD lectures during grand rounds 2 (2) “I remember she gave her big grand rounds talk. Which I thought was really helpful and I happened to be in clinic. . .So it was really helpful cause it was kind of like putting it into use actively because I was on that rotation.”
SUD readings and resources available on the OBGYN resident education blog 6 (3) “Having just a really basic handout or booklet online to reference I thought…gave you kind of the tools to work with in her clinic, which was really invaluable.”
SUD clinical skills real-time feedback 10 (3) “The reading gave me a good background to start from, but I think watching her do it and having the real time feedback was probably the most helpful thing.”
Self-directed SUD readings 18 (4) “Reading the papers gave me a good background. So if the patients asked me questions, I felt confident like discussing the material with them…And I felt like that confidence allowed them to trust me more to tell [them] things.”
Insight into SUD clinical skills self-assessment results 60 (4)
Perceived limitations being a resident versus a fellow or attending 5 (2) “I think I honestly feel pretty confident screening people, but it’s because I’m a resident and I always, always need supervision. Like I need an attending.”
Needing more practice with Motivational Interviewing 8 (4) “I have been to many talks about motivational interviewing. I have read about it. I know a lot about it, but then when I try and put it in place, it’s hard and I just need to keep practicing it more.”
Reasons for self-assessment survey responses 28 (4) “I mean, I feel competent asking patients the questions that you’ve been uncomfortable asking. And to become an expert. I think that would take a lot of experience [and] years of experience.”
Impact of curriculum experience on self-assessed competence in treating women with SUD 19 (4)
Confidence in referring patients for SUD treatment 8 (4) “I feel comfortable within our own system knowing how things work and who to refer to.”
Confidence in treating women with SUD after residency 11 (4) “I think I feel pretty confident in screening women for substance use disorders, particularly if I was able to work it into a work-flow of a clinic.”
Opportunities to improve the SUD curriculum 73 (4)
General feedback on the SUD curriculum 37 (4) “I definitely need more practice.”
“And I don’t know if it would actually make a difference of being able to actually go out into the community to another clinic outside of our own brick and mortar building.”
More sessions and more SUD patient exposure 31 (4) “Of course, the volume, doing it more often.”
“I mean eight sessions is good. You get to be with her every week, but that’s still, you know, at the end of the day that’s only eight times that you’ve done it.”
Tailoring the curriculum to individuals’ unique learning styles 5 (2) “I think it’s just my learning style. I don’t remember things as well when I just hear one lecture about it. You know, I have to do a little bit more to remember it.”
Barriers to improvements of SUD clinical skills, evidence-based practice and self-directed learning 5 (3)
Resident time limitations 5 (3) “It was just like taking time to do the actual things sometimes when you’re busy, even though the clinic and you think you should have a lot of time, sometimes it slips away from you, but I don’t know”
“I think as far as the didactics go, I mean those are helpful but they don’t always happen. Like depending on how busy the clinic day was.”

*SUD: Substance Use Disorders.

Discussion

In the ongoing overdose crisis, there is a call nationally for providers and health systems across specialties to better integrate care for people with SUD [24]. However, OBGYN trainees are not receiving comprehensive education in SUD [25], along with residents in surgical [26] and primary care [27] specialties. We piloted a SUD curriculum for OBGYN residents to provide targeted SUD training beyond opioid prescribing. We found that integration of such a curriculum into residents’ clinical teaching is feasible and acceptable to residents. Further, completion of this novel curriculum led to improvements in both trainees’ self-reported supervision levels needed for key SUD clinical skills and attending milestone assessments of residents according to ACGME benchmarks in our small study sample.

OBGYN residents have the potential to play important roles in the optimization of SUD care across critical timeframes, including the perioperative [28] and perinatal periods [29]. It is imperative that trainees are comfortable and competent with identifying people with SUD. Both licit (i.e., tobacco, alcohol) and illicit (e.g., cocaine, non-prescribed opioids) substance use can significantly impact anesthesia effects intraoperatively and pain management postoperatively [30]. Recommendations are consistent that a well-devised, multi-disciplinary plan made preoperatively is ideal [30], including for people on medication for opioid use disorder (e.g., methadone, buprenorphine) [31]. During pregnancy, the same standards apply, as provision of SUD treatment within a comprehensive care model improves both maternal and fetal outcomes [32]. SUD that is not identified in either of these scenarios represents a missed opportunity to devise such care plans. Thus, OBGYN residents would likely benefit from effective training in substance use assessment. While medical schools are now more often teaching these skills [33], we found PGY-1 OBGYN residents self-reported needing significant supervision regarding clinical skills across the SBIRT model. After completion of the pilot curriculum, residents demonstrated significant improvement in self-reported supervision needed for these core SUD clinical skills, including screening, suggesting this curriculum could begin to address this critical gap in training.

After identification of substance use, OBGYN residents would further benefit from being able to provide brief interventions and link patients to SUD treatment when indicated. The perioperative and perinatal timeframes are windows of opportunity for patients to attain behavioral change for many reasons, such as how decreased substance use typically translates into decreased perioperative morbidity [34,35] and improved infant health outcomes [36]. Motivational Interviewing is an effective tool that providers can use to assist patients on this path [20]. At study baseline, residents reported the lowest levels of self-assessed competence in Motivational Interviewing across the four clinical skills assessed. In the pilot curriculum, a short didactic was given within the clinical setting with directed practice in Motivational Interviewing for tobacco use with patients. After curriculum completion, residents reported improved self-assessed competence in their Motivational Interviewing abilities. Notably, patients seen in the clinical setting of this study vary substantially in their stages of change, as the clinic prioritizes a low-threshold, harm reduction approach [37]; this represented a unique opportunity for residents to apply their new Motivational Interviewing skills and compassionate, person-centered approaches as role modeled by the clinic providers. Considering these findings and feedback from residents obtained in our qualitative interviews, future adaptations of this pilot SUD curriculum by other institutions should prioritize training in Motivational Interviewing and harm reduction as it relates to substance use that includes both didactic and experiential components.

With the recent increased attention to opioid use disorder, most initial responses from providers, public health professionals and health systems across fields have centered on prevention–specifically decreasing opioid overprescribing [38]. While this response is encouraging, an effective approach to improving the care of people with SUD will likely require attention on more than just opioid prescribing. This aligns with the Department of Health and Human Services 5-Point Strategy to combat the opioid crisis [2]. In medical education, emerging innovative interventions show promise to prepare trainees in general [39,40], as well as residents in surgical specialties [4,4144] to properly prescribe opioids. Yet approaches to provide residents with comprehensive SUD training are much more limited and, as such, needed [28,45]. Similar to prior work among primary care residents [46,47], this curriculum led to improvements in OBGYN residents’ self-reported competence to link patients to and care for patients in SUD treatment, many of whom were on buprenorphine for opioid use disorder. An encouraging finding was that not only did residents’ clinical skills self-assessments improve with the pilot curriculum, but also that attendings’ assessments of residents showed significant improvements over time. Additionally, addiction stigma is, arguably, the most significant barrier to accessing and utilizing evidence-based SUD treatments [48], especially during pregnancy [49]. While not an outcome assessed in this study, stigma was addressed throughout the resident clinical experiences; for example, all residents are required to review addiction person-centered language recommendations [50] and are given immediate feedback on their language in the clinic. Since this study, we have added additional person-centered language training focused on addiction among pregnant and parenting people [51], with the goal to prepare the next generation of OBGYN providers to be leaders in destigmatizing the disease of addiction.

There is a significant gap between met and unmet SUD treatment need among women, including during pregnancy [52]. Equipping OBGYNs during residency in SUD evaluation and management is one avenue to close this critical gap in treatment access [29,53]. With this in mind, the pilot curriculum was designed to not only target key topics in SUD but also to address ACGME milestone assessments required of OBGYN residency training programs. The findings of both improvements in the ACGME milestone set levels assigned by attendings and high acceptability of the curriculum to residents as reported in the qualitative interviews highlight how SUD education does align well with the training environment of OBGYN residency. Overall, more research with larger sample sizes is needed in order to identify how to best provide proper education and training in SUD treatment for OBGYN residents and support residency program leadership in doing so.

Qualitatively, residents reported high acceptability and feasibility of the SUD curriculum. A motivating finding was how many residents stated they intend to integrate SUD management in some capacity into their future practice post-residency, and that they felt confident doing so. Most of the limitations of the curriculum discussed by residents revolved around their desire for more opportunities to apply their new knowledge and strengthen clinical skills, such as Motivational Interviewing, with directed teaching by the attending. While residents stated it was difficult at times to participate as fully as they intended due to time limitations and competing tasks, no residents stated the curriculum components were too burdensome. In response to resident feedback, we modified the curriculum for the 2020–2021 academic year with more varied resources to best match different learning styles (e.g., pre-recorded lecture [54]), opportunities for additional sessions during a 3rd year elective rotation, and an hour-long didactic on Motivational Interviewing for residents of all levels.

The strengths of this study lie in the innovative curriculum design. To our knowledge, no formalized curricula exist in the literature tailored to OBGYN residents focused on SUD beyond opioid prescribing. Our approach was to design a pilot curriculum based on CREOG objectives that is also feasible within a busy outpatient clinic. This allowed us to direct the new curriculum to the specific needs and time limitations of OBGYN residents. The major weakness of this study is the small sample size and limited generalizability of the findings. In particular, only 4 residents completed the interviews and 10 had attending milestone assessments available for abstraction due to shifts in resident coverage in the COVID-19 pandemic. Despite these limitations, the results of the current study for this pilot curriculum informed the formation of a new, more comprehensive (e.g., additional components focused on destigmatizing SUD [50]), year-long curriculum that is currently being evaluated at our institution with plans to expand to other programs in the near future.

Residency directors want to improve trainee education to identify and care for people who use substances [26]. Providing trainees with the tools directed solely towards proper opioid prescribing is not sufficient to effectively combat the current opioid crisis. Further, given the stable national predominance of alcohol over drug use disorders among people with SUD [52] and increasing prevalence of methamphetamine misuse [9], residents need more robust SUD training not only in clinical skills beyond opioid prescribing but also in substances beyond opioids. As such, educational programming that allows residents to provide evidence-based care for people with SUD, including for people on medication for opioid use disorder, will be essential. OBGYN providers have unique opportunities to develop such clinically relevant educational programming given their interactions with patients throughout the perioperative and perinatal periods. Resident training programs will benefit from curricula that best prepare the next generation of OBGYN providers to improve the care of people with SUD. These findings highlight that integration of a SUD curriculum into a busy clinical environment is feasible, acceptable and likely effective at improving self-assessed competence in key clinical skills related to substance use.

Supporting information

S1 Appendix. CREOG objectives addressed by OBGYN residency pilot substance use disorder curriculum.

(DOCX)

S2 Appendix. Interview guide for OBGYN PGY-1s completing the substance use disorder pilot curriculum.

(DOCX)

Acknowledgments

The authors thank Dr. Sally Santen and the medical education office at the Virginia Commonwealth University School of Medicine for their guidance on publishing medical education and support of educational scholarship to Dr. Martin. We also thank Dr. Kate Miele for her assistance in providing input in the curriculum development. Lastly, we thank the residents of the OBGYN residency at the Virginia Commonwealth University for their willingness to participate in this pilot curriculum and provide such helpful feedback for continued work in this area.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This study was supported by the Virginia Commonwealth University School of Medicine Educational Scholarship Fund. Dr. Martin is supported by NIDA award No. K23 DA053507 from the National Institute of Drug Abuse. This study was supported partially by UL1TR002649 and KL2TR002648 from the National Center for Advancing Translational Sciences. Drs. Jones and Johnson are supported by NIDA 1R01DA047867. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Scholl L, Seth P, Kariisa M, Wilson N, G B. Drug and Opioid-Involved Overdose Deaths—United States, 2013–2017. CDC; 2019 2019. Jan 4. [Google Scholar]
  • 2.HHS. Strategy to Combat Opioid Abuse, Misuse, and Overdose: A Framework Based on the Five Point Strategy. In: Services UDoHaH, editor. Washington, D.C.2017.
  • 3.Creedon TB, Cook BL. Access To Mental Health Care Increased But Not For Substance Use, While Disparities Remain. Health affairs (Project Hope). 2016;35(6):1017–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lancaster E, Bongiovanni T, Lin J, Croci R, Wick E, Hirose K. Residents as Key Effectors of Change in Improving Opioid Prescribing Behavior. Journal of surgical education. 2019;76(6):e167–e72. doi: 10.1016/j.jsurg.2019.05.016 [DOI] [PubMed] [Google Scholar]
  • 5.Shuey B, Lee D, Ugalde I, Borgan S, Bresnan C, Qureshi M, et al. Evaluation of Resident Physicians’ Knowledge of and Attitudes Towards Prescribing Buprenorphine for Patients With Opioid Use Disorder. Journal of Addiction Medicine. 2021;15(3):219–25. doi: 10.1097/ADM.0000000000000750 [DOI] [PubMed] [Google Scholar]
  • 6.Schiff DM, Zuckerman B, Wachman EM, Bair-Merritt M. Trainees’ knowledge, attitudes, and practices towards caring for the substance-exposed mother-infant dyad. Substance Abuse. 2017;38(4):414–21. doi: 10.1080/08897077.2017.1356423 [DOI] [PubMed] [Google Scholar]
  • 7.Smid MC, Terplan M. What Obstetrician–Gynecologists Should Know About Substance Use Disorders in the Perinatal Period. Obstetrics & Gynecology. 2022;139(2):317–37. doi: 10.1097/AOG.0000000000004657 [DOI] [PubMed] [Google Scholar]
  • 8.ACOG. Tobacco, Alcohol, Opioids, and Substance Use Disorders 2019 [Available from: https://www.acog.org/About-ACOG/ACOG-Departments/Tobacco—Alcohol—and-Substance-Abuse/.
  • 9.Admon LK, Bart G, Kozhimannil KB, Richardson CR, Dalton VK, Winkelman TNA. Amphetamine- and Opioid-Affected Births: Incidence, Outcomes, and Costs, United States, 2004–2015. American journal of public health. 2018:e1–e7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Haight SC, Ko JY, Tong VT, Bohm MK, Callaghan WM. Opioid Use Disorder Documented at Delivery Hospitalization—United States, 1999–2014. MMWR Morbidity and mortality weekly report. 2018;67(31):845–9. doi: 10.15585/mmwr.mm6731a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.CDC. Prescription Painkiller Overdoses: A Growing Epidemic, Especially Among Women: CDC; 2018. [Available from: https://www.cdc.gov/vitalsigns/prescriptionpainkilleroverdoses/index.html. [Google Scholar]
  • 12.Klaman SL, Isaacs K, Leopold A, Perpich J, Hayashi S, Vender J, et al. Treating Women Who Are Pregnant and Parenting for Opioid Use Disorder and the Concurrent Care of Their Infants and Children: Literature Review to Support National Guidance. Journal of addiction medicine. 2017;11(3):178–90. doi: 10.1097/ADM.0000000000000308 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Simmons L, Leavitt L, Ray A, Fosburgh B, Sepucha K. Shared Decision Making in Common Chronic Conditions: Impact of a Resident Training Workshop. Teaching and learning in medicine. 2016;28(2):202–9. doi: 10.1080/10401334.2016.1146600 [DOI] [PubMed] [Google Scholar]
  • 14.Ghesquiere A, Martinez J, Jalali C, Sirey JA, Morales S. Training residents in depression and grief. The clinical teacher. 2018;15(2):114–9. doi: 10.1111/tct.12636 [DOI] [PubMed] [Google Scholar]
  • 15.Gandhi M, Beasley A, Vinas E, Sangi-Haghpeykar H, Ramin SM, Kilpatrick CC. Electronic Learning-Spaced Education to Facilitate Resident Knowledge and Guide Program Didactics. Obstetrics and gynecology. 2016;128 Suppl 1:23s–6s. doi: 10.1097/AOG.0000000000001576 [DOI] [PubMed] [Google Scholar]
  • 16.ACOG. CREOG Educational Objectives, Core Curriculum in Obstetrics and Gynecology, 11th Edition. Washington, DC; 2016.
  • 17.SAMHSA. Clinical Guidance for Treating Pregnant and Parenting Women With Opioid Use Disorder and Their Infants. HHS Publication No. (SMA) 18–5054. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2018. [Google Scholar]
  • 18.Miller GE. The assessment of clinical skills/competence/performance. Academic medicine: journal of the Association of American Medical Colleges. 1990;65(9):S63–7. doi: 10.1097/00001888-199009000-00045 [DOI] [PubMed] [Google Scholar]
  • 19.Jones HE, Kaltenbach K, Heil SH, Stine SM, Coyle MG, Arria AM, et al. Neonatal abstinence syndrome after methadone or buprenorphine exposure. The New England journal of medicine. 2010;363(24):2320–31. doi: 10.1056/NEJMoa1005359 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Wright TE, Terplan M, Ondersma SJ, Boyce C, Yonkers K, Chang G, et al. The role of screening, brief intervention, and referral to treatment in the perinatal period. American journal of obstetrics and gynecology. 2016;215(5):539–47. doi: 10.1016/j.ajog.2016.06.038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.George BC, Teitelbaum EN, Meyerson SL, Schuller MC, DaRosa DA, Petrusa ER, et al. Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance. Journal of surgical education. 2014;71(6):e90–6. doi: 10.1016/j.jsurg.2014.06.018 [DOI] [PubMed] [Google Scholar]
  • 22.Husk KE, Learman LA, Field C, Connolly A. Implementation and Initial Construct Validity Evidence of a Tool, myTIPreport, for Interactive Workplace Feedback on ACGME Milestones. Journal of surgical education. 2020. doi: 10.1016/j.jsurg.2020.05.002 [DOI] [PubMed] [Google Scholar]
  • 23.Connolly A, Goepfert A, Blanchard A, Buys E, Donnellan N, Amundsen CL, et al. myTIPreport and Training for Independent Practice: A Tool for Real-Time Workplace Feedback for Milestones and Procedural Skills. Journal of graduate medical education. 2018;10(1):70–7. doi: 10.4300/JGME-D-17-00137.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wakeman SE, Barnett ML. Primary Care and the Opioid-Overdose Crisis—Buprenorphine Myths and Realities. The New England journal of medicine. 2018;379(1):1–4. doi: 10.1056/NEJMp1802741 [DOI] [PubMed] [Google Scholar]
  • 25.Nguemeni Tiako MJ, Culhane J, South E, Srinivas SK, Meisel ZF. Prevalence and Geographic Distribution of Obstetrician-Gynecologists Who Treat Medicaid Enrollees and Are Trained to Prescribe Buprenorphine. JAMA Network Open. 2020;3(12):e2029043–e. doi: 10.1001/jamanetworkopen.2020.29043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Yorkgitis BK, Bryant E, Raygor D, Brat G, Smink DS, Crandall M. Opioid Prescribing Education in Surgical Residencies: A Program Director Survey. Journal of surgical education. 2018;75(3):552–6. doi: 10.1016/j.jsurg.2017.08.023 [DOI] [PubMed] [Google Scholar]
  • 27.Tesema L, Marshall J, Hathaway R, Pham C, Clarke C, Bergeron G, et al. Training in office-based opioid treatment with buprenorphine in US residency programs: A national survey of residency program directors. Subst Abus. 2018;39(4):434–40. doi: 10.1080/08897077.2018.1449047 [DOI] [PubMed] [Google Scholar]
  • 28.Motameni AT. Opioids: A Need for Better Education and a Call to Action. Annals of surgery. 2018;268(6):930–1. doi: 10.1097/SLA.0000000000002743 [DOI] [PubMed] [Google Scholar]
  • 29.Hollander MAG, Jarlenski MP, Donohue JM, Cole ES, Kelley D, Krans EE. Medical specialty of buprenorphine prescribers for pregnant women with opioid use disorder. American journal of obstetrics and gynecology. 2019;220(5):502–3. doi: 10.1016/j.ajog.2019.01.226 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Dowdy SC, Kalogera E, Scott M. Optimizing Preanesthesia Care for the Gynecologic Patient. Obstetrics and gynecology. 2019;134(2):395–408. doi: 10.1097/AOG.0000000000003323 [DOI] [PubMed] [Google Scholar]
  • 31.Goel A, Azargive S, Weissman JS, Shanthanna H, Hanlon JG, Samman B, et al. Perioperative Pain and Addiction Interdisciplinary Network (PAIN) clinical practice advisory for perioperative management of buprenorphine: results of a modified Delphi process. Br J Anaesth. 2019;123(2):e333–e42. doi: 10.1016/j.bja.2019.03.044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Johnson E. Models of care for opioid dependent pregnant women. Seminars in perinatology. 2019;43(3):132–40. doi: 10.1053/j.semperi.2019.01.002 [DOI] [PubMed] [Google Scholar]
  • 33.Fleming M, Barry K, Davis A, Kropp S, Kahn R, Rivo M. Medical education about substance abuse: changes in curriculum and faculty between 1976 and 1992. Academic medicine: journal of the Association of American Medical Colleges. 1994;69(5):362–9. doi: 10.1097/00001888-199405000-00009 [DOI] [PubMed] [Google Scholar]
  • 34.Menendez ME, Ring D, Bateman BT. Preoperative Opioid Misuse is Associated With Increased Morbidity and Mortality After Elective Orthopaedic Surgery. Clinical orthopaedics and related research. 2015;473(7):2402–12. doi: 10.1007/s11999-015-4173-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Eliasen M, Gronkjaer M, Skov-Ettrup LS, Mikkelsen SS, Becker U, Tolstrup JS, et al. Preoperative alcohol consumption and postoperative complications: a systematic review and meta-analysis. Annals of surgery. 2013;258(6):930–42. doi: 10.1097/SLA.0b013e3182988d59 [DOI] [PubMed] [Google Scholar]
  • 36.Terplan M, Laird HJ, Hand DJ, Wright TE, Premkumar A, Martin CE, et al. Opioid Detoxification During Pregnancy: A Systematic Review. Obstetrics and gynecology. 2018;131(5):803–14. doi: 10.1097/AOG.0000000000002562 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Ellis LP, Parlier-Ahmad AB, Scheikl M, Martin CE. An Integrated Care Model for Pregnant and Postpartum Individuals Receiving Medication for Opioid Use Disorder. Journal of addiction medicine. 2022. doi: 10.1097/ADM.0000000000001052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Meisenberg BR, Grover J, Campbell C, Korpon D. Assessment of Opioid Prescribing Practices Before and After Implementation of a Health System Intervention to Reduce Opioid Overprescribing. JAMA network open. 2018;1(5):e182908. doi: 10.1001/jamanetworkopen.2018.2908 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Raheemullah A, Andruska N, Saeed M, Kumar P. Improving Residency Education on Chronic Pain and Opioid Use Disorder: Evaluation of CDC Guideline-Based Education. Substance use & misuse. 2019:1–7. doi: 10.1080/10826084.2019.1691600 [DOI] [PubMed] [Google Scholar]
  • 40.Vettese TE, Thati N, Roxas R. Effective Chronic Pain Management and Responsible Opioid Prescribing: Aligning a Resident Workshop to a Protocol for Improved Outcomes. MedEdPORTAL: the journal of teaching and learning resources. 2018;14:10756. doi: 10.15766/mep_2374-8265.10756 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Nooromid MJ, Mansukhani NA, Deschner BW, Moradian S, Issa N, Ho KJ, et al. Surgical interns: Preparedness for opioid prescribing before and after a training intervention. American journal of surgery. 2018;215(2):238–42. doi: 10.1016/j.amjsurg.2017.11.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Nguyen L, Bowlds S, Munford C, Miller K, Finnegan T, Clayton E, et al. Decreasing Postoperative Opioid Prescribing through Education. Journal of surgical education. 2019. [DOI] [PubMed] [Google Scholar]
  • 43.Chiu AS, Healy JM, DeWane MP, Longo WE, Yoo PS. Trainees as Agents of Change in the Opioid Epidemic: Optimizing the Opioid Prescription Practices of Surgical Residents. Journal of surgical education. 2018;75(1):65–71. doi: 10.1016/j.jsurg.2017.06.020 [DOI] [PubMed] [Google Scholar]
  • 44.Chiu AS, Ahle SL, Freedman-Weiss MR, Yoo PS, Pei KY. The impact of a curriculum on postoperative opioid prescribing for novice surgical trainees. American journal of surgery. 2019;217(2):228–32. doi: 10.1016/j.amjsurg.2018.08.007 [DOI] [PubMed] [Google Scholar]
  • 45.Schiff DM, Zuckerman B, Wachman EM, Bair-Merritt M. Trainees’ knowledge, attitudes, and practices towards caring for the substance-exposed mother-infant dyad. Subst Abus. 2017;38(4):414–21. doi: 10.1080/08897077.2017.1356423 [DOI] [PubMed] [Google Scholar]
  • 46.Kunins HV, Sohler NL, Giovanniello A, Thompson D, Cunningham CO. A buprenorphine education and training program for primary care residents: implementation and evaluation. Subst Abus. 2013;34(3):242–7. doi: 10.1080/08897077.2012.752777 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Thakrar AP, Furfaro D, Keller S, Graddy R, Buresh M, Feldman L. A Resident-Led Intervention to Increase Initiation of Buprenorphine Maintenance for Hospitalized Patients With Opioid Use Disorder. Journal of Hospital Medicine. 2021;16(6):339–44. doi: 10.12788/jhm.3544 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Tsai AC, Kiang MV, Barnett ML, Beletsky L, Keyes KM, McGinty EE, et al. Stigma as a fundamental hindrance to the United States opioid overdose crisis response. PLoS medicine. 2019;16(11):e1002969. doi: 10.1371/journal.pmed.1002969 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.ASTHO. Stigma Reinforces Barriers to Care for Pregnant and Postpartum Women with Substance Use Disorder: ASSOCIATION OF STATE AND TERRITORIAL HEALTH OFFICIALS; 2019 [Available from: https://www.astho.org/ASTHOBriefs/Stigma-Reinforces-Barriers-to-Care-for-Pregnant-and-Postpartum-Women-with-Substance-Use-Disorder/.
  • 50.NIDA. Words Matter: Terms to Use and Avoid When Talking About Addiction. 2019.
  • 51.NIDA. Your Words Matter–Language Showing Compassion and Care for Women, Infants, Families, and Communities Impacted by Substance Use Disorder 2022 [Available from: https://nida.nih.gov/nidamed-medical-health-professionals/health-professions-education/words-matter-language-showing-compassion-care-women-infants-families-communities-impacted-substance-use-disorder.
  • 52.Martin CE, Scialli A, Terplan M. Unmet substance use disorder treatment need among reproductive age women. Drug and alcohol dependence. 2019:107679. doi: 10.1016/j.drugalcdep.2019.107679 [DOI] [PubMed] [Google Scholar]
  • 53.Meinhofer A, Hinde JM, Ali MM. Substance use disorder treatment services for pregnant and postpartum women in residential and outpatient settings. Journal of substance abuse treatment. 2020;110:9–17. doi: 10.1016/j.jsat.2019.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Martin CEOpioid Use Disorder in Pregnancy 2020 Available from: [https://ucsf.app.box.com/s/5bfbvl6jr3k33scednri8bqegahyfotg.

Decision Letter 0

Nadine Harker

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

12 Aug 2022

PONE-D-22-16004Beyond Opioid Prescribing: Evaluation of a Substance Use Disorder Curriculum for OBGYN ResidentsPLOS ONE

Dear Dr. Martin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 26 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Nadine Harker, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf  and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Abstract- some acronyms not explained and difficult to understand. Suggest removing those not explained if word count is an issue. (ACGME)

Ethical statement- What does IRB stand for?

Introduction-

Line 1- overdose crisis- opioid overdose or general overdose of all illicit substances?

Line 90- Non American readers will not know what ACGME is. Please provide a brief description/explanation of who they are and what they do.

Table 1: there is an * that explains ACGME but no corresponding *. this explanation should be earlier in text.

Methods

Line 138 notes 6 residents that were due to participate. Later in line 186 there are 4 interviews that take place. Cant follow any explanation of what happened to the other 2 and why not all participated.

Table 2 - the scale needs clarity. The scale is 1-4 but there are 5 descriptors (show how and Tell, Active Help, Passive Help, Supervision Only, Expert)

Results

Line 209- all 18 residents. This is confusing as initially there were 6, then 4 interviews and now 18 completed the curriculum. A better explanation of the numbers is needed.

Table 3 could be better interpreted after table 2 is clarified. It is clear there is an improvement in the PGs supervision needed but at what level and how do the scores correspond to the categories?

Line 221- what was the purpose of the extended curriculum? Who was it offered to and why was it not part of the original curriculum that was being studied?

Discussion

There is some room for discussion around stigma and advocacy for patients with SUD.

Some discussion around the concept of harm reduction would also be helpful as not all people are in the same stages of change (even with motivational interviewing) and preventing negative consequences of drug use should be seen as key to preventing esp infectious diseases like HIV and hepatitis.

General-

Good topic. i think its very important for specialists to be able to identify and manage SUDs.

The methods section and participant numbers and enrolment needs more clarity.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 15;17(9):e0274563. doi: 10.1371/journal.pone.0274563.r002

Author response to Decision Letter 0


19 Aug 2022

Journal Comments

Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Thank you for your comments. We have included the consent details in Lines 104-105 and on the submission website.

Reviewer Comments to the Author

Reviewer #1: Abstract- some acronyms not explained and difficult to understand. Suggest removing those not explained if word count is an issue. (ACGME)

Ethical statement- What does IRB stand for?

Our apologies for not explaining the acronyms. We have made the necessary changes throughout the manuscript. For example, in the abstract we have spelled out ACGME to “Accreditation Council for Graduate Medical Education Milestones.”

Introduction-

Line 1- overdose crisis- opioid overdose or general overdose of all illicit substances?

In line with the shift in drug use and overdose trends, we use the terminology “overdose crisis” as it refers to the epidemic of overdose deaths occurring due to opioids as well as other substances, such as methamphetamine (https://www.cdc.gov/drugoverdose/prevention/index.html). Our SUD curriculum, while it has a large focus on opioid use disorder, does also address intricacies of other use disorders.

Line 90- Non American readers will not know what ACGME is. Please provide a brief description/explanation of who they are and what they do.

Table 1: there is an * that explains ACGME but no corresponding *. this explanation should be earlier in text.

We have added more information about the ACGME and its milestones in lines 89-91 and 170-175. For example, we now state in the introduction: “Thus, the objectives of this study were…to explore its ability to improve attending evaluations of residents’ clinical skills according to the benchmarks set forth by the United States’ guiding body for resident education, the Accreditation Council for Graduate Medical Education Milestones (ACGME)…” We also added a * to ACGME in Table 1 to correspond to the footnote for this acronym.

Methods

Line 138 notes 6 residents that were due to participate. Later in line 186 there are 4 interviews that take place. Cant follow any explanation of what happened to the other 2 and why not all participated.

Unfortunately, due to residents being pulled to cover clinical duties on other services at the height of the COVID-19 pandemic for our hospital, 2 residents were not able to complete all curriculum sessions in the academic year of recruitment for the qualitative interview. We have clarified this in the text: “Due to shifting of clinical responsibilities in the COVID-19 pandemic, only four out of the possible six residents completed all 6 sessions of the curriculum. These residents (n=4) also completed both the self-assessments and interviews.” We have included this in lines 142-144.

Table 2 - the scale needs clarity. The scale is 1-4 but there are 5 descriptors (show how and Tell, Active Help, Passive Help, Supervision Only, Expert)

Thank you for noting this typo. Our apologies for the confusion. The range of scores on the Zwisch Rating Scale is 1-5. We have made the changes in line number 159.

Results

Line 209- all 18 residents. This is confusing as initially there were 6, then 4 interviews and now 18 completed the curriculum. A better explanation of the numbers is needed.

Thank you for your comments. Since our study was conducted across 3 academic years with the COVID-19 pandemic during that timeframe, our sample sizes for our outcomes corresponding to the study aims do differ. Figure 1 gives detail about our study sample. For clarity, for our three outcomes in the results text, we have also added a sentence at the start of every paragraph describing the number of residents who completed that outcome.

For our primary objective assessing curriculum effectiveness, 18 PGY-1 OBGYN residents completed the Clinical skills resident self-assessments. This has been included in lines 216-217.

For our exploratory aim, where we assessed curriculum effectiveness using myTIP report, evaluations for 10 PGY-1 OBGYN residents were completed by the teacher Attending. This has been included in lines 231-232.

For our exploratory aim, where we assessed curriculum feasibility and acceptability using semi-structured resident interviews, 4 PGY-1 OBGYN residents completed the interview. This has been included in line 242.

Table 3 could be better interpreted after table 2 is clarified. It is clear there is an improvement in the PGs supervision needed but at what level and how do the scores correspond to the categories?

We have added more information explaining the results in lines 219-224: “As an example, for the core clinical skill where residents counseled patients with SUD, residents reported requiring, on average, direct supervision before the curriculum. After completing the curriculum, residents quantitatively reported improvement in this skill, stating they now required no more than indirect supervision. Similar improvements were observed for the other core clinical skills.”

Line 221- what was the purpose of the extended curriculum? Who was it offered to and why was it not part of the original curriculum that was being studied?

For the academic year 2018-2019, when the pilot curriculum was initiated, the curriculum included 3 outpatient clinical sessions; this was primarily driven by what accommodated the resident schedules and the fact that the OBGYN-Addiction faculty leading the curriculum joined the institution that academic year. During these 3 sessions, residents were expected to demonstrate their knowledge as they saw patients and coordinated plans of care with the OBGYN-Addiction attending. After reviewing the results from the first year and positive feedback from residents, the OBGYN-Addiction faculty added three more sessions to the curriculum, and the residency leadership accommodated resident schedules to complete the extended curriculum in academic year 2019-2020. In these additional sessions, the residents were expected to demonstrate, through their performance, that they are capable of using their knowledge gained during the initial three sessions while being supervised and observed. The 6 session (extended curriculum) continued to be offered to residents during the third academic year of this study, 2020-2021.

Discussion

There is some room for discussion around stigma and advocacy for patients with SUD.

Some discussion around the concept of harm reduction would also be helpful as not all people are in the same stages of change (even with motivational interviewing) and preventing negative consequences of drug use should be seen as key to preventing esp infectious diseases like HIV and hepatitis.

We agree; these topics are very important!

We have added more discussion about harm reduction with a citation about our clinic to lines 289-293: “Notably, patients seen in the clinical setting of this study vary substantially in their stages of change, as the clinic prioritizes a low-threshold, harm reduction approach; this represented a unique opportunity for residents to apply their new Motivational Interviewing skills and compassionate, person-centered approaches as role modeled by the clinic providers.”

We have added more discussion about stigma with citations to lines 311-318: “Additionally, addiction stigma is, arguably, the most significant barrier to accessing and utilizing evidence-based SUD treatments, especially during pregnancy. While not an outcome assessed in this study, stigma was addressed throughout the resident clinical experiences; for example, all residents are required to review addiction person-centered language recommendations and are given immediate feedback on their language in the clinic. Since this study, we have added additional person-centered language training focused on addiction among pregnant and parenting people, with the goal to prepare the next generation of OBGYN providers to be leaders in destigmatizing the disease of addiction.”

General-

Good topic. i think its very important for specialists to be able to identify and manage SUDs.

The methods section and participant numbers and enrolment needs more clarity.

Thank you for the feedback; we appreciate it. We believe we have addressed the comments above adequately with additional clarity about our study design and sample to couple Figure 1.

Attachment

Submitted filename: Response to comments_RI.docx

Decision Letter 1

Nadine Harker

31 Aug 2022

Beyond Opioid Prescribing: Evaluation of a Substance Use Disorder Curriculum for OBGYN Residents

PONE-D-22-16004R1

Dear Dr. Martin,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Nadine Harker, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Nadine Harker

6 Sep 2022

PONE-D-22-16004R1

Beyond Opioid Prescribing: Evaluation of a Substance Use Disorder Curriculum for OBGYN Residents

Dear Dr. Martin:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof Nadine Harker

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. CREOG objectives addressed by OBGYN residency pilot substance use disorder curriculum.

    (DOCX)

    S2 Appendix. Interview guide for OBGYN PGY-1s completing the substance use disorder pilot curriculum.

    (DOCX)

    Attachment

    Submitted filename: Response to comments_RI.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES