Abstract
Background
The objective of this study was to assess potential challenges, prioritize adaptations, and develop an implementation and research approach to integrate and study a parenting intervention for mothers in recovery from substance use disorders in community-based home-visiting programs.
Method
An explanatory mixed-methods design, guided by process mapping with Failure Modes and Effects Analysis tools, and an Advisory Panel of 15 community members, identified potential implementation challenges and recommended solutions for the proposed intervention within five pre-specified domains. Thematic content analysis identified themes from detailed field notes.
Results
The Advisory Panel identified 44 potential challenges across all domains. They determined that the recruitment domain was most likely to create challenges. Regarding the potential challenges, two cross-domain themes emerged: (1) development of mistrust in the community and (2) difficulty initiating and sustaining engagement. Potential solutions and adaptations to protocols are reported.
Conclusion
Mistrust in the community was cited as a potentially important challenge for the delivery and study of an evidence-based parenting intervention for mothers in recovery through home-visiting programs. Adaptations to research protocols and intervention delivery strategies are needed to prioritize the psychological safety of families, particularly for groups that have been historically stigmatized.
Plain Language Summary
Effective evidence-based public health interventions for women and children face common implementation challenges in community-based settings, frequently yielding lower benefits to participants. Adaptation can improve the integration of interventions in these settings. In this study, implementation process mapping was a particularly effective approach to adapt a complex community-based intervention to a population that has been stigmatized. This tool may be useful for adapting other community-based interventions.
Keywords: behavioral health services, adaptation, interventions community-based, substance abuse prevention, adult mental health intervention
Introduction
Effective evidence-based public health interventions for women and children face common implementation challenges in community-based settings (Aarons & Palinkas, 2007; Feinberg et al., 2011; Worthington et al., 2011). Such interventions delivered in-home or through public sector systems frequently yield lower benefits in real-world settings, a phenomenon known as the “voltage drop” (Kilbourne et al., 2007). The use of systematic approaches to adaptation and implementation can help address these challenges by increasing acceptability and engagement (Chambers et al., 2013; Rathod et al., 2018). Additionally, adaptations that improve the match of the intervention to its practice setting and existing processes lead to longer-term sustainability (Scheirer & Dearing, 2011).
Maternal, infant, and early childhood home-visiting programs are examples of complex, multi-component, community-based services. While home-visiting programs select service delivery models that are evidence-based, a need to adapt programs to local contexts and specific populations remains. For example, sub-populations, such as women in recovery from substance use disorders (SUDs), may not receive the full benefit or exit programs prematurely (Suchman et al., 2006). Targeted interventions may support the greater promotion of recovery and improved parent–infant relationships (Suchman et al., 2006).
Mothering from the Inside Out (MIO) is an attachment-based intervention for mothers with SUDs tested in multiple randomized control trials with positive effects on maternal relapse and parent–child interactions (Suchman, 2016; Suchman et al., 2017). Adapting the implementation process of MIO for community-based home-visiting programs may help broaden its reach (Dennis & Chung-Lee, 2006). However, additional adaptation and evaluation of the implementation and research processes are needed to support acceptability and feasibility when integrated into community settings (Onken et al., 2014).
Intervention process mapping together with failure modes and effects analysis (FMEA) are tools that aid in intervention adaptation and are used within health services (Broder-Fingert et al., 2019; Lins et al., 2018; Tamene et al., 2020). The coupling of process mapping with FMEA aims to identify and reduce challenges inherent in complex interventions by gathering diverse perspectives of community members and addressing potential problems prior to implementation (Failure Modes and Effects Analysis (FMEA) Tool, 2017). Their utilization has produced more appropriate, effective, and sustainable systems with improved service delivery (Lins et al., 2018). This approach may be particularly useful in guiding the adaptation of interventions for inherently complex community-based delivery.
This article reports our team's work adapting the implementation process of MIO for delivery through home-visiting programs within a research context. Specifically, a process mapping and FMEA exercise conducted with an Advisory Panel of community members guided the systematic adaption of MIO for home-based delivery. The aim of the study was to identify the aspects of intervention implementation most likely to create challenges, prioritize the focus of adaptations within a research context, and develop an implementation approach most likely to support engagement and delivery of MIO for mothers in recovery through home-visiting programs.
Method
Study Design and Participants
We employed an explanatory sequential mixed-methods design (Figure 1) using process mapping and FMEA tools (Creswell & Clark, 2017). Both quantitative and qualitative analyses identified potential challenges within five specific domains of the research and intervention process and developed potential adaptations (Johnson & Onwuegbuzie, 2004). The FMEA was conducted in a group setting with an Advisory Panel. Participants were community service providers and members of the larger [Springfield, MA] community actively engaged in providing services to women in recovery. Potential participants were informed of the study via email and offered participation in-person or via video-conference. Verbal informed consent was obtained at the first meeting. Participants completed a demographic survey before beginning participation. The Institutional Review Board at [Baystate Medical Center] approved this study.
Figure 1.
Explanatory Sequential Mixed-Methods Process.
Development of a Preliminary Process Map
Two of the authors (EPC and MCC) worked together to create a preliminary process map with input from home-visiting directors, a behavioral health specialist and community partner (TMF), and the FMEA facilitator. Authors iteratively incorporated feedback and edited the map after sequential meetings. The map described the steps involved in the research and intervention implementation process. Qualitative data from prior studies of engagement in home-visiting services (Edwards et al., 2017; Lea, 2006; Magnusson et al., 2017; Peacock-Chambers et al., 2020) informed the map. The five domains of the preliminary implementation and research process map included: (1) recruitment, (2) screening, (3) enrollment, (4) matching, and (5) delivery (Figure 2). This served as the basis for FMEA discussions.
Figure 2.
Refined Process Map of MIO Implementation.
Note. HV = home visiting. MIO = Mothering from the Inside Out intervention.
Advisory Panel Meetings
A total of 15 community members from a variety of disciplines and life experiences related to SUDs participated in two separate 2-hour Advisory Panel meetings focused on identifying the process domains most likely to present potential challenges. Maximal variation sampling was used to ensure the inclusion of a variety of professional and personal perspectives (Sandelowski, 2000). No other people were present.
FMEA
FMEA is a risk management tool and quality assurance process used to identify and address potential failures related to a particular process or intervention prior to implementation (Failure Modes and Effects Analysis (FMEA) Tool, 2017). The process follows specific steps led by a facilitator. It has been developed into an effective tool to guide the implementation of behavioral health interventions (Broder-Fingert et al., 2019). Note, we use the world “challenges” rather than “failures” to align with strengths-based language.
Identification of Potential Challenges
In the first meeting, the PI provided a brief overview of MIO and an experienced FMEA facilitator (SD, registered nurse, Division of Health Care Quality, with no prior relationship to participants) gave a detailed explanation of FMEA methodology. Participants reviewed the preliminary process map, asked questions, and suggested modifications before starting the FMEA.
To begin the FMEA, Advisory Panel participants collectively identified individual challenges that could contribute to performance gaps in the implementation of the intervention across the five process map domains within the context of a research study. They also identified possible causes and consequences of the potential problems. Participants came to a consensus on a number value (0–10 Likert-type scale) of the overall likelihood of the challenge occurring, detection, and severity, with 10 being the highest likelihood, for each of the domains in the process map. The Risk Profile Number represents the overall risk for potential challenges to occur in each of the process map domains.
Generation of Solutions to Address Potential Challenges
In the second meeting, the Advisory Panel focused on the process domain with the highest Risk Profile Number and developed strategies to reduce the specific challenges based on causes, likelihood of occurrence, detection, and severity. The Advisory Panel drew from their own lived and local experience as well as professional training to develop solutions through collective discussion.
Data Analysis
Quantitative Data Analysis
The recommended standards (Failure Modes and Effects Analysis (FMEA) Tool, 2017) and input from an experienced facilitator (SD) guided the conduct of the FMEA. Risk priority numbers (RPNs) were calculated collectively for the potential challenges within each step of the intervention delivery process as the product of the likelihood of occurrence, detection, and severity values with the composite score ranging between 0 and 1,000 (RPN = Severity × Occurrence × Detection). Descriptive statistics summarize participant demographic data.
Qualitative Data Analysis
We conducted a qualitative analysis of detailed field notes collected during the FMEA to understand individual challenges and solutions across all the process domains. Content analysis identified emergent themes and sub-themes (Vaismoradi et al., 2013). Consistent with FMEA methodology (Broder-Fingert et al., 2019), the study team worked to review field notes systematically, reach consensus on key concepts, and organized concepts into principal themes and sub-themes.
Integration and Prioritization of Adaptation
The study team integrated qualitative and quantitative findings to inform protocol and process map adaptations. Adaptions were focused on the highest risk domains, as well as the availability and feasibility of possible solutions recommended by the Advisory Panel, consistent with the Planned Adaptation Framework (Lee et al., 2008). Decisions were triangulated for feedback from the Advisory Panel and community members that did not participate in the panel.
Results
Advisory Panel Participants
Advisory panel participants included parents in recovery (n = 2), and providers working in the fields of substance use treatment services (n = 8), healthcare (n = 2), Early Intervention (n = 3), and others (n = 1). There were 14 females and one male. Race/ethnicity included American Indian/Alaska Native (n = 1), Black or African American (n = 2), Hispanic or Latino (n = 2), and White (n = 10) representation. The average age of participants was 48 years old.
Quantitative Analysis: Ratings Potential Challenges
The Advisory Panel identified 44 potential challenges across the research and intervention process: 13 within the recruitment domain, 10 within screening, six within enrollment, four within matching, and 11 within intervention delivery. RPNs were generated for each domain in the process (Table 1). The recruitment domain had the highest overall risk (RPN = 800), as well as the highest score for the likelihood of challenge occurrence and difficulty detecting the challenge. The intervention delivery domain received the highest severity rating (10), indicating this domain posed the greatest potential risk of harm to participants.
Table 1.
Challenges, Mean Risk Priority Numbers, and Solutions by Intervention Delivery Domains.
| Intervention delivery domains | Description | Potential challenges | Occurrence (1–10) mean | Detection (1–10) mean | Severity (1–10) mean | Risk priority number | Solutions to potential challenges |
|---|---|---|---|---|---|---|---|
| Recruitment | Outreach in the community; explanation of program; connections with referral sources | Use of stigmatizing language: lack of interest from parents or buy-in from providers; complexity of referral process | 8 | 10 | 10 | 800 | Partner with those in community trusted by eligible population; share findings on the effectiveness of the intervention; identify invested provider champions at referral sites |
| Screening | Determination of eligibility | Screening language; feelings of rejection from parents determined ineligible | 5 | 3 | 7 | 105 | Ensure the use of nonstigmatizing language; Establish a clear referral plan and warm handoff for ineligible parents |
| Enrollment | Referral to home visiting program; informed consent process; pre-intervention assessment | Eligibility changes post-screening | 5 | 2 | 8 | 80 | Expand inclusion criteria to mothers who do not have custody of child(ren) |
| Matching | Determination of parent and provider availability; pairing of parent and provider | Schedules do not align; parent does not like provider | 7 | 10 | 7 | 490 | Establish process to re-match parents and providers; focus on culturally, non-stigmatizing language in training |
| Delivery | Intervention sessions; supervision sessions | Parent privacy concerns with recording sessions; parent does not want sessions to take place at home; parent loses interest in intervention | 4 | 2 | 10 | 80 | Make clear audio-recording is for supervision of provider; offer private setting as alternative to home for sessions; use of non-stigmatizing language |
Qualitative Analysis: Potential Challenges, Causes, and Solutions
Two cross-domain themes emerged related to individual challenges and their causes, consequences, and solutions: (1) development of mistrust in the community and (2) difficulty initiating and sustaining engagement. Themes, sub-themes, and potential consequences of challenges are provided in Table 2. Solutions to potential challenges were generated by the Advisory Panel in response to potentially high-risk challenges (Table 1).
Table 2.
Potential Implementation Challenges: Cross-Domain Themes and Sub-Themes.
| Themes | Sub-themes | Potential consequences |
|---|---|---|
| Development of mistrust in the community | Unintentional use of stigmatizing, culturally insensitive, and “deficit-based language” | Creating a bad reputation for the program and study team in the community through peer-to-peer information sharing |
| Difficult to detect due to the absence of engagement | Unable to mitigate development of mistrust if it develops | |
| Stimulate feelings of rejection among the most vulnerable due to study ineligibility (specifically parents without custody of their children) | Negatively affect parents and damage reputation of the program | |
| Privacy and confidentiality concerns (audio-recording, other family members present during sessions) | Failure to consent, withdrawal from program, unable to fully benefit from sessions | |
| Difficulty initiating and sustaining engagement | Oversaturation of services for new mothers in recovery | Lack of interest in the MIO program |
| Complexity of the referral process, “too many hands on the referral process” | Lack of understanding of procedures by referral sources, failure to make referral | |
| Fluidity of circumstances (e.g., changing residence, provider changing jobs, changing schedules) | Difficulty maintaining a parent-provider match |
Refined Process Map
Changes were made to the process map and study protocol in direct response to the recommendations from the Advisory Panel. Examples include edits to the screening script, identification of champions in multiple community-based organizations, and improved channels of communication with collaborators. Overall, allowing parents greater choice was seen as critical to building trust in the community. The Advisory Panel emphasized that the population of parents in recovery are diverse and likely will need flexible pathways to the intervention. Protocols were modified to give participants greater choice in terms of meeting location, privacy, and method of recording to further protect confidentiality.
Furthermore, the panel identified parent–child relationships for mothers without custody as potentially fragile. Participants believed that noncustodial parents needed greater support around changes in custody and that this intervention could mitigate these stressors. The study team expanded the inclusion criteria to mothers without custody, working towards reunification. A referral resource guide was added for parents determined ineligible for the program. Changes were integrated into the final process map (Figure 1).
Discussion
This study identified potential challenges that could occur when integrating an evidence-based parenting intervention for mothers in recovery from SUDs into community-based home-visiting programs. These challenges were specific to intervention adaptation within a research context and related to working with mothers in recovery. Using quantitative method to identify the highest risk domains, and qualitative method to map themes across domains, we found that the recruitment domain in the research process was at the highest risk of presenting potential challenges. The development of mistrust in the community emerged as a primary theme related to recruitment challenges. Overall, consideration of the psychological safety for parents with SUDs, in terms of empowerment through choice and consideration of the needs of individuals that have been highly stigmatized, arose as the optimal solution for mitigating these risks within the context of research and within the parenting intervention. Changes to the preliminary process map also reflect solutions identified by the Advisory Panel in response to logistical barriers to sustained engagement for parents and community collaborators.
Community-based behavioral interventions are inherently complex, particularly those engaging populations that have been marginalized (Aarons & Palinkas, 2007; Suchman et al., 2006). FMEA provides a systematic way to identify potential challenges prior to the implementation of the intervention and study procedures. We focused our adaptation on strategies that addressed the local and historical context when recruiting and working with mothers in recovery in a research study and new home-based setting.
Participant recruitment is a significant challenge across a range of research settings (Treweek et al., 2013). Equitable recruitment into community-based maternal-child health programs is also challenging (Feinberg et al., 2011), likely as a result of a combination of individual, environmental, and historical factors (UyBico et al., 2007). Although strategies for addressing barriers to research recruitment for people with SUDs have been identified (Jaffee et al., 2009), much less is known about the recruitment of mothers in recovery (Pinto et al., 2011; Winhusen et al., 2012). Our study adds to the existing literature by identifying the development of mistrust as a potential cause of recruitment challenges for these mothers.
Historical and present-day context outside of the intervention can contribute to mistrust of research and healthcare more broadly. People with SUDs often mistrust both research and medical systems because of perceived stigma, adverse prior experiences, and the intersection between criminal justice systems and SUDs (Hewell et al., 2017; Snoek & Horstkötter, 2018; Winkelman et al., 2018). For parents in recovery, the fear of custody loss of children for reasons related to substance use history can compound mistrust (Harp & Oser, 2018; Ondersma et al., 2010; Snoek & Horstkötter, 2018).
The Advisory Panel perceived that parents without active custody of their children would benefit most from the proposed parenting intervention. In [Massachusetts], parents working to reunite with their children should be involved in EI, though this is not common practice. Thus, the solution proposed by the panel to purposefully include this population could provide needed support and engagement while paying special attention to their unique risks (Holland et al., 2022). Although research guidelines and requirements help ensure the physical and psychological safety of research participants, protocols still need to be tailored to unique risks as the safety measures built into the research process may not be adequate or readily apparent to potential participants. The FMEA tool may be particularly useful in developing these strategies for other community-based intervention research involving similar groups that have been historically marginalized or disempowered.
This analytic approach moved our research protocol and intervention delivery strategies in the direction of greater prioritization of psychological safety for potential participants by highlighting the importance of providing options for how they engage in the study and allowing flexibility to meet specific needs. In addition, it raised our awareness that addressing the needs of ineligible participants, is an important advance beyond traditional physical and psychological protections for human research subjects (Hébert et al., 2015).
Strengths and Limitations
While our results were specific to a community and intervention delivered in the context of research, implementation process mapping and FMEA can be applied to a variety of settings. We expect that the findings of an FMEA conducted outside of the research context would differ. This FMEA study did not involve analysis at the level of individual challenges, rather it focused on five process domains supplemented by qualitative data. Other settings and processes may benefit from analysis at the level of individual challenges to optimize protocols. In addition, we utilized group consensus to determine the process domain at the highest risk of facing challenges. This approach may have caused our results to skew toward the opinions of more outspoken participants. A skilled facilitator works to elicit opinions across the group when using this approach. Alternatively, one can perform the FMEA by collecting RPN scores from individuals and averaging the scores to mitigate this risk. Our Advisory Panel consisted primarily of service providers. Depending on the research question, different community members may be preferable.
Conclusion
Our study provides a novel approach to the adaptation of intervention for mothers in recovery from SUDs, delivered and studied in a community setting. This process may inform future community-based research serving populations facing similar social or economic disadvantages. Additional research is needed to understand whether this methodology accurately predicted potential challenges and effective solutions, whether it led to greater uptake of the intervention, and whether process mapping and FMEA tools can help provide additional protections to people receiving community-based behavioral interventions in research and practice.
Acknowledgements
The authors thank Shannon Dillard for her skilled facilitation of the FMEA process and Tina Marie Fioroni for her input throughout the research process. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr. Byatt has received salary and/or funding support from the Massachusetts Department of Mental Health via the Massachusetts Child Psychiatry Access Program for Moms (MCPAP for Moms). She is also the statewide Medical Director of MCPAP for Moms and the Executive Director of the Lifeline for Families Center at UMass Chan Medical School. She has served on the Medscape Steering Committee on Clinical Advances in Postpartum Depression. She received honoraria from Global Learning Collaborative, Medscape, and Mathematica. She has also served as a consultant for The Kinetix Group. The other authors have indicated they have no potential conflicts of interest to disclose.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Supported by the National Center for Advancing Translational Sciences, National Institutes of Health (award no. 1KL2TR002545), and the National Institute on Drug Abuse (award no. K23DA050731).
References
- Aarons G. A., Palinkas L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 411–419. 10.1007/s10488-007-0121-3 [DOI] [PubMed] [Google Scholar]
- Broder-Fingert S., Qin S., Goupil J., Rosenberg J., Augustyn M., Blum N., Bennett A., Weitzman C., Guevara J. P., Fenick A., Silverstein M., Feinberg E. (2019). A mixed-methods process evaluation of Family Navigation implementation for autism spectrum disorder. Autism, 23(5), 1288–1299. 10.1177/1362361318808460 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chambers D. A., Glasgow R. E., Stange K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), 117. 10.1186/1748-5908-8-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Creswell J. W., Clark V. L. P. (2017). Designing and conducting mixed methods research. Sage publications. [Google Scholar]
- Dennis C. L., Chung-Lee L. (2006). Postpartum depression help-seeking barriers and maternal treatment preferences: A qualitative systematic review. Birth, 33(4), 323–331. 10.1111/j.1523-536X.2006.00130.x [DOI] [PubMed] [Google Scholar]
- Edwards A., Brebner C., McCormack P., MacDougall C. (2017). The early intervention message: Perspectives of parents of children with autism spectrum disorder. Child: Care, Health and Development, 43(2), 202–210. 10.1111/cch.12428 [DOI] [PubMed] [Google Scholar]
- Failure Modes and Effects Analysis (FMEA) Tool. (2017). Institute for Healthcare Improvement. Retrieved December 12, 2017, from http://www.ihi.org/resources/Pages/Tools/FailureModesandEffectsAnalysisTool.aspx [DOI] [PMC free article] [PubMed]
- Feinberg E., Silverstein M., Donahue S., Bliss R. (2011). The impact of race on participation in part C early intervention services. Journal of Developmental & Behavioral Pediatrics, 32(4), 284–291. 10.1097/DBP.0b013e3182142fbd [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harp K. L. H., Oser C. B. (2018). A longitudinal analysis of the impact of child custody loss on drug use and crime among a sample of African American mothers. Child Abuse & Neglect, 77, 1–12. 10.1016/j.chiabu.2017.12.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hébert J. R., Satariano W. A., Friedman D. B., Armstead C. A., Greiner A., Felder T. M., Coggins T. A., Tanjasiri S., Braun K. L. (2015). Fulfilling ethical responsibility: Moving beyond the minimal standards of protecting human subjects from research harm. Progress in Community Health Partnerships: Research, Education, and Action, 9(Suppl), 41–50. 10.1353/cpr.2015.0021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hewell V. M., Vasquez A. R., Rivkin I. D. (2017). Systemic and individual factors in the buprenorphine treatment-seeking process: A qualitative study. Substance Abuse Treatment, Prevention, and Policy, 12(1), 3. 10.1186/s13011-016-0085-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holland M. L., Esserman D., Taylor R. M., Flaherty S., Leventhal J. M. (2022). Estimating surveillance bias in child maltreatment reporting during home visiting program involvement. Child Maltreatment, 10775595221118606. 10.1177/10775595221118606 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jaffee W. B., Bailey G. L., Lohman M., Riggs P., McDonald L., Weiss R. D. (2009). Methods of recruiting adolescents with psychiatric and substance use disorders for a clinical trial. The American Journal of Drug and Alcohol Abuse, 35(5), 381–384. 10.1080/00952990903150860 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson R. B., Onwuegbuzie A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26. 10.3102/0013189x033007014 [DOI] [Google Scholar]
- Kilbourne A. M., Neumann M. S., Pincus H. A., Bauer M. S., Stall R. (2007). Implementing evidence-based interventions in health care: Application of the replicating effective programs framework. Implementation Science, 2(1), 42. 10.1186/1748-5908-2-42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lea D. (2006). ‘You don't know me like that’: Patterns of disconnect between adolescent mothers of children with disabilities and their early interventionists. Journal of Early Intervention, 28(4), 264–282. 10.1177/105381510602800403 [DOI] [Google Scholar]
- Lee S. J., Altschul I., Mowbray C. T. (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41(3-4), 290–303. 10.1007/s10464-008-9160-5 [DOI] [PubMed] [Google Scholar]
- Lins C., Gerka A., Lüpkes C., Röhrig R., Hein A. (2018). Enhancing safety of artificially ventilated patients using ambient process analysis. Studies in Health Technology and Informatics, 247, 316–320. [PubMed] [Google Scholar]
- Magnusson D. M., Minkovitz C. S., Kuhlthau K. A., Caballero T. M., Mistry K. B. (2017). Beliefs regarding development and early intervention among low-income African American and Hispanic mothers. Pediatrics, 140(5), 10.1542/peds.2017-2059 [DOI] [PubMed] [Google Scholar]
- Ondersma S. J., Winhusen T., Lewis D. F. (2010). External pressure, motivation, and treatment outcome among pregnant substance-using women. Drug and Alcohol Dependence, 107(2-3), 149–153. 10.1016/j.drugalcdep.2009.10.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Onken L. S., Carroll K. M., Shoham V., Cuthbert B. N., Riddle M. (2014). Reenvisioning clinical science: Unifying the discipline to improve the public health. Clinical Psychological Science, 2(1), 22–34. 10.1177/2167702613497932 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peacock-Chambers E., Feinberg E., Senn-McNally M., Clark M. C., Jurkowski B., Suchman N. E., Byatt N., Friedmann P. D. (2020). Engagement in early intervention services among mothers in recovery from opioid use disorders. Pediatrics, 145(2), 10.1542/peds.2019-1957 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pinto R. M., Campbell A. N., Hien D. A., Yu G., Gorroochurn P. (2011). Retention in the national institute on drug abuse clinical trials network women and trauma study: Implications for posttrial implementation. American Journal of Orthopsychiatry, 81(2), 211–217. 10.1111/j.1939-0025.2011.01090.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rathod S., Gega L., Degnan A., Pikard J., Khan T., Husain N., Munshi T., Naeem F. (2018). The current status of culturally adapted mental health interventions: A practice-focused review of meta-analyses. Neuropsychiatric Disease and Treatment, 14, 165–178. 10.2147/ndt.s138430 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sandelowski M. (2000). Whatever happened to qualitative description? Research in Nursing & Health, 23(4), 334–340. [DOI] [PubMed] [Google Scholar]
- Scheirer M. A., Dearing J. W. (2011). An agenda for research on the sustainability of public health programs. American Journal of Public Health, 101(11), 2059–2067. 10.2105/ajph.2011.300193 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Snoek A., Horstkötter D. (2018). Ethical issues in research on substance-dependent parents: The risk of implicit normative judgements by researchers. Bioethics, 32(9), 620–627. 10.1111/bioe.12514 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Suchman N., Pajulo M., Decoste C., Mayes L. (2006). Parenting interventions for drug-dependent mothers and their young children: The case for an attachment-based approach. Family Relations, 55(2), 211–226. 10.1111/j.1741-3729.2006.00371.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Suchman N. E. (2016). Mothering from the Inside Out: A mentalization-based therapy for mothers in treatment for drug addiction. Int J Birth Parent Educ, 3(4), 19–24. https://www.ncbi.nlm.nih.gov/pubmed/27840685 [PMC free article] [PubMed] [Google Scholar]
- Suchman N. E., DeCoste C. L., McMahon T. J., Dalton R., Mayes L. C., Borelli J. (2017). Mothering from the Inside Out: Results of a second randomized clinical trial testing a mentalization-based intervention for mothers in addiction treatment. Development and Psychopathology, 29(2), 617–636. 10.1017/S0954579417000220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tamene M., Morris A., Feinberg E., Bair-Merritt M. H. (2020). Using the quality improvement (QI) tool Failure Modes and Effects Analysis (FMEA) to examine implementation barriers to common workflows in integrated pediatric care. Clinical Practice in Pediatric Psychology, 8(3), 257–267. 10.1037/cpp0000365 [DOI] [Google Scholar]
- Treweek S., Lockhart P., Pitkethly M., Cook J. A., Kjeldstrøm M., Johansen M., Taskila T. K., Sullivan F. M., Wilson S., Jackson C., Jones R., Mitchell E. D. (2013). Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis. BMJ Open, 3(2), e002360. 10.1136/bmjopen-2012-002360 [DOI] [PMC free article] [PubMed] [Google Scholar]
- UyBico S. J., Pavel S., Gross C. P. (2007). Recruiting vulnerable populations into research: A systematic review of recruitment interventions. Journal of General Internal Medicine, 22(6), 852–863. 10.1007/s11606-007-0126-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaismoradi M., Turunen H., Bondas T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398–405. 10.1111/nhs.12048 [DOI] [PubMed] [Google Scholar]
- Winhusen T., Winstanley E. L., Somoza E., Brigham G. (2012). The potential impact of recruitment method on sample characteristics and treatment outcomes in a psychosocial trial for women with co-occurring substance use disorder and PTSD. Drug and Alcohol Dependence, 120(1-3), 225–228. 10.1016/j.drugalcdep.2011.06.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Winkelman T. N. A., Chang V. W., Binswanger I. A. (2018). Health, polysubstance use, and criminal justice involvement among adults with varying levels of opioid use. JAMA Network Open, 1(3), e180558. 10.1001/jamanetworkopen.2018.0558 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Worthington E., Maude S., Hughes K., Luze G., Peterson C., Brotherson M. J., Bruna K., Luchtel M. (2011). A qualitative examination of the challenges, resources, and strategies for serving children learning English in Head Start. Early Childhood Education Journal, 39(1), 51–60. 10.1007/s10643-010-0440-y [DOI] [Google Scholar]


