Abstract
Background:
Psychosocial vulnerabilities (e.g., inadequate social support, financial insecurity, stress) and substance use elevate risks for adverse perinatal outcomes and maternal mental health morbidities. However, various barriers, including paucity of validated, simple and usable comprehensive instruments, impede execution of the recommendations to screen for such vulnerabilities in the first antenatal care visit. The current study presents findings from a newly implemented self-report tool created to overcome screening barriers in outpatient antenatal clinics.
Methods:
This was a retrospective chart-review of 904 women who completed the Profile for Maternal & Obstetric Treatment Effectiveness (PROMOTE) during their first antenatal visit between June and December 2019. The PROMOTE includes the 4-item NIDA Quick Screen and 15 additional items that each assess a different psychosocial vulnerability. Statistical analysis included evaluation of missing data, and exploration of missing data patterns using univariate correlations and hierarchical clustering.
Results:
Three quarters of women (70.0%) had no missing items. In the entire sample, all but four PROMOTE items (opioid use, planned pregnancy, educational level, and financial state) had < 5% missing values, suggesting good acceptability and feasibility. Several respondent-related characteristics such as lower education, less family support, and greater stress were associated with greater likelihood of missing items. Instrument-related characteristics associated with missing values were completing the PROMOTE in Spanish or question positioning at the end of the instrument.
Conclusions and Implications:
Conducting a comprehensive screening of theoretically and clinically meaningful vulnerabilities in an outpatient setting is feasible. Study findings will inform modifications of the PROMOTE and subsequent digitization.
Keywords: Psychosocial screening, Antenatal care, Substance use risk, Instrument evaluation, Missingness patterns
Introduction
Leading health organizations recommend comprehensive psychosocial risk assessment, or Screening, Brief Intervention and Referral to Treatment (SBIRT), during the first antenatal visit (American College of Obstetrics and Gynecology, 2006; Patnode et al., 2020; Reddy, Davis, Ren, & Greene, 2017; Wright et al., 2016). SBIRT focuses on substance use and mental health problems. However, it does not regularly address other psychosocial factors which are known to affect women’s health. There is need for an evidence-based, feasible (e.g., short, self-report, acceptable), comprehensive psychosocial screening instrument to identify vulnerable women at risk of adverse perinatal (e.g., preterm birth, Neonatal Abstinence Syndrome), behavioural (e.g., inadequate care, substance use) and mental health outcomes (e.g., depression, anxiety).
Barriers to comprehensive screening
Stress, insufficient social support, interpersonal violence, residential instability, low income and education, and psychiatric co-morbidities are risk factors for poor maternal and infant outcomes due to their association with inadequate care, poor treatment adherence, and health behaviours during pregnancy (Lobel et al., 2008). Substances such as alcohol, tobacco, and opioids adversely affect outcomes due to their teratogenic or placental impact and their associated behavioural risks (Kozhimannil, Graves, Levy, & Patrick, 2017; Schempf & Strobino, 2009). Therefore, comprehensive screening should include the psychological, social, and behavioural risk factors that are directly or indirectly associated with adverse outcomes (Preis, Garry, Herrera, Garretto, & Lobel, 2020).
A dearth of validated simple clinical tools along with professional and patient driven barriers help account for the poor detection and assessment of psychosocial and substance use risk factors in antenatal care (Connell, Barnett, & Waters, 2018; Harrison & Sidebottom, 2008; Oni, Buultjens, Abdel-Latif, & Islam, 2019). Providers often lack time to conduct assessment, may be unaware that psychosocial factors affect treatment and health, may not be skilled in screening, and may be reluctant or unable to intervene if vulnerabilities are detected (Chang et al., 2008; Williams et al., 2015; Rahm et al., 2015; Wright et al., 2016). Patients underreport information they are not specifically asked about, may not understand the relevance of psychosocial questioning, and may allow perceived stigma to hinder disclosing psychosocial problems and substance use (Frazer, McConnell, & Jansson, 2019; Leis, Mendelson, Perry, & Tandon, 2011; Preis, Inman, & Lobel, 2020).
Using a screening questionnaire in antenatal care increases the likelihood of detecting substance use and psychosocial vulnerabilities (Carroll et al., 2005). Yet there are no validated, systematic, efficient, easily administered instruments to comprehensively yet simply assess psychosocial risk factors in pregnancy while being aligned with antenatal appointment time constraints and United States culture (Harrison & Sidebottom, 2008; Ko et al., 2020). Existing validated instruments that were developed outside the United States are sometimes limited in their focus (e.g., on mental health or substance use) or cultural context, are less feasible for clinical use, or do not quantify risk severity systematically and in a simple manner to enable development of sophisticated methods to predict risk (Johnson et al., 2012). For example, validates instruments such as ALPHA, KINDEX, Mind2Care, ANRQ-R, PDPI-R (Alves, Fonseca, Canavarro, & Pereira, 2019; Carroll et al., 2005; Priest, Austin, Barnett, & Buist, 2008; Quispel et al., 2014; Reilly et al., 2021; Spyridou, Schauer, & Ruf-Leuschner, 2015) are either not self-administered, making them less aligned with time constraints related to the many tasks providers have to accomplish during a busy first antenatal visit (ALPHA), are long and require calculations (KINDEX), do not assess important domains such as healthy behaviours or factors relevant to pregnant women in the United States such as home ownership (Mind2Care), or are focused on mental health risk (ANRQ-R, PDPI-R). We know of no well-validated screening tool in the United States that assesses substance use and other psychosocial risk factors that are critical for perinatal physical and mental health such as overall stress, major life events, health behaviours, partner support and family support, and economic indicators (Preis et al., 2020) in a single instrument. The current investigation is part of the process evaluation of a comprehensive instrument that assesses these factors.
Current study
In June 2019, we developed a novel substance use and psychosocial screening instrument, the Profile for Maternal & Obstetric Treatment Effectiveness (PROMOTE), for antenatal clinics affiliated with a large tertiary care public hospital. The objective of this study was to assess patients’ completion of the PROMOTE and evaluate whether the magnitude and pattern of missing items (i.e., item nonresponse) is associated with instrument structure or patient characteristics (Bulut, Xiao, Rodriguez, & Gorgun, 2020; Hughes et al., 2019). Items may be intentionally skipped or unintentionally missed, implicating problems with content (e.g., sensitive topic or irrelevant to respondent), ambiguous or incomprehensible wording, or formatting and placement issues. Examining item missingness helps ensure that instrument structure is sound, and items are comprehensible. Missingness can also diminish the fidelity of data, its generalizability, and its use to create sophisticated prediction models. In-depth investigation will identify any necessary modifications to the PROMOTE. Our main study questions were:
How fully do patients complete the screening instrument?
Are there distinguishable missing item patterns?
Which individual factors and structural factors are associated with missingness?
Materials and Methods
Study Design and Participants
We conducted retrospective chart review of all women who completed the PROMOTE during their first antenatal visit at an outpatient clinic associated with a large university hospital on Long Island, New York between June 6 and December 10, 2019.
Procedure
All patients are asked to arrive 15 minutes in advance of their antenatal care appointment. At check-in, they received a clipboard with the paper PROMOTE in English or Spanish together with additional forms in their intake packet to be completed before their appointment. The PROMOTE began with a prompt stating, “Below are questions that will help your doctors and nurses get to know you better and provide care that meets your needs. There are no right or wrong answers. Please answer as honestly as you can. If any question makes you feel uncomfortable, please skip it.” Patients completed the PROMOTE while sitting in the waiting room, sometimes with another person of their choice present with them. The completed form was then used by their provider to assess vulnerabilities following the SBIRT framework. Each completed PROMOTE was scanned into the Electronic Medical Record (EMR). The Institutional Review Board at Stony Brook University granted ethical approval for abstraction of records and entry into REDCap data collection software and approved a waiver of informed consent for this minimal risk study (IRB2019–00512).
Assessments
The PROMOTE was created by a team of social scientists, obstetrics providers, and administrators. Each constituent item assesses a single psychosocial construct (e.g., perceived stress, support from partner, domestic violence) or health behaviour (e.g., tobacco use, opioid use, healthy antenatal behaviours). The first section contains 19 items that are the focus of this investigation. At the end of this section is a brief description of opioids and a question about use of opioids in the last year. The following items were included in the PROMOTE, listed by order of appearance. Tables 1 and 2 list response options.
Table 1.
Sociodemographic sample characteristics
| n (valid %) | Missing n (%) | |
|---|---|---|
| Planned pregnancy | 78 (8.6) | |
| No | 340 (41.2) | |
| Yes | 486 (58.8) | |
| Employment | 21 (2.3) | |
| Full time | 454 (50.2) | |
| Part-time | 129 (14.3) | |
| Homemaker | 114 (12.6) | |
| Unemployed | 105 (11.6) | |
| Student | 28 (3.1) | |
| Other | 53 (5.9) | |
| Education level | 60 (6.6) | |
| Some high school (no diploma) | 51 (5.6) | |
| High school graduate | 268 (29.6) | |
| Associate’s degree | 116 (12.8) | |
| Bachelor’s degree or more | 409 (45.2) | |
| Financial state | 73 (8.1) | |
| Below average | 137 (15.2) | |
| Average | 610 (67.5) | |
| Above average | 84 (9.3) | |
| Residence | 19 (2.1) | |
| Homeowner | 373 (40.5) | |
| Renting | 324 (34.7) | |
| With family or friends | 167 (18.5) | |
| Group residence | 6 (0.7) | |
| Homeless/ shelter | 4 (0.4) | |
| Other | 28 (3.1) | |
| Current relationship | 32 (3.5) | |
| Married or cohabiting | 588 (65.0) | |
| Serious relationship | 219 (24.2) | |
| No relationship | 38 (4.2) | |
| Other | 27 (3.0) |
Table 2.
Behavioural health, substance use screening and distribution
| M±SD | Missing n (%) |
Never n (valid %) |
1–2 times n (valid %) |
Monthly n (valid %) |
Weekly n (valid %) |
Daily n (valid %) |
|
|---|---|---|---|---|---|---|---|
| Alcohol (four drinks or more) | 1.46±0.84 | 17 (1.9) | 620 (68.6) | 172 (19.0) | 59 (6.5) | 25 (2.8) | 11 (1.2) |
| Tobacco | 1.44±1.15 | 9 (1.0) | 755 (83.5) | 46 (5.1) | 11 (1.2) | 9 (1.0) | 74 (8.2) |
| Prescription drugs | 1.05±0.40 | 10 (1.1) | 877 (97.0) | 5 (0.6) | 4 (0.4) | 1 (0.1) | 7 (0.8) |
| Illegal drugs | 1.14±0.61 | 13 (1.4) | 834 (92.3) | 28 (3.1) | 9 (1.0) | 5 (0.6) | 15 (1.7) |
| Very little | Very much | ||||||
| 1 | 2 | 3 | 4 | 5 | |||
| Family support | 4.35±1.12 | 16 (1.8) | 45 (5.1) | 31 (3.5) | 95 (10.7) | 114 (12.8) | 603 (67.9) |
| Partner support* | 4.71±0.81 | 15 (1.7) | 22 (2.5) | 8 (0.9) | 38 (4.1) | 71(7.8) | 752 (82.9) |
| Antenatal stress | 4.06±1.18 | 18 (2.0) | 179 (20.2) | 215 (24.3) | 293 (33.1) | 133 (15.0) | 66 (7.4) |
| Positive health behaviours | 4.06±0.97 | 22 (2.4) | 14 (1.5) | 45 (5.0) | 172 (19.0) | 292 (32.3) | 359 (39.7) |
| No n (valid %) |
Yes n (valid %) |
||||||
| Major life events | 25 (2.8) | 746 (84.9) | 133 (15.1) | ||||
| Abuse | 25 (2.8) | 851 (96.8) | 28 (3.2) | ||||
| Emotional difficulty | 20 (2.2) | 795 (89.9) | 89 (10.1) | ||||
| Psychiatric medication | 21 (2.3) | 833 (94.3) | 50 (5.7) | ||||
| Any kind of opioids | 90 (10.0) | 778 (95.6) | 36 (4.4) |
Partner support data does not include n = 16 (1.8%) women who mentioned that this was not applicable to them
Planned pregnancy was assessed by asking women ”was this pregnancy planned”. Sociodemographic data included employment, education, financial state, residential stability, and relationship status. Social Support was assessed with two items: extent of help or support from family or friends, and from partner or spouse. Antenatal stress was assessed by asking, “How much stress do you currently have in your life?” Healthy antenatal behaviours were assessed with, “To what extent are you involved in healthy activities (eat well, take vitamins, come to medical appointments, etc.)?” Substance use was assessed using the 4-item NIDA quick screen (National Institute on Drug Abuse, 2012): frequency of past year risky alcohol use (four or more drinks), tobacco, prescription drugs for non-medical use, and illicit drugs. Women indicated whether they had experienced major life events (e.g., “break-up, moving, death of someone close, etc.”) since becoming pregnant. Intimate Partner violence was assessed by asking if women had “ever been emotionally or physically abused by a partner or someone important to you”. Emotional difficulty was assessed by asking about current “emotional or psychiatric problems” and if yes, which. Respondents were asked if they are regularly taking psychiatric medication and if so, which. Opioid use was the last question in the first section of the PROMOTE and began with an explanation and examples of opioids such as heroin, Fentanyl, painkillers (Oxycodone, Percocet) or medication assisted treatment (Subutex, Methadone, Suboxone) followed by a question regarding any past year opioid use. The second section of the PROMOTE is comprised of in-depth questioning on substance use completed only by women who endorse past year opioid use. These data are not analysed in the current investigation.
Age, gestational week of pregnancy, race/ethnicity, and language in which the PROMOTE was completed (English or Spanish) were also abstracted.
Analysis
Analyses were performed using SPSS 27.0 and Python (NumPy, SciPy, Seaborn, Scikit-learn libraries). We examined overall completion rates of the PROMOTE and missing values patterns, including missing pairs. Distribution patterns were compared across items with differences evaluated by χ2 tests. Hierarchical clustering of respondents based on missingness was used to identify and visualize missingness patterns. YN×K represented a matrix of responses of N respondents to K questions; the missingness indicator was defined by the matrix M, such that mij = 1 if yij is missing, and mij = 0 if yij is not missing (Little & Rubin, 2019). The matrix M, has 268 rows (number of respondents with missing item) and 19 columns (number of items). Next, we clustered respondents and items into similar groups in terms of missingness patterns. We defined M′ as the clustered version of M, where its rows are clusters of respondents and columns are clusters of items. We applied hierarchical clustering with a bottom-up approach, where each observation starts in its own cluster, and pairs of clusters merge based on similarity of their missingness pattern.
Results
Study sample
The sample included 904 women, on average 30.7±5.9 years old (range 15–47), average gestational age 12.7±8.2 weeks. The majority completed the PROMOTE in English (n=871, 96.5%). The sample was representative of the suburban population where the study was conducted with half of the participants working full-time (n=454, 50.2%), a fifth identifying as Hispanic/ Latinx (n=193, 21.8%), over a third that were homeowners (n=373, 40.5%), and nearly two-thirds (n=588, 65.0%) who were married or cohabiting. Additional sample characteristics and item distributions are in Tables 1 and 2.
Missing value patterns
95.7% of women had three or fewer missing items from all 19 items. 636 women (70.0%) had no missing items, 166 (18.4%) had one, 46 (5.0%) had two, 17 (1.8%) had three, and 39 women (4.3%) had four or more missing items. Five women completed fewer than half of the items. Little’s test to estimate Missing Completely at Random (R. J. A. Little, 1988) indicated that missingness was not random (χ2(110)=196.5, p<0.001). Therefore, we conducted further investigation of missing item patterns.
Missingness was more common in some items (see Tables 1 and 2) and some item pairs. As can be seen in Figure 1, four items had more than 5% missing values: Opioid Use (10.0%), Pregnancy Planning (8.6%), Financial State (8.1%), and Education (6.6%). Missing values for other items ranged from 1.1% (past year tobacco use) to 3.5% (current relationship).While not exhibiting high missingness, the five sets of items most frequently missing in pairs included Education and Financial State (n=27, 2.9% missing both), Education and Relationship Status (n=20, 2.2% missing both), Psychiatric Medication and Opioid Use (n=20, 2.2% missing both), Emotional Problems and Opioid Use (n=19, 2.1% missing both), and Emotional Problems and Psychiatric Medication (n=19, 2.1% missing both). Generally, missingness in pairs was more common for items within the same domain, such as sociodemographic data (e.g., Education and Financial State; Education and Relationship), or for items located closely (e.g., Opioid Use, Emotional Difficulty, Psychiatric Medication).
Figure 1:

Count and percentage of missing values per item
Correlates of missing patterns
A missing value on the Opioid Use item was more common among women with a high school education than those with an Associates or college degree (χ2(2)=31.59, p<0.001), among women with below average rather than average or above average Financial State (χ2(2)=6.13, p=0.047), and among women who completed the instrument in Spanish rather than English (χ2(2)=12.19, p<0.001). Women who missed the Opioid Use item were younger (t(897)=2.21, p=0.04) and reported less Family Support than those who responded (t(886)=2.17, p=0.03).
A missing Pregnancy Planning response was more common among women who did not use any tobacco (χ2(2)=6.59, p=0.01) or alcohol (χ2(2)=8.91, p=0.003) compared to those who did, and among multiparous women versus primiparous women (χ2(2)=4.28, p=0.04).
A missing value for Financial State was more common among those with a high school education than an Associates or college degree (χ2(2)=40.78, p<0.001), among women who did not use psychiatric medication versus those who did (χ2(2)=4.35, p=0.04), among those who were in a serious relationship or not in a relationship compared with women who were married or cohabiting (χ2(2)=21.78, p<0.001), among those who did not use alcohol (χ2(2)=7.22, p=0.007) or illicit drugs (χ2(2)=5.03, p=0.025) compared to those who did, and among women who completed the instrument in Spanish rather than English (χ2(2)=17.93, p<0.001).Women who missed the Financial State item reported more Stress than those who did respond to this item (t(884)=2.30, p=0.02).
Finally, a missing Education Level response was more common among women who reported having below average rather than average or above average Financial State (χ2(2)=25.56, p<0.001), among those who did not use illicit drugs versus those who did (χ2(2)=4.01, p=0.045), and among women who completed the instrument in Spanish versus English (χ2(2)=249.90, p<0.001). Women who missed the Education Level item reported less Family Support than those who did respond (t(886)=3.35, p<0.001), and the former reported more Antenatal Stress than those who responded (t(884)=2.56, p=0.01).
Clustering patients by missingness patterns
Figure 2 shows the heatmap visualization of M′ among 268 women who had any missing items. The red colour intensity illustrates the percentage of respondents who missed the question corresponding to that column (labelled at the bottom of the map). Values to the left of the map are the number of respondents in the corresponding cluster. For example, the first row has four respondents who exhibited the highest missing percentage, the bottom row has 13 respondents who missed the last few PROMOTE questions (items 16 to 19), and the row second to the bottom had 67 respondents who missed only the Opioid Use question. Figure 2 also illustrates various ways to cluster respondents based on patterns of missingness. For example, to produce two clusters, respondents in the first row would comprise cluster 1, and the remaining respondents would comprise cluster 2. To produce three clusters, cluster 2 is split into clusters of respondents in the bottom row versus a cluster of remaining respondents. The heatmap also illustrates that items placed proximally, or which are thematically similar, were more often missing together. For example, in the second row from the top, the cluster is missing items from the psychosocial background section (Family Support, Partner Support, Stress, Healthy Behaviours).
Figure 2: Hierarchical clustering of 268 patients with missing items.

Note: Rows represent patients, and the number at the left represents the number of patients in that row. Columns represent items and the colour represents missingness (i.e., darker is more likely to be missing). The figure represents clustered respondents and items based on their missingness patterns.
Discussion
In this study, we evaluated missingness patterns in the PROMOTE, a new comprehensive instrument to conduct psychosocial and substance use screening in antenatal care. Although overall, few items were missing, missingness patterns implicate instrument characteristics (e.g., positioning, language) and patient characteristics (e.g., age, education) in item nonresponse and indicate that more vulnerable patients (e.g., less social support, greater stress) tend to complete less of the PROMOTE. The high completion rate (95.7% of women had three or fewer missing items) establishes the feasibility of the PROMOTE as a tool self-administered by patients and results of this investigation will inform modification and use of the PROMOTE.
Substance use screening in the PROMOTE was conducted with the NIDA quick screen (National Institute on Drug Abuse, 2012) and a separate question regarding use of any opioid in the last year. The missingness of items in the NIDA quick screen, which was located in the middle section of the PROMOTE, was minimal (<2%), whereas the opioid question, located at the end of the form, had relatively high missingness (10.0%). Pregnant women often do not report substance use due to shame and concerns about potential consequences of disclosure (Palamar, 2019). Compared with other substance use screening instruments that specify a time frame within the antenatal period (e.g., since becoming pregnant, in the past month), the one-year time frame used in the PROMOTE item encompasses the preconception period. Thus, it does not spotlight substance use during pregnancy, but rather a risk for use during pregnancy. Indeed, over a third of participants reported harmful substance use in the year prior to their first antenatal visit, putting them at greater risk during pregnancy, since preconceptional substance use is a strong predictor of antenatal use (Harrison & Sidebottom, 2009; Skagerstróm, Chang, & Nilsen, 2011).
While focusing on past year (preconceptional) use might be associated with “false positives”, this type of screening method is likely to reduce more consequential “false negatives” (i.e., not identifying antenatally substance using women), by substance-using women reluctant to disclose substance use in pregnancy. For women, this approach could provide an opening to discuss substance use during pregnancy, and for providers, it could indicate a reason for additional substance use screening (e.g., direct questioning about substance use or urinalysis) in an empathic encounter. Additional research is needed to assess the predictive validity of this questioning for antenatal substance use. Nevertheless, a tenth of participants did not respond to the past year opioid use item. Since this was the last item on the PROMOTE, and was on the second page together with in-depth questioning about substance use, it might have been mistakenly overlooked. It is unlikely that missingness of the opioid use item was related to insufficient time to complete the full measure, because the item preceding opioid use had high completion rates (psychiatric medication; 2.3% missingness).
Modifications of the PROMOTE will include grouping this item with the other substance use items. Finally, the NIDA Quick Screen does not explicitly list marijuana. This might contribute to under-identification of women who use marijuana if they do not consider marijuana an illicit drug, a possibility that we confirmed in qualitative, in-depth interviews of some respondents (Authors, in preparation). Only 7.7% of respondents reported illicit substance use, which is lower than national rates of marijuana use which are 34.3% past year use among women 18–25 and 12.1% among women 26 and older (Center for Behavioral Health Statistics and Quality, 2020). Therefore, we will modify the PROMOTE to add a separate question regarding marijuana use in the year before pregnancy.
Missingness of Pregnancy Planning, Financial State, and Education were somewhat higher than other items, despite their location at the beginning of the PROMOTE. Women may be reluctant to answer these items because of social desirability, shame or inner conflict, or not understanding their relevance to antenatal care. Having an unplanned pregnancy could be embarrassing or women might feel judged that they were not ‘careful enough’. In addition, some women may not endorse a pregnancy as unplanned if they interpret this to mean that the pregnancy was unwanted (Aiken, Borrero, Callegari, & Dehlendorf, 2016). Yet this is an important factor to assess early in pregnancy since unplanned pregnancies are associated with greater preconception substance use, poorer mental health, and worse perinatal outcomes (Lundsberg, Peglow, Qasba, Yonkers, & Gariepy, 2018; Meiksin et al., 2010). Therefore, in clinical practice, missingness of the Pregnancy Planning item will warrant further inquiry by provider. As for the assessment of financial status, respondents often consider this a private matter. Reluctance to disclose one’s income is a known problem in data collection (Yan, Curtin, & Jans, 2010). Moreover, nonresponse to financial state was more common among women who were more stressed and had less family support, suggesting that they may have had financial strains that they did not want to disclose, potentially out of embarrassment. Since the aim of this question is to assess financial instability, we will modify it to directly assess difficulty obtaining or paying for necessities.
Finally, the higher rate of missing items among patients who completed the PROMOTE in Spanish requires further investigation of possible contributors. These could be related to wording, cultural misfit, or to unique strains faced by Spanish speaking patients.
Limitations and Strengths
One strength of the PROMOTE is that it includes single items to assess each risk construct, making it brief and usable. Although single-item assessment has been shown to be acceptable in previous antenatal contexts (Sagrestano et al., 2002), further research is needed to confirm the validity of this approach when assessing the specific vulnerabilities and risk factors included in the PROMOTE. Additionally, although self-report instruments are recommended to screen for substance use in pregnancy, reluctance to disclose could lead to under-identification of substance using pregnant women (Elertson & Schmitt, 2019; Reddy et al., 2017). There is a need for further investigation of ways to indirectly assess risk for substance use and to confirm the validity of such assessment based on prospective research that includes biological sampling (González-Colmenero et al., 2021). Finally, our assessment of the PROMOTE relied on outpatients of a single university-affiliated medical centre and further study with the modified PROMOTE should assess its feasibility in other antenatal settings (e.g., diverse population, varying appointment times).
Conclusion
The PROMOTE exhibited acceptability and overall, produced little missing data. Nevertheless, the current analysis laid the groundwork for some modifications of item placement and wording to improve completion of the instrument. Together with results of qualitative investigations of providers, administrators, and patients examining the ease of distribution and use of the instrument, a modified version of the PROMOTE will be created and digitized. The modified and digitized PROMOTE is expected to be as acceptable and accessible to patients (Kingston et al., 2017), and less likely to result in missing data (Highet, Gamble, & Creedy, 2019; Spark et al., 2015). Moreover, digitizing the PROMOTE will enable directly linking it to the EMR, and facilitate identifying women at risk. Administering the PROMOTE electronically will also make it easy to use in subsequent antenatal visits (Kiely, Gantz, El-Khorazaty, & El-Mohandes, 2013), but we believe that its utility in identifying risk and conducting SBIRT is best achieved as early in pregnancy as possible.
With proper implementation (Reilly, Brake, Kalra, & Austin, 2020), use of the PROMOTE will allow providers to deliver evidence-based care for their pregnant patients based on the patients’ perspectives, experiences, and the providers’ clinical judgment (Ben-David, Jonson-Reid, & Tompkins, 2017). As demonstrated by some of our findings and other recent research (Ray, Gitz, Hu, Davis, & Miller, 2020), missingness of social needs items is more likely among vulnerable groups. Further research and techniques are needed to indirectly and directly identify individuals with psychosocial risks, especially when missing items are related to disclosure reluctance. Currently, our team is working on developing machine learning algorithms to flag patients who are more vulnerable to social, behavioural, or medical risks including perinatal outcomes (e.g., inadequate antenatal care, preterm birth, positive urine toxicology, antenatal and postnatal depression assessed using the Edinburgh Depression Scale).The successful use of the PROMOTE to identify women at risk and foster appropriate interventions for them is a critical means to protect the health and well-being of pregnant women and their offspring.
Acknowledgements
The authors would like to thank colleagues from Stony Brook Medicine that played a significant role in propelling the PROMOTE project: Elsa Singh and Nichole Seda (outpatient prenatal care administration) and Marianna Lawrence (Regional Perinatal Center) who contributed to the development and implementation of the PROMOTE and who have been supportive of its goals, Kristen Alarcon and Nancy Bowden (obstetric Nurse Practitioners) for their input regarding the PROMOTE, Elena Davidiak who assisted in translating the PROMOTE to Spanish, and Elizabeth Roemer, Deidre Lee, and Rosalinda Barba (Department of Obstetrics, Gynecology and Reproductive Medicine Research Support), who assisted in the collection of the data presented in this manuscript.
Funding
The authors report no conflict of interest. Research reported in this manuscript was supported by National Institute on Drug Abuse under award number R21DA049827. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
Geolocation Information
40.915236835731, -73.122478554817
Declaration of Interest
The authors report no conflict of interest. Research reported in this manuscript was supported by National Institute on Drug Abuse under award number R21DA049827. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
References
- Aiken ARA, Borrero S, Callegari LS, & Dehlendorf C (2016). Rethinking the pregnancy planning paradigm: Unintended conceptions or unrepresentative concepts? Perspectives on Sexual and Reproductive Health, 48(3), 147–151. doi: 10.1363/48e10316 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Alves S, Fonseca A, Canavarro MC, & Pereira M (2019). Predictive validity of the Postpartum Depression Predictors Inventory-Revised (PDPI-R): A longitudinal study with Portuguese women. Midwifery, 69, 113–120. doi: 10.1016/j.midw.2018.11.006 [DOI] [PubMed] [Google Scholar]
- American College of Obstetrics and Gynecology (2006). ACOG Committee Opinion No. 343: psychosocial risk factors: perinatal screening and intervention. Obstetetrics and Gynecology, 108(2), 8. [DOI] [PubMed] [Google Scholar]
- Ben-David V, Jonson-Reid M, & Tompkins R (2017). Addressing the missing part of evidence-based practice: The importance of respecting clinical judgment in the process of adopting a new screening tool for postpartum depression. Issues in Mental Health Nursing, 38(12), 989–995. doi: 10.1080/01612840.2017.1347221 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bulut O, Xiao JY, Rodriguez MC, & Gorgun G (2020). An empirical investigation of factors contributing to item nonresponse in self-reported bullying instruments. Journal of School Violence, 19(4), 539–552. doi: 10.1080/15388220.2020.1770603 [DOI] [Google Scholar]
- Carroll JC, Reid AJ, Biringer A, Midmer D, Glazier RH, Wilson L, … Stewart (2005). Effectiveness of the Antenatal Psychosocial Health Assessment (ALPHA) form in detecting psychosocial concerns: a randomized controlled trial. Canadian Medical Association journal, 173(3), 253–259. doi: 10.1503/cmaj.1040610 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chang JC, Dado D, Frankel RM, Rodriguez KL, Zickmund S, Ling BS, & Arnold RM (2008). When pregnant patients disclose substance use: Missed opportunities for behavioral change counseling. Patient Education and Counseling, 72(3), 394–401. doi: 10.1016/j.pec.2008.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Connell T, Barnett B, & Waters D (2018). Barriers to antenatal psychosocial assessment and depression screening in private hospital settings. Women and Birth, 31(4), 292–298. doi: 10.1016/j.wombi.2017.09.021 [DOI] [PubMed] [Google Scholar]
- Elertson KM, & Schmitt CA (2019). Ask them all: Self-report universal prenatal substance use screening in the United States. Journal of Substance Use, 24(5), 520–523. doi: 10.1080/14659891.2019.1614233 [DOI] [Google Scholar]
- Frazer Z, McConnell K, & Jansson LM Treatment for substance use disorders in pregnant women: Motivators and barriers. Drug and Alcohol Dependence, 205. doi: 10.1016/j.drugalcdep.2019.107652 [DOI] [PubMed] [Google Scholar]
- González-Colmenero E, Concheiro-Guisán A, Lorenzo-Martínez M, Concheiro M, Lendoiro E, de-Castro-Ríos A, … Fernández-Lorenzo JR (2021). Drug testing in biological samples vs. maternal surveys for the detection of substance use during whole pregnancy. Journal of Addictive Diseases, 39(2), 175–182. doi: 10.1080/10550887.2020.1831137 [DOI] [PubMed] [Google Scholar]
- Harrison PA, & Sidebottom AC (2008). Systematic prenatal screening for psychosocial risks. Journal of Health Care for the Poor and Underserved, 19(1), 258–276. [DOI] [PubMed] [Google Scholar]
- Harrison PA, & Sidebottom AC (2009). Alcohol and drug use before and during pregnancy: an examination of use patterns and predictors of cessation. Maternal and Child Health Journal, 13(3), 386. [DOI] [PubMed] [Google Scholar]
- Highet N, Gamble J, & Creedy D (2019). Perinatal mental health and psychosocial risk screening in a community maternal and child health setting: evaluation of a digital platform. Primary Health Care Research and Development, 20. doi: 10.1017/s1463423618000336 [DOI] [Google Scholar]
- Hughes SC, Hogue CJ, Clark MA, Graber JE, Eaker ED, Herring AH, & Natl Childrens S (2019). Screening for pregnancy status in a population-based sample: Characteristics associated with item nonresponse. Maternal and child health journal, 23(3), 316–324. doi: 10.1007/s10995-018-2665-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson M, Schmeid V, Lupton SJ, Austin MP, Matthey SM, Kemp L, … Yeo AE (2012). Measuring perinatal mental health risk. Archives of Women’s Mental Health, 15(5), 375–386. doi: 10.1007/s00737-012-0297-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiely M, Gantz MG, El-Khorazaty MN, & El-Mohandes AAE (2013). Sequential screening for psychosocial and behavioural risk during pregnancy in a population of urban African Americans. BJOG, 120(11), 1395–1402. doi: 10.1111/1471-0528.12202 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kingston D, Austin MP, van Zanten SV, Harvalik P, Giallo R, McDonald SD, … Biringer A (2017). Pregnant women’s views on the feasibility and acceptability of web-based mental health E-screening versus paper-based screening: A randomized controlled trial. Journal of Medical Internet Research, 19(4). doi: 10.2196/jmir.6866 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ko JY, Tong VT, Haight SC, Terplan M, Stark L, Snead C, & Schulkin J (2020). Obstetrician–gynecologists’ practices and attitudes on substance use screening during pregnancy. Journal of Perinatology, 40(3), 422–432. doi: 10.1038/s41372-019-0542-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kozhimannil KB, Graves AJ, Levy R, & Patrick SW (2017). Nonmedical use of prescription opioids among pregnant US women. Women’s Health Issues, 27(3), 308–315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leis JA, Mendelson T, Perry DF, & Tandon SD (2011). Perceptions of mental health services among low-income, perinatal African-American women. Women’s Health Issues, 21(4), 314–319. doi: 10.1016/j.whi.2011.03.005 [DOI] [PubMed] [Google Scholar]
- Little RJ, & Rubin DB (2019). Statistical analysis with missing data (Vol. 793): John Wiley & Sons. [Google Scholar]
- Little RJA (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American statistical Association, 83(404), 1198–1202. [Google Scholar]
- Lobel M, Cannella DL, Graham JE, DeVincent C, Schneider J, & Meyer BA (2008). Pregnancy-specific stress, prenatal health behaviors, and birth outcomes. Health Psychology, 27(5), 604. [DOI] [PubMed] [Google Scholar]
- Lundsberg LS, Peglow S, Qasba N, Yonkers KA, & Gariepy AM (2018). Is preconception dubstance use associated with unplanned or poorly timed pregnancy? Journal of Addiction Medicine, 12(4), 321–328. doi: 10.1097/ADM.0000000000000409 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meiksin R, Chang JC, Bhargava T, Arnold R, Dado D, Frankel R, … Zickmund S (2010). Now is the chance: Patient–provider communication about unplanned pregnancy during the first prenatal visit. Patient Education and Counseling, 81(3), 462–467. doi: 10.1016/j.pec.2010.09.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Institute on Drug Abuse (2012). Resource Guide: Screening for Drug Use in General Medical Settings. Retrieved from https://archives.drugabuse.gov/publications/resource-guide-screening-drug-use-in-general-medical-settings.
- Oni HT, Buultjens M, Abdel-Latif ME, & Islam MM (2019). Barriers to screening pregnant women for alcohol or other drugs: A narrative synthesis. Women and Birth, 32(6), 479–486. doi: 10.1016/j.wombi.2018.11.009 [DOI] [PubMed] [Google Scholar]
- Palamar JJ (2019). Commentary on Ondersma et al. (2019): Will better self‐report screening instruments be enough to detect drug use during pregnancy? Addiction, 114(9), 1694–1695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patnode CD, Perdue LA, Rushkin M, Dana T, Blazina I, Bougatsos C, … Chou R (2020). Screening for unhealthy drug use: Updated evidence report and systematic review for the US Preventive Services Task Force. JAMA, 323(22), 2310–2328. doi: 10.1001/jama.2019.21381 [DOI] [PubMed] [Google Scholar]
- Petersen Williams P, Petersen Z, Sorsdahl K, Mathews C, Everett-Murphy K, & Parry CD (2015). Screening and brief interventions for alcohol and other drug use among pregnant women attending midwife obstetric units in Cape Town, South Africa: A qualitative study of the views of health care professionals. Journal of Midwifery & Women’s Health, 60(4), 401–409. doi: 10.1111/jmwh.12328 [DOI] [PubMed] [Google Scholar]
- Preis H, Garry DJ, Herrera K, Garretto DJ, & Lobel M (2020). Improving assessment, treatment, and understanding of pregnant women with opioid use disorder: The importance of life context. Women’s Reproductive Health, 7(3), 153–163. [Google Scholar]
- Preis H, Inman EM, & Lobel M (2020). Contributions of psychology to research, treatment, and care of pregnant women with opioid use disorder. American Psychologist, 75(6), 853–865. doi: 10.1037/amp0000675 [DOI] [PubMed] [Google Scholar]
- Priest SR, Austin MP, Barnett BB, & Buist A (2008). A psychosocial risk assessment model (PRAM) for use with pregnant and postpartum women in primary care settings. Archives of Womens Mental Health, 11(5–6), 307–317. doi: 10.1007/s00737-008-0028-3 [DOI] [PubMed] [Google Scholar]
- Center for Behavioral Health Statistics and Quality (2020). Results from the 2019 National Survey on Drug Use and Health: Detailed tables. Substance Abuse and Mental Health Services Administration; Rockville, MD. Retrieved from https://www.samhsa.gov/data/ [Google Scholar]
- Quispel C, van Veen MJ, Zuijderhoudt C, Steegers EAP, Hoogendijk WJG, Birnie E, … Lambregtse-van den Berg MP (2014). Patient versus professional based psychosocial risk factor screening for adverse pregnancy outcomes. Maternal and Child Health Journal, 18(9), 2089–2097. doi: 10.1007/s10995-014-1456-5 [DOI] [PubMed] [Google Scholar]
- Rahm AK, Boggs JM, Martin C, Price DW, Beck A, Backer TE, & Dearing JW (2015). Facilitators and barriers to implementing Screening, Brief Intervention, and Referral to Treatment (SBIRT) in primary care in integrated health care settings. Substance Abuse, 36(3), 281–288. doi: 10.1080/08897077.2014.951140 [DOI] [PubMed] [Google Scholar]
- Ray KN, Gitz KM, Hu A, Davis AA, & Miller E (2020). Nonresponse to health-related social needs screening questions. Pediatrics, 146(3). doi: 10.1542/peds.2020-0174 [DOI] [PubMed] [Google Scholar]
- Reddy UM, Davis JM, Ren Z, & Greene MF (2017). Opioid use in pregnancy, neonatal abstinence syndrome, and childhood outcomes: executive summary of a joint workshop by the Eunice Kennedy Shriver National Institute of Child Health and Human Development, American Congress of Obstetricians and Gynecologists, American Academy of Pediatrics, Society for Maternal-Fetal Medicine, Centers for Disease Control and Prevention, and the March of Dimes Foundation. Obstetrics and Gynecology, 130(1), 10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reilly N, Brake E, Kalra H, & Austin MP (2020). Insights into implementation of routine depression screening and psychosocial assessment in a private hospital setting: A qualitative study. Australian & New Zealand Journal of Obstetrics & Gynaecology, 60(3), 419–424. doi: 10.1111/ajo.13083 [DOI] [PubMed] [Google Scholar]
- Reilly N, Hadzi-Pavlovic D, Loxton D, Black E, Mule V, & Austin MP (2021). Supporting routine psychosocial assessment in the perinatal period: The concurrent and predictive validity of the Antenatal Risk Questionnaire-Revised. Women and Birth, in press. doi: 10.1016/j.wombi.2021.04.003 [DOI] [PubMed] [Google Scholar]
- Sagrestano LM, Rodriguez AC, Carroll D, Bieniarz A, Greenberg A, Castro L, & Nuwayhid B (2002). A comparison of standardized measures of psychosocial variables with single‐item screening measures used in an urban obstetric clinic. Journal of Obstetric, Gynecologic, & Neonatal Nursing, 31(2), 147–155. [DOI] [PubMed] [Google Scholar]
- Schempf AH, & Strobino DM (2009). Drug use and limited prenatal care: an examination of responsible barriers. In (Vol. 200, pp. 412.e411–412.e410). [DOI] [PubMed] [Google Scholar]
- Skagerstróm J, Chang G, & Nilsen P (2011). Predictors of drinking during pregnancy: A systematic review. Journal of Women’s Health, 20(6), 901–913. doi: 10.1089/jwh.2010.2216 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spark S, Lewis D, Vaisey A, Smyth E, Wood A, Temple-Smith M, … Hocking J (2015). Using computer-assisted, survey instruments instead of paper and pencil increased completeness of self-administered sexual behavior questionnaires. Journal of Clinical Epidemiology, 68(1), 94–101. doi: 10.1016/j.jclinepi.2014.09.011 [DOI] [PubMed] [Google Scholar]
- Spyridou A, Schauer M, & Ruf-Leuschner M (2015). Obstetric care providers are able to assess psychosocial risks, identify and refer high-risk pregnant women: validation of a short assessment tool – the KINDEX Greek version. BMC Pregnancy and Childbirth, 15(1), 41. doi: 10.1186/s12884-015-0462-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wright TE, Terplan M, Ondersma SJ, Boyce C, Yonkers K, Chang G, & Creanga AA (2016). The role of screening, brief intervention, and referral to treatment in the perinatal period. American Journal of Obstetrics and Gynecology, 215(5), 539–547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yan T, Curtin R, & Jans M (2010). Trends in income nonresponse over two decades. Journal of Official Statistics, 26(1), 145. [Google Scholar]
