Skip to main content
PLOS One logoLink to PLOS One
. 2022 Mar 3;17(3):e0264748. doi: 10.1371/journal.pone.0264748

“It just seemed like a perfect storm”: A multi-methods feasibility study on the use of Facebook, Google Ads, and Reddit to collect data on abortion-seeking experiences from people who considered but did not obtain abortion care in the United States

Heidi Moseson 1,*, Jane W Seymour 2,¤, Carmela Zuniga 2, Alexandra Wollum 1, Anna Katz 1, Terri-Ann Thompson 2, Caitlin Gerdts 1
Editor: Godwin Otuodichinma Akaba3
PMCID: PMC8893629  PMID: 35239738

Abstract

Most studies of abortion access have recruited participants from abortion clinics, thereby missing people for whom barriers to care were insurmountable. Consequently, research may underestimate the nature and scope of barriers that exist. We aimed to recruit participants who had considered, but failed to obtain, an abortion using three online platforms, and to evaluate the feasibility of collecting data on their abortion-seeking experiences in a multi-modal online study. In 2018, we recruited participants for this feasibility study from Facebook, Google Ads, and Reddit for an online survey about experiences seeking abortion care in the United States; we additionally conducted in-depth interviews among a subset of survey participants. We completed descriptive analyses of survey data, and thematic analyses of interview data. Recruitment results have been previously published. For the primary outcomes of this analysis, over one month, we succeeded in capturing data on abortion-seeking experiences from 66 individuals who were not currently pregnant and reported not having obtained an abortion, nor visited an abortion facility, despite feeling that abortion could have been the best option for a recent pregnancy. A subset of survey respondents (n = 14) completed in-depth interviews. Results highlighted multiple, reinforcing barriers to abortion care, including legal restrictions such as gestational limits and waiting periods that exacerbated financial and other burdens, logistical and informational barriers, as well as barriers to abortion care less frequently reported in the literature, such as a preference for medication abortion. These findings support the use of online recruitment to identify and survey an understudied population about their abortion-seeking experiences. Further, findings contribute to a more complete understanding of the full range of barriers to abortion care that people experience in the United States, and how these barriers intersect to not just delay, but to prevent people from obtaining abortion.

Introduction

In the United States, people have difficulty accessing abortion care because of a range of barriers, including cost of services and ancillary expenses; gestational age restrictions; legal restrictions; long distances to care; and lack of abortion-related information [112]. Although these barriers have negative consequences individually [5], people seeking abortion often experience them in combination, which compounds their effect [13]. These overlapping barriers result in higher costs, and thus may be particularly burdensome to the majority of US abortion patients who are low-income or live below the Federal Poverty Level [12].

Although many studies have examined barriers to abortion, most have recruited participants from abortion-providing facilities, thereby excluding people for whom barriers to care were insurmountable. As a result, existing research may underestimate the extent to which certain factors act as barriers to abortion, and there may be unidentified barriers to care or interactions between barriers. Recognizing the limitation of recruiting only from abortion clinics, a study in Louisiana and Maryland concluded that recruitment in prenatal clinics is a feasible way to find people who considered, but did not obtain, an abortion [14]; approximately one-third of participants considered, but did not obtain an abortion, citing personal preferences and policy-related barriers. However, even the expansion to prenatal clinics may still miss portions of the target population, including people who miscarry, who have not yet entered into care, or who feel they have no source of care or cannot access care without increasing risks of deportation or other privacy concerns. Addressing many of these concerns, a recent study recruited currently pregnant participants searching for information on abortion from Google Ads: at the one-month follow-up, less than half of participants (48%) had had an abortion [15,16].

The harms of not obtaining wanted abortion care are well established [1722]; yet, without understanding the full range and impact of barriers to abortion care, public health practitioners and policymakers cannot develop appropriate interventions to improve access. With this multi-methods feasibility study, we used three online platforms (Facebook, Google Ads, and Reddit) to recruit a narrow population of people who have been left out of most prior research on abortion access: namely, people who had considered, but not obtained an abortion, nor made it to an abortion clinic, and to assess their experiences with accessing abortion care. We hypothesized that: (1) we would successfully find and recruit members of this population using online platforms, and (2) would be able to capture new information on the number and nature of barriers to abortion care experienced by this understudied population. We have previously published results regarding the first hypothesis: we found that these platforms can indeed identify and recruit the target population [23]. This study reports results related to the second hypothesis: the ability to collect data on barriers to abortion care from this previously excluded population.

Materials and methods

Recruitment

Between August 15 and September 15, 2018, we recruited for a brief online survey through advertisements on Facebook, Google Ads, and two Reddit threads (birth control and menstruation; the abortion thread did not allow researchers to post for study recruitment). The one-month recruitment period mirrored a recent abortion-related study that recruited using Google Ads [23]. A digital marketing firm, BUMP Recruitment, managed the posting and purchasing of Facebook and Google Ads advertisements. Study authors managed the Reddit campaigns. Advertisements in English and Spanish (the two most widely spoken languages in the United States) read: “Complete a 5 minute survey about unplanned pregnancy and be entered to win $50 gift card” and offered a link to complete an “Unplanned Pregnancy Study.” The advertisements led to a study website with additional study information and a link to the eligibility screener. If eligible, individuals were offered the opportunity to complete the short online survey. At survey completion, participants could indicate their interest in an in-depth interview. Further details of recruitment methods and results have been previously published [23].

Survey details and analysis

To recruit the narrowly defined population of interest, the survey screener identified eligible participants who were: aged 15 to 49 years old and English or Spanish speaking US residents. In addition, respondents had to report at least one pregnancy in the past five years for which they felt abortion was the best option, but did not obtain an abortion (nor visit an abortion clinic) for any pregnancy in the past five years. Eligibility questions included: “Did you consider abortion for any of these pregnancies, even for just one second?” and “If it had been available to you, could abortion have potentially been the best option for any of these pregnancies?” An individual needed to respond “yes” to both of these questions to be eligible. The survey was administered via Qualtrics (Qualtrics, Provo, UT) and included up to 28 open- and closed-ended questions about experiences with unwanted pregnancy, considering abortion, obtaining abortion care, and sociodemographic characteristics (S1 File). Adaptive questioning reduced the number of questions based on responses; questions were displayed between three and 12 screens. To minimize fraudulent responses designed to avoid skip logic patterns, respondents could not go back to revise responses. Study team members pre-tested the questionnaire’s technical functionality before study launch.

Respondents reported number of pregnancies in the last five years, for how many pregnancies they considered abortion, for how many pregnancies abortion could have been the best option, and barriers they faced when seeking abortion care. In addition to selecting from pre-specified barriers, participants could write-in barriers and were asked, “Please tell us in your own words about why you did not obtain the abortion.” Participants who completed the survey were entered into a raffle for a single $50 gift card. For this feasibility study, we aimed to recruit a minimum of 10 participants per recruitment platform, or a minimum of 30 total participants across Facebook, Google Ads, and Reddit in the one-month period.

We conducted descriptive analyses of data from closed-ended survey questions using Stata version 15.1 (Stata, StataCorp, College Station, TX), and summarized open-ended question responses. Where appropriate, closed-ended responses were recoded based on open-ended responses. We report results in accordance with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [24].

In-depth interview details and analysis

All participants who completed the quantitative survey were asked if they were interested in participating in an in-depth interview; if interested, participants provided their name or pseudonym, email address or phone number, and preferred language. The research team contacted all participants who expressed interest to schedule an interview. Five cisgender women who identified as Afrolatina, Asian, white, and/or Latinx, fluent in English (and two also in Spanish), resided in California or Massachusetts, and were trained in in-depth interviewing, conducted all 30–60 minute interviews. Participants who completed the interview received a $25 gift card. As a formative study, we aimed to capture a small sampling of experiences to identify areas for further research, rather than a pre-specified sample size. We conducted an in-depth interview with all interested participants who responded to investigator outreach.

Using a semi-structured guide, interviewers asked participants about: their experiences with pregnancy; circumstances, emotions, and decision-making processes related to their most recent pregnancy for which abortion may have been the best option; factors or barriers that led them to not have an abortion; and, if abortion was considered for more than one pregnancy, any differences in circumstances compared to their most recent pregnancy for which they considered abortion; and sociodemographic characteristics. Interviews were conducted and audio-recorded via a secure online platform, and subsequently transcribed. We analyzed de-identified transcripts thematically, using an iteratively adapted codebook, which initially contained a priori identified codes. To ensure consistency, two transcripts were coded independently by three reviewers, and discrepancies were resolved prior to coding the remaining transcripts. We coded interviews in Dedoose (Dedoose Version 8.1.8 (2018) Los Angeles, CA).

The survey and in-depth interview guide were designed concurrently to complement one another. We analyzed survey data prior to interview data. We note convergence between survey and interview findings in the results. Along with quotes from open-ended survey questions or interviews, we include participants’ age, self-reported race or ethnicity, and U.S. Census Region for context.

Ethical review

To minimize risk of breach of participant confidentiality, all participants gave digital consent to participate in the survey. Similarly, participants gave verbal consent to participate in the interviews; verbal consent was audio-recorded in the audio file, and also documented in a printed consent form, signed and dated by the interviewer. This study, including informed consent processes, was approved by the Allendale Investigational Review Board.

Results and discussion

Survey results

Participant characteristics

Out of 1,254 eligibility screener submissions, the final analytic sample for these analyses included 66 participants (68.5% of those eligible) from 30 states (Fig 1). Participants were 29 years old on average, the majority identified as female and white, and eight (12%) as Hispanic or Latinx. Nearly two-thirds lived in the Midwest or South Census regions, and 53 (80%) had health insurance (Table 1). Most participants in this sample found the study through Facebook (86%). Nine participants (14%) skipped the final survey section on sociodemographic characteristics: two of these respondents took the survey in Spanish and seven in English.

Fig 1. Recruitment flow diagram.

Fig 1

Participant pathways from screening to survey to interview.

Table 1. Characteristics of eligible survey participants among an online sample of people who considered, but did not obtain, abortion care for a recent pregnancy (n = 66).
Participant Characteristics n %
Sex
    Female 57 86
    Missing 9 14
Age
    Average, SD 29 6
    Minimum, maximum 19 44
    Missing 0 0
Survey language
    English
    Spanish

63
3

95
5
Recruitment source
    Facebook
    Google Ads
    Reddit
    Friend shared the link
Census region*

57
2
6
1

86
3
9
2
    South 27 41
    Midwest 16 24
    West 9 14
    Northeast 5 8
    Missing 9 14
Relationship status
    Single 9 14
    In a relationship 21 32
    Married/civil union 26 40
    Separated/widowed/divorced 3 5
    Missing 9 14
Education
    Less than high school graduate 3 5
    High school graduate or GED 11 17
    Some college or Associates degree 27 41
    Bachelor’s degree or more 10 15
    Missing 9 14
Race **
    American Indian or Alaska Native 4 6
    Middle Eastern or North African 1 2
    Native Hawaiian or Pacific Islander 1 2
    White 49 74
    Missing 13 20
Hispanic
    Yes 8 12
    Missing 9 14
Proportion of the time you had enough money to meet basic living needs last month
    All/most of the time 35 53
    Some of the time/rarely/never 22 33
    Missing 9 14
Current insurance status
    Public/government 31 47
    Private 22 33
    Uninsured 4 6
    Missing 9 14

** Participants could select more than one response.

Barriers to abortion care

From the multiple choice list of barriers to abortion, all participants reported at least one listed barrier, and 52% (n = 34) experienced two or more, with 29% (n = 19) reporting three or more. The most commonly reported barriers were ability to pay (56%), concern about judgement (45%), and ability to locate a provider (35%) (Table 2), many of which were experienced simultaneously (Fig 2).

Table 2. Barriers to abortion access among an online sample of people who considered, but did not obtain, abortion care for a recent pregnancy (n = 66).
Past pregnancies
n (%)
Could not pay 37 (56)
Worried about judgment 30 (45)
Could not locate nearby provider 22 (33)
Could not get time off from work 9 (14)
Too far in pregnancy 6 (9)
Personally opposed to abortion 6 (9)
Could not find childcare 3 (5)
Another barrier 14 (21)

Note: Columns may not total 100%, as participants could select more than one response.

Fig 2. Overlapping barriers to abortion care.

Fig 2

A Venn diagram depicting overlap across the three most frequently reported barriers to abortion care among an online sample of people who considered, but did not obtain, abortion care for a recent pregnancy.

In open-ended responses, 19.7% (n = 13) of participants described additional reasons they did not obtain an abortion. Most (n = 12) noted personal reasons, including 12.7% (n = 8) who chose to continue the pregnancy, 3.0% (n = 2) who would “hate” themselves for having an abortion, 1.5% (n = 1) who “wouldn’t be able to handle it,” and 1.5% (n = 1) who felt it was wrong to terminate because they were marrying the other person involved in the pregnancy. Additionally, participants described wanting an abortion so they could more readily leave an abusive relationship, or to better care for the children they already had. Others elaborated on the overlapping barriers posed by policy requirements (the additional consultation visit), time off work, loss of wages, and also stigma. A participant from the South (white, 24 years old) described it: “The nearest provider was in another state. I would’ve had to have a consultation appointment before an abortion. It would have caused me to take too much time off work and lose too much money. Also many people already knew about the pregnancy and would’ve judged me.” Another respondent from the South (white, 28 years old) described informational barriers to abortion care stating that “I could not find a provider close to me that would answer my questions without an appointment. And research online gave websites that had false information presented like facts that basically scared me into changing my mind.” These findings were echoed and elaborated on in the in-depth interviews.

In-depth interview results

Participant characteristics

We conducted 14 interviews. Ten interviews were included for this analysis; we excluded four interviews from participants who reported a miscarriage as the primary reason that they did not obtain abortion. Nine participants disclosed their age at the time of their most recent pregnancy for which they considered abortion; ages ranged from 19 to 43 years (Table 3). Five participants discovered their pregnancy at or before 6 weeks gestation, while the other five discovered their pregnancies at 8, 9, 10, or 12 weeks gestation.

Table 3. Characteristics of eligible in-depth interview participants (n = 10), among an online sample of people who considered, but did not obtain, abortion care for a recent pregnancy.
N
Gender identity
    Cisgender woman 10
Age at time of interview, years
    Average 30
    Minimum, maximum 20, 45
Census region *
    Northeast 0
    South 4
    Midwest 4
    West 2
Education
    Less than high school graduate
    High school graduate or GED 2
    Some college or Associates degree 3
    Bachelor’s degree or more 5
Number of children
    0 0
    1 4
    2 2
    3 3
    6 1
Race **
    American Indian or Alaska Native 1
    Native Hawaiian or Other Pacific Islander 1
    White 8
Hispanic
    Yes 3
Age at first pregnancy
    17–19 4
    20–22 4
    23–25 2
Number of pregnancies in the past 5 years
    1 2
    2 3
    3 3
    4 2
Number of pregnancies in the past 5 years for which abortion could have been the best option
    1 8
    2 2

** Participants could select more than one response.

Barriers to abortion care

Consistent with survey results, participants described multiple barriers that prevented them from obtaining abortion care. In most cases, two or more barriers exacerbated one another.

Financial barriers. All but one participant mentioned the cost of abortion as a barrier to care. Participants described low hourly wages and a lack of savings that precluded their ability to pay for care, partners who did not or would not contribute to abortion costs, and having to decide between paying essential monthly bills and paying for an abortion. Some noted the irony of cost being a barrier, given the low cost of abortion relative to parenting. One participant from the Midwest (white, 17 years old at time of pregnancy) highlighted how lack of insurance coverage for abortion, possibly as a result of policy restrictions on public funding for abortion, made the cost of abortion too high:

[…] insurance did not cover [abortion] at all, so everything would be out-of-pocket. And any complications that arose from it would also not be covered by insurance. It sounds dumb at the time, but it was more expensive for me to go through with an abortion than it was to just keep the baby, which after you have the baby, obviously it’s a lot more expensive than just terminating a pregnancy. But it’s just one of those things that if you don’t have the [money] upfront for it, then they can’t really do it.

Participants also described how financial costs layered on top of other barriers, including a lack of information about abortion cost, gestational limits, stigma from partners or family, and a need for time off from work and/or childcare. Most participants did not have accurate information on the cost of abortion, either because clinics would not quote a price over the phone or they found conflicting information in online forums and Internet search results. While some participants were aware of abortion funds, one did not reach out to a fund due to uncertainty as to how it might work with her insurance. This lack of information further complicated participants’ planning. Several described that financial challenges were exacerbated by their understanding of the gestational limit on abortion in their state, meaning that they had a short window of time to gather the needed funds, and restrictions on public funding for abortion.

Policy-related barriers. Nearly all participants discussed policy-related barriers to care that affected their abortion-seeking experience; in particular, waiting periods, gestational limits, and restrictions on public funding for abortion. One participant explicitly stated that abortion-related laws acted as a “roadblock” to obtaining abortion, because she could not get information she needed to navigate the conflicting and varied restrictions by state. As a result of gestational limits, some participants felt time pressure to decide whether abortion was right for their pregnancy, believing that they only had a few weeks from a later discovery of the pregnancy until the gestational limit for abortion in their state. In some cases, participants’ understanding of the gestational limit in their state was not accurate, but still influenced their decision-making. One participant from the Midwest (Pacific Islander, 25 years old at the time of pregnancy) incorrectly believed she was only days away from the gestational limit, so ended up continuing the pregnancy because she could not make the decision quickly enough:

So I just wish that I had a little bit more time to think about it […]–when I was on week 11 of the pregnancy we were really on the fence about it and I just wish I had more time to think about it.

Another participant said that she and her partner could not obtain enough money for the abortion before the gestational limit. If that policy had not been in place, she felt she could have raised enough money for the abortion; but because she experienced both barriers–cost and the gestational limit–abortion became unobtainable. Another participant described the mandatory counseling and waiting period laws in her state as a deterrent to seeking abortion care. To comply with the required additional clinic visit, this participant would have had to pay for an overnight stay in a hotel, take more time off from work, and cover childcare costs–the waiting period policy thus worsened the financial burden of seeking care.

Logistical barriers. Many participants mentioned logistical barriers to abortion, such as an inability to take time off work or requirements to disclose to their employer the reason for time off, an inability to find childcare, or time required for travel. Participants discussed how policy and financial barriers exacerbated the barriers imposed by these logistical factors. For instance, the need for time off work and childcare was often compounded by large distances to the nearest abortion clinic; many reported drive times of 3.5–4 hours to the nearest facility and needing at least two nights in a hotel, which increased the ancillary costs of abortion and made it financially unobtainable. A participant from the South (white, 25 years old at the time of her pregnancy) described multiple such barriers: the logistical barrier of a four hour drive across state lines to the nearest abortion provider; the social barrier of anti-abortion stigma from her partner, sister, and other family members; the logistical barrier of her partner traveling for work for months at a time, leaving her alone with her children; and an additional logistical barrier of the inability to obtain childcare for her children, one of whom had special needs:

I still look at my [child] all the time and think like I wish I had–I know this sounds really awful–I just wish I would have tried harder [to have the abortion]. I wish I would have offered someone some money to watch my [other child] or tried to convince someone–tried to plead with my sister or someone to come out to watch him. …at the time, I did the best I could do, but … it just seemed like a perfect storm of everything coming together so that I couldn’t have the procedure done.

Informational barriers. Participants described a lack of information about abortion. The most frequently reported information gaps included not knowing the cost of abortion care, details about the procedure and what to expect, and where or how to find an abortion-providing facility. Other information gaps included knowledge of gestational age eligibility, any long-term health effects of abortion, and whether legal restrictions existed in their state. Many interviewees did not have all of the information about abortion they wanted. The information that participants obtained came from online searches and forums, and the experiences of friends. Even health care providers were not always a trusted or reliable source of information; several participants mentioned frustration with providers who never acknowledged abortion as an option, omitted information about abortion from counseling, or explicitly refused to provide information based on their personal opposition to abortion. One participant from the Midwest (white, 17 years old at the time of her pregnancy) described such an interaction, saying:

I mean, my doctor gives me every sort of treatment option for like my depression. She gave me options for hypothyroidism. She’s given me options for everything. But whenever it came to pregnancy it was ‘Congratulations,’ and that was it…. They just kind of skated on by and just figured that I was keeping the baby, and that was that.

Relatedly, two participants received counseling from Crisis Pregnancy Centers (CPCs) without knowing that CPCs did not provide abortions, and reported confusion as to why abortion was not mentioned. In these cases, social stigma toward abortion and assumptions about pregnancy desires directly influenced participants’ ability to access thorough and accurate information about abortion. Notably, two respondents stated that they might have made a different choice about their pregnancy had they known more about the cost of abortion, where they could obtain care, and up to what gestational age abortion was available.

Stigma barriers. Participants discussed strong perceived and felt abortion stigma from their partners, families, communities, and health care providers. The desire to avoid judgment and social ostracism delayed participants’ decision-making past gestational limits, or deterred them from seeking abortion. Participants described internalized stigma that stemmed from a religious upbringing and was perpetuated by their communities. This interplay of individual and community stigma complicated and lengthened participants’ decision-making, and restricted who they could approach for financial and informational support. A participant from the South (Hispanic, 25 at the time of the pregnancy) referenced financial barriers, lack of knowledge, and internalized stigma as barriers that prevented her from obtaining an abortion:

And just how do I drum up money for an abortion? Do I pay my rent or do [I] pay for an abortion? Because my understanding of it was that it was [a] rather expensive option. So I guess I feel like I may have been misinformed about the price at the time, but I pretty much just decided based on I guess social stigmas I had placed on myself; that I should have a baby who is now a toddler who is screaming outside of the door.

Abortion method preference. Some respondents stated that medication abortion was the only acceptable method of abortion for them. In particular, three participants described an aversion to surgical abortion. This preference made participants hesitant to seek abortion care; for some, policy- and information-related barriers intersected with abortion method preferences because they were afraid of being beyond the gestational limit for medication abortion, while for others information-related barriers intersected with preferences because of a misconception that a surgical procedure would be painful for the fetus. One participant from the South (Hispanic, 19 years old at the time of her pregnancy) highlighted how policy, information gaps, and method preference barriers interacted, saying:

…because I didn’t want to get an abortion past 12 weeks—or I think is it eight weeks that you can do the pill? I didn’t want to go past the pill mark basically, because I don’t think I could have gone through further in a pregnancy with the secondary option of abortion…So I just knew that for me, I had to make a choice within the time period for the pill—for the abortion pill.

Consequences of failure to obtain abortion

Across interviews, participants described varied ways in which carrying an unplanned pregnancy to term and raising an unexpected child impacted their lives. Some described shifts to education plans and work ability, and others described emotional and social consequences, including for their relationship with the child. One participant from the South (white, 25 years old at the time of pregnancy) described difficulty in bonding with the pregnancy and the baby:

“Sometimes it’s really hard to talk about because my–the one that I wanted the abortion for, he’s 2 and he’s running around the house right now. […] I never bonded with him during my pregnancy because I just didn’t want him. And it took a lot of–it was really a strain to try to bond with him after he was born. Even when I went into labor with him, I almost had him in the parking lot because I just didn’t even want to go in the hospital and do it all. I didn’t want to feed him and I didn’t want to hold him.[…] I just didn’t want to do it all over again.”

Discussion

In this multi-methods feasibility study, we evaluated whether it was possible to collect data on abortion-seeking experiences from an understudied population recruited via three online platforms. In a one-month recruitment period, we succeeded in identifying and enrolling 66 individuals that met these criteria, and in collecting data on the nature and extent of barriers to abortion care that they had faced. Specifically, participants described multiple, intersecting barriers to abortion care which ultimately deterred them from seeking, or prevented them from obtaining, an abortion in the United States. Future abortion access studies should sample not just from those who present at abortion-providing facilities, but from all those who consider abortion to better understand the magnitude and scope of barriers to care, and to identify the full range of possible intervention points for dismantling barriers and increasing access to abortion–a safe and essential public health service [25]. The online recruitment methods utilized in this study can be utilized to conduct this research.

Implementing these underutilized online recruitment approaches, we identified many barriers similar to those identified in prior research involving participants recruited from abortion clinics, such as the inability to pay for the abortion, long distances to the nearest provider, logistical difficulties, legal restrictions on abortion, and abortion stigma [110,13]. Similarly, barriers related to inaccurate information about gestational and other legal limits identified in this feasibility study build on prior research that explores information gaps related to finding and accessing abortion care [6,8]. The magnitude of the barriers identified in this feasibility study, however, and the extent of overlap across barriers may be of greater magnitude than previously measured: nearly one-third of participants reported experiencing three or more barriers. However, due to the nature of study questions, it is not possible to disentangle greater or lesser motivation to obtain abortion care from the magnitude of barriers faced.

Additionally, one barrier identified by this study–medication abortion preference–has not been widely emphasized in the existing literature. This preference was so strong as to drive some participants to continue an unwanted pregnancy and parent, rather than have a surgical abortion due to misconceptions about safety, future fertility implications, or fetal pain. Further, study findings highlight the burden of secondary abortion costs, the shortened timeline for abortion fundraising imposed by gestational limits (or individual misconceptions about gestational limits), and the powerful influence of fear of stigma from health care providers, partners, employers or family on deterring abortion seeking.

Of note, despite the advantage of high insurance coverage in the sample, participants experienced multiple barriers that did not just delay, but outright prevented them from obtaining an abortion. This is cause for concern given the established harms of being denied abortion care [1722], including ramifications for socioeconomic status, achieving aspirational one-year plans, perceived stress, future pregnancies, and risk of violence from the man involved in the pregnancy [1720].

Targeted interventions could reduce these barriers. To address information gaps, general health care providers–not just those family planning providers–could be trained to discuss pregnancy options, including abortion, for patients at routine annual exams and in contraception counseling, to ensure that people have abortion information before they need it [8]. Provider counseling could include information about abortion cost, gestational limits and other restrictions, and abortion funds to help cover the financial and practical costs of care. Similarly, advocates could focus on creating educational campaigns to spread awareness of abortion options and laws, as well as abortion funds, to reduce the number of people deterred from abortion-seeking because of a lack of information or funds.

Policy-related interventions could include the expansion of gestational limits for medication abortion, as the scientific evidence confirms that medication abortion is safe at a wider range of gestational ages than for which it is currently approved [26]. This would help ensure that a medication abortion preference is not a barrier to accessing facility-based abortion. Policymakers could also remove waiting period requirements and other laws that result in the need for multiple clinic visits, as these barriers deterred people from seeking care due to the additional monetary and time costs, and fear of stigma from repeated clinic visits. Other policy-related implications include the lack of insurance coverage for abortion, and the resulting financial strain for many participants that exacerbated other barriers.

Limitations

This feasibility study has limitations. First, the study population is unlikely to be representative of all individuals who considered but did not obtain abortion care. The narrowly defined analytic sample was small, and included no Asian or Black participants. This is in stark contrast to the racial and ethnic composition of abortion patients nationally, among whom approximately 28% are Black, 25% Hispanic, and 6% Asian or Pacific Islander [27]. For a more direct comparison, a recent study that recruited abortion-seekers using Google Ads had greater success in recruiting Black or African-American as well as Asian participants (28.7% and 2.1% of their sample, respectively)–suggesting gaps in our advertisement campaign, rather than the inability of these online methods to recruit a more racially diverse sample [15]. Indeed, the lack of racial and ethnic diversity in our sample may partially have resulted from the set of advertisements most frequently displayed by Facebook, which excluded the advertisement sets with images of Asian and/or Black individuals. Future studies could better control the diversity of advertisements displayed by creating dedicated campaigns for each advertisement with separate, dedicated funds, and prioritizing advertisement posting to groups and pages that center the experiences and interests of people who hold multiple racial and ethnic identities other than “white”.

Second, we saw a non-negligible degree of non-consent among eligible respondents. Approximately 31% of eligible screener respondents did not consent to participate; this proportion is similar to a recent study recruiting abortion seekers using Google Ads that saw 25% non-consent [15]. Understanding which respondents do not consent, and why, could add important information for assessing broader generalizability of these findings.

Third, recruitment may have been affected by retrospective reporting of pregnancy wantedness or desire for abortion. We know that retrospective assessment of pregnancy intention changes for those who are denied a wanted abortion in the clinic setting [28]. However, to be eligible for the current study, individuals had to express interest in a study about unplanned pregnancy and then report that abortion may have been the best option for at least one pregnancy. For pregnancies that participants continued and (many) went on to parent a resulting child, this is a high bar. Thus, we may have missed people with the experiences of interest, but who do not describe or recall their experiences in alignment with screening questions. Future studies should examine alternative screening questions to assess how such questions affect the sample, or prospective studies should be implemented.

Conclusions

Despite the above limitations, this feasibility study succeeded in collecting data from a narrowly defined and understudied population recruited via three online platforms, and the findings presented here can inform future research among larger samples to ensure greater diversity across participant experiences and identities, and to uncover lesser studied barriers to abortion care and the ways in which barriers interact to reinforce each other. Despite some challenges, online recruitment is often faster, less expensive, and has wider geographic reach than does in-person clinic-based recruitment [29]. Thus, investments in further improving and refining online recruitment strategies may generate high returns for research.

Supporting information

S1 File. Online survey instrument.

(DOCX)

S2 File. Semi structured interview guide.

(DOCX)

Acknowledgments

We would like to thank our colleagues, Sofia Filippa and Samantha Ruggiero, who together conducted five in-depth interviews for this study, as well as Margot Cohen for support in preparing the manuscript.

Data Availability

Data cannot be shared publicly because of identifiability concerns given nature of questions asked, and confidentiality promises made during the informed consent process. De-identified and pared down data can be made available to researchers who meet the criteria for access to confidential data and provide a reasonable request. Interested researchers, can request access to the data via addition to our IRB protocol by contacting our data access committee, chaired by Allie Wollum (awollum@ibisreproductivehealth.org), and by contacting the IRB for the study: the Allendale Investigational Review Board by phone at +1-860-434-5872 or via email (Rta1ali1@aol.com).

Funding Statement

HM, CG received a grant from the Society of Family Planning (grant#: SFPRF11-11) to fund this work (https://societyfp.org/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Gerdts C, Fuentes L, Grossman D, White K, Keefe-Oates B, Baum SE, et al. Impact of Clinic Closures on Women Obtaining Abortion Services After Implementation of a Restrictive Law in Texas. Am J Public Health. 2016;106(5):857–64. doi: 10.2105/AJPH.2016.303134 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Jones RK, Upadhyay UD, Weitz TA. At what cost? Payment for abortion care by U.S. women. Womens Health Issues. 2013;23(3):e173–8. Epub 2013/05/11. doi: 10.1016/j.whi.2013.03.001 . [DOI] [PubMed] [Google Scholar]
  • 3.Karasek D, Roberts SC, Weitz TA. Abortion Patients’ Experience and Perceptions of Waiting Periods: Survey Evidence before Arizona’s Two-visit 24-hour Mandatory Waiting Period Law. Womens Health Issues. 2016;26(1):60–6. Epub 2015/12/03. doi: 10.1016/j.whi.2015.10.004 . [DOI] [PubMed] [Google Scholar]
  • 4.Ralph LJ, King E, Belusa E, Foster DG, Brindis CD, Biggs MA. The Impact of a Parental Notification Requirement on Illinois Minors’ Access to and Decision-Making Around Abortion. J Adolesc Health. 2018;62(3):281–7. Epub 2017/12/19. doi: 10.1016/j.jadohealth.2017.09.031 . [DOI] [PubMed] [Google Scholar]
  • 5.Roberts SC, Gould H, Kimport K, Weitz TA, Foster DG. Out-of-pocket costs and insurance coverage for abortion in the United States. Womens Health Issues. 2014;24(2):e211–8. Epub 2014/03/19. doi: 10.1016/j.whi.2014.01.003 . [DOI] [PubMed] [Google Scholar]
  • 6.White K, deMartelly V, Grossman D, Turan JM. Experiences Accessing Abortion Care in Alabama among Women Traveling for Services. Womens Health Issues. 2016;26(3):298–304. Epub 2016/02/22. doi: 10.1016/j.whi.2016.01.003 . [DOI] [PubMed] [Google Scholar]
  • 7.Upadhyay UD, Weitz TA, Jones RK, Barar RE, Foster DG. Denial of abortion because of provider gestational age limits in the United States. Am J Public Health. 2014;104(9):1687–94. Epub 2013/08/21. doi: 10.2105/AJPH.2013.301378 ; PubMed Central PMCID: PMC4151926. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Kavanaugh ML, Jerman J, Frohwirth L. "It’s not something you talk about really": information barriers encountered by women who travel long distances for abortion care. Contraception. 2019;100(1):79–84. Epub 2019/04/14. doi: 10.1016/j.contraception.2019.03.048 ; PubMed Central PMCID: PMC6589392. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Fuentes L, Lebenkoff S, White K, Gerdts C, Hopkins K, Potter JE, et al. Women’s experiences seeking abortion care shortly after the closure of clinics due to a restrictive law in Texas. Contraception. 2016;93(4):292–7. Epub 2016/01/16. doi: 10.1016/j.contraception.2015.12.017 ; PubMed Central PMCID: PMC4896137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Jones RK, Jerman J. Time to Appointment and Delays in Accessing Care Among U.S. Abortion Patients. New York, NY, USA: Guttmacher Institute, 2016. [Google Scholar]
  • 11.Bearak JM, Burke KL, Jones RK. Disparities and change over time in distance women would need to travel to have an abortion in the USA: a spatial analysis. The Lancet Public Health. 2017;2(11):e493–e500. doi: 10.1016/S2468-2667(17)30158-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Jones RK, Ingerick M, Jerman J. Differences in Abortion Service Delivery in Hostile, Middle-ground, and Supportive States in 2014. Womens Health Issues. 2018;28(3):212–8. Epub 2018/01/18. doi: 10.1016/j.whi.2017.12.003 ; PubMed Central PMCID: PMC5959790. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Jerman J, Frohwirth L, Kavanaugh ML, Blades N. Barriers to Abortion Care and Their Consequences For Patients Traveling for Services: Qualitative Findings from Two States. Perspect Sex Reprod Health. 2017;49(2):95–102. Epub 2017/04/11. doi: 10.1363/psrh.12024 ; PubMed Central PMCID: PMC5953191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Roberts SCM, Kimport K, Kriz R, Holl J, Mark K, Williams V. Consideration of and Reasons for Not Obtaining Abortion Among Women Entering Prenatal Care in Southern Louisiana and Baltimore, Maryland. Sexuality Research and Social Policy. 2018;16(4):476–87. doi: 10.1007/s13178-018-0359-4 [DOI] [Google Scholar]
  • 15.Upadhyay UD, Jovel IJ, McCuaig KD, Cartwright AF. Using Google Ads to recruit and retain a cohort considering abortion in the United States. Contracept X. 2020;2:100017. Epub 2020/06/19. doi: 10.1016/j.conx.2019.100017 ; PubMed Central PMCID: PMC7286139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Upadhyay UD, McCook AA, Bennett AH, Cartwright AF, Roberts SCM. State abortion policies and Medicaid coverage of abortion are associated with pregnancy outcomes among individuals seeking abortion recruited using Google Ads: A national cohort study. Soc Sci Med. 2021;274:113747. Epub 2021/03/02. doi: 10.1016/j.socscimed.2021.113747 . [DOI] [PubMed] [Google Scholar]
  • 17.Biggs M, Upadhyay UD, McCulloch CE, Foster DG. Women’s mental health and well-being 5 years after receiving or being denied an abortion: A prospective, longitudinal cohort study. JAMA Psychiatry. 2017;74(2):169–78. doi: 10.1001/jamapsychiatry.2016.3478 [DOI] [PubMed] [Google Scholar]
  • 18.Upadhyay UD, Biggs MA, Foster DG. The effect of abortion on having and achieving aspirational one-year plans. BMC Womens Health. 2015;15(1):102. doi: 10.1186/s12905-015-0259-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Roberts SC, Biggs MA, Chibber KS, Gould H, Rocca CH, Foster DG. Risk of violence from the man involved in the pregnancy after receiving or being denied an abortion. BMC Med. 2014;12:144. Epub 2014/09/30. doi: 10.1186/s12916-014-0144-z ; PubMed Central PMCID: PMC4182793. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Foster DG, Biggs MA, Ralph L, Gerdts C, Roberts S, Glymour MM. Socioeconomic Outcomes of Women Who Receive and Women Who Are Denied Wanted Abortions in the United States. Am J Public Health. 2018;108(3):407–13. Epub 2018/01/19. doi: 10.2105/AJPH.2017.304247 ; PubMed Central PMCID: PMC5803812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Foster DG, Steinberg JR, Roberts SC, Neuhaus J, Biggs MA. A comparison of depression and anxiety symptom trajectories between women who had an abortion and women denied one. Psychol Med. 2015;45(10):2073–82. Epub 2015/01/30. doi: 10.1017/S0033291714003213 ; PubMed Central PMCID: PMC5004731. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Harris LF, Roberts SC, Biggs MA, Rocca CH, Foster DG. Perceived stress and emotional social support among women who are denied or receive abortions in the United States: a prospective cohort study. BMC Womens Health. 2014;14:76. Epub 2014/06/21. doi: 10.1186/1472-6874-14-76 ; PubMed Central PMCID: PMC4080695. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Moseson H, Wollum A, Seymour J, Zuniga C, Thompson T, Gerdts C. Comparison of Facebook, Google Ads, and Reddit for recruitment of people who were not able to obtain wanted abortion care in the United States. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34. Epub 2004/10/09. doi: 10.2196/jmir.6.3.e34 ; PubMed Central PMCID: PMC1550605. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.National Academies of Sciences E, and Medicine. The Safety and Quality of Abortion Care in the United States: The National Academies Press; 2018. [PubMed]
  • 26.Borgatta L, Kapp N, Society of Family P. Clinical guidelines. Labor induction abortion in the second trimester. Contraception. 2011;84(1):4–18. Epub 2011/06/15. doi: 10.1016/j.contraception.2011.02.005 . [DOI] [PubMed] [Google Scholar]
  • 27.Jerman J, Jones RK, Onda T. Characteristics of U.S. Abortion patients in 2014 and changes since 2008. New York, NY: Guttmacher Institute, 2016. [Google Scholar]
  • 28.Rocca CH, Wilson MR, Jeon M, Foster DG. Stability of Retrospective Pregnancy Intention Reporting Among Women with Unwanted Pregnancies in the United States. Matern Child Health J. 2019;23(11):1547–55. Epub 2019/06/27. doi: 10.1007/s10995-019-02782-9 ; PubMed Central PMCID: PMC6786959. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Moseson H, Kumar S, Juusola JL. Comparison of study samples recruited with virtual versus traditional recruitment methods. Contemp Clin Trials Commun. 2020;19:100590. Epub 2020/07/09. doi: 10.1016/j.conctc.2020.100590 ; PubMed Central PMCID: PMC7327265. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Patricia Ongwen

8 Jun 2021

PONE-D-20-38906

“It just seemed like a perfect storm of everything coming together so that I couldn’t have the [abortion]”: a multi-methods study on people who considered but did not obtain abortion care in the United States

PLOS ONE

Dear Dr. Moseson,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript is generally well-written, addressing an important topic and using novel strategies to recruit and collect data from women who considered but did not access abortion services. However, the writing can be improved and additional information provided to make the Methods and Results sections clearer to the readers. Kindly read the comments of the three independent reviewers and make the recommended revisions.

Please submit your revised manuscript by July 18, 2021. If you .will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Patricia Ongwen, MBChB, MPH

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that consent for the survey was described as written, but that the questionnaire was described as taking place online, therefore please clarify whether consent was digital. Please also state in the Methods:

- Why written consent could not be obtained from interview participants

- Whether the Institutional Review Board (IRB) approved use of oral consent for the interview, and digital consent for the survey

- How oral consent for the interview was documented

For more information, please see our guidelines for human subjects research: https://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research

3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information.

4. Please include a copy of the interview guide used in the study, in both the original language and English, as Supporting Information, or include a citation if it has been published previously.

5.  We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

6. We note that Figure 2 in your submission contain map images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

6.1.    You may seek permission from the original copyright holder of Figure 2 to publish the content specifically under the CC BY 4.0 license. 

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

6.2.    If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Abstract

No comments

Introduction

- Line 58: period at the end of the sentence. This study that is mentioned is also not cited.

Materials and Methods

- Recruitment

o Line 70: Short recruitment period? Why?

o Line 72: Space between Google and Ads

o Line 74: Why only in English and Spanish?

o Line 79-80: In a supplemental text or appendix? Where has it been described?

- Survey

o Line 84: Inclusion and exclusion criteria is unclear. A flow chart might be helpful. It’s unclear if individuals who have ever had an abortion during the study time frame was included. If subjects who had an abortion were excluded why? It is possible that circumstances changed.

o Line 92: Why could they not go back to revise their answers?

o Line 99-101: If part of the goal of this study was to also look at the feasibility of recruitment via Reddit, Facebook and Google Ads, that should be explicitly stated. Right now, it looks like it is just an excuse you provide to justify why you do not have a target sample size. The study should be explicitly stated as a an exploratory/feasibility study, especially because there

- In-depth interviews

o No comment

- Ethical review

o No comment

Results

- Survey results

o Participant characteristics

� Since you have a figure 1, Lines 137-142 can be shortened.

� You’ve highlighted the regions where participants are from in Table 1 so figure 2 seems unnecessary to me

o Barriers to abortion care

� Presentation of the results are a little confusing. Consider presenting the percentages primarily with n in parentheses

- In-depth interview results

o Participant characteristics

� No comments

o Barriers to abortion care

� No comments

o Consequences of failure to obtain abortion

� No comments

Discussion

I would provide more detail about the feasibility of your recruitment methods since you mention this in your methods section. How does it compare to other studies that recruit in this way? Are you able to recruit a generalizable population? You mention that it the recruitment was successful, but how do you know that? Do you have anything to compare it to? Your sample size is small, is this comparable to other studies that have used these recruitment methods. Elaboration is needed.

Reviewer #2: Overall, this feels like two papers in one: a methods paper about online recruitment methods for this target population and a descriptive/qualitative analysis of barriers experienced by this population. If the intention of this paper is to explicitly report the test of the hypothesis stated on p 2 line 64-67, (minor) revisions are needed to make this more explicit. The current emphasis is on describing the barriers experienced by this population, rather than drawing conclusions about how well these methods identified this understudied population AND/OR whether the (qualitatively or quantitatively) different experience of this population offers critical insights into barriers to care that might be missed by only studying populations captured by more traditional recruitment methods.

It wouldn't take much work to round out either or both of these analyses. For the methods portion, it would be nice to see a little more about the feasibility/lessons learned about these methods, perhaps after providing a little more data (e.g., the relative contribution and value of each recruitment source, measures of reach or efficiency like recruitment time, screen positive rate, missingness, representativeness, etc.) and comparing in some way to other recruitment methods. For the barriers portion, it would be nice to see some analytic conclusions about how the population composition and the barriers experienced by this population compare (in number or type) to other, better characterized populations desiring pregnancy termination. These comparisons could be narrative (rather than statistical) as long as they were well cited and clear.

Additional questions, thoughts, and suggestions are included in comments on the manuscript attached.

Reviewer #3: Overall comments

This is a well-written paper describing a project that recruit people who did not seek abortion care and present at a facility but for whom abortion might have been the best option if not for myriad barriers to accessing care, which is an understudied population. The authors expand on the literature by using novel recruitment strategies to recruit from non-clinical sources. Below I provide detailed feedback on the manuscript, which is mostly minor, but I would like some additional information on the performance of the specific recruitment approaches to strengthen this contribution to the literature to inform related work moving forward.

Specific comments

• Line 58: The authors mention a study that used Google Ads but provided no details or citation. Describe these authors’ experience/findings since that design seems the most relevant to this study.

• Line 72: Was there no Reddit thread for abortion specifically? If there was, why was it not used for recruitment? Would provide this information as readers may question why a more specific “abortion” Reddit thread was not used for recruitment.

• Line 78: Missing the word “to” in “the opportunity complete”.

• Line 98: Was there just one $50 gift card up for raffle? Clarify the incentive for the quantitative component.

• Line 108: Can authors clarify whether all participants who completed the quantitative survey were asked if they were interested in participating in the in-depth interviews? And then if they replied yes, investigators reached out to all of them? Unclear about eligibility/recruitment for this component.

• Line 125: Were quantitative data analyzed before conducting the qualitative interviews? Curious if those findings informed the development of the in-depth interview guide.

• Lines 140-142: From the 217 screened respondents who indicated abortion may have been the best options, how many were further screened out based on age, residence, abortion clinic presentation? Want to know among eligible respondents, what percent the 98 (and 90) represent. Also, in reviewing Figure 1 later in the manuscript, I don’t see the 217 number. Would ensure numbers reference in text reflected in Figure 1. The figure also makes clearer that 143 were actually eligible and 43 didn’t consent, so response rate among eligible respondents was 63% (90/1430?

• Table 1: Do authors have information on when the pregnancy about which they are discussing occurred? Would be particularly useful in interpreting the data on “proportion of time you had enough money to meet basic needs in last month” given that may not reflect the economic situation for many if their pregnancy was not recent.

• Table 1 and associated text: Since authors are using different recruitment strategies to identify an understudied population, would like some information on which of the three approaches were most effective. Authors could add information about recruitment source in Table 1 (Facebook, Google Ads, Reddit) and perhaps also describe broader response rates for each in relation to Figure 1, which just provides overall numbers. This can inform future research, which authors refer to at the end of the discussion but with little details re: which specific strategy worked best.

• Line 170-175: Are these all reasons that authors categorized as “another barrier”? Clarifying where they appear in Table 2 would be helpful.

• Table 3: Missing “0” in N column for “Less than high school graduate”

• Lines 210-212 and 217-219: Authors earlier indicated that all in-depth interview respondents determined their pregnancy before 12 weeks yet these sentences suggest they only had a “few weeks” to decide whether to abort before gestation age limits in the state precluded this option. While authors likely aren’t able to identify participants’ specific states, would be helpful to know what the gestation limits are since these limits seem particularly low if participants only had a few weeks to determine whether to have abortion/how to pay (or maybe I am interpreting “few” to strictly?). Obviously misinformation about gestational limits impacting their decision is a different matter.

• Lines 304-309: What a powerful quote.

• Discussion: Would highlight that although many of the barriers identified are similarly those identified in prior research involving patients recruited from clinics, these barriers may be even greater for the population in this study. Or that the motivation to obtain an abortion is lower. Can’t tell from these findings exactly the role that these two factors played but think it’s worth mentioning in the interpretation of study results.

• Line 355: “(e.g., 28)”? Did authors mean to include text after “e.g.”?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-20-38906_reviewer.pdf

PLoS One. 2022 Mar 3;17(3):e0264748. doi: 10.1371/journal.pone.0264748.r002

Author response to Decision Letter 0


11 Nov 2021

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Thank you for sharing these guidelines. We have gone through the manuscript and updated section headings and figure captions to match these requirements.

2. We note that consent for the survey was described as written, but that the questionnaire was described as taking place online, therefore please clarify whether consent was digital. Please also state in the Methods:

- Why written consent could not be obtained from interview participants

- Whether the Institutional Review Board (IRB) approved use of oral consent for the interview, and digital consent for the survey

- How oral consent for the interview was documented

For more information, please see our guidelines for human subjects research: https://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research

Thank you for this guidance. We have revised the methods section in lines 147-151 to address these points. It now reads as follows: “To minimize risk of breach of participant confidentiality, all participants gave digital consent to participate in the survey. Similarly, participants gave verbal consent to participate in the interviews; verbal consent was audio-recorded in the audio file, and also documented in a printed consent form, signed and dated by the interviewer. This study, including informed consent processes, was approved by the Allendale Investigational Review Board.”

3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information.

We are happy to provide this information. We have uploaded the survey and interview guides as supporting information.

4. Please include a copy of the interview guide used in the study, in both the original language and English, as Supporting Information, or include a citation if it has been published previously.

Per above, we are happy to do this and have uploaded the interview guide as supporting information.

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

We are unable to share data publicly because of ethical and legal restrictions imposed by the ethics committee that permitted data to be available only to members of the research team named in the institutional review board protocol; and further, because the data contain potentially identifying and sensitive participant information. Interested researchers can request access to the data via addition to our IRB protocol by contacting our data access committee, chaired by Allie Wollum (awollum@ibisreproductivehealth.org). We have added this information to our revised cover letter as well.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Thank you.

6. We note that Figure 2 in your submission contain map images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines:http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

6.1. You may seek permission from the original copyright holder of Figure 2 to publish the content specifically under the CC BY 4.0 license.

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following txt:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

Per comments from the reviewers, we have opted to remove the figure as it does not add essential information to the publication.

6.2. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

Per above, we have opted to remove the figure as it does not add essential information to the publication.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

Reviewer #3: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: No

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Abstract

No comments

Introduction

- Line 58: period at the end of the sentence. This study that is mentioned is also not cited.

Thank you for highlighting this. We have added a period to the end of the sentence, and added two references from the study mentioned, including a core finding. The added text reads: “Another recruited currently pregnant participants searching for information on abortion from Google Ads: at the one-month follow-up, less than half of participants (48%) had had an abortion.1,2”

Materials and Methods

- Recruitment

o Line 70: Short recruitment period? Why?

The one-month recruitment period mirrored a similar study conducted with online recruitment to measure self-managed abortion experiences. We were interested in learning how many people we could recruit in a short period of time. The sentence in lines 83-84 reads: ‘The one-month recruitment period mirrored a recent abortion-related study that recruited using GoogleAds.23”

o Line 72: Space between Google and Ads

We have added the space – thank you.

o Line 74: Why only in English and Spanish?

We fielded advertisements and bid on keywords in English and Spanish only, primarily because Spanish is the second most widely spoken language in the United States after English, and also based on research team language abilities, and the need to balance study team bandwidth and budget. Adding each additional language was not just a matter of translation – we also had to think about the words used to search in each language, many of which are not direct translations – rather, entirely different phrases in some settings. We have revised the text slightly to make this rationale more clear (lines 86-87): “Advertisements in English and Spanish (the two most widely spoken languages in the United States) read:”

o Line 79-80: In a supplemental text or appendix? Where has it been described?

Thank you for catching our omission of the appropriate reference here. We have previously described recruitment results in a published manuscript focused exclusively on the performance of each of the three recruitment platforms: Facebook, Google Ads and Reddit. We have revised the text to make this clearer, and added the reference to the publication. The revised text in lines 91-92 reads: “Further details of recruitment methods and results have been previously published.[23]”

- Survey

o Line 84: Inclusion and exclusion criteria is unclear. A flow chart might be helpful. It’s unclear if individuals who have ever had an abortion during the study time frame was included. If subjects who had an abortion were excluded why? It is possible that circumstances changed.

Thank you for highlighting that we could be clearer in this section. We have added a revised flow chart to clarify (Figure 1), and also revised the text. To the reviewer’s question: yes, people who ever had an abortion in the five year study time frame were excluded. The rationale was that we were trying to evaluate whether these online platforms could successfully recruit from a narrowly defined population that had previously been excluded from research. If a person had been to an abortion clinic in the past five years, there is a chance they were recruited into a clinic-based study about abortion access, and at least once had successfully navigated some of the barriers to care. For future research, the reviewer is completely correct that it is important to expand these narrow criteria to include anyone who sought abortion care (whether they obtained it or not) – because yes, circumstances can and do change and we want to capture the fullest breadth possible of experiences. For this particular study, however, because we aimed to test whether we could recruit this previously excluded population, we focused only on those who had not obtained an abortion at all in the past five years. The revised text is in lines 94-98 and reads: “To recruit the narrowly defined population of interest, the survey screener identified eligible participants who were: aged 15 to 49 years old and English or Spanish speaking US residents. In addition, respondents had to report at least one pregnancy in the past five years for which they felt abortion was the best option, but did not obtain an abortion (nor visit an abortion clinic) for any pregnancy in the past five years.”

o Line 92: Why could they not go back to revise their answers?

We programmed the survey in this way to prevent fraudulent submissions, i.e. respondents trying to “game” the survey to become eligible, continually changing their responses until they can get through as eligible and enter for a gift card. We acknowledge that this decision is a trade-off, because some respondents genuinely enter a response in error and wish to go back and fix it. However, with our experience with prior online surveys, this feature helps to minimize fraudulent submissions, and it is our hope that this balances out against the loss of any errors in data some participants might wish to correct. We do offer study team contact information at the end of the survey in case any participant wishes to contact us to correct an error in their survey data. We have added language to explain this in lines 105-106: “To minimize fraudulent responses designed to avoid skip logic patterns, respondents could not go back to revise responses.”

o Line 99-101: If part of the goal of this study was to also look at the feasibility of recruitment via Reddit, Facebook and Google Ads, that should be explicitly stated. Right now, it looks like it is just an excuse you provide to justify why you do not have a target sample size. The study should be explicitly stated as a an exploratory/feasibility study, especially because there

We appreciate this comment from the reviewer. This was indeed a feasibility study, as we address in the discussion, but it was an error to not introduce this earlier in the text. We apologize for the lack of clarity, and have revised throughout the text to make this clearer. For this particular line of text with regard to the sample size, we stated in our IRB protocol and grant proposal that we aimed to recruit at least 10 participants per recruitment method (or a minimum of 30 participants total across Facebook, Google Ads, and Reddit). We initially did not provide this detail in the manuscript, but the reviewer’s point emphasizes the appropriateness of sharing this information. Thus, we have revised the line in question to read: “For this feasibility study, we aimed to recruit a minimum of 10 participants per recruitment platform, or a minimum of 30 total participants across Facebook, Google Ads, and Reddit.” (lines 113-115).

- In-depth interviews

o No comment

- Ethical review

o No comment

Results

- Survey results

o Participant characteristics

� Since you have a figure 1, Lines 137-142 can be shortened.

This point is well taken. We have considerably shortened the text in the referenced lines. The revised text in lines 157-158 now reads: “Out of 1,254 eligibility screener submissions, the final analytic sample for these analyses included 66 participants (68.5% of those eligible) from 30 states (Fig 1).”

� You’ve highlighted the regions where participants are from in Table 1 so figure 2 seems unnecessary to me

We have removed Figure 2, per the reviewer’s point.

o Barriers to abortion care

� Presentation of the results are a little confusing. Consider presenting the percentages primarily with n in parentheses

We have revised the narrative description of these results in line with the reviewer’s suggestion, and present the percentages with n in parentheses, except where n’s are available in a table – then, we just present the percentages to simplify the text.

- In-depth interview results

o Participant characteristics

� No comments

o Barriers to abortion care

� No comments

o Consequences of failure to obtain abortion

� No comments

Discussion

I would provide more detail about the feasibility of your recruitment methods since you mention this in your methods section. How does it compare to other studies that recruit in this way? Are you able to recruit a generalizable population? You mention that it the recruitment was successful, but how do you know that? Do you have anything to compare it to? Your sample size is small, is this comparable to other studies that have used these recruitment methods. Elaboration is needed.

We are grateful to the reviewer for these comments. Per our responses to reviewer #2, we appreciate that our initial framing of the paper did not make it clear that the focus of this study is on the secondary hypothesis of the feasibility study: whether we could collect information on barriers to abortion care for this population, rather than on the primary hypothesis of whether these online platforms could successfully recruit this narrowly defined target population. We have revised the introduction and full text to make this focus on the secondary hypothesis and thus on data related to abortion-seeking experiences the clear focus, rather than the results on recruitment methods as those data have been previously published. We have added text in the abstract, introduction and the discussion to make this clearer. For instance, added text in the abstract (lines 23-25) reads: “We aimed to recruit participants who had considered, but failed to obtain, an abortion using three online platforms, and to evaluate the feasibility of collecting data on their abortion-seeking experiences in a multi-modal online study.” Added text in the intro in lines 71-77: “We hypothesized that: (1) we would successfully find and recruit members of this population using online platforms, and (2) would be able to capture new information on the number and nature of barriers to abortion care experienced by this understudied population. We have previously published results regarding the first hypothesis: we found that these platforms can indeed identify and recruit the target population.[23] This study reports results related to the second hypothesis: the ability to collect data on barriers to abortion care from this previously excluded population.” And finally, we also added text in the discussion (lines 334-337) to clarify this focus, which reads: “In this multi-methods feasibility study, we evaluated whether it was possible to collect data on abortion-seeking experiences from an understudied population recruited via three online platforms. In a one-month recruitment period, we succeeded in identifying and enrolling 66 individuals that met these criteria, and in collecting data on the nature and extent of barriers to abortion care that they had faced.”

Reviewer #2:

Overall, this feels like two papers in one: a methods paper about online recruitment methods for this target population and a descriptive/qualitative analysis of barriers experienced by this population. If the intention of this paper is to explicitly report the test of the hypothesis stated on p 2 line 64-67, (minor) revisions are needed to make this more explicit. The current emphasis is on describing the barriers experienced by this population, rather than drawing conclusions about how well these methods identified this understudied population AND/OR whether the (qualitatively or quantitatively) different experience of this population offers critical insights into barriers to care that might be missed by only studying populations captured by more traditional recruitment methods.

It wouldn't take much work to round out either or both of these analyses. For the methods portion, it would be nice to see a little more about the feasibility/lessons learned about these methods, perhaps after providing a little more data (e.g., the relative contribution and value of each recruitment source, measures of reach or efficiency like recruitment time, screen positive rate, missingness, representativeness, etc.) and comparing in some way to other recruitment methods. For the barriers portion, it would be nice to see some analytic conclusions about how the population composition and the barriers experienced by this population compare (in number or type) to other, better characterized populations desiring pregnancy termination. These comparisons could be narrative (rather than statistical) as long as they were well cited and clear.

We very much appreciate these comments from the reviewer about this manuscript feeling like two papers in one. Indeed, the larger objective of this feasibility study was twofold: (1) evaluate the ability of three online recruitment methods to identify a previously excluded population, and (2) explore whether this population might offer insights into previously missed barriers to abortion care. We have previously published a manuscript on the results of the recruitment evaluation comparing the three online platforms for recruitment in the Journal of Medical Internet Research (2020). The aim of this current manuscript is to explore the second part of our objectives: whether we could collect data on abortion-seeking experiences from this population that might offer new insights into barriers to abortion care. Thus, we have revised the introduction – especially the framing of our hypothesis as highlighted by the reviewer – as well as the rest of the paper and the discussion in particular to focus in on this secondary objective, and thereby hopefully eliminate some of the confusion. In this vein, we have also added discussion of analytic conclusions about how the population and barriers identified differ from prior studies, to the extent appropriate and warranted given the small sample size. These conclusions are located in the discussion section in several points, notably the second paragraph of the discussion, and the first paragraph of the limitations section. The text reframing the hypothesis and focus of the paper can be found in lines 23-25, 71-77, and 334-337, as quoted above in response to reviewer #1’s comments.

Additional questions, thoughts, and suggestions are included in comments on the manuscript attached.

Comments from manuscript copied here:

Abstract, lines 27-29: Framing the results in this way makes the study population look bigger than it actually was. I understand that part of the goal was to assess these digital recruitment methods, but the title and Discussion portion of the abstract are not focused on the method but instead on the content of the responses to these surveys & interviews.

We appreciate this feedback. The reviewer is correct that the primary goal of this paper is to present results from the surveys and interviews, not to evaluate the recruitment methods as that was done in a prior publication. Initially, we included the information on initial responses and exclusion due to ineligibility to highlight the relatively high proportion (18.2%) of respondents who reported not having obtained an abortion despite feeling it could have been the best option for their pregnancy. This is an important finding and suggests that many people might not be obtaining wanted abortion care. However, we very much appreciate the reviewer’s point that this might mislead readers that the manuscript will present results from a larger study sample than we analyzed for this particular manuscript. Thus, we have revised the text in the abstract to focus on the participants who completed the full survey, including those who participated in the in-depth interviews. The revised text in the abstract (lines 29-32) now reads: “For the primary outcomes of this analysis, we succeeded in capturing data on abortion-seeking experiences from 66 individuals who were not currently pregnant and reported not having obtained an abortion, nor visited an abortion facility, despite feeling that abortion could have been the best option for a recent pregnancy.”

Lines 53-57: May want to highlight why abortion clinics + prenatal clinics is still insufficient. Who does this miss? I would argue some of the people missed are also populations excluded from this study (e.g., people who miscarry, people who are currently pregnant but have not yet entered into care) as well as people who have no source of care or feel they can't access care without increasing risks (e.g., deportation or other privacy concerns).

This is an important suggestion. We have added text to the introduction where suggested to make this point. The added text in lines 59-62 reads: “However, even the expansion to prenatal clinics may still miss portions of the target population, including people who miscarry, who have not yet entered into care, or who feel they have no source of care or cannot access care without increasing risks of deportation or other privacy concerns.”

Lines 57-58: What did this study find that indicated the need for your study? Why wasn't it sufficient? Also, this is missing a citation (and a period).

Our study was conducted concurrently to the study cited; thus, both studies were responding to the same need to recruit from a broader population of people considering abortion, not just those who made it to care. In comparison to the cited study, however, our study recruited from a broader range of online sites (not just Google Ads, but also Facebook and Reddit). We have added the citation as suggested by the reviewer, and added more relevant context to the sentence. The revised text now in lines 62-64 reads: “Addressing many of these concerns, a recent study recruited currently pregnant participants searching for information on abortion from Google Ads: at the one-month follow-up, less than half of participants (48%) had had an abortion.[15, 16]”

Lines 64-67: If the intention of this paper is to explicitly report the test of this hypothesis, (minor) revisions are needed to make this more explicit. The current emphasis is on describing the barriers experienced by this population, rather than drawing conclusions about how well these methods identified this understudied population OR whether this population appears to experience qualitatively or quantitatively different barriers than the populations captured by more traditional recruitment methods.

This is a point well taken. We have revised the presentation of our hypothesis to more clearly delineate the overall hypotheses of the feasibility study, and which specific hypothesis is addressed in this manuscript. The revised text in the introduction in lines 67-77 reads: “With this multi-methods feasibility study, we used three online platforms (Facebook, Google Ads, and Reddit) to recruit a narrow population of people who have been left out of most prior research on abortion access: namely, people who had considered, but not obtained an abortion, nor made it to an abortion clinic, and to assess their experiences with accessing abortion care. We hypothesized that: (1) we would successfully find and recruit members of this population using online platforms, and (2) would be able to capture new information on the number and nature of barriers to abortion care experienced by this understudied population. We have previously published results regarding the first hypothesis: we found that these platforms can indeed identify and recruit the target population.[23] This study reports results related to the second hypothesis: the ability to collect data on barriers to abortion care from this previously excluded population.”

Lines 72: Assuming this is the missing citation above?

Actually – a different study that focused only on self-managed abortion, but we have added the appropriate citation to the text above as recommended. Thank you for flagging.

Lines 74: Given the focus on the recruitment method, more details may be warranted here. How were the Reddit campaigns handled?

The Reddit campaigns were handled by members of the research team reaching out to administrators of individual Reddit threads, asking permission to post, and then posting. Given that the previously published manuscript focuses in detail on recruitment methods and results, we opted not to add more detail here as this has been previously covered. To the reviewer’s point, we added language to refer readers to the prior publication where more details are provided on Reddit and other platform recruitment (lines 91-92).

Lines 79-80: Where have details on study recruitment been described?

Per above, we have added the citation.

Lines 92-93: any cognitive testing?

We did not conduct cognitive testing prior to launching the survey; however, short-answer survey questions allowed participants to provide context for how they interpreted and responded to key questions. We have uploaded the survey and interview instruments as supplemental materials for this paper.

Lines 100-101: How was reach measured? And what did you find?

Quantitatively, reach was measured in terms of the number of impressions and clicks on advertisements, reported in our prior publication. Qualitatively, reach was measured by whether we succeeded in recruiting anyone who reported not obtaining an abortion for a pregnancy in the past 5 years, despite feeling that abortion could have been the best option for that pregnancy. In short, it was a binary measure of whether we could identify people in this previously excluded population using each of the three platforms, or not. We report on these outcomes in more detail in our prior publication, and have revised the text in this line per a comment from reviewer #1, to add more detail about target sample size (lines 113-115).

Lines 109-110: Cisgender is called out here, but other characteristics of these interviewers might also be relevant. In particular, it could be imagined age, race, region, fluency in participants preferred language, and positioning about abortion might all relate participants comfort during the interview.

We agree. We did not know if additional detail would be welcome; but given this comment, have provided more detail on interviewer characteristics that could influence positionality vis a vis the interviewees. The revised text in lines 125-127 reads: “Five cisgender women who identified as Afrolatina, Asian, white, and/or Latinx, fluent in English (and two also in Spanish), resided in California or Massachusetts, and were trained in in-depth interviewing, conducted all 30-60 minute interviews.”

Line 138: If you still have access to these "duplicates", they may be worth looking at more closely. This target population is likely to overlap with those of lower SES which may also coincide with group living situations or and more public internet use (e.g., in libraries). How often were the pattern of responses different enough to likely be a different person?

We agree very much this comment, and it is a point we emphasize on our research teams. Correspondingly, we did not rely on IP address alone to identify duplicates. Rather, we flagged anyone with a duplicate IP address, and then carefully reviewed responses for submissions from the same IP address to determine whether it appeared to be a duplicate, or a unique respondent.

Line 142-145: These populations may also be worth looking at more closely. The miscarriage group are unlikey to be captured by other recruitment methods so may offer new information, and (maybe more pertinent) not all people clearly differentiate between miscarriage and abortion, particularly abortions "obtained" outside of a formal medical setting. Those that are currently pregnant (or anyone excluded because they did visit a facility and/or obtain an abortion) might be a good comparison group for how the primary target population may be similar or different (above and beyond any difference attributable to the novel recruitment method).

We appreciate these comments. We excluded those who reported a miscarriage because, in the few participants for which that was the case, most had scheduled abortion appointments and had no difficulties in doing so, but only reported not obtaining the abortion because they miscarried. In in-depth interviews, we probed as to whether they had done anything to bring on the “miscarriage” – and in all cases, it truly seemed to be a spontaneous miscarriage, rather than something brought on by use of mifepristone, misoprostol, or other means.

The suggestion to look at currently pregnant people/those excluded due to having visited a facility is an interesting one, and one we will explore in the full study being conducted now. Unfortunately, with just 11 and 13 people in each of these groups, the sample size feels too small to identify or draw meaningful conclusions about similarities or differences.

Lines 153-155: How does this compare to demographic characteristics of those obtaining abortions? Those having babies? The lack of Black and Asian women is noted in the discussion, but maybe worth an explicit comparison?

To the reviewer’s excellent suggestion, we have added information on how the racial composition of our sample compares to abortion patients nationally, as well as the only previously recruited sample of general abortion –seekers (recruited via Google Ads) in the discussion section (lines 384-396). This revised text reads: “This feasibility study has limitations. First, the study population is unlikely to be representative of all individuals who considered but did not obtain abortion care. The narrowly defined analytic sample was small, and included no Asian or Black participants. This is in stark contrast to the racial and ethnic composition of abortion patients nationally, among whom approximately 28% are Black, 25% Hispanic, and 6% Asian or Pacific Islander.[27] For a more direct comparison, a recent study that recruited abortion-seekers using Google Ads had greater success in recruiting Black or African-American as well as Asian participants (28.7% and 2.1% of their sample, respectively) – suggesting gaps in our advertisement campaign, rather than the inability of these online methods to recruit a more racially diverse sample.[15] Indeed, the lack of racial and ethnic diversity in our sample may partially have resulted from the set of advertisements most frequently displayed by Facebook, which excluded the advertisement sets with images of Asian and/or Black individuals. Future studies could better control the diversity of advertisements displayed by creating dedicated campaigns for each advertisement with separate, dedicated funds.”

Table 1:

- missing census region for 9 people: Can this be identified based on IP address?

Unfortunately, due to IRB protocols – we deleted the IP address after data were collected and cleaned (to protect participant identifying information), and thus cannot go back and recreate Census region.

- Missing relationship status and education: Was information missing from the same 9 people? If yes, any other notable differences in their pattern of responses? Could this have been a problem with the survey or internet stability or something? 14% missing is of interest to anyone wanting to duplicate these methods so you may want to explain this a little more.

Yes, these sociodemographic data were missing from the same nine people. We have reviewed their responses, and these participants answered all core survey questions but skipped the last section on sociodemographic characteristics which came at the end of the survey. These participants came from all three sites Facebook, Google, and Reddit, some took the survey in English and others in Spanish, participated on a range of dates (from 8/20 to 9/11), and provided detailed write-in responses to short answer questions describing different scenarios. Participants spent a range of time in the survey as well. All to say, these seem to be data from participants who either were interrupted, or decided to skip the sociodemographic questions out of privacy concerns or some other reason. We have added context on this to the first section of the results, in lines 161-163. The text reads: “Nine participants (14%) skipped the final survey section on sociodemographic characteristics: two of these respondents took the survey in Spanish and seven in English.”

Barriers to abortion care, line 161: how does this compare to types and number of barriers experienced by women captured by other recruitment methods?

This is a central point that the reviewer raises. We have added more direct commentary on this in the second and third paragraphs of the discussion section. Many of the barriers identified in this study have been identified in previous studies – however, the extent of overlap, and the nature of some of the barriers identified are novel. Some of this text includes the following (lines 345-356): “Utilizing these underutilized online recruitment approaches, we identified many barriers similar to those identified in prior research involving participants recruited from abortion clinics, such as the inability to pay for the abortion, long distances to the nearest provider, logistical difficulties, legal restrictions on abortion, and abortion stigma.[1-10, 13] Similarly, barriers related to inaccurate information about gestational and other legal limits identified in this feasibility study build on prior research that explores information gaps related to finding and accessing abortion care.[6, 8] The magnitude of the barriers identified in this feasibility study, however, and the extent of overlap across barriers may be of greater magnitude than previously measured: nearly one-third of participants reported experiencing three or more barriers.

Additionally, one barrier identified by this study – medication abortion preference – has not been widely emphasized in the existing literature. …”

182-183 re participant GA among IDI participants : Is this information available for the survey respondents? This would be another potential characteristic to compare between this and better characterized populations.

We did not collect data on gestational age at time of pregnancy discovery (or of abortion) among survey participants, unfortunately. We asked as to whether later GA was a factor in not obtaining abortion care, but did not inquire about specific gestational age.

Also, are more specific details about timing of discovery available for the interviewees? Big functional difference between discovery at 11 weeks and 6 days versus 8 weeks, though they are both <12 weeks. Especially because of the observation about medical abortion, if the data is there, might be worthwhile to look into how many discovered their pregnancy before 10 weeks.

We went back through the transcripts, and for the 10 interviews included for this analysis, participants discovered their pregnancies at: 4, 5, 6, 6, 6, 8, 8, 9, 10, and 12 weeks (mean of 7.4 weeks). So, all to say, about half discovered their pregnancies at 8 weeks or later, meaning they had a short window of time to schedule an appointment, raise funds, and manage the logistics of getting there with additional visits etc for a medication abortion within the 10 week window. To provide this context, we have added this detail to the IDI participant characteristics section in lines 203-205: “Five participants discovered their pregnancy at or before 6 weeks gestation, while the other five discovered their pregnancies at 8, 9, 10, or 12 weeks gestation.”

Age of IDIs at preg, lines 182-183: I think I understand why the lower bound is 19 (most recent versus earliest pregnancy for which abortion was considered), but it's a little confusing when the person who was pregnant at 17 is quoted below.

Yes, the reviewer is correct. In the interviews, we consistently asked about age at most recent pregnancy for which abortion was considered, but not all interviewees provided information on age at earliest pregnancy for which abortion was considered. Thus, we provide the data on most recent pregnancy for consistency, and age at other pregnancies when it was available.

Line 190: Given the emphasis on interaction or overlapping reasons, a proportional venn diagram or similar graphic might be nice? Either here, above, or both. Both would show similarities between the full survey sample and the interview sample.

Per this excellent suggestion, we created a venn diagram in Stata to depict the overlap across the three most frequently reported barriers in the survey. This diagram has been added as figure 2, and depicts overlap across financial, stigma, and provider location barriers. While this added figure does not compare interview barriers to those reported in the survey, it highlights the overlap of barriers participants reported in both data collection modes.

Discussion

Lines 311-312: Some points that could have been clearer in the discussion:

1. How well did you capture this population?

2. How does this population compare with other better characterized populations? Any observations here about whether the composition or the barriers are different for those that are delayed vs. those that are prevented?

3. What insights does this population offer into less well characterized barriers or the effect of multiple, intersecting barriers? (THIS POINT IS THE MOST COVERED, but still could be more direct.)

4. Was the information gained worthwhile given the effort/learning curve/limitations of these online methods?

We appreciate these clarifying questions from the reviewer as to the top-line conclusions that are most helpful to emphasize in the discussion. Per our clarification on the focus of this analysis on our secondary hypothesis – whether we could collect data on (potentially novel) abortion experiences from this narrowly defined target population – we have reframed the first section of the discussion to focus on answering questions 3 and 4 from the reviewer. Our previously published paper on recruitment results addresses or primary hypothesis (CAN we identify and enroll this population? Any members of it?) – which speaks to question #1. Given that this population has not been exhaustively documented or studied, we can’t necessarily definitively comment on how well or how representatively we captured this population, but we can and do address how this sample compares to one prior sample recruited in this way (lines 386-392): “This is in stark contrast to the racial and ethnic composition of abortion patients nationally, among whom approximately 28% are Black, 25% Hispanic, and 6% Asian or Pacific Islander.[27] For a more direct comparison, a recent study that recruited abortion-seekers using Google Ads had greater success in recruiting Black or African-American as well as Asian participants (28.7% and 2.1% of their sample, respectively) – suggesting gaps in our advertisement campaign, rather than the inability of these online methods to recruit a more racially diverse sample.[15]” Further, we’ve revised the discussion text to better show what insights this population offers to barriers to abortion care, and added additional language referenced in responses above and to subsequent reviewer comments to indicate why we feel the information gleaned was worth the effort, and how to overcome some of the limitations via lessons learned in this feasibility study.

Lines 352: What other reasons could there be? And how might any of them be addressed? Giving some thoughts on this latter question will help bolster confidence in these novel methods, unless the intention is to leave the reader with the feeling that (these) online methods are of limited utility.

We are fairly certain the failure resulted from the fact that Facebook did not evenly display our advertisements (which included a wide range of images with people presenting as various races/ethnicities). Instead, Facebook only displayed ~2 of the ads (instead of the 10 we developed) – and the 2 they displayed included fairly white and/or Latinx presenting people, and no images of Black or African American, or Asian, individuals. We have added to the discussion (in lines 394-397) a conclusion that future recruitment efforts should utilize individually funded advertisement campaign with dedicated funds for each advertisement individually which could combat this erasure of certain ads. The added text reads: “Future studies could better control the diversity of advertisements displayed by creating dedicated campaigns for each advertisement with separate, dedicated funds, and prioritizing advertisement posting to groups and pages that center the experiences and interests of people who hold multiple racial and ethnic identities other than “white”.” There is also a long standing, warranted mistrust of sexual and reproductive health research on the part of many communities – however, given that other studies have successfully recruited more racially diverse samples via similar platforms, we attribute this failure to the details of the advertisement display algorithm, rather than the recruitment platform itself.

Lines 354-355: Similar to above... This is everyone's concern about online methods, so it is definitely important to recognize, but probably equally important to directly address. Again, unless the intention is for the reader to conclude that valid, generalizable data is unikely to be derived from studies using online recruitment methods, you may need to give some information here as to why these methods should still be employed (and under what circumstances) and how to use the findings reported here.

This point is very well taken. We have revised this section of the discussion to provide more context and framing around the value of these online recruitment strategies, see lines 413-420: “Despite the above limitations, this feasibility study succeeded in collecting data from a narrowly defined and understudied population recruited via three online platforms, and the findings presented here can inform future research among larger samples to ensure greater diversity across participant experiences and identities, and to uncover lesser studied barriers to abortion care and the ways in which barriers interact to reinforce each other. Despite some challenges, online recruitment is often faster, less expensive, and has wider geographic reach than does in-person clinic-based recruitment.[29] Thus, investments in further improving and refining online recruitment strategies may generate high returns for research.”

Lines 369-371:What was the metric for success in this context?

Per a response to a prior comment in the methods section, the metric for success was a more or less binary measure of whether we could find and enroll people who fit the eligibility criteria (did not obtain an abortion for a pregnancy in the past 5 years, even though abortion could have been the best option for that pregnancy) using each of the three platforms. We were not sure if people would willingly / openly disclose that the abortion would have been the best option for a recent pregnancy (a pregnancy that they continued and in most cases, are now parenting a child from). We initially hoped to recruit at least 10 from each platform in a one month period, and we did. Further, we succeeded in capturing data from them about their abortion seeking experiences using these online platforms. To make this more explicit, we have revised the text here in lines 334-339 to read: “In this multi-methods feasibility study, we evaluated whether it was possible to collect data on abortion-seeking experiences from an understudied population recruited via three online platforms. In a one-month recruitment period, we succeeded in identifying and enrolling 66 individuals that met these criteria, and in collecting data on the nature and extent of barriers to abortion care that they had faced. Specifically, participants described multiple, intersecting barriers to abortion care which ultimately deterred them from seeking, or prevented them from obtaining, an abortion in the United States.”

Figure 1 flow chart:

1048 excluded due to age, no preg, etc: Would be great to know the breakdown here, i.e., how many were excluded for each reason?

We have revised Figure 1 to provide the detailed information on how many were excluded for each reason.

Screener submission: Would be great to know how many of these came from Google vs Facebook vs Reddit, and whether or not one source was better than another at capturing finding truly eligible people or produced a more diverse/representative final sample.

We have revised Figure 1 to indicate how many came from each platform for the initial screener submission. Beyond screener submissions, we do not break this information down further as it has already been published in our prior publication.

Reviewer #3:

Overall comments

This is a well-written paper describing a project that recruit people who did not seek abortion care and present at a facility but for whom abortion might have been the best option if not for myriad barriers to accessing care, which is an understudied population. The authors expand on the literature by using novel recruitment strategies to recruit from non-clinical sources. Below I provide detailed feedback on the manuscript, which is mostly minor, but I would like some additional information on the performance of the specific recruitment approaches to strengthen this contribution to the literature to inform related work moving forward.

Specific comments

• Line 58: The authors mention a study that used Google Ads but provided no details or citation. Describe these authors’ experience/findings since that design seems the most relevant to this study.

We thank the reviewer for catching our omission, and we have provided the citation and additional detail in the introduction (lines 64) and discussion (lines 392), per responses to above reviewer comments as well.

• Line 72: Was there no Reddit thread for abortion specifically? If there was, why was it not used for recruitment? Would provide this information as readers may question why a more specific “abortion” Reddit thread was not used for recruitment.

To the reviewer’s question: yes, there is a Reddit thread for abortion specifically, but it does not allow posts from researchers (or did not at the time). Further, as we wanted to capture people who failed to obtain an abortion, the threads that we selected were broader and likely to encompass people who considered but did not obtain abortion. We have added this in lines 81-83: “Between August 15 and September 15, 2018, we recruited for a brief online survey through advertisements on Facebook, Google Ads, and two Reddit threads (birth control and menstruation; the abortion thread did not allow researchers to post for study recruitment).”

• Line 78: Missing the word “to” in “the opportunity complete”.

We have added in the missing “to”; we thank the reviewer for catching this.

• Line 98: Was there just one $50 gift card up for raffle? Clarify the incentive for the quantitative component.

Yes, due to limited budget for this feasibility study, we offered one $50 gift card for raffle. We have clarified this in line 112-113: “Participants who completed the survey were entered into a raffle for a single $50 gift card.”

• Line 108: Can authors clarify whether all participants who completed the quantitative survey were asked if they were interested in participating in the in-depth interviews? And then if they replied yes, investigators reached out to all of them? Unclear about eligibility/recruitment for this component.

Yes, all participants who completed the quantitative survey were invited to participate in an interview, and anyone who expressed interest was contacted to set up an interview. Not all participants who expressed interest responded to our outreach. We have clarified this in the text in lines 122-125: “All participants who completed the quantitative survey were asked if they were interested in participating in an in-depth interview; if interested, participants provided their name or pseudonym, email address or phone number, and preferred language. The research team contacted all participants who expressed interest to schedule an interview.”

• Line 125: Were quantitative data analyzed before conducting the qualitative interviews? Curious if those findings informed the development of the in-depth interview guide.

The in-depth interview guide was designed at the same time as the quantitative survey instrument. Quantitative data, however, were analyzed prior to qualitative interview transcripts. We have clarified this in lines 142-143: “The survey and in-depth interview guide were designed concurrently to complement one another. We analyzed survey data prior to interview data.”

• Lines 140-142: From the 217 screened respondents who indicated abortion may have been the best options, how many were further screened out based on age, residence, abortion clinic presentation? Want to know among eligible respondents, what percent the 98 (and 90) represent. Also, in reviewing Figure 1 later in the manuscript, I don’t see the 217 number. Would ensure numbers reference in text reflected in Figure 1. The figure also makes clearer that 143 were actually eligible and 43 didn’t consent, so response rate among eligible respondents was 63% (90/143)?

We appreciate these comments on eligibility and where in the process participants were screened out. Our previously published publication contains some of this information, but we have also revised Figure 1 extensively to provide this requested detail. The revised figure is uploaded with this submission, and includes information on how many respondents came from each platform, as well as the numbers excluded for each particular eligibility criteria. To the reviewer’s specific question: the 217 number does not appear in the flow chart because people were additionally screened out after this question before getting to the final eligible number of respondents. Per the comment from the reviewer, we have also included the response rate (98/143=68.5% among eligible respondents) in line 158: “Out of 1,254 eligibility screener submissions, the final analytic sample for these analyses included 66 participants (68.5% of those eligible)…”

• Table 1: Do authors have information on when the pregnancy about which they are discussing occurred? Would be particularly useful in interpreting the data on “proportion of time you had enough money to meet basic needs in last month” given that may not reflect the economic situation for many if their pregnancy was not recent.

Unfortunately, we did not collect data on the specific year in which the pregnancy occurred – only that it was in the past five years. Thus, data about current financial situation may or may not have applied at the time of the pregnancy. That data is included in Table 1 to present a picture of the current profile of study participants.

• Table 1 and associated text: Since authors are using different recruitment strategies to identify an understudied population, would like some information on which of the three approaches were most effective. Authors could add information about recruitment source in Table 1 (Facebook, Google Ads, Reddit) and perhaps also describe broader response rates for each in relation to Figure 1, which just provides overall numbers. This can inform future research, which authors refer to at the end of the discussion but with little details re: which specific strategy worked best.

We very much appreciate this comment. We have added this initial information in the revised Figure 1, and also to Table 1 to provide information on how many were recruited from each platform, as well as how many among the final, eligible, included sample came from each platform.

• Line 170-175: Are these all reasons that authors categorized as “another barrier”? Clarifying where they appear in Table 2 would be helpful.

Yes, these reasons were categorized as “another barrier”. We have added a note in the text to make this clearer. The revised text in lines 182-183 reads “In open-ended responses provided for the “another barrier” item, 19.7% (n=13) of participants described additional reasons they did not obtain an abortion.” One participant of the 14 who marked this choice did not provide a write-in response; hence, 13 responses.

• Table 3: Missing “0” in N column for “Less than high school graduate”

We have added the 0 where indicated.

• Lines 210-212 and 217-219: Authors earlier indicated that all in-depth interview respondents determined their pregnancy before 12 weeks yet these sentences suggest they only had a “few weeks” to decide whether to abort before gestation age limits in the state precluded this option. While authors likely aren’t able to identify participants’ specific states, would be helpful to know what the gestation limits are since these limits seem particularly low if participants only had a few weeks to determine whether to have abortion/how to pay (or maybe I am interpreting “few” to strictly?). Obviously misinformation about gestational limits impacting their decision is a different matter.

Thanks for this important reflection and question. A few factors were at play in participants feeling that they only had “a few weeks” to gather funds for their abortion, two most frequently:

(1) Some participants found out about their pregnancies later than average, meaning that they truly only did have a few weeks until they reached the legal gestational limit in their state (on the lower end, 14 weeks in states like Indiana, and 20-24 weeks elsewhere).

(2) Some participants did not have accurate information on the gestational limit in their state, so BELIEVED that they only had a few weeks, when in reality, they would have had longer. However, because they thought they only had a certain window, they gave up pursuing abortion care feeling that they could not raise the needed funds in time.

Rather than naming individual states where participants came from, we’ve instead added some language to clarify how the two named factors above influenced people sense of time pressure in their abortion consideration. The revised text is in lines 233-235 and reads: “Several described that financial challenges were exacerbated by their understanding of the gestational limit on abortion in their state, meaning that they had a short window of time to gather the needed funds, and restrictions on public funding for abortion.”

• Lines 304-309: What a powerful quote.

Agreed.

• Discussion: Would highlight that although many of the barriers identified are similarly those identified in prior research involving patients recruited from clinics, these barriers may be even greater for the population in this study. Or that the motivation to obtain an abortion is lower. Can’t tell from these findings exactly the role that these two factors played but think it’s worth mentioning in the interpretation of study results.

The reviewer makes an important and relevant point. We have added this context to the discussion in lines 353-354: “However, due to the nature of study questions, it is not possible to disentangle greater or lesser motivation to obtain abortion care from the magnitude of barriers faced.”

• Line 355: “(e.g., 28)”? Did authors mean to include text after “e.g.”?

Apologies. We utilized the “e.g.” here to indicate that the reference we cite is one example of many references that could be cited – it is not an exhaustive list of references. However, as this may confuse readers, we have removed the “e.g.”

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 1

Godwin Otuodichinma Akaba

17 Feb 2022

“It just seemed like a perfect storm”: A multi-methods feasibility study on the use of Facebook, Google Ads, and Reddit to collect data on abortion-seeking experiences from people who considered but did not obtain abortion care in the United States

PONE-D-20-38906R1

Dear Dr. Moseson,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Godwin Otuodichinma Akaba, MBBS,MSc,MPH,FWACS

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

The recommended revisons have been extensively implemented.The work is now acceptable for publication.However author should please correct the statement on page 15 line 354-356:Furthermore, given that Internet users are not representative of the generalpopulation (e.g., 28 ), additional work is necessary to recruit for a study that could be generalized to the

larger population of US abortion seekers.

Comment:The e.g in bracket should be deleted

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: No

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: As per the authors, data cannot be made fully publicly available in accordance with the terms of their IRB approval.

Reviewer #3: The authors have thoroughly responded to my comments, and have similarly addressed other reviewer concerns. I believe it is acceptable for publication.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

Acceptance letter

Godwin Otuodichinma Akaba

24 Feb 2022

PONE-D-20-38906R1

“It just seemed like a perfect storm”: A multi-methods feasibility study on the use of Facebook, Google Ads, and Reddit to collect data on abortion-seeking experiences from people who considered but did not obtain abortion care in the United States

Dear Dr. Moseson:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Godwin Otuodichinma Akaba

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Online survey instrument.

    (DOCX)

    S2 File. Semi structured interview guide.

    (DOCX)

    Attachment

    Submitted filename: PONE-D-20-38906_reviewer.pdf

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    Data cannot be shared publicly because of identifiability concerns given nature of questions asked, and confidentiality promises made during the informed consent process. De-identified and pared down data can be made available to researchers who meet the criteria for access to confidential data and provide a reasonable request. Interested researchers, can request access to the data via addition to our IRB protocol by contacting our data access committee, chaired by Allie Wollum (awollum@ibisreproductivehealth.org), and by contacting the IRB for the study: the Allendale Investigational Review Board by phone at +1-860-434-5872 or via email (Rta1ali1@aol.com).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES