Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jun 19;15(6):e0234783. doi: 10.1371/journal.pone.0234783

Recruiters' perspectives of recruiting women during pregnancy and childbirth to clinical trials: A qualitative evidence synthesis

Vivienne Hanrahan 1,*, Katie Gillies 2, Linda Biesty 1
Editor: Tim Mathes3
PMCID: PMC7304625  PMID: 32559236

Abstract

Introduction

Research on research is key to enhancing efficacy in trial methodology. Clinical trials involving women during pregnancy and childbirth are limited, with a paucity of data guiding evidence-based practice. Following a prioritisation exercise that highlighted the top-ten unanswered recruitment questions, this qualitative evidence synthesis was designed specifically to focus on the barriers and enablers for clinicians/healthcare professionals in helping conduct randomised trials within the context of recruitment during pregnancy and childbirth.

Methods

The synthesis was undertaken using Thomas and Harden’s three stage thematic synthesis method and reported following the ENTREQ guidelines. Using a pre-determined SPIDER strategy, we conducted a comprehensive search of databases; Pubmed, CINAHL, PsycINFO, EMBASE, and grey searches for records until January 2019. We included all reports of qualitative data on recruiter’s experiences, perceptions, views of recruiting women during pregnancy and childbirth to clinical trials. Altogether 13,401 records were screened, resulting in 31 full-text reviews, of which five were eligible for inclusion. Quality was appraised using CASP. Data were extracted onto a specifically defined form. We used thematic synthesis to identify descriptive and analytical themes, and to interpret and generate theory. Confidence was assessed using GRADE-CERQual. The review protocol is publicly available (OSF https://osf.io/g4dt9/).

Results

Five papers (representing four individual studies) from two different countries were included. All studies focused on the experiences of trial recruiters in the maternity setting. We identified four analytical themes; Recruitment through a clinician’s lens, Recruiters judgement on acceptability, From protocol to recruiters lived experience, Framing recruitment in context. These were linked by an overarching theme combining beliefs and power.

Conclusion

The overarching theme combining beliefs and power links the experiences and perceptions of recruiters. This synthesis shows a gap between the trial design study protocol and the recruiter’s lived experience. Strategies such as collaborative trial design, mitigating gatekeeping behaviours, and training may support recruiters in their endeavour.

Introduction

Recruitment of participants to randomised trials is essential to their successful completion yet difficulties in recruiting remains a significant challenge to trialists [1]. Trials frequently fail to reach recruitment targets [2], more recently a UK study [3] found just 50% of trials achieve optimal participant numbers. Consequently, these difficulties produce underpowered results of reduced clinical meaning and precision, which negatively impacts the quality and generalisability of the study [4]. Poor recruitment is also associated with increased costs, both in terms of time and money, and contributing to ‘research waste’ [5]. Furthermore, failure to reach a recruitment target can pose an ethical issue, in that a participant is exposed to an intervention which then proves to be of indeterminate benefit [4].

In acknowledging the inefficiencies and waste in the field of clinical trials, Chalmers et al., suggest that research on research is key to enhancing efficacy in trial methodology [6]. An example of research on trial methodology is the Prioritising Recruitment in Randomised Trials Priority Setting Partnership Study (PRioRiTy PSP) [7], Healy et al. identified and prioritised unanswered questions around trial recruitment research. Following on from this work, Hennessy et al., [8] list significant opportunities for qualitative methodologies to contribute to better understanding of trial recruitment issues and suggest that the true value of such methodologies is yet to be fully realised. This qualitative evidence synthesis (QES) was designed to specifically focus on question five of the PRioRiTy Study; ‘What are the barriers and enablers for clinicians/healthcare professionals in helping conduct randomised trials?’ within the context of recruitment during pregnancy and childbirth, but could well have learning relevant to other top 10 areas.

We conducted a scoping search to help formulate the research question and identify key search terms. This revealed limited qualitative evidence on recruitment to trials during pregnancy and childbirth from either the woman’s or the recruiter’s perspective, as historically, these women had been excluded from participation in clinical research studies. Among the reasons for exclusion are; the potential risk of teratogenic effects to the foetus, adverse pregnancy outcomes [9], and the ‘vulnerability’ of the population [10], although more recent debate challenges the notion of vulnerability [11]. Mohanna & Tunna [12] highlight the unique position posed by recruitment during pregnancy and childbirth as two people are involved, the woman and her unborn baby. How the woman views the trial and the decision to participate or not may shift according to which lens (maternal or foetal) is applied. In addition to this, the father’s attitudes and views may also influence the decision-making process [12]. These combined factors have likely resulted in the underrepresentation of women during pregnancy and childbirth in clinical research [13, 14], and consequently little evidence to guide researchers on how to effectively recruit this cohort to clinical trials.

Patient experiences of recruitment to clinical trials has been the focus of previous QES [15] and one ongoing [16], both have included women during pregnancy and childbirth. However, the experiences of trial recruiters are largely absent from the literature on clinical trials during pregnancy and childbirth. Directed by the Priority study [7] question on barriers and enablers for healthcare providers in recruiting to RCTs we attempt to address this evidence gap, to gain a better understanding of the experiences and perceptions of recruiters across a range of maternity care settings and conditions, e.g. emergency and non-emergency. To our knowledge this is the first QES exploration in this area and provides a single point of access for synthesised evidence on recruiting this cohort, which can be used to inform decisions around trial methodology.

The aim of this QES is to explore the evidence on the recruiter’s experience and perceptions of recruitment during pregnancy and childbirth to trials. The specific objectives for this review are:

  1. To describe recruiters’ perceptions and experiences of recruiting women during pregnancy & childbirth (period extends from first trimester to six weeks postpartum) to clinical trials.

  2. To describe the recruiter’s perceptions and awareness of how their own role (e.g. clinical or non-clinical) may have an influence on recruitment.

  3. To explore the recruiter’s perceptions of how the ‘type of trial’ might have an influence on their experience of recruitment.

  4. To explore the setting and environment in which recruitment is undertaken, and the recruiter’s perception of what influence setting and environment has on their experience of recruitment.

Methods

The protocol for this QES, was considered by the team at PROSPERO as outside the scope of PROSPERO registration, as it does not address health outcomes. However, it is publicly available online (https://osf.io/g4dt9/). The ENTREQ statement [17] was used to guide the reporting of this QES as it is recognised to improve both the conduct and reporting of qualitative syntheses and enable the end-user to better understand the processes involved in developing a qualitative synthesis (See S1 Table).

Literature search and selection

Inclusion criteria

Types of studies. We included all qualitative studies, such as grounded theory studies, phenomenological studies, ethnographies, and case studies. Studies using qualitative methods for data collection, such as focus groups, face-to-face interviews, observations, arts-based methods or document analysis, and for data analysis such as content analysis, thematic analysis, constant comparison, or other qualitatively inspired analytical approaches were included. Editorials, commentaries, opinion papers, and studies that did not provide a transparent audit trail of the methods used were not be included. Only studies published in English were included as language nuances often present difficulty when interpreting concepts.

Types of participants. All studies focusing on the perceptions and experiences of recruiters when recruiting women and/or their partners during pregnancy and childbirth to clinical trials were included. No restrictions were placed on age, social status, ethnic background, or country of recruitment.

Study search strategy and process

An expansive rather than exhaustive search [18], was undertaken. This method of literature search is appropriate to QES as it affords the opportunity to continually redefine the research question and explores the emergence of research findings. The search strategy (See S1 Appendix) combines the five concepts of the SPIDER tool [19]:

Sample–Participants and Recruiters (clinical & non-clinical)

Phenomenon of Interest—Recruiting women to clinical trials during pregnancy & childbirth (clinical trials are defined as any clinical/medical research requiring consent to participate)

Design—“case study” OR observation OR “focus group*” OR interview* OR

Evaluation—experience* OR attitude* OR belief* OR perceive OR perception OR opportunit* OR opinion

Research Type—Qualitative OR “mixed-method” OR “mixed method” OR “multi-method” OR “Multi method”

Electronic searches

We conducted a tailored search using a combination of index terms and free-text words, of each of the following databases:

  • CINAHL (OvidSP) (1937 to 7th January 2019)

  • Embase (OvidSP) (1947 to 7th January 2019)

  • PubMed (OvidSP) (1948 to 7th January 2019)

  • PsycINFO (OvidSP) (1887 to 7th January 2019)

Using the table of terms (S1 Appendix), synonyms for the key search terms were entered into the database and truncated where appropriate. The individual searches for each SPIDER component were combined using the “OR” Boolean operator into a single group. Initially, the groups S and PI were combined with “AND” and then, in turn, “AND-ed” with the three methodological terms (namely “D OR E OR R”) as suggested by Cooke et al., [19]. The final list of citations were saved into Endnote (Thomson Reuters 2012) and screened for duplicates. Records of all searches in each database were maintained [20].

Searching other resources—grey literature

Relevant resources were identified through backward reference and forward citation searching of reference lists using Scopus, Web of Science and Google Scholar. In addition, other sources such as reports, dissertations, theses databases and databases of conference abstracts (ETHOS, ProQuest) were searched. Hand searches of relevant journals, authors of relevant studies and content experts were performed looking for additional published or unpublished work. Google Books was also searched to retrieve books and book chapters.

Study selection

All articles underwent a two-stage screening process (Fig 1). In stage 1: all citations were screened based on title and abstract. Rayyan QCRI software [21] was used by two review authors (VH & LB), independently to determine if the predefined set of inclusion criteria outlined by SPIDER [19] were met. In stage 2: full text of each included article was obtained, read in full and assessed for inclusion independently by both reviewers (VH & LB). Authors met regularly to discuss any differences in opinion were resolved through discussion.

Fig 1. PRISMA flow diagram.

Fig 1

Appraisal of the methodological limitations of included studies

The methodological limitations of the included studies were appraised using an adapted version of the Critical Appraisal Skills Programme [22]. This version, used by Ames et al., [23] and more recently in Karimi‐Shahanjarini et al., [24], offers a reasonable framework to assess the methodological limitations of primary qualitative studies in the absence of a gold standard approach.

The adapted tool includes the following eight questions:

  1. Are the setting(s) and context described adequately?

  2. Is the sampling strategy described, and is this appropriate?

  3. Is the data collection strategy described and justified?

  4. Is the data analysis described, and is this appropriate?

  5. Are the claims made/findings supported by sufficient evidence?

  6. Is there evidence of reflexivity?

  7. Does the study demonstrate sensitivity to ethical concerns?

  8. Any other concerns?/Overall assessment of methodological limitations

Quality assessment

Two authors (VH, LB) assessed the quality of included studies independently, appraisal was compared, and agreed by consensus (See S2 Table). The summary of methodological limitations is included in Table 2. No studies were excluded on the basis of quality assessment, rather the quality assessment served as an identifier of weak study methodology and facilitated the later confidence of findings assessment [25]. The Cochrane Qualitative and Implementation Methods Group, whilst acknowledging the subjectivity of critical appraisal, comment that the guiding principle of undertaking assessment of methodological strengths and weaknesses is transparency in the reporting of all decisions and to provide rationale to support them [26].

Table 2. GRADE-CERQual summary of qualitative findings.

Summary of Review Finding Studies Contributing to the Review Finding CERQual Assessment of Confidence in the Evidence Explanation of CERQual Assessment
Theme 1: Recruitment through a clinician’s lens
1. Recruiters in the maternity care setting were predominately clinicians. Primarily identifying as clinicians, recruiters prioritised clinical care over recruitment responsibilities. [3135] Moderate confidence Minor methodological concerns with four studies as reflexivity is not addressed. Moderate concerns about the fit with data in the primary studies. Minor concerns about adequacy as studies 2 & 3 based on same participants.
2. The duality of the clinician/recruiter role meant that recruiters were already busy juggling a high clinical workload, which allowed little time for the task of recruitment. In contrast, recruiters employed purely in a research capacity, experienced recruitment as unhurried and complementary to the women’s care experience [31, 32, 34] High confidence Only minor methodological concerns with all three studies as reflexivity is not addressed.
3. Recruiters made judgements, and assumptions, about pregnant women’s mental capacity and their ability to comprehend what trial participation involved. Recruiters regarded pregnant women as vulnerable and as such they believed women needed to be protected from research and therefore were less inclined to recruit them to trial. [31, 3335] High confidence Only minor methodological concerns with all four studies as reflexivity is not addressed.
4. Recruiters made assumptions of knowledge regarding how receptive pregnant women would be towards the trial, and also demonstrated an ‘ownership’ of women through the language they used. [34, 35] Moderate confidence Minor methodological concerns with both studies as reflexivity is not addressed. Moderate concerns regarding coherence and adequacy, however, both studies offered rich data.
Theme 2: The recruiter’s judgement of acceptability
5. Recruiters made a judgement on the clinical relevance and aim of the trial. Concordance between the recruiter’s values and beliefs, and the research goals, promoted their willingness to engage in recruitment. Whilst discordance, in turn, dissuaded recruitment. [3235] Moderate confidence Minor methodological concerns with four studies as reflexivity is not addressed. Moderate concerns regarding coherence and minor concerns about adequacy as studies 2 & 3 based on same participants.
6. It was important to recruiters that recruitment processes and protocols were pragmatic and an efficient use of the resources available. [33, 34] Moderate confidence Minor methodological concerns with both studies as reflexivity is not addressed. Moderate concerns about adequacy as two studies with moderately rich data.
7. Recruiters formed an opinion around the acceptability of the trial intervention based on its utility, potential benefits for stakeholders (women, clinicians, and the organisation of care), and potential to ultimately improve the current standard of care. [3235] High confidence Only minor methodological concerns with all four studies as reflexivity is not addressed.
8. Recruiters expressed optimism and hope for a successful trial outcome. Their engagement triggered a cyclical process where the recruiters ‘buy in’ to the trial generated recruitment, leading to a sense of achievement, which in turn provided positive reinforcement for their efforts and generated further recruitment. However, the cycle could also be reversed when declining recruitment rates lead to disengagement. [3234] Moderate confidence Minor methodological concerns with all three studies as reflexivity is not addressed. Moderate concerns about coherence and adequacy as studies 2 & 3 based on same participants.
9. Recruiters had strong ties with established clinical practice and were uncomfortable recruiting for a trial that moved away from their routine. [34, 35] Low confidence Minor methodological concerns with both studies as reflexivity is not addressed. Very minor concerns about coherence. Serious concerns about adequacy as both studies offered thin data.
10. The recruiter’s perception of risk (associated with the intervention) was fundamental in their judgement of acceptability, and therefore a key determinant in their willingness to engage in recruitment. Recruiters were more comfortable recruiting to a trial they considered to be low risk. [31, 32, 34, 35] High confidence Minor methodological concerns with four studies as reflexivity not addressed. Only minor concerns with coherence and adequacy.
Theme 3: From protocol to recruiter’s lived experience
11. Recruiters were also gatekeepers to potential participants and assumed the role of a protective advocate of women. Recruiters were paternalistic in the role and were seen to withhold trial information and steer women towards decision making which was aligned with their own views. Gatekeeping could also include protecting the interests of the trial [3135] High confidence Minor methodological concerns with five studies as reflexivity is not addressed. Only minor concerns with coherence and adequacy.
12. An additional layer of gatekeeping existed between midwife recruiters and recruiters from other professional backgrounds. In what was apparently a culturally appointed hierarchy, recruiters sought permission from the midwife (recruiter) to approach a potential participant. [31, 34] Low confidence Minor methodological concerns with both studies as reflexivity is not addressed. Serious concerns about adequacy as only two studies offered thin data.
13. Recruitment frequently involved a team approach, with often more than one recruiter over several encounters. Recruiters often engaged in an ‘exit’ encounter, post-trial, which appeared to bring closure to the trial recruitment process for both women and recruiters. [3133] Moderate confidence Minor methodological concerns with three studies as reflexivity is not addressed. Minor concerns about coherence and moderate concerns about adequacy as two studies offered moderately rich data.
14. There was no consensus reached amongst recruiters regarding either, the best method for communicating trial information to potential participants or at what time point the information should be given. [31, 33] Moderate confidence Minor methodological concerns with both studies as reflexivity is not addressed. Minor concerns about coherence and moderate concerns about adequacy as both studies offered thin data.
Theme 4: Framing recruitment in context
15. Recruiting pregnant women during an emergency or in a time-critical situation challenged recruiters to communicate effectively in a highly pressured time constrained environment. Recruiters were not comfortable with the task of obtaining informed consent in this environment. [31, 33] Moderate Minor methodological concerns with both studies as reflexivity is not addressed. Minor concerns with both coherence and adequacy as moderately rich data offered.
16. Training in methodological aspects of the trial and recruitment protocols provides recruiters with the knowledge and confidence to perform their recruitment task well. Recruiters recognised the need for regular structured multidisciplinary recruitment training, both initially, and throughout life of trial [31, 32, 34, 35] High confidence Only minor methodological concerns with four studies as reflexivity is not addressed and minor concerns with adequacy as one study offered moderately rich data.

Table format from Lewin et al., 2018 [36]

Public and patient involvement

This QES had no direct patient and public involvement but there was indirect involvement through other sources. The PRioRiTy Study [7], incorporated public and patient involvement (PPI) from inception to dissemination ensuring it’s meaningful and relevant contribution. This QES has advanced the work of Healy and colleagues [7] by synthesising the existing qualitative studies in relation to recruiter’s experiences and perceptions of recruitment during pregnancy and childbirth to trials.

Reflexivity

Reflexivity is a key component of qualitative research, and its use enhances the audit trail by providing records of personal responses and contributions of the review author and the larger team [27]. In keeping with quality standards for rigour in qualitative research, we considered our views and opinions on recruitment to clinical trial during pregnancy and childbirth, and the possible influences on the decisions made in the design and conduct of this QES, including the search strategy, inclusion decisions, synthesis and interpretation of the findings. VH, is a registered midwife, and has experienced the barriers clinical staff encounter when recruiting for trials and came to the project with prior beliefs about the complexity and interdependency of factors which impact the recruitment of pregnant women to clinical trials. LB, a lecturer of midwifery, was also informed by a clinical background in midwifery, is experienced in leading previous primary research with women and health professionals in Ireland. KG, is a clinical trial methodologist with a specific interest in how people make decisions about participation in clinical trials. The resolution of any disagreements regarding decisions made throughout the selection and review process has been documented, in the form of a reflexive journal, and forms part of the written audit trail.

Data abstraction and synthesis

Guided by the RETREAT framework [28], we undertook this qualitative evidence synthesis using a thematic synthesis method by Thomas & Harden [29]. This method was chosen as it draws on the conceptualisation and techniques of thematic analysis in order to facilitate the transparent identification and development of descriptive and analytical themes. Given the small number of papers, we used MS Excel to manage the data and opted to code and synthesise data manually. The thematic synthesis included three overlapping stages: line by line coding, developing descriptive themes, and generation of analytical themes. Papers were ordered alphabetically, and data extracted in order. All qualitative findings from the primary studies relevant to the research question were extracted. Findings were defined as any qualitative data describing a theory, new concept, theme, sub-theme or finding statement, presented in forms including, but not limited to, text, tables, diagrams, supplementary files located anywhere in the paper. Through a line-by-line coding process (VH) we developed ‘free codes’ (without hierarchical structure), this bank of codes grew as each paper was coded. An iterative process was then applied as data was examined and checked (VH, LB) for meaning and content, this process allowed the translation of codes and concepts between studies. As similarities and differences between codes became apparent, we grouped them into a hierarchical structure to form descriptive themes (VH, LB). Finally, we attempted to generate analytical themes from each category to go beyond the findings of the original studies into a higher order abstraction of the phenomena (VH, LB, KG) (see S3 Table). We looked for agreement and differences in views and perceptions of recruiters within and across settings such as hospital and community, recruiters professional and clinical backgrounds, and different types of trials.

Assessment of confidence in the review findings

We applied Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative research (GRADE-CERQual) [30] to the findings of the thematic synthesis. The GRADE-CERQual approach is based on four components which include: the methodological limitations of included studies, the coherence of the review findings and the adequacy of data contributing to the review findings and the relevance of the included studies to the review question. A ‘Summary of Qualitative Findings’ was derived from the findings of the thematic synthesis, as the research team summarised and identified the central idea of each finding, the authors then made an overall GRADE-CERQual assessment of confidence based on these findings. Each review finding was assessed by review authors (VH, LB), concerns regarding any of the four components was noted. Findings were discussed with the third author (KG) before applying the overall GRADE-CERQual assessment. We based our judgements on an initial assumption that all findings were ‘high confidence’ and were a reasonable representation of the phenomenon of interest, and then downgraded them accordingly if there were concerns regarding any of the GRADE-CERQual components. The ‘Summary of qualitative findings’ along with their GRADE-CERQual rating are shown in Table 2, in addition, the detailed ‘Evidence profile’ for each finding is shown in S4 Table.

Findings

This synthesis of qualitative evidence includes five papers, from four studies, all of which were identified through an electronic database search. Four are from the United Kingdom [3134] and one from The Netherlands [35]. Four of the studies were hospital based and involved trial recruitment in an emergency or time-critical situation [3133, 35], of these one was study involved a non-medicinal intervention [31], while the other three had CTIMP interventions [32, 33, 35]. Stuart et al.’s study was in a primary care setting, non-emergency, with a non-CTIMP intervention [34]. Most data were collected by individual interviews and/or focus group discussion. Table 1 details the characteristics of the studies included in the review.

Table 1. Characteristics of included studies.

Author & Year Country & setting Type of trial/intervention Aim Study populations & sample size Methodology/design Key Themes Limitations
Chhoa et al., 2017 [31] England Maternity hospital Cord Pilot Trial (immediate or deferred cord clamping in very preterm birth To assess clinicians’ views and experiences of offering these two consent pathways. Clinicians n = 7 Qualitative Interview—open ended questions Inductive thematic analysis Six Themes Results are based on a single trial, and other factors may be more important, or less important, in trials with different populations and different risk and benefit profiles.
N = 5 consultant (1) team approach to offering participation
neonatologists,
N = 3 neonatal or (2) consent form as a record
paediatric registrars, (3) consent and participation as a continual process
N = 5 neonatal nurses,
N = 4 midwives (4) different consent pathways for different trials
(5) balance between time, information, and understanding
(6) validity of consent
Hallowell et al., 2016 [32] England Maternity hospitals (8 pilot sites) Got-it trial is a randomised, placebo-controlled, double-blind, pragmatic UK-wide randomised controlled trial (RCT) involving women who have a retained placenta (RP) recruited from delivery wards in UK maternity hospitals. To explore staff’s and women’s experiences of, and views about, the information and consent pathway used in the pilot phase of the Got-it study. Staff n = 27 including clinical midwives, research midwives and obstetricians (consultants, registrars, specialist trainees) The study was informed by the principles of grounded theory Four Themes Confined to clinical staff who were involved in Got-it; therefore, it does not provide insight into the views of those who had declined to recruit to this trial
Accounting for uncertainty: initial perceptions of trial design
Familiarity breeds therapeutic optimism: perceptions of the study drug
Simultaneous data collection and analysis
Self-presentation; it is possible that the staff we interviewed tailored their accounts of trial involvement to present themselves as responsible and morally upstanding individuals.
Data were collected during telephone interviews (with one exception) Constructing therapeutic optimism: perceptions of clinical need
Interviews were carried out during the first few months of the Got-it trial; one might, therefore, expect high levels of TO to be reported at this point.
Maintaining therapeutic optimism and sustaining trial recruitment
Data from staff involved in one trial. staff feel and act very differently about different trials, difficult to generalise from these results.
Lawton et al., 2016 [33] England Maternity hospital Got-It Trial (see above dscription) To explore the experiences and views of women and trial staff about the information and consent pathway used within the pilot with close attention paid to the potentially challenging context within which recruitment took place. Women n = 22 Qualitative Study Design Seven Themes Could not evaluate whether, and how, pregnant women may be sensitised to the issues around RPs.
Staff n = 27 (n = 10 Doctors, n = 3 consultants, n = 6 Clinical MW, n = 2 Labour ward Lead, n = 11 Research MW) 1) Women’s views about the trial
In-depth interviews
Iterative approach that entailed simultaneous data collection & analysis 2) Women’s views about information delivery and giving informed consent Powerful endorsement for information to be given at the time of recruitment in simplified verbal and written forms, the relatively straightforward (and hence easy to explain) nature of the Got-it trial intervention needs to be taken into account.
3) Women’s experiences of, and views about, the information and consent pathway
Interviews of women and staff in parallel
Thematical analysis using method of constant comparison 4) Women’s views about improving the information and consent pathway: extending information-giving into the antenatal period
5) Women’s views about improving the information and consent pathway: extending information-giving into the postnatal
6) Staff views and experiences of recruitment and gaining informed consent
7) Staff views about the timing of information delivery and extending the consent pathway
Stuart et al., 2015 [34] England Community Setting (midwives from 6 of the 7 sites participating in the RCT (UK NHS Group Family Nurse Partnership Programme)) First Steps Randomised Controlled Trial of Group Family Nurse Partnership (gFNP). The multisite RCT aimed to examine if provision of gFNP, compared to routine antenatal and postnatal services, could reduce risk factors for child maltreatment (Barnes et al., 2013) To investigate the perceptions of community midwives about their role in identifying potential participants in early pregnancy for the first steps RCT trial of Group Family Nurse Partnership (gFNP). Community Midwives n = 13 Descriptive qualitative investigation Face-to-face, semi-structured, using interview Thematic content analysis Five Themes Small number of respondents may not represent all experiences, which would have been possible with a larger sample if the study had been funded to explore midwives' experiences in more depth.
1) Issues with the midwifery role in the trial process
(a) Insufficient information about their role
(b) Recruiting versus identifying trial participants
(c) Insufficient time for research activities
2) Issues with the criteria for trial participants
(a) Difference between identifying for FNP and gFNP
(b) Criteria too detailed
(c) Not a fit with their population
3) Reasons for potential participant refusal
(a) Pregnant women dislike groups
(b) Will not be able to travel to groups
(c) Targeting vulnerable group who do not want more support
4) Reservations about midwifery care as part of gFNP
(a) Concern about the midwifery care and system breakdown
(b) Concerns about self-care
5) Views about the gFNP programme in the future
(a) Potential for positive impact
(b) Possible identification in future mainstreaming
van der Zande et al., 2019 [35] Netherlands Two academic hospitals APOSTEL VI study assesses whether a cervical pessary prolongs pregnancy in women who have been admitted for threatened preterm birth but remained undelivered after 48 hours To explore what stakeholders think about inclusion of pregnant women in the APOSTEL VI study: a low-risk obstetrical randomised controlled trial (RCT). Healthcare professionals n = 14 (Gyn/Ob n = 9, Mw n = 5) Qualitative study design Four Themes (3+1) 1) Sample highly educated stakeholders regarding only the Dutch situation.
1) Motivations for participation
Semi-structured interviews 2) Gatekeeping
REC members n = 5 3) Counselling 2) Saturation number of 20 interviews was reached on group level, but not always on sub-group level.
One focus group discussion with Regulators 4) Interest in (routine) inclusion
Regulators n = 5
Pregnant Women n = 14 3) Only included pregnant participants who were recruited for the APOSTEL VI study, a group that consists of women that become sick during their pregnancy and who are recruited for a low-risk obstetric study.
4. No data from any representatives from a pharmaceutical company.

Sample sizes ranged from 13 to 27 (median = 20), with a total of 71 participants represented in this QES, two studies [32, 33] contained data from the same sample. Contributing to the sample were: clinical midwives (n = 28), research midwives (n = 11), obstetricians & gynaecologists (n = 19), neonatologists & paediatricians (n = 8) and neonatal nurses (n = 5).

Sixteen summary of qualitative findings statements (SQF) were gleaned from the synthesised evidence, these mapped onto four distinct themes (Fig 2): recruitment through a clinician’s lens (four SQF); recruiter’s judgement of acceptability (six SQF); from protocol to recruiter’s lived experience (four SQF); and framing recruitment in context (two SQF) (see Table 2). Exemplars of supporting data for each theme are provided in S5 Table.

Fig 2. QES framework.

Fig 2

Theme 1: Recruitment through a clinician’s lens

Recruiters, across all of the studies included for synthesis, were trained clinicians by background, however some (n = 60) remained in clinical roles providing maternity care, and other (n = 11) held research roles. The range of their professional backgrounds included midwives, neonatal nurses, neonatologists, obstetricians and gynaecologists (Table 1). Overall, trial recruitment relied on the cooperation of clinicians to undertake recruitment in addition to their clinical role. It was not clear from the studies whether clinicians had a choice or not in assuming this additional role or if it was an expectation within their clinical environment. Undertaking the role of recruitment was placed within the wider context of clinical duties, and as such, the task was viewed from a clinician’s perspective. This theme focuses on how the clinical role identity of the recruiter influenced their experiences of recruiting women to clinical trials.

1.1 Clinical care is the priority

The duality of the roles of clinician and recruiter led to competing considerations in the management of the recruiter’s workload. In all five of the studies in this synthesis, there was evidence that recruiters prioritised clinical care. Two studies [32, 34], were explicit in reporting “research was not a priority” and that recruiters considered recruitment secondary to clinical care.

Recruiters, commonly reported experiencing ‘pressure’ and feeling ‘burdened’ by the additional task of recruitment. This pressure was often attributed to managing a high clinical workload and staff shortages, which made their involvement in recruitment difficult.

In the majority of studies [3134], recruiters emphasised that their busy clinical workload did not allow time for recruitment. This sentiment was in complete contrast to the experiences of recruiters from the same study whose role was dedicated recruitment [31].

Whilst all of the recruiters across the studies included in this synthesis, engaged in their trial recruitment role, they primarily identified with their clinical role, and for the variety of reasons mentioned, prioritised the woman’s clinical care over their recruiting responsibilities.

1.2 Recruiter’s perception of pregnant women in clinical trials

The clinical background of the recruiter influenced their perception of pregnant women’s participation in clinical trials. Recruiters made judgements, based on their clinical assumptions, about a potential participant’s mental capacity (or lack of,) which determined, whether or not they engaged them in the recruitment process, and if so, how they went about it [31, 3335]. These judgements were based on their perceptions that pregnant women lacked the capacity to understand and make decisions around trial information.

The recruiter’s assumptions around women’s educational attainment was a factor in three studies [31, 33, 34]. Recruiters were concerned that the women, they perceived to have lower educational levels, would not be able to understand what trial participation involved [31]. Furthermore, in two of the studies recruiters expressed the view that potential trial participants did not have the ability to read or were illiterate [33, 34]. In many of the studies, recruiters regarded pregnant and child-birthing women as vulnerable and as such, expressed the need to protect them from research [31, 3335].

The recruiter’s experiential knowledge as a clinician influenced their perception of how receptive pregnant women would be towards the trial [34, 35]. For example, midwife recruiters in Stuart’s study [34], assumed that women would be disinterested in trial involvement, and because of this, despite meeting the inclusion criteria of the trial, they did not invite them to participate.

The recruiter’s perception of pregnant women was also apparent in the language they used when referring to potential participants. In two studies [34, 35], recruiters used language that implied ownership of the pregnant women in their care. For example, recruiters refer to women as ‘theirs’ [35], while two midwife recruiters in another study [34] are quoted referring to women as “my ladies…” and “our girls”. This suggests that recruiters assumed a deep knowledge of potential participants way of thinking.

From the studies included in this qualitative evidence synthesis, it is evident that recruiters could not ignore their maternity care professional status. It appears that their professional knowledge was an influencing factor in how they viewed potential participants and the task of recruitment, and consequently shaped the manner in which they went about it.

Theme 2: The recruiter’s judgement of acceptability

This theme focuses on the recruiter’s perception of the acceptability of both the trial and the intervention. Acceptability was founded on the recruiter’s opinion of the trial aim, methodology, and proposed processes (e.g. recruitment pathway), in addition to their opinion on the acceptability, or not, of the trial intervention itself.

2.1 Acceptability of the trial

It was widely recognised that the clinical relevance and nature of the research was important to recruiters and an influential factor in how they viewed the trial [31, 3335]. Recruiters were reluctant to seek trial participants if they deemed the research study was of little relevance to the women to whom they offered care [35]. Recruiters were curious to understand the aim and the rationale behind the trial, which assisted them in forming an opinion on the acceptability of the trial [32]. In determining the acceptability of the trial, recruiters needed their views to be in synchronicity with the aim of the trial and that the trial made astute use of scarce resources [34]. Furthermore, the recruiter’s judgement of trial acceptability also centred on the design of the trial processes such as the information and recruitment pathways. At times the recruitment protocols themselves were considered a hinderance to the recruitment, for example, eligibility criteria that was considered too stringent presented an obstacle for some recruiters [34]. While, recruitment protocols that made efficient use of time and resources were also fundamental to the recruiter’s judgement of acceptability [33].

The acceptability of the trial may also rest on the recruiter’s perception of what impact the trial outcome could have on their way of practice. Interestingly, authors of one study noted that recruiters were less likely to seek participants, if they considered the trial had the potential to undermine their clinical practice [34]. While judging the nature and methods of the trial was important to recruiters, so too was their assessment of the intervention itself, which proved equally important in their overall opinion on acceptability.

2.2 Acceptability of the trial intervention

In several studies, recruiters took a pragmatic view of the usefulness of the trial intervention [31, 3335]. The recruiters emphasised that it was important to them that the trial intervention had the potential to contribute to an improvement in care. The recruiter’s perception of the utility of the trial intervention appeared to be measured by several criteria, e.g. whether the potential outcome addressed an unmet clinical need [35], and whether receiving the trial intervention enhanced the woman’s care experience and, was of therapeutic benefit [33].

Recruiters also appeared to consider the trial intervention’s utility beyond improving care for women, e.g. identifying potential benefits of its use for clinicians, recruiters, and the organisation of care [32].

The recruiter’s judgement of acceptability of the trial intervention was confirmed by their ‘buy-in’ and enthusiasm for recruitment. Across three studies, recruiters shared their optimism for a successful outcome [32, 34, 35], which appeared to incentivise their recruitment efforts.

The phenomenon of ‘therapeutic optimism’, (namely, hoping that one will benefit from trial participation), was described in one of the studies as being tied to recruiter morale [32]. Suggesting that, in trials where recruiters witnessed an outcome that did not match their expectations, recruiters were less inclined to engage with recruitment. If recruiters judged the intervention not to be acceptable, they were less likely to recruit. In one study [35], recruiters showed reluctance to recruit to the trial because the intervention required a change in practice which contravened routine care. Recruiters were also less inclined to recruit to the trial if they considered the intervention suboptimal to existing care offered and expressed concern that trial participants could “be lost or missed” due to receiving the intervention [34].

Judgment on the acceptability of an intervention was also dependent on the recruiter’s perception of the risks involved in receiving it [31, 32, 34, 35]. Some recruiters were explicit in expressing their concern about the issue of safety for the women receiving the intervention [34].

In contrast, depended on the nature of the trial, recruiters believed there to be little to no risk in receiving the trial intervention they were involved with [31, 32].

In studies where the trial recruiter also delivered the trial intervention [31, 32], the concept of risk appeared especially important. The authors of one study remarked that because recruiters were familiar with the intervention, they more comfortable recruiting to and delivering a trial intervention as they perceived it to be low risk [32]. However, the same study also noted that as recruiters witnessed the apparent trial outcome, their perception of risk (associated with the intervention) could shift during the life of the trial [32].

The recruiter’s judgement on acceptability appears to centre around; their beliefs about the clinical relevance and utility of the trial, their ability to navigate the information and recruitment pathways, the utility of the intervention and their perception of risk associated with participating. When recruiters found these aspects acceptable, they were more likely to engage with recruitment to the trial.

Theme 3: From protocol to recruiter’s lived experience

The third theme focuses on the recruiter’s lived experiences and interactions with trial recruitment on a practical level. The synthesis of evidence reveals a discordance in the operationalisation of trial recruitment between the theoretical plans and the actual lived experience of delivering the recruitment phase of the trial. This theme considers how the recruiters self-perception as gatekeeper, and their recruitment encounters impacted on their experience of recruitment.

3.1 Recruiters as gatekeepers

In all five studies, the recruiters also performed the role of clinical gatekeeper (i.e. controlled access to the trial) of potential trial participants [3135]. The recruiters regarded their position of gatekeeper as advantageous for recruitment because they often had an established rapport with potential participants [31, 34, 35].

The significant contribution of the role of gatekeeper was explicitly acknowledged as essential to the recruitment process [32, 34]. Interestingly, one study observed an additional layer of gatekeeping existed between midwife recruiters and recruiters from other professional backgrounds. In what is apparently a culturally appointed hierarchy, recruiters sought permission from the midwife (recruiter) to approach a potential participant [31]. In their gatekeeper role, recruiters often assumed a protective stance towards pregnant women, by deliberately withholding trial information [33].

There is evidence that the recruiters made the conscious decision not to follow stipulated recruitment protocol and steered women towards making a decision that aligned with their own professional opinion [35]. Recruiters felt vindicated in their decision not to include all eligible women in the trial, as they were acting ‘in their patient’s interests’ or did so in an attempt “to protect the woman and her foetus and not overburden her” [33, 35]. One study author offered a potential explanation for the lack of adherence to protocol, suggesting clinicians may experience a loss of professional autonomy in the role of recruiter which triggered gatekeeper behaviour [34].

An additional aspect of gatekeeping was highlighted in van der Zande’s study, whereby recruiters also acted as gatekeeper for the trial. Some recruiters appeared protective toward the trial, and deliberately avoided some potential participants they considered not suitable trial candidates for fear they would make a “mess” of the study [35].

3.2 Recruitment encounters

The recruitment encounter did not always follow protocol design. The interactions between recruiter and potential trial participant could take on many guises, from formal counselling about the trial to a passing mention at a clinic appointment. The synthesised evidence showed the various methods of trial communication recruiters used during these recruitment encounters. Recruiters often employed a teamwork approach to trial recruitment, frequently this included two recruiters from different professional backgrounds [31, 32]. Furthermore, it was not unusual for recruiters to have more than one recruitment encounter (with the exception of emergency or time-critical trials, which are discussed in the next theme). In fact, successful recruitment of women during pregnancy to clinical trials, often necessitated several counselling encounters with different research team members [32].

The methods and merits of communication during these recruitment encounters was also important to recruiters. Some recruiters believed that counselling conversations were more conducive to decision making for women, than receiving written trial information, especially in an intrapartum context [31]. While other recruiters believed giving written trial information at the time of enrolment best served recruitment and were rigid in this view, despite learning this approach was contrary to women wishes [33]. Conversely, other recruiters were of the opinion that embedding trial information earlier in antenatal care would provide a helpful introduction for potential participants and may facilitate recruitment [31]. An unanticipated finding of the synthesis was the ‘exit’ encounter. By way of conclusion to the woman’s participation in the trial, recruiters made follow up visits. This is not something recruiters were expected or obliged to do, however, the post-trial visit appeared to draw to a close to the trial recruitment process for both women and recruiters [31, 33].

The recruiter’s lived experience of trial recruitment does not always follow protocol. The synthesis of data in this theme illuminates the impact that, the recruiter as gatekeeper, and the recruitment encounters has on trial recruitment.

Theme 4: Framing recruitment in context

This theme encompasses both the physical and virtual environments in which recruitment to clinical trials during pregnancy and childbirth occurred. The findings from this synthesis identified the role of the recruiter is framed by the context of the situation in which recruitment occurs, and by their research knowledge and understanding of the trial.

4.1 The situational context

The findings showed the importance of considering the situational context in which recruitment occurs and how this is reflected in the recruiter’s experience. Care in the maternity setting may be unplanned at times, and three papers included for synthesis are derived from trials conducted during an unplanned emergency or time-critical situation [3133]. In these papers, recruiters identified there were a number of key differences between ‘routine’ recruitment and recruiting pregnant women to trial during an emergency or in a time-critical situation [31, 33].

Firstly, recruitment to perinatal trials challenged recruiters to adapt how they communicated information about the trial to women and their families. Providing trial information in an inherently pressurised environment often necessitated that recruiters to be pragmatic with the amount of information they gave [31, 33]. Due to the time-critical nature of the trial, there may be a very limited time period in which discussion and decision-making can take place. Recruiters had to strike a balance between the time available and the amount of information given to women [33]. As a consequence of recruitment during an emergency or time-critical trial, recruitment and consent became a fluid encounter. The additional task of obtaining informed consent proved uneasy for some recruiters, as they called to question whether informed consent was even possible in such a time pressured context [31]. It was important to recruiters that they provide proof of a woman’s willingness to participate in the trial, emphasising that evidence of informed consent offered a means of legal protection should the validity of consent ever be challenged [31].

4.2 Research knowledge and understanding of the trial

The synthesised evidence highlighted that research knowledge and understanding of the trial was a factor in the recruiter’s ability to successfully recruit to the trial. Possessing a general methodological awareness of trial recruitment was helpful in facilitating recruiters to carry out their role [31, 34]. Indeed, this knowledge and understanding of the methodological aspects of recruitment, was a driver for participant recruitment [31]. Furthermore, knowledge of the particular trial in question, and having a sound understanding of its recruitment protocol gave recruiters certainty in their role and allowed them to be impartial in how they presented the trial to potential participants [35]. However, recruiters were not always equipped with sufficient trial information to perform their role. Ineffective methods for transferring knowledge were seen in Stuart’s study, where the trial relied on information cascading from clinical managers to recruiting staff, which resulted in misunderstanding and confusion about the trial, and the recruitment process, and consequently poor recruitment [34].

Recruiters recognise the need for structured multidisciplinary recruitment training, both initially, and throughout life of trial [31, 32, 34]. The regular rotation of staff in the maternity care space was acknowledged by recruiters as a hindrance to recruitment, and they were especially keen for on-going trial and recruitment training as a way to address the deficit [31].

In addition, training concerning the conceptional underpinnings of the trial could benefit recruiters by enabling them to recognise how clinical equipoise directs their approach to recruitment and, assist them in presenting trial participation objectively [32].

The synthesis findings showed that the recruiter’s experience and ability to recruit to clinical trials is framed by the context in which recruitment occurs. The situational context and the context of knowledge and understanding are influential factors in how recruiters perform their task.

Confidence in the findings

Our confidence in the findings of this review are based on our GRADE-CERQual [36] assessment which ranged from high to low. Findings were downgraded for methodological limitations due to the lack of reported researcher reflexivity across all studies. We typically downgraded a finding for concerns about coherence when there were some concerns about the fit between the data from primary studies. Downgrading due to data adequacy occurred when we had concerns about the richness or quantity of the data supporting a review finding. However, no findings were downgraded because of concerns about relevance.

Discussion

This is the first report of a qualitative evidence synthesis to focus solely on the recruiter’s perspectives of clinical trial recruitment of women during pregnancy and childbirth, and as such provides in depth analysis in this context. Our discussion considers the most salient findings threaded throughout the synthesis of evidence, linked by an overarching theme which combines beliefs and power. In other words, our review suggests that when it comes to trial recruitment, recruiters believe they know ‘best’. Recruiters often cite their assumed knowledge and beliefs regarding women’s preferences, capabilities and personal circumstances, alongside their judgements and assumptions in relation to the trial and the trial intervention. Our synthesis also highlights other considerations for recruiters which are woven into the overarching theme of beliefs and power which relate to the operationalisation or the ‘doing’ of trial recruitment.

Our synthesis shows recruiters frequently adopt a position of thinking they know ‘best’ in making judgements and assumptions, which were often overly negative which resulted in women being excluded from trial participation. Recruiter’s judgements were based on experiential knowledge, and were often harsh in nature regarding women’s mental capacity and educational attainment, which denied eligible women trial access. The implications of restricting trial access has potentially far reaching consequences for the health of pregnant women and their unborn babies, and limits the ability to make evidence-based clinical decisions [13]. Several recruiters referred to pregnant women as vulnerable and deserving of protection from the demands of trial involvement. This finding is commonly reported in the literature [37, 38], and may provide an important insight in understanding the cause of the underrepresentation of pregnant women in clinical research [9]. More recently, the concept of vulnerability in pregnancy is coming under challenge in the literature [11], suggesting that pregnancy should not be considered a deterrent for inclusion in clinical research, however, this concept may not have filtered through to clinical practice. Through their beliefs and professional judgement, recruiters assessed acceptability and risk, leading them to either embrace or reject the trial, and in some cases develop suspicions around it. For instance, the trial intervention could be perceived as a threat to practice for some recruiters that had strong ties with established clinical practices and were uncomfortable recruiting for a trial that moved away from their routine.

The overarching theme of beliefs and power is perhaps best illustrated in the language of paternalism that were evident in the narrative used throughout the review. The expressions of professional ownership, such as ‘my girls’ are particularly striking, although frequently used in the language of maternity care [39, 40], paternalistic references such as these are demeaning to women and inappropriate in any healthcare context. Further examples of paternalism were evidenced in the gatekeeping behaviours of recruiters. Many recruiters considered it their duty to act as a protective advocate for women–acting as gatekeeper between trial and woman. Although a low confidence finding, our synthesis also revealed a gatekeeping hierarchy which placed the midwife at the top, ahead of recruiters from other professional backgrounds. Findings from other research on trial recruitment has proposed that gatekeeping behaviours in recruitment may be triggered by the recruiter’s own implicit beliefs about the best interests of the patient, or in some cases, the best interests of the research [41]. While, recruiter’s framed paternalistic behaviour in this context as serving a moral good [42], it must be acknowledged as problematic as it derogates the woman’s capacity for self-determination and is ethically indefensible [43].

Drawing on Michel Foucault’s [44] notion that power is inseparable from knowledge, our synthesis identifies the authoritative power recruiters derived from their professional knowledge. For example, the professional clinical status of the recruiter utilises an existing power dynamic in their relationship with women, which enables recruiters to assert persuasive power and influence. However, the duality of the role presented a complexity, previously identified by Lawton and colleagues [45], where the blurring of boundaries between acting on clinical opinion and following recruitment protocols, meant clinician recruiters grappled with relinquishing power. Alternative explanations in the literature point to the lack of power as being responsible for waiving from ascribed protocols. For example, Benoit et al., [46] suggest in their study of the social organisations of maternity care, that midwives’ resistance to protocols was a response to feeling subjugated by the system in which they work and by disregarding protocol midwives exercised their power. The ‘hired hands’ phenomenon, identified by Roth [47], where recruiters feel they have no stake or indeed interest in the research they are working on, was found to be responsible for nonadherence to research protocol in Dyson & Dyson’s [48] investigation of midwives engagement in research activity. Similarly, recruiters from the medical profession also experienced a loss of power. A seminal review by Ross and colleagues [49] found the potential loss of clinical autonomy and decision-making power deterred doctors from engaging in clinical trials.

The overarching theme of beliefs is threaded through the ‘doing’ of recruitment, which was evidenced by the way recruiters acted with confidence, aligning their approach to recruitment with their own beliefs which often contradicted trial protocol. Our synthesis shows that in the maternity care setting, clinical care is frequently prioritised as the demands of a busy clinical workload often superseded recruitment work. It is worth noting that in stark contrast, recruiters employed solely in a research capacity, experienced recruitment as unhurried and complementary to the women’s care experience. Our synthesis highlights that recruiters are acutely aware of their knowledge needs, typically identifying their current training and knowledge levels as inadequate. It is clear that training in methodological aspects of the trial and in recruitment protocols gave recruiters the confidence and surety to perform their task. Whilst pragmatic and efficient recruitment processes are important to recruiters, no definitive method for recruitment was identified. The considerable variation in the approach to the recruitment encounter, ranging from team involvement to timing and exchanging trial information, is justifiable given the wide range of trial designs, point on pathway and setting where trial recruitment during pregnancy can occur.

Our synthesis revealed different types of trials presented various challenges. The recruiter’s discomfort with recruiting pregnant women during an emergency or in a time-critical situation centred around questioning the ethics and validity of obtaining informed consent in such an environment. These issues were also raised in a recent QES presenting the conflicts and ethical dilemmas faced by research nurses when recruiting under these circumstance, and the adverse impact this had on recruitment rates [50]. One potential solution, used in emergency paediatric trials, is deferred consent, which has proven to be an effective strategy for recruitment in high-stress environments [51].

The findings of our qualitative evidence synthesis, on recruiter’s perspectives of the recruitment of women during pregnancy and childbirth, are comparable with many of the findings from other reviews of recruiter’s experiences in different clinical areas [5254]. However, unlike these aforementioned reviews, randomisation and treatment preferences of potential participants were not discussed within the papers included in our synthesis. As the overarching theme illustrated, the recruiter’s knowledge and power are key, both in terms of facilitating recruitment but also, in creating barriers to recruitment through paternalistic and gatekeeping behaviours.

Implications for practice

Our synthesis has illustrated that there are a collection of factors contributing to the recruiter’s perspectives and engagement with recruitment that may be overlooked during the trial development stage. The trial design community should consider the development of trial protocols in collaboration with recruiters, this could address the gap between the recruitment protocol and lived experience. Examples of involving stakeholders at all phases of trial planning and conduct have proven effective in increasing both recruitment and retention [55]. We have illustrated that recruitment in maternity care occurs within a pre-existing power dynamic which potentially gives rise to behaviours such as gatekeeping and paternalism. In tackling the issue of gatekeeping behaviours, it has been suggested that trial designers recognise and adjust for this mitigating factor by using strategies such as a gatekeeping screening tool [42]. We believe it would also be reasonable to suggest that to improve recruitment, attention should be given to expanding the clinical trials knowledge base of recruiters. Providing comprehensive training for recruiters of all professional backgrounds, both on the operationalisation and conceptual underpinnings of the research would be particularly useful.

Implications for future research

Interventions such as QuinteT Recruitment Intervention [56] (a two-phase intervention applied to RCT’s encountering recruitment difficulties, which gathers evidence at the clinical site(s) about the recruitment processes and then produces a plan to address these difficulties), have been developed to optimise recruitment and address the knowledge training gap. However, QRI has not been applied to trials in the maternity care setting and therefore further research is needed to explore the application of such interventions in the maternity care space. Given the paucity of evidence in this area, there is a need for good quality, rigorous primary studies focusing on the recruiter’s perspective across various maternity contexts including multicentre trials in emergency and non-emergency situations, both CTIMP and non-CTIMP. On reflection of our findings, future research addressing other questions identified by the PRioRiTy Study [7] including; “What are the best approaches to ensure inclusion and participation of under-represented or vulnerable groups in randomised trials?”; and “What are the best approaches to ensuring manageable workloads for clinical and research staff responsible for recruiting members of the public to randomised trials?”, appear particularly pertinent in gaining a richer understanding of recruitment in maternity care trials. Furthermore, there is a clear need for future primary qualitative research to include evidence of reflexivity, to provide context to, and a deeper level of understanding of the interpretations and analysis made.

Strengths and limitations

The themes outlined in this review are a combination of descriptive and, at times, reaching into analytical level. Our ability to advance to a truly analytical level was somewhat curtailed by the number of studies (four) and therefore data available to the authors. A potential strategy to address this could be to seek extensive stakeholder input and the inclusion of a theory development stage to ‘bridge the gaps' with new hypotheses. Or alternatively, investigate if any of the primary studies were linked to interventions (i.e. trial sibling studies), granting the opportunity to make use of the data in its original context to explain how a specific trial recruited and the potential impact of staff behaviours on recruitment rates. A strength of our review is the comprehensive and systematic literature search, which identified a small number of qualitative studies of trial recruitment during pregnancy and childbirth (in both non-emergency and emergency settings) from the recruiter’s perspective. Following decisions made at the protocol stage, we limited the review to studies published in the English language. As the five papers in this review represented only four studies, it is possible there may have been some over representation of particular concepts and ideas. The studies included were from UK and Netherlands, therefore it should be noted these findings are reflective of a European perspective and are from two countries with universal healthcare. We are also cognisant that the available studies did not cover the full duration of pregnancy 0r cover the full variety of care settings, and therefore not all concepts may be adequately represented in this analysis. Nonetheless, a strength of the study was the team approach undertaken for the qualitative synthesis, and the rigorous and transparent adherence to reporting standards. We acknowledge that the gender and make-up of the research team (two midwives and a trial methodologist) working in Ireland and Scotland is likely to have influenced thematic synthesis. Undoubtably, our interpretation of the primary studies and approach to synthesis is a reflection of our professional and personal backgrounds. However, we consider our reflexivity throughout the data analysis process, has strengthened the validity and rigor of the QES.

Conclusion

Our QES is the first study to have synthesised primary qualitative evidence, from the recruiter’s perspective when recruiting women during pregnancy and childbirth to clinical trials. We have gained important new insights, that go beyond the sum of parts, in identifying the overarching theme combining belief and power, which underpins the experiences and perceptions of recruiters. The synthesised evidence shows there is a gap between the trial design study protocol and the recruiter’s lived experience of actualising of it. In focusing on strategies such as collaborative trial design, mitigating gatekeeping behaviours, and ensuring regular structured training in all aspects of clinical trial recruitment, recruiters may be supported and become more successful in their endeavour.

Supporting information

S1 Table. ENTREQ checklist.

(DOCX)

S2 Table. Critical appraisal skills programme.

(DOCX)

S3 Table. Themes matrix.

(DOCX)

S4 Table. CERQual evidence profiles.

(DOCX)

S5 Table. Exemplars of supporting data.

(DOCX)

S1 Appendix. SPIDER tool and search strategy.

(DOCX)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This paper forms part of doctorial research project supported by the Health Research Board Trial Methodology Research Network (of Ireland) PhD scholarship awarded to VH. https://www.hrb-tmrn.ie/. The manuscript represents the views of the named authors only. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Tudur Smith C, Hickey H, Clarke M, Blazeby J, Williamson P. The trials methodological research agenda: results from a priority setting exercise. Trials. 2014;15(1):32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7(1):9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Walters SJ, Bonacho dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276 10.1136/bmjopen-2016-015276 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Treweek S, Pitkethly M, Cook J, Fraser C, Mitchell E, Sullivan F, et al. Strategies to improve recruitment to randomised trials. Cochrane Database of Systematic Reviews. 2018(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Salman RA-S, Beller E, Kagan J, Hemminki E, Phillips RS, Savulescu J, et al. Increasing value and reducing waste in biomedical research regulation and management. The Lancet. 2014;383(9912):176–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. The Lancet. 2014;383(9912):156–65. [DOI] [PubMed] [Google Scholar]
  • 7.Healy P, Galvin S, Williamson PR, Treweek S, Whiting C, Maeso B, et al. Identifying trial recruitment uncertainties using a James Lind Alliance Priority Setting Partnership–the PRioRiTy (Prioritising Recruitment in Randomised Trials) study. Trials. 2018;19(1):147 10.1186/s13063-018-2544-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hennessy M, Hunter A, Healy P, Galvin S, Houghton C. Improving trial recruitment processes: how qualitative methodologies can be used to address the top 10 research priorities identified within the PRioRiTy study. Trials. 2018;19(1):584 10.1186/s13063-018-2964-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Frew PM, Saint-Victor DS, Isaacs MB, Kim S, Swamy GK, Sheffield JS, et al. Recruitment and retention of pregnant women into clinical research trials: an overview of challenges, facilitators, and best practices. Clin Infect Dis. 2014;59 Suppl 7:S400–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Blehar MC, Spong C, Grady C, Goldkind SF, Sahin L, Clayton JA. Enrolling pregnant women: issues in clinical research. Women's Health Issues. 2013;23(1):e39–e45. 10.1016/j.whi.2012.10.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.van der Zande ISE, van der Graaf R, Oudijk MA, van Delden JJM. Vulnerability of pregnant women in clinical research. J Med Ethics. 2017;43(10):657–63. 10.1136/medethics-2016-103955 [DOI] [PubMed] [Google Scholar]
  • 12.Mohanna K, Tunna K. Withholding consent to participate in clinical trials: decisions of pregnant women. British journal of obstetrics and gynaecology. 1999;106:892–7. 10.1111/j.1471-0528.1999.tb08426.x [DOI] [PubMed] [Google Scholar]
  • 13.Heyrana K, Byers HM, Stratton P. Increasing the Participation of Pregnant Women in Clinical Trials. JAMA. 2018;320(20):2077–8. 10.1001/jama.2018.17716 [DOI] [PubMed] [Google Scholar]
  • 14.Tooher RL, Middleton PF, Crowther CA. A thematic analysis of factors influencing recruitment to maternal and perinatal trials. BMC Pregnancy & Childbirth. 2008;8:36–. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.McCann S, Campbell M, Entwistle V. Recruitment to clinical trials: a meta-ethnographic synthesis of studies of reasons for participation. J Health Serv Res Policy. 2013;18(4):233–41. 10.1177/1355819613483126 [DOI] [PubMed] [Google Scholar]
  • 16.Houghton C, Dowling M, Meskell P, Hunter A, Gardner H, Conway A, et al. Factors that impact on recruitment to randomised trials in health care: a qualitative evidence synthesis. Cochrane Database of Systematic Reviews. 2017;Issue 5 5 10.1002/14651858.MR000045.(5) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Medical Research Methodology. 2012;12(1):181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Booth A. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Systematic Reviews. 2016;5(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Cooke A, Smith D, Booth A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012;22(10):1435–43. 10.1177/1049732312452938 [DOI] [PubMed] [Google Scholar]
  • 20.Butler A, Hall H, Copnell B. A Guide to Writing a Qualitative Systematic Review Protocol to Enhance Evidence-Based Practice in Nursing and Health Care. Worldviews on Evidence-Based Nursing. 2016;13(3):241–9. 10.1111/wvn.12134 [DOI] [PubMed] [Google Scholar]
  • 21.Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Systematic Reviews. 2016;5(1):210 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Programme CAS. CASP Qualitative Checklist 2018.
  • 23.Ames HM, Glenton C, Lewin S. Parents' and informal caregivers' views and experiences of communication about routine childhood vaccination: a synthesis of qualitative evidence. Cochrane Database Syst Rev. 2017;2:CD011787 10.1002/14651858.CD011787.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Karimi-Shahanjarini A, Shakibazadeh E, Rashidian A, Hajimiri K, Glenton C, Noyes J, et al. Barriers and facilitators to the implementation of doctor-nurse substitution strategies in primary care: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2019;4:CD010412 10.1002/14651858.CD010412.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Bengough T, von Elm E, Heyvaert M, Hannes K. Factors that influence women’s engagement with breastfeeding support: a qualitative evidence synthesis. Cochrane Database of Systematic Reviews. 2018; CD013115 (9). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Noyes J, Booth A, Flemming K, Garside R, Harden A, Lewin S, et al. Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings. J Clin Epidemiol. 2018;97:49–58. 10.1016/j.jclinepi.2017.06.020 [DOI] [PubMed] [Google Scholar]
  • 27.Sandelowski M. A matter of taste: evaluating the quality of qualitative research. Nurs Inq. 2015;22(2):86–94. 10.1111/nin.12080 [DOI] [PubMed] [Google Scholar]
  • 28.Booth A, Noyes J, Flemming K, Gerhardus A, Wahlster P, van der Wilt GJ, et al. Structured methodology review identified seven (RETREAT) criteria for selecting qualitative evidence synthesis approaches. J Clin Epidemiol. 2018;99:41–52. 10.1016/j.jclinepi.2018.03.003 [DOI] [PubMed] [Google Scholar]
  • 29.Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45 10.1186/1471-2288-8-45 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implementation Science. 2018;13(1):2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Chhoa CY, Sawyer A, Ayers S, Pushpa-Rajah A, Duley L. Clinicians' views and experiences of offering two alternative consent pathways for participation in a preterm intrapartum trial: a qualitative study. Trials. 2017;18(1):196 10.1186/s13063-017-1940-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hallowell N, Snowdon C, Morrow S, Norman JE, Denison FC, Lawton J. The role of therapeutic optimism in recruitment to a clinical trial in a peripartum setting: balancing hope and uncertainty. Trials. 2016;17:1–13. 10.1186/s13063-015-1128-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lawton J, Snowdon C, Morrow S, Norman JE, Denison FC, Hallowell N. Recruiting and consenting into a peripartum trial in an emergency setting: a qualitative study of the experiences and views of women and healthcare professionals. Trials. 2016;17(195). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Stuart J, Barnes J, Spiby H, Elbourne D. Understanding barriers to involving community midwives in identifying research participants; experience of the first steps randomised controlled trial. Midwifery. 2015;31(8):779–86. 10.1016/j.midw.2015.04.011 [DOI] [PubMed] [Google Scholar]
  • 35.van der Zande ISE, van der Graaf R, Oudijk MA, van Vliet-Lachotzki EH, van Delden JJM. A qualitative study on stakeholders' views on the participation of pregnant women in the APOSTEL VI study: a low-risk obstetrical RCT. BMC Pregnancy Childbirth. 2019;19(1):65 10.1186/s12884-019-2209-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Lewin S, Bohren M, Rashidian A, Munthe-Kaas H, Glenton C, Colvin CJ, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 2: how to make an overall CERQual assessment of confidence and create a Summary of Qualitative Findings table. Implement Sci. 2018;13(Suppl 1):10 10.1186/s13012-017-0689-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Sheppard MK. Vulnerability, therapeutic misconception and informed consent: is there a need for special treatment of pregnant women in fetus-regarding clinical trials? J Med Ethics. 2016;42(2):127–31. 10.1136/medethics-2014-102595 [DOI] [PubMed] [Google Scholar]
  • 38.Daly D, Hannon S, Brady V. Motivators and challenges to research recruitment—A qualitative study with midwives. Midwifery. 2019;74:14–20. 10.1016/j.midw.2019.03.011 [DOI] [PubMed] [Google Scholar]
  • 39.Mobbs NW, C. Weeks, A D. Humanising birth: Does the language we use matter? [Opinion]. 2018 [updated 8 February 2018. 8 February 2018:[Available from: https://blogs.bmj.com/bmj/2018/02/08/humanising-birth-does-the-language-we-use-matter/.
  • 40.Furber CM, Thomson AM. The power of language: a secondary analysis of a qualitative study exploring English midwives' support of mother's baby-feeding practice. Midwifery. 2010;26(2):232–40. 10.1016/j.midw.2008.05.003 [DOI] [PubMed] [Google Scholar]
  • 41.Newington L, Metcalfe A. Researchers' and clinicians' perceptions of recruiting participants to clinical research: a thematic meta-synthesis. J Clin Med Res. 2014;6(3):162–72. 10.14740/jocmr1619w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Snowden A, Young J. A screening tool for predicting gatekeeping behaviour. Nurs Open. 2017;4(4):187–99. 10.1002/nop2.83 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Sharkey K, Savulescu J, Aranda S, Schofield P. Clinician gate-keeping in clinical research is not ethically defensible: an analysis. J Med Ethics. 2010;36(6):363–6. 10.1136/jme.2009.031716 [DOI] [PubMed] [Google Scholar]
  • 44.Foucault M. Power. Faubion JD, editor. London: London: Penguin; 2002. [Google Scholar]
  • 45.Lawton J, Jenkins N, Darbyshire J, Farmer A, Holman R, Hallowell N. Understanding the outcomes of multi-centre clinical trials: a qualitative study of health professional experiences and views. Soc Sci Med. 2012;74(4):574–81. 10.1016/j.socscimed.2011.11.012 [DOI] [PubMed] [Google Scholar]
  • 46.Benoit C, Wrede S, Bourgeault I, Sandall J, De Vries R, Teijlingen ERv. Understanding the social organisation of maternity care systems: midwifery as a touchstone. Sociology of Health & Illness. 2005;27(6):722–37. [DOI] [PubMed] [Google Scholar]
  • 47.Roth JA. Hired hand research American Sociologist. 1966;1(4):190–6. [Google Scholar]
  • 48.Dyson S, Dyson S. The Politics of Health Services Research: Health Professionals as Hired Hands in a Commissioned Research Project in England. Sociological Research Online. 2014;19(3):1–11. [Google Scholar]
  • 49.Ross S, Grant A, Counsell C, Gillespie W, Russell I. Barriers to participation in randomised controlled trials. J Clin Epidemiol. 1999;52(12):1143–56. 10.1016/s0895-4356(99)00141-9 [DOI] [PubMed] [Google Scholar]
  • 50.Hernon O, Dalton R, Dowling M. Clinical research nurses' expectations and realities of their role: A qualitative evidence synthesis. J Clin Nurs. 2019;00:1–17. [DOI] [PubMed] [Google Scholar]
  • 51.Harron K, Woolfall K, Dwan K, Gamble C, Mok Q, Ramnarayan P, et al. Deferred Consent for Randomized Controlled Trials in Emergency Care Settings. Pediatrics. 2015;136(5):e1316–22. 10.1542/peds.2015-0512 [DOI] [PubMed] [Google Scholar]
  • 52.Donovan JL, Paramasivan S, de Salis I, Toerien M. Clear Obstacles and hidden challenges. Trials. 2014;15(5). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Elliott D, Husbands S, Hamdy FC, Holmberg L, Donovan JL. Understanding and Improving Recruitment to Randomised Controlled Trials: Qualitative Research Approaches. Eur Urol. 2017;72(5):789–98. 10.1016/j.eururo.2017.04.036 [DOI] [PubMed] [Google Scholar]
  • 54.Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S. Improving the recruitment activity of clinicians in randomised controlled trials: a systematic review. BMJ Open. 2012;2(1):e000496 10.1136/bmjopen-2011-000496 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Minneci PC, Nacion KM, Lodwick DL, Cooper JN, Deans KJ. Improving Surgical Research by Involving Stakeholders. JAMA Surg. 2016;151(6):579–80. 10.1001/jamasurg.2015.4898 [DOI] [PubMed] [Google Scholar]
  • 56.Donovan JL, Rooshenas L, Jepson M, Elliott D, Wade J, Avery K, et al. Optimising recruitment and informed consent in randomised controlled trials: the development and implementation of the Quintet Recruitment Intervention (QRI). Trials. 2016;17(1):283 10.1186/s13063-016-1391-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Tim Mathes

6 Apr 2020

PONE-D-20-04175

Recruiters' perspectives of recruiting women during pregnancy and childbirth to clinical trials: a qualitative evidence synthesis

PLOS ONE

Dear Dr. Hanrahan,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by May 21 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Tim Mathes

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

1. Please provide any updates you might have since the original search was performed in January 2019, or  provide a specific rationale for ending your search at that time.

2. In the methods, please describe how risk of bias was assessed in individual studies (including specification of whether this was done at the study or outcome level, or both, and the specific test employed, such as the I^2 statistic), and how this information was used in any data synthesis.

3. In the Methods, please specify any assessment of risk of bias that may affect the cumulative evidence (e.g., publication bias, selective reporting within studies). Please ensure that the specific method of assessment (funnel plot, Egger's test, Begg's test, etc) is mentioned.

4. We notice that the email address and names included in the supplementary information file may be potentially identifying. Please ensure that the email is shared only with consent; it may be removed at this time if the sender did not consent to the email being published.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

Reviewer #3: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for asking me to peer review this novel qualitative evidence synthesis. It appears to have been well conducted using an appropriate amount of systematic processing. There are however a number of issues that require your attention to further strengthen the manuscript. Some are methodological and some are reporting issues.

1. ENTREQ is a generic reporting guideline for a range of different qualitative evidence synthesis types. The language used in places (such as the abstract) inappropriately elevates this generic QES reporting guideline to the level of a methods manual (which it is not). See for example the abstract 'our synthesis was guided by the ENTREQ statement'. Suggest consider rewriting along the following lines: 'The synthesis was undertaken using Thomas and Harden's three stage thematic synthesis method, and reported following the ENTREQ reporting guideline for generic qualitative evidence syntheses.'

1.1 The manuscript also reports that the review follows PRISMA guidelines. All relevant elements of PRISMA were incorporated into ENTREQ with the caveat that ENTREQ guidelines do not explicitly state that the flow of literature should be reported with a PRISMA type diagram. Please clarify.

2. It is more usual to consider 'the factors that create barriers and enablers to'...

3. The convention as you state is to report number of studies and number of articles. This also needs to be reflected in the flow diagram. The last box needs to reflect number of studies and number of articles.

4. Please cross check reporting against the journal headings and subheadings for reporting reviews and syntheses. See for example your heading 'methodology of synthesis'. This is not a usual heading. 'Synthesis methodology' or just 'Synthesis' is more appropriate. I could not however find a 'data extraction/ abstraction subheading'. As the Thomas and Harden method combines data abstraction and synthesis you could see if a 'Data abstraction and synthesis heading' is agreeable to the journal.

5. PROSPERO is becoming more flexible concerning the protocols they publish. Arguably recruitment rates to clinical trials or not is an important clinical indicator. Did you try registering the review or did you just assume that it did not meet their increasingly flexible criteria?

6. Some of the terminology used to describe included study types is a bit unconventional (such as visual and collaborative studies). Suggest stick to naming the types of types of qualitative methodologies and methods that would meet the inclusion criteria and be consistent throughout the paper.

7. Definition of a finding (p7) 'This review defined a finding as a statement made by a study author'. This feels too restrictive and is open to misinterpretation. A finding can be a theory, a new concept, a typology, a theme, subtheme, findings statement, impact statement etc etc, findings can be presented in tables, diagrams, infograms, pictures, summary statements additional online only files, abstracts, summary bullet points etc etc (ie anywhere in the paper). The suggestion is to rewrite 'what is a finding' and to articulate that findings can be found anywhere in the paper. A theoretical lens for framing findings for example can be found in the introduction or methods section of a primary study.

8. Anthropomorphism. Please avoid giving the review human qualities. The review is an object - it cannot do anything. See for example: 'This review defined...' Rewrite as 'Findings were defined as ........'

9. Data extraction. With the Thomas and Harden's method of thematic synthesis, it is usual to code the entire paper and develop the synthesis using a software product. The text suggests that data were extracted into a table and then coded? It is more usual to extract the study information and characteristics into a table and then upload the entire manuscript and additional files to a software product for coding and synthesis. Please clarify.

10. Synthesis. The analytical themes presented in the findings section appear to be close to the primary studies and do not yet seem to move substantially away to develop new patterns and understandings that were not apparent in single primary studies. This becomes more apparent when you look at the summary of themes and subthemes presented in the supplemental files. The question then arises are these descriptive level themes rather than analytical themes? You may need to be clearer that with 4 studies there appeared to be less opportunity to 'go beyond' the primary studies to analytical level. Given that you only had 4 studies, you may not have been able to advance to a truly analytical level without the input of extensive stakeholder consultation and building in a theory development stage in which you 'bridge the gaps' with new hypotheses. The other option would have been to see if any of the primary qualitative studies were linked to interventions (ie trial sibling studies) where you could have made better use of the data in it's original context to explain how a specific trial recruited and the potential impact of staff behaviours on recruitment rates. The key is not to overplay your findings if they really are not truly 'analytical' level. You may have a combination of descriptive with some reaching up into analytical - but at face value they don't look like stand alone analytical findings that move beyond the primary studies. Simply revising the theme head to something different but similar is not sufficient.

If not able to further advance the findings to a truly analytical level then suggest be transparent and outline the additional strategies that you could potentially have used in the limitations section. Please reconsider, and clarify.

10.1 if able to make a more convincing case for analytical level findings, it would also be helpful for the reader to distinguish between descriptive level and analytical level themes in the text and the tables.

Overall the supplementary online files are very useful. Good to see a table of methodological limitations in each study reported in full.

Reviewer #2: I enjoyed reading this paper. It addressed an important topic, was well written and easy to read. My comments are below:

Abstract conclusion refers to ‘combing’ – should this be ‘combining’?

Methodology- some authors use thematic synthesis in a very broad sense. Suggest in the abstract you make reference to Thomas and Hardy’s approach specifically.

Table 1: please add the reference numbers for included papers otherwise readers need to scan the full reference list to find these.

Reflexivity: I was very pleased to see such information provided. I would suggest though that the information about the researchers is added to your strengths/limitations section on p36 as your professional background is the context in which your interpretations/analysis are made so, it helps readers to understand this when they are reading about the strengths/limitations of your study.

Findings: page 20. A) You note five papers from four studies but this does not match your PRISMA diagram which says five studies. Please amend your PRISMA diagram to say 4 studies, 5 papers. B) Could you report somewhere whether these 4 studies were found via the electronic searching or if any were found via the grey literature search? References suggest these were from the e-searches but, it is useful for readers to know this in terms of study quality. Perhaps add to page 20 all identified papers were found through database searching.

Strengths and limitations and confidence of findings: Perhaps these sections could be merged but with more detail added? You raise key points but you need to go further. For example, your team consists of two midwives and a trial methodologist working in Scotland and Ireland. Team make up e.g. discipline, gender, is likely to have influenced your thematic synthesis. Perhaps a team of obstetricians may have interpreted the original study findings in a slightly different way to you as they would approach this synthesis from a different professional perspective? Please can you add something to this effect in this section of your paper – just the point that your final synthesis reflects your professional and personal backgrounds. Also, please comment that your included studies were from UK and Netherlands so findings reflect a European perspective from two countries with universal healthcare.

Figure 2: I liked this but felt it was incomplete. A) The title needs improved it was too vague e.g. maybe it could mention themes? B) A point for consideration – could the 4 themes/columns be brought together in some way e.g. within a box? Perhaps providing an over-arching theme such as ‘recruiters’ perspectives of recruiting women during pregnancy and childbirth to clinical trials: 4 dimensions informing their practice’. At the moment, it’s simply a visual representation of your descriptive narrative. I feel there is potential for Fig 2 to say more – perhaps linking it to your interpretation/discussion so, it goes beyond just summarising your themes. This sort of thing could give your figure more impact and meaning to readers.

S3 – one column is missing its reference.

Reviewer #3: Thank you for the opportunity to read this Qualitative Evidence Synthesis investigating recruiter experiences and perceptions of barriers and facilitators to recruitment to randomised trials conducted during pregnancy and childbirth.

I enjoyed reading this systematically presented and well written study. Findings include new interpretations, arguing knowledge and power interact and influence recruitment in this context. The authors suggest findings could have relevance to others of the top 10 areas identified for PRIORITY (specifically how best to ensure inclusion of underrepresented and vulnerable groups and how best to ensure manageable workloads for clinical and research staff who recruit to trials - p 35).

There is a lack of research involvement of women recruited during pregnancy and childbirth and this QES will contribute important insights into recruiter perspectives in an area where knowledge is currently lacking.

This work deserves publication. My comments focus mainly on making more explicit 1) the methods of the QES; 2) clarifying findings. Please see the attached document for my detailed comments.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Jane Noyes

Reviewer #2: Yes: Dr Nicola Ann Ring

Reviewer #3: Yes: Julia Wade

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PLOS ONE reviews March 2020.docx

PLoS One. 2020 Jun 19;15(6):e0234783. doi: 10.1371/journal.pone.0234783.r002

Author response to Decision Letter 0


28 Apr 2020

We would like to thank the reviewers for their time and care in providing us with very helpful feedback. We feel that the manuscript has been greatly enhanced by this contribution.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Tim Mathes

3 Jun 2020

Recruiters' perspectives of recruiting women during pregnancy and childbirth to clinical trials: a qualitative evidence synthesis

PONE-D-20-04175R1

Dear Dr. Hanrahan,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Tim Mathes

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

Reviewer #3: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thank you for addressing the issues I raised. I enjoyed reading your revised paper and the improvements had strengthened your work.

Reviewer #3: Thank you for the opportunity to review this resubmitted manuscript. I am happy that the issues I raised have been addressed.

I wanted to raise the following 3 minor points for minor edits:

1. P15 (unmarked MS) first paragraph, line 5 – change synthesis to synthesise.

2. P16 first paragraph ‘A summary….WAS…’ and again later same page perhaps: A ‘Summary of Qualitative Findings’ WAS derived from the findings of the thematic synthesis. As the research team summarised and identified the central idea of each finding, the authors then made an overall GRADE-CERQual assessment of confidence based on these findings.

3. P37 Conclusion: suggest the authors bring the reference to ‘knowledge’ in line with Abstract and Findings, both of which now refer to ‘overarching theme of belief and power which links’ (rather than ‘knowledge and power which underpins’). Also correct ‘combing’ to ‘combining’.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Jane Noyes

Reviewer #2: Yes: Dr Nicola A. Ring

Reviewer #3: Yes: Julia Wade

Acceptance letter

Tim Mathes

10 Jun 2020

PONE-D-20-04175R1

Recruiters' perspectives of recruiting women during pregnancy and childbirth to clinical trials: a qualitative evidence synthesis

Dear Dr. Hanrahan:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Tim Mathes

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. ENTREQ checklist.

    (DOCX)

    S2 Table. Critical appraisal skills programme.

    (DOCX)

    S3 Table. Themes matrix.

    (DOCX)

    S4 Table. CERQual evidence profiles.

    (DOCX)

    S5 Table. Exemplars of supporting data.

    (DOCX)

    S1 Appendix. SPIDER tool and search strategy.

    (DOCX)

    Attachment

    Submitted filename: PLOS ONE reviews March 2020.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES