Skip to main content
Nursing Open logoLink to Nursing Open
. 2017 May 7;4(4):187–199. doi: 10.1002/nop2.83

A screening tool for predicting gatekeeping behaviour

Austyn Snowden 1,, Jenny Young 1
PMCID: PMC5653390  PMID: 29085645

Abstract

Aim

To develop a typology and screening tool for gatekeeping behaviours by nurses responsible for recruitment in palliative care research.

Design

Concurrent analysis.

Method

Two focus groups were conducted in 2015 with nine qualified hospice community nurses involved in recruitment to a trial in palliative care. The literature was searched for research into gatekeeping from 2000–2016. All narrative examples of gatekeeping activity were coded using gerunds. Common codes were then grouped and interpreted as a social process.

Results

Gatekeeping is normal and should be expected. A continuum typology emerged, ranging from unintentional to active disengagement. Justification ranged from forgetting to deliberately not mentioning the study for fear of burdening patients. Viewing gatekeeping as a continuum allowed for the creation of a screening tool designed to collaboratively discuss and hence mitigate specific types of gatekeeping behaviour before they occur. This is a unique international contribution to this persistent issue.

Keywords: burden, concurrent analysis, gatekeeping, gate‐keeping, nurse, palliative care, paternalism, recruitment, research methods, screening tool, vulnerable populations

1. Introduction

Recruitment problems are common in research studies (Treweek et al., 2010). Problems are particularly acute in populations characterized as “vulnerable”, such as terminally ill patients, or patients with mental health issues (Bond Sutton et al., 2003; Witham, Beddow, & Haigh, 2013). It is suggested that 50% of randomized control trials fail to recruit to their target number (Fletcher et al., 2012). In the palliative care setting, the focus of this paper, Hanson et al. (2014) claim that 80% of studies struggle to recruit sufficient numbers.

Successful recruitment has been associated with: good communication with all stakeholders, clear protocols, “buy in” from nurses, good support from the research team, management support and the use of dedicated recruitment personnel (Caldwell et al., 2010; LeBlanc et al., 2013; McDonald et al., 2006; Treweek et al., 2010; Watson & Torgerson, 2006). Common barriers to recruitment include the reverse of these factors. However, a further common difficulty, particularly but not exclusively in palliative care research, is “gatekeeping” (Bucci et al., 2015; Sharkey et al., 2010; Witham et al., 2013). Gatekeeping in this paper refers to the prevention of access to eligible patients for research recruitment (Sharkey et al., 2010).

Kars et al. (2015) suggest there are five groups of gatekeepers:

  • Healthcare Practitioners (physicians, nurses and allied healthcare workers),

  • Research ethics committees (RECs),

  • Management,

  • Relatives,

  • Researchers.

All areas are touched on in this paper. This paper focuses on gatekeeping behaviour in nurses, because they represent the largest potentially remedial cause of under‐recruitment (Stone et al., 2013).

1.1. Background

Gatekeeping is unethical (Sharkey et al., 2010). It conflicts with the evidence that patients want to be given the choice to participate in research (Bellamy, Gott, & Frey, 2011). However, this argument alone does not seem to be convincing enough to change gatekeeping behaviour. Consequently, a deeper, more balanced analysis of why gatekeeping persists is needed.

The literature contains thousands of reflective pieces borne of frustration at recruitment failure (e.g. Finlayson, 2015). A recent systematic review on gatekeeping activity in palliative populations alone found 1865 papers written since 2000 (Kars et al., 2016). However, primary research into gatekeeping was not the focus of any of these papers. Instead Kars et al.'s (2016) review sample had to be constructed from literature that discussed gatekeeping as part of wider investigations into attitudes to research and barriers to recruitment more generally. Therefore, despite the huge amount of commentary, there is clearly a need to conduct primary research into gatekeeping activity (Kars et al., 2016).

Kars et al. suggested that patients should be the focus of this research, but this begs the question of how they could be, given that gatekeepers may not permit access to relevant patients in the first place. The more logical step is to conduct primary research into nursing behaviours associated with gatekeeping activity in palliative care research. If these can be better and more sympathetically understood, then perhaps some of these behaviours could be mitigated where appropriate to do so.

1.2. Research question

What are the common actions taken by nurses in the process of preventing patients from participating in palliative care research?

2. The study

2.1. Design

Concurrent Analysis (Snowden & Martin, 2010a,b), explained in detail below.

2.2. Data collection

To obtain relevant primary data, two focus groups were conducted in August 2015 with a total of nine participants. All participants were qualified hospice community nurses. Age ranged from 44 to 58 years with mean 53 years. Eight were female, one was male. All were considerably experienced nurses with average time since qualification of 31 years.

Participants were asked about their experiences of identifying suitable participants for the study (Table 1) and any challenges associated with this process. JY conducted the focus groups using the semi‐structured schedule in Table 2. The structure of the focus group followed long‐standing principles originally articulated by Stewart and Shamdasani (1990), such that questions were constructed to move from the general to the specific, but remain open enough to include all contributions. Each focus group lasted between 35 and 40 min. The recordings were transcribed verbatim (Bailey, 2008) by JY.

Table 1.

The case study

The case study
A randomized, controlled trial began in 2013 to examine the impact of holistic needs assessment (HNA) in community palliative care. Holistic needs assessment is:
“…a process of gathering and discussing information with the patient and/or carer/supporter in order to develop an understanding of what the person living with and beyond cancer knows, understands and needs. This holistic assessment is focused on the whole person, their entire well‐being is discussed – physical, emotional, spiritual, mental, social, and environmental. The process culminates when the assessment results are used to inform a care plan.” (National Cancer Survivorship Initiative 2013)
The UK Gold Standards Framework and NICE guidelines (2004) promote the importance of holistic assessment in palliative care, yet there is limited research on the impact of this intervention. Therefore, a protocol was developed to examine its efficacy, consistent with a comparable study in acute care (Snowden et al. 2015). Two community hospice teams volunteered to participate. The teams provided care to individuals across two contrasting geographical areas; one urban and one rural. Community nurses were required at their routine home visits to invite patients with a diagnosis of cancer to take part. Inclusion and exclusion criteria were:
  • Inclusion:

  • Community outpatient under the palliative care of the site.

  • Over 18, capable of informed consent and expresses a wish to participate.

  • Diagnosed with cancer.

  • Exclusion criteria:

  • Non English speaker

  • Person deemed incapable of consenting to participate as defined by the Adults with Incapacity Act (2000)l

  • Individuals that are in the last weeks of their life as identified by a member of the clinical care team.

If patients agreed then the clinician would either integrate the HNA into their visits (experimental group) or not (control group). All consultations were to be audio‐recorded and then analysed by the research team to establish the impact of the intervention (Snowden et al., 2015).The NHS and university ethics committees had approved the study and the participating organizations were keen to be involved. The research team was multi‐disciplinary including an international team specializing in conversation analysis (Lussier et al. 2013). For sufficient power the study needed 60 participants in each arm, 120 in total. Before recruitment began the clinicians received training in holistic needs assessment from a clinical psychologist who specialised in psycho‐oncology. The research team attended six staff meetings and informal visits to offer ongoing support to the clinicians throughout the trial period. However, after 2 years only 10 participants had been recruited in total and so the trial was stopped.

Table 2.

Semi‐structured interview schedule

Questions and prompts
Can you tell me about your experiences identifying eligible patients from your caseload?
  • How did you decide who was suitable?

  • How differ from inclusion/exclusion criteria already set?

How did you go about asking patients to take part?
  • Explore difficulties.

  • Explore confidence.

  • Any good experiences.

Did your clinical role and the research you were asked to do complement each other or were there difficulties?
  • Perception of research.

  • Any other work pressures.

Do you think you wanted to protect your patients from the research?
  • Why?

  • How can we give these patients a voice?

What do you see as the benefits of this research?
  • Positive benefits.

  • Wider benefit and purpose of the research study.

How could we have provided more support
  • Was training suitable?

  • More input?

  • Wider reflections.

Any further thoughts.

Relevant literature was obtained by updating the original search strategy conducted by Kars et al. (2016) in PsychInfo, Embase, Cinahl and Medline:

(gatekeep* OR gate‐keep* OR impediment OR impediments OR barrier OR barriers OR challenge OR challenges OR refusal to participate) AND (palliative care OR end of life care OR end‐of‐life care OR terminal care) AND (particip* OR respondent OR respondents OR patient OR patients) AND (research OR clinical trial OR study) NOT (dementia OR newborn)

This generated an additional 462 papers published since 2015 (the year of first acceptance of the paper). Screening for duplicates, then reading titles and abstracts for relevant primary research including nurses in palliative care reduced these to just one further empirical article, a small but important qualitative exploration of palliative care patient involvement in research (Froggatt et al., 2015).

Sections of this paper that discussed gatekeeping activity were identified alongside similar sections that included the nursing perspective from Kars et al.'s original search. Details of all papers and the sections where gatekeeping was specifically discussed are in Table 3. Quality appraisal criteria were not applicable in this study because none of the included papers were primary research into gatekeeping and so the quality of the original paper was not relevant. In other words, the purpose of the literature review was not simply to update Kars et al.'s work but to use their search terms to identify literature most likely to contain relevant sections of narrative data suitable for concurrent analysis.

Table 3.

Kars et al.'s (2016) lit review updated and relevant data for concurrent analysis identified

Reference Discusses nurses? Type of article and section gatekeeping was addressed Country Aim of original study Method and data collection in original study Sample original study Contains data suitable for Concurrent Analysis?
(Bullen et al., 2014) Yes Retrospective case study: discussions AU Identify barriers to research in palliative care Case study Retrospective process review Yes
(Casarett, Karlawish, & Hirschman, 2002) Yes Original article: findings US Assess hospice staff readiness for research and attitudes to barriers to research Survey and telephone interviews Random sample of hospices (n = 79) Yes.
(Casarett, Kassner, & Kutner, 2004) No Original article: findings US Testing of a hypothetical screening tool to select patients for research into pall care Cross‐sectional study Patients or carers as proxy (n = 214) No
(Chen et al., 2014) Yes Original article: findings US Identify barriers to palliative care research Qualitative Interviews Nurse researchers (n = 61) Yes
(Daniels & Exley, 2001) Yes Original article: findings UK To explore the experiences of nurses involved in recruitment of terminal patients in an RCT Qualitative semi‐structured interviews Specialist nurses (= 10) and lead researcher (= 1) Yes
(Ewing et al., 2004) No Retrospective review/commentary UK To investigate the level of agreement on symptom assessment between patients and primary care professionals Commentary Retrospective review No
(Froggatt et al., 2015) Yes Original article: findings UK To describe the experiences of people's participation in patient and public involvement (PPI) in supportive and palliative care research, specifically with respect to the benefits and challenges of participation for the individuals and the broader research support structures. Qualitative exploratory Patients involved in PPI (n = 9) Yes
(Gardiner et al., 2010) No Retrospective review UK To explore the ethical challenges associated with pall care research Commentary Retrospective review No
(Gibbins et al., 2013) Yes Feasibility study: discussion UK To establish likelihood of death during admission and test process to involve those identified in research Observation Patients (n = 327) Yes
(Hanratty et al., 2012) No Comparative analysis: N/A UK Compare recruitment of patients and bereaved carers from general practices in areas with different research network support, and identify challenges in obtaining samples representative of those in need of end‐of‐life care Qualitative Interviews Patients (n = 13) and carers (n = 118) No
(Hanson et al., 2014) Yes Original article: findings US To evaluate strategies to support recruitment in palliative care RCT Qualitative semi‐structured interviews All PIs and research coordinators (n = 18) Yes
(Hickman, Cartwright, Nelson, & Knafl, 2012) Yes Original article: findings US Investigate strategies designed to assuage ethical concerns in palliative care studies Case studies PIs of 43 studies Yes
(Hopkinson, Nm, & Macmillan, 2005) Yes Original article: findings UK Exploration of appetite for participation in research by people with advanced cancer Qualitative Nurses responsible for recruiting 233 patients Yes
(Kirsh et al., 2004) Yes Original article: findings US Survey staff attitudes to research with dying patients Survey Hospice staff (n = 227) of which 67 were nurses Yes
(Kutner et al., 2010) Yes Retrospective report of the researchers' experiences concerning study procedures US To investigate the efficacy of massage therapy for decreasing pain RCT Patients life expectancy of 3 weeks from 15 hospices (= 380) Yes
(Ling, Rees, & Hardy, 2000) No Original article: findings UK Investigate barriers into recruitment to clinical trials in palliative care Survey Patients (n = 558) eligible for recruitment into various trials No
(McMillan & Weitzner, 2003) Yes Retrospective descriptive analysis: discussion US Clinical trial examining quality of life issues RCT Hospice patients & caregivers (= 150) Yes
(O'Mara, Germain, Ferrell, & Borneman, 2009) Yes Original article: findings US Investigate recruitment challenges in pall care research Survey and follow up telephone interview PIs of 15 funded research projects Yes
(Payne, Field, Rolls, Hawker, & Kerr, 2007) Yes Reflective account using case studies: discussion UK To investigate existing palliative care provision and bereavement care (in adults and children) Mixed methods Wide range of participants over three studies No
(Ross & Cornbleet, 2003) Yes Original article: findings UK Comparison of patient and staff views on participating in hypothetical research studies in palliative care. Observation Patients (n = 40) and staff nurses (n = 13) Yes
(Steinhauser et al., 2006) No Reflection on recruitment in a longitudinal study from the researchers' US To construct in depth analysis of patient/carer experience of illness and death Longitudinal study Dyads of seriously ill patients (n = 240) No
(Stevens et al., 2003) No Original article: N/A UK Investigation into ethics committees exploring the need for specialist review in pall care Interviews Chairs and vice chairs of UK ethics committees No
(Stone et al., 2013) Yes Original article: findings UK Identify factors adversely affecting recruitment in pall care studies Observational study examining eligibility, accessibility and consent. Referrals to 18 palliative care services (n = 12,412) Yes
(Tan, Wilson, Olver, & Barton, 2010) Yes Original article: findings AU To describe experience of participants in a research study into a spiritual care intervention in pall care Qualitative: semi‐structured interviews Hopsice staff members (n = 14) Yes
(White, Gilshenan, & Hardy, 2008) Yes Original article: findings AU To determine which trial‐related factors might influence a healthcare professional's decision to refer a patient Questionnaire Doctors (n = 122) and nurses (n = 68) Yes
(White, Hardy, Gilshenan, Charles, & Pinkerton, 2008) No Original article: N/A AU Logistic regression of patient willingness to participate in above trial Questionnaire Patients (n = 101) and carers (n = 101) No

2.3. Ethics

Permission to undertake the study was granted by NHS Scotland REC 4 WS/13. All focus group participants were provided with study information, all opted to participate and signed consent forms. They were assured their contributions would be anonymized and that they could withdraw from the study at any time.

2.4. Data analysis

Concurrent Analysis is a method of simultaneously analysing primary data alongside relevant secondary data where the focus of enquiry is the same. It has its roots in constructivist grounded theory in that its purpose is to illuminate social processes (Charmaz, 2009). It moves away from grounded theory in relation to the role of the literature. Grounded theorists have traditionally needed to make a decision as to whether to engage with relevant literature before or after gathering primary data (Dunne, 2011). Concurrent Analysis is grounded in a rejection of this debate altogether (Snowden & Atkinson, 2012). It takes an alternative position by analysing the primary data at the same time as relevant elements of the literature.

The method has successfully been used in previous studies designed to better understand satisfaction in childbirth (Hollins‐Martin, Snowden, & Martin, 2012; Snowden et al., 2011), the process of becoming competent as a nurse prescriber (Snowden, 2010; Snowden & Martin, 2010a,b) and the process of organizational change associated with implementing an electronic health record (Snowden & Kolb, 2017). It is a pragmatic method of synthesizing primary data with literature to produce more generalizable results than doing either alone (Snowden & Martin, 2010a,b). For a detailed description of the philosophy of Concurrent Analysis please see Snowden and Atkinson (2012).

The process of Concurrent Analysis involves four stages:

  1. The gathering, transcription and collation of all relevant data.Relevant data include all narrative research data focused on the topic of interest. In this study, it meant primary data gathered in the focus groups obtained to answer the research question. It also included the relevant sections of the papers identified in Table 3, where either researchers or participants in their study described gatekeeping behaviour. All data were imported into NVivo 10 for coding.

  2. Line by line coding of the data focusing on gerunds.The purpose of Concurrent Analysis is to identify a social process. Concurrent Analysis considers the units of social process to consist of actions taken by participants (Snowden & Atkinson, 2012). Coding at this level, therefore, looks for words describing action or behaviour such as gerunds for example (Charmaz, 2006). For example, “forgetting” is a gerund, as is “being too busy”.

  3. Identification of commonalities and connections between codes.During the line‐by‐line coding, commonalities are flagged for further analysis. For example, if a significant proportion of participants mention that they imagine that partaking in research would be burdening their patients, then “burdening” is identified at this stage as a potentially important category. Connection is maintained at this point as to who is discussing “burdening” and under what circumstances. This maintains the context for the codes thus providing explanation for a given behaviour. For example, “burdening” may mainly occur in conjunction with participants describing the physical or mental state of the potential participant. These are important connections to maintain.

  4. Thematic grouping of key themes to explain the whole as a social process. The final phase is to examine all the codes, connections and themes in relation to each other. Where actions are widely reported these are considered key themes. All the key themes are then considered as a whole to see if an underlying social process can be described to explain them all.

2.5. Rigour

Both authors independently coded all the data and then came together to discuss anomalies in interpretation. These were rare and were resolved by discussing and then agreeing on the most coherent rationale for differing judgements. Both authors were involved in all stages of the analysis. Agreement was reached on the inclusion of all themes and the data summaries discussed next. A version of the interpretation and subsequent screening tool was presented to an audience of over 50 nurses at the RCN International Research Conference in Edinburgh (Snowden & Young, 2016). Formal feedback was not gathered, but the debate that followed the presentation suggested that the findings were generalizable to that particular audience, adding a final external element of rigour (Morse, 2015).

3. Results

The key interpretation was that there is a continuum of gatekeeping activity. The continuum from nurses forgetting about the research study (unconscious aspects) to actively disengaging from it (conscious aspects). These actions are a function of a range of causes from simple distractions through to discomfort and distress. Nurses give a generalizable range of reasons for their behaviour, including seeing research as a burden for both themselves and the patient, or seeing research as a low priority in relation to more pressing clinical issues. Regardless of cause or explanation, the outcome is the same: the patient is not asked to participate in the study.

This typology is summarized in Fig. 1. The key themes and subthemes are presented alongside supporting evidence from the literature and focus groups in Table 4.

Figure 1.

Figure 1

A typology of gatekeeping activity including its cause and outcome

Table 4.

Themes, their causes and explanation from the focus group and the literature

Theme/Behaviour Cause Explanation Examples from the literature Examples from the focus groups
Active disengagement Distress Incongruent with development of therapeutic relationship I'm not in favour of clinical staff doing research… often, patients have very short lengths of stay which prohibits development of rapport.(Kirsh et al. 2004, p. 277) It takes a few visits to build up trust and a relationship with the patients and I think jumping in with a study initially is wrong. I think that could be detrimental to our service as patients could say “I don't want these nurses back as they're asking about studies”.
Burden (for staff and patients) …offering a clinical study to this population may be perceived as placing undue burden on the patient (O'Mara et al., 2009, p. 4)
…a form of “catch‐22” occurs in which staff are interested in research and want to control access to it but won't get involved and actually let it happen because they do not have time to absorb the extra burden it would create. (Kirsh et al. 2004, p. 278)
I felt perhaps myself it was a huge burden to ask patients, perhaps I held off for that reason without asking them.
A priori assumptions “I can't imagine anyone wanting to talk about these things.” (Tan et al. 2010, p. 163) I think I was probably making the decision for them because I thought there's no way you could take this on.
Paternalism “He and his wife are very, very anxious and I think would be made worse by extra ‘fuss and attention’. I therefore do not think it would be appropriate to approach them.” (Ewing et al., 2004; p. 456) I know we often get labelled as being very parental about our patients but there is something in that because we are advocates for our patient. There are so many other things that we need to do for them, their agenda and this was our agenda so you probably do a bit of blocking.
Discomfort Complexity …as trials became more complex with potential side effects, less were willing to refer.(White & Hardy, 2009; p1399). I think it's… I've got these papers and this to fill out and I've got to read that and now I've got to use this tape and you don't have a table and a contained room and you have to go with where the patient is going, it's not all clean and tidy.
Creating bespoke inclusion criteria We'd be kind of thinking about a family that has a degree of cohesiveness and may have things that are unsaid that if put in this forum would be able to be brought out…[By contrast] there were some cases that were probably far too complicated with too much history and friction.” (Tan et al. 2010, p. 162) They are very few and far between where the patient is so easy. What I think in that particular situation though, she wasn't perhaps a typical patient like I generally have on my caseload. I'm wondering what it was about her that maybe made her less typical and maybe she was generally quite well.
Protection The poor performance status, fatigue and low mood of many patients should not be underestimated and may make apparently straightforward procedures such as record or diary keeping too onerous for the potential trial participant.
(Ross et al. 2015, p. 15)
I think we looked for a patient that would fit a certain criteria. I suppose we are all doing the same job but we are all different people doing it differently and therefore I think our selection is probably different.
Discord Lack of collaboration Negative attitudes towards research held by dominant individuals within the team were evident, influencing less‐decided team members about the value of the project… it was observed that if one individual proposed a particular view there was a tendency for others to agree or remain silent rather than expressing divergent views. (Bullen et al., 2014, p. 80) [The study protocol] was almost completed when it arrived.
Passive disengagement Distraction Not proper work Research activities are not “proper work” (Woodward et al., 2007; p. 234) To be honest I was too busy with other work…
Not enough time More work needs to be done to free up time of gatekeepers for involvement with research and more education needs to be provided by study teams to gatekeepers to generate interest.(Borschmann et al., 2014, p. 5)
Not core business Conducting clinical research to inform nursing practice is not viewed as “core business” as it is seen to detract from a patient care focus. (Bullen et al., 2014, p. 79) We have had staff changes, staff sickness all of that has impacted definitely, so the study got lost…I must admit I was too busy… I didn't even think about the study.

3.1. Active disengagement

3.1.1. Distress

Several participants expressed conscious decisions to disengage from the research process. There were two main justifications for this. First was the view that research was incongruent with the development of a therapeutic relationship and therefore damaging to the development of rapport. Secondly and more frequently expressed was the belief that inviting patients to participate would be a burden for them.

Like Kars et al. (2016), Witham et al. (2013) found the explanation for considering research a burden for the patient to be grounded in particular disease‐specific discourses. Individual justifications for not “burdening” patients with details of potential participation in research were often framed in disease‐specific notions of vulnerability. For example, people with dementia or learning disability “would not understand”, while people with terminal illness “should not be bothered”. “Ill health” was given as the major rationale for gatekeeping in Hanratty et al.'s (2012) investigation.

Nurses knew they were removing choice by taking this position, but often explained their actions as morally justifiable because they were protecting the vulnerable. For example, while acknowledging the paternalistic nature of gatekeeping behaviour, the term “advocate” was used by one nurse, effectively reframing paternalism as a moral good. There was also the claim that introducing research moves away from a focus on the patient's needs. This “a priori” stance that the patient needs protecting from research is widely evident in the literature and not confined to nurses (Ammari, Hendriksen, & Rydahl‐Hansen, 2015). Gysels et al. (2008), for example, found carers asked recruiters not to approach their partners for interview as they thought the experience may harm them. Payne (2013) pointed out that patients often act to protect their carers from the “burden” of research. Protection of a loved one is an entirely understandable, rational response, as is the protection of the therapeutic relationship. It may, therefore, be helpful as a starting point to view gatekeeping as a normal response rather than a misguided one. People protect both themselves and others from perceived stress wherever possible (Festinger, 1957).

3.1.2. Discomfort

Avoiding discomfort could explain gatekeeping behaviour that may be a function of knowledge deficits. For example, it has been shown that gatekeeping increases consistently with the complexity of the study design (White & Hardy, 2009).

Dunleavy et al. (2011) showed that nurses who do not understand randomization are unlikely to be able to explain it adequately to patients and thus consciously or unconsciously do not discuss it at all. One of the focus group participants described a failed attempt to recruit as not being “clean and tidy” (Table 4). This is quite clearly an expression of discomfort with the unfamiliar.

Extending from this were claims that those who were deemed to be suitable for inclusion were classed as being unusual in some way. There is evidence that nurses do not necessarily follow set inclusion/exclusion criteria (Tan et al., 2010), but rather select potential recruits on characteristics that they think may be useful to the research (Table 4).

Alternatively, Ross et al. (2015) suggest researchers may overestimate the capacity of some patients. This shows that in these instances nurses and researchers have different perspectives on what constitutes a suitable patient for any given study. The impact on the research is biased recruitment and hence invalid results. As in much of the literature (Kars et al., 2016) our study (Table 1) did not recruit to power and it is likely that those that were recruited could not be described as having consistently fit the inclusion/exclusion criteria.

3.1.3. Disharmony

Team dynamics play a substantial role in the success of any initiative (Snowden & Kolb, 2017). Initially the research team had hoped that if one or two members of the nursing team reported positive experiences of recruitment then it might encourage others to engage. Unfortunately, the reverse appeared to happen. It has been recognized previously that if one or two stronger members of staff disengage it becomes much harder for others (Kars et al., 2016). A factor in this particular study may have been the fact that the study protocol had been largely developed without the involvement of the staff responsible for recruitment (Table 4). Greater collaboration between the research and clinical team during the planning stage of this project in particular could possibly have helped engagement.

3.2. Passive disengagement

3.2.1. Distraction

The final category contains all the less conscious elements of recruitment failure. The work pattern into which the study fit was a significant factor. Where other work pressures emerged, the research became less important. Lack of time to do anything other than routine but urgent work was mentioned almost unanimously (Table 4). Research is often not considered “core business” (Bullen et al., 2014, p. 79), or even “proper work” (Woodward, Webb, & Prowse, 2007, p. 234). Some participants simply forgot about the study and this was usually explained as a function of being very busy.

4. Discussion

The challenges associated with recruitment in palliative care are commonly reported in the literature. Gatekeeping by nurses is known to present a substantial problem, but solutions are less clear. There is a tendency for authors of gatekeeping critiques to propose “culture change” as solution (Bucci et al., 2015; Witham et al., 2013). While this may be a desirable endpoint, it is difficult to enact and so even where the critiques are credible they demonstrate a lack of practicality. What this study adds is a categorization of types of gatekeeping activity exhibited by nurses. The function of this categorization is to help future researchers mitigate these behaviours wherever feasible and appropriate.

In summary, a range of gatekeeping responses was found, from benign unconscious forms of disengagement through to conscious and deliberate decision‐making forms. This is important because different actions may be useful to mitigate gatekeeping consistent with the particular type of gatekeeping behaviour. For example, a benign form of gatekeeping is simply forgetting to ask people (Jessiman, 2013). If this was generalizable, as seems the case here, then it could easily be addressed using various prompting techniques. A step up from forgetting included nurses justifying omission in relation to more pressing clinical priorities (Potter, Dale, & Caramlau, 2009; Kars et al., 2015). In these cases, the research was seen as separate and less important than clinical work. Where this is the case then a discussion on whether this is an accurate appraisal may be helpful. Likewise, in the cases where assumptions about burden result in gatekeeping these assumptions could be questioned, especially given that Graffy et al. (2009) concluded that the positive attitude to research of clinicians was the most important component of successful recruitment.

It is easy from an outsider perspective to argue that gatekeeping is irrational. For example, take the claim that introducing a research study would somehow breach the therapeutic relationship. The components of a successful therapeutic relationship are widely agreed. They include trust and commitment, empathy, unconditional positive regard, genuineness, honesty and support (Ramjan, 2004). It is difficult to see how asking a person to become involved in research may breach any of these, especially as there is considerable evidence that people want to participate in research for altruistic reasons (Newington & Metcalfe, 2014).

Nevertheless, the perception that damage could occur is real. This perception is shared by other health professionals, patients and their carers. Participants in our study reported genuine concern for the patient, anxiety about research competence and competing workload issues. These findings were consistent with the wider literature, suggesting that nurses show a consistent pattern of behaviour and use a consistent range of explanations to explain their behaviour.

As a consequence a more measured response to gatekeeping is needed beginning with the expectation that gatekeeping will occur (Ewing et al., 2004). On reflection, neither the researchers nor nurses understood the magnitude and type of gatekeeping behaviour that would be likely, or the reasons for it, both before and during the study. Therefore, discussing the likelihood of gatekeeping before the study has been fully conceptualized would be the best method of mitigating it where appropriate.

This discussion needs to be evidence based. To facilitate this, the typology developed here was used to construct a screening tool. The screening tool is in Table 5. It turns the key findings from the typology into statements that the responding nurse can agree with, disagree with or be undecided about. Gatekeeping likelihood and support can then be clarified. To be clear, all the nurse recruiters in the study (Table 1) were very keen to take part and had not expressed any qualms to the research team about their capacity to recruit the study sample needed. In fact, they were confident and enthused about the study. Completion of the screening tool may have facilitated a more focused, realistic discussion starting from the perspective that gatekeeping is likely to occur.

Table 5.

Screening tool for likely gatekeeping activity

Gatekeeping screening tool
Please answer every question as honestly as possible by placing a tick in the relevant box. There are no right or wrong answers and your responses will only be used for discussion purposes.
Yes No I don't know
I will mention research participation to every patient who meets the inclusion criteria.
I think patients with capacity to consent should always be given the choice to make their own decisions.
I will not mention research participation to a patient if they look as if they couldn't manage it.
I think that research is as important as clinical work.
Research informs my clinical practice.
I know what I need to do to fulfill my role in this study.
I can answer any questions the patient may have about the research.
I sometimes forget to ask people if they want to participate in research.

It is interesting to note that proposals designed to minimize gatekeeping are similar regardless of the subject. For example, in relation to conducting anthropological studies in indigenous populations, Kawulich (2015) recommends the following:

Establishing trusting, long‐term relationships through social networking, acquiring specific permissions at various levels, selecting key informants, presenting oneself appropriately and showing respect for cultural mores are essential aspects of being granted entry by gatekeepers.(p57)

These are transferable principles and it is widely agreed that one of the best ways of operationalizing this agenda is through deployment of dedicated recruitment personnel (LeBlanc et al., 2013). Not every study can afford such a resource, but “clinical champions” are also effective (Hanson et al., 2014). The screening tool could potentially identify those more likely to be effective in this role. Recall the introduction stated that successful recruitment is also consistently associated with good support from clinical management (Caldwell et al., 2010; LeBlanc et al., 2013; McDonald et al., 2006; Treweek et al., 2010; Watson & Torgerson, 2006). Again the screening tool could provide a snapshot of the depth of this support.

It is very important that any discussion of gatekeeping starts from a balanced and sympathetic view of why gatekeeping is likely to occur. For example, a complex and sensitive issue is the belief that participation in a research study will cause unnecessary burden to the patient. Telling nurses this may not be true is a very ineffective strategy. Discussing beliefs around advocacy, paternalism, choice and risk in a supportive collaborative environment, beginning by acknowledging the rationality of taking a protectionist stance is much more likely to be effective.

There are also practical elements of ongoing support likely to be necessary (Borschmann et al., 2014). It was clear in the focus groups that the nurses were uncomfortable with the study design and the literature is very clear in showing a relationship between study complexity and recruitment success. However, the nurses' discomfort did not come to light until after the study had been stopped. Had the screening tool been completed beforehand perhaps a more complete picture of nurse discomfort with the research methods may have emerged.

4.1. Limitations

It is not the aim of qualitative research to make broad generalizations. Concurrent Analysis is designed to support greater generalizability (Snowden & Martin, 2010a,b) but it could still be argued that the small sample size may not be representative of gatekeeping responses from nurses in the wider community palliative setting. Furthermore, the participants in this study were known to the researcher who carried out the focus groups. This may have hindered discussion around the challenges associated with recruitment, particularly in relation to active disengagement or frustrations at the research process. The study relied on an updated literature‐searching algorithm previously used successfully by Kars et al. (2016). While their focus was on gatekeeping and their systematic review was published in a high‐impact journal, there is the possibility that some research may have been omitted in error. Finally, this was a retrospective account, with recall going back 2 years in some cases. Prospective studies of this typology are therefore needed.

5. Conclusion

Despite its small primary data set, this study has original implications for future studies in palliative care. Qualitative explorations of gatekeeping activity by nurses are under‐reported, as gatekeeping activity itself is rarely the focus of the research. Therefore, despite numerous statements that gatekeeping is problematic there is a lack of understanding around how to challenge it, when appropriate. This study has developed a continuum typology of gatekeeping behaviour and gone on to construct a screening tool designed to ascertain and discuss the likelihood of these behaviours and attitudes which have an impact on recruitment. Several evidence‐based initiatives may then be used to mitigate these specific behaviours where appropriate.

The first step is to bring gatekeeping into the open at the earliest opportunity by asking recruiting nurses to complete the screening tool. This means investing time before the study begins to discuss issues such as selection criteria, perceived burden and issues of patient autonomy. Ideally, recruiting nurses should be involved throughout the research process from study funding application and design onwards and thus drive these discussions. However, studies are often constructed by external partners and then brought into practice once funded. In these cases, the potential for gatekeeping should be discussed in a collaborative and supportive manner from the start, beginning with the expectation that gatekeeping will occur and that this is usual. This will allow nurses to reflect on their likely responses in a safe environment and consider what they are actually likely to do when faced with typical scenarios.

If this first step is achieved the study is more likely to remain as a significant priority amongst other competing priorities. Furthermore, once a good relationship has been built between the researchers and nurses there is more likelihood that complex issues such as the patient right to participate will be broached in a critical and collegiate manner. It is a fundamental right of any patient to refuse to participate in any research, but it is also a fundamental right to be asked in the first place unless capacity is legally impaired. This decision is much more likely to be facilitated in an atmosphere of collaboration and the screening tool developed here has been designed to support this process.

Conflict of interest

No conflict of interest has been declared by the authors.

Snowden A, Young J. A screening tool for predicting gatekeeping behaviour. Nurs Open. 2017;4:187–199. https://doi.org/10.1002/nop2.83

References

  1. Ammari, A. B. H. , Hendriksen, C. , & Rydahl‐Hansen, S. (2015). Recruitment and reasons for non‐participation in a family coping orientated palliative home care trial (FamCope). Journal of Psychosocial Oncology, 33, 655–674. [DOI] [PubMed] [Google Scholar]
  2. Bailey, J. (2008). First steps in qualitative data analysis: Transcribing. Family Practice, 25, 127–131. [DOI] [PubMed] [Google Scholar]
  3. Bellamy, G. , Gott, M. , & Frey, R. (2011). ‘it's my pleasure?’: The views of palliative care patients about being asked to participate in research. Progress in Palliative Care, 19, 159–164. [Google Scholar]
  4. Bond Sutton, L. , Erlen, J. A. , Glad, J. M. , & Siminoff, L. A. (2003). Recruiting vulnerable populations for research: Revisiting the ethical issues. Journal of Professional Nursing, 19, 106–112. [DOI] [PubMed] [Google Scholar]
  5. Borschmann, R. , Patterson, S. , Poovendran, D. , Wilson, D. , & Weaver, T. (2014). Influences on recruitment to randomised controlled trials in mental health settings in England: A national cross‐sectional survey of researchers working for the Mental Health Research Network. BMC Medical Research methodology, 14, 23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bucci, S. , Butcher, I. , Hartley, S. , Neil, S. T. , Mulligan, J. , & Haddock, G. (2015). Barriers and facilitators to recruitment in mental health services: Care coordinators' expectations and experience of referring to a psychosis research trial. Psychology and Psychotherapy: Theory, Research and Practice, 88, 335–350. [DOI] [PubMed] [Google Scholar]
  7. Bullen, T. , Maher, K. , Rosenberg, J. P. , & Smith, B. (2014). Establishing research in a palliative care clinical setting: Perceived barriers and implemented strategies. Applied Nursing Research, 27, 78–83. [DOI] [PubMed] [Google Scholar]
  8. Caldwell, P. H. Y. , Hamilton, S. , Tan, A. , & Craig, J. C. (2010). Strategies for increasing recruitment to randomised controlled trials: Systematic review. PLoS Medicine, 7, e1000368 https://doi.org/10.1371/journal.pmed.1000368. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Casarett, D. J. , Karlawish, J. , & Hirschman, K. B. (2002). Are hospices ready to participate in palliative care research? Results of a national survey. Journal of Palliative Medicine, 5, 397–406. [DOI] [PubMed] [Google Scholar]
  10. Casarett, D. , Kassner, C. T. , & Kutner, J. S. (2004). Recruiting for research in hospice: feasibility of a research screening protocol. Journal of Palliative Medicine, 7, 854–860. [DOI] [PubMed] [Google Scholar]
  11. Charmaz, K. (2006). Constructing grounded theory; A practical guide through qualitative analysis. London: Sage. [Google Scholar]
  12. Charmaz, K. (2009). Developing grounded theory: The second generation In Morse J. M., Stern P. N., Corbin J., Bowers B., Clarke A. E. & Charmaz K. (Eds.), Walnut Creek (pp. 127–149). CA: Left Coast Press. [Google Scholar]
  13. Chen, E. K. , Riffin, C. , Reid, M. C. , Adelman, R. , Warmington, M. , Mehta, S. S. , & Pillemer, K. (2014). Why is high‐quality research on palliative care so hard to do? Barriers to improved research from a survey of palliative care researchers. Journal of Palliative Medicine, 17, 782–788. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Daniels, L. E. , & Exley, C. (2001). Preparation, information and liaison: conducting successful research in palliative care. International Journal of Palliative Nursing, 7, 192–197. [DOI] [PubMed] [Google Scholar]
  15. Dunleavy, L. , Griggs, A. , Wiley, G. , & Hughes, M. (2011). Overcoming the hurdles: Setting up clinical trials in three UK hospices. International Journal of Palliative Nursing, 17, 131–134. [DOI] [PubMed] [Google Scholar]
  16. Dunne, C. (2011). The place of the literature review in grounded theory research. International Journal of Social Research Methodology, 14, 1–14. [Google Scholar]
  17. Ewing, G. , Rogers, M. , Barclay, S. , McCabe, J. , Martin, A. , & Todd, C. (2004). ecruiting patients into a primary care based study of palliative care: Why is it so difficult? Palliative Medicine, 18, 452–459. [DOI] [PubMed] [Google Scholar]
  18. Festinger, L. (1957). A theory of cognitive dissonance, Stanford University Press. Available from: http://books.google.com/books?id=voeQ-8CASacC [last accessed 21 April 2017].
  19. Finlayson, C. (2015). Review: Reflections on access: Too vulnerable to research? Journal of Research in Nursing, 20, 38–38. [Google Scholar]
  20. Fletcher, B. , Gheorghe, A. , Moore, D. , Wilson, S. , & Damery, S. (2012). Improving the recruitment activity of clinicians in randomised controlled trials: A systematic review. British Medical Journal Open, 2, e000496–e000496. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Froggatt, K. , Preston, N. , Turner, M. , & Kerr, C. (2015). Patient and public involvement in research and the Cancer Experiences Collaborative: benefits and challenges. BMJ Supportive & Palliative Care, 11, 1–4. [DOI] [PubMed] [Google Scholar]
  22. Gardiner, C. , Barnes, S. , Small, N. , Gott, M. , Payne, S. , Seamark, D. , & Halpin, D. (2010). Reconciling informed consent and ‘do no harm’: ethical challenges in palliativecare research and practice in chronic obstructive pulmonary disease. Palliative Medicine, 24, 469–472. [DOI] [PubMed] [Google Scholar]
  23. Gibbins, J. , Reid, C. M. , Bloor, S. , Burcombe, M. , McCoubrie, R. , & Forbes, K. (2013). Overcoming barriers to recruitment in care of the dying research in hospitals. Journal of Pain and Symptom Management, 45, 859–867. [DOI] [PubMed] [Google Scholar]
  24. Graffy, J. , Grant, J. , Boase, S. , Ward, E. , Wallace, P. , Miller, J. , & Kinmonth, A. L. (2009). UK research staff perspectives on improving recruitment and retention to primary care research; nominal group exercise. Family Practice, 26, 48–55. [DOI] [PubMed] [Google Scholar]
  25. Gysels, M. , Shipman, C. , & Higginson, I. J. (2008). Is the qualitative research interview an acceptable medium for research with palliative care patients and carers? BMC Medical Ethics, 9, 7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hanratty, B. , Lowson, E. , Holmes, L. , Addington‐Hall, J. , Arthur, A. , Grande, G. , … Seymour, J. (2012). A comparison of strategies to recruit older patients and carers to end‐of‐life research in primary care. BMC Health Services Research, 12, 342. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hanson, L. C. , Bull, J. , Wessell, K. , Massie, L. , Bennett, R. E. , Kutner, J. S. , … Abernethy, A. (2014). Strategies to Support Recruitment of Patients With Life‐Limiting Illness for Research: The Palliative Care Research Cooperative Group. Journal of Pain and Symptom Management, 46, 1021–1030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hickman, S. E. , Cartwright, J. C. , Nelson, C. A. , & Knafl, K. (2012). Compassion and vigilance: investigators' strategies to manage ethical concerns in palliative and end‐of‐life research. Journal of Palliative Medicine, 15, 880–889. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hollins‐Martin, C. , Snowden, A. , & Martin, C. R. (2012). Concurrent analysis: Validation of the domains within the Birth Satisfaction Scale. Journal of Reproductive and Infant Psychology, 30, 247–269. [Google Scholar]
  30. Hopkinson, J. B. , Wright, D. N. M. , & Corner, J. L. (2005). Seeking new methodology for palliative care research: challenging assumptions about studying people who are approaching the end of life. Palliative Medicine, 19, 532–537. [DOI] [PubMed] [Google Scholar]
  31. Jessiman, W. C. (2013). ‘To be honest, I haven't even thought about it’ – recruitment in small‐scale, qualitative research in primary care. Nurse Researcher, 21, 18–24. [DOI] [PubMed] [Google Scholar]
  32. Kars, M. C. , van Thiel, G. J. M. W. , van der Graaf, R. , Moors, M. , de Graeff, A. , & van Delden, J. J. M. (2016). A systematic review of reasons for gatekeeping in palliative care research. Palliative Medicine, 30, 533–548. [DOI] [PubMed] [Google Scholar]
  33. Kawulich, B. B. (2015). Gatekeeping: An ongoing adventure in research. Field Methods, 23, 57–76. [Google Scholar]
  34. Kirsh, K. L. , Walker, R. , Snider, S. , Weisenfluh, S. , Brown, G. M. , & Passik, S. D. (2004). Hospice staff members' views on conducting end‐of‐life research. Palliat Support Care, 2, 273–282. [DOI] [PubMed] [Google Scholar]
  35. Kutner, J. , Smith, M. , Mellis, K. , Felton, S. , Yamashita, T. , & Corbin, L. (2010). Methodological challenges in conducting a multi‐site randomized clinical trial of massage therapy in hospice. Journal of Palliative Medicine, 13, 739–744. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. LeBlanc, T. W. , Lodato, J. E. , Currow, D. C. , & Abernethy, A. P. (2013). Overcoming recruitment challenges in palliative care clinical trials. Journal of Oncology Practice/American Society of Clinical Oncology, 9, 277–282. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Ling, J. , Rees, E. , & Hardy, J. (2000). What influences participation in clinical trials in palliative care in a cancer centre? European Journal of Cancer, 36, 621–626. [DOI] [PubMed] [Google Scholar]
  38. Lussier, M. T. , Richard, C. , Guirguis, L. , Goldman, R. , Snowden, A. , & Latter, S. S. A. (2013). MEDICODE A comprehensive coding method to describe content and dialogue in medication discussions in healthcare provider‐patient encounters: Perspectives from Medicine, Nursing and Pharmacy. In International Conference on Communication in Healthcare. Montreal. EACH: International Association for Communication in Healthcare.
  39. McDonald, A. M. , Knight, R. C. , Campbell, M. K. , Entwistle, V. A. , Grant, A. M. , Cook, J. A. , … Snowdon, C. (2006). What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials, 7, 9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. McMillan, S. C. , & Weitzner, M. A. (2003). Methodologic issues in collecting data from debilitated patients with cancer near the end of life. Oncology Nursing Forum, 30, 123–129. [DOI] [PubMed] [Google Scholar]
  41. Morse, J. M. (2015). Critical analysis of strategies for determining rigor in qualitative inquiry. Qualitative Health Research, 25, 1212–1222. [DOI] [PubMed] [Google Scholar]
  42. Newington, L. , & Metcalfe, A. (2014). Factors influencing recruitment to research: Qualitative study of the experiences and perceptions of research teams. BMC Medical Research Methodology, 14, 10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. O'Mara, A. , Germain, D. S. , Ferrell, B. , & Borneman, T. (2009). Challenges to and lessons learned from conducting palliative care research. Journal of Pain and Symptom Management, 37, 387–394. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Payne, S. (2013). Recruitment into palliative care research studies: A common challenge. Progress in Palliative Care, 21, 263. [Google Scholar]
  45. Payne, S. , Field, D. , Rolls, L. , Hawker, S. , & Kerr, C. (2007). Case study research methods in end‐of‐life care: reflections on three studies. Journal of Advanced Nursing, 58, 236–245. [DOI] [PubMed] [Google Scholar]
  46. Potter, R. , Dale, J. , & Caramlau, I. (2009). A qualitative study exploring practice nurses' experience of participating in a primary care‐based randomised controlled trial. Journal of Research in Nursing, 14, 439–447. [Google Scholar]
  47. Ramjan, L. M. (2004). Nurses and the ‘therapeutic relationship’: Caring for adolescents with anorexia nervosa. Journal of Advanced Nursing, 45, 495–503. [DOI] [PubMed] [Google Scholar]
  48. Ross, C. , Cornbleet, M. , & Marie, F . (2015). Attitudes of patients and staff to research in a specialist palliative care unit, 491–497. [DOI] [PubMed] [Google Scholar]
  49. Sharkey, K. , Savulescu, J. , Aranda, S. , & Schofield, P. (2010). Clinician gate‐keeping in clinical research is not ethically defensible: An analysis. Journal of Medical Ethics, 36, 363–366. [DOI] [PubMed] [Google Scholar]
  50. Snowden, A. (2010). Integrating medicines management into mental health nursing in UK. Archives of Psychiatric Nursing, 24, 178–188. [DOI] [PubMed] [Google Scholar]
  51. Snowden, A. , & Atkinson, J. (2012). Concurrent analysis: A pragmatic justification. Nursing Philosophy, 13, 126–141. [DOI] [PubMed] [Google Scholar]
  52. Snowden, A. , & Kolb, H. (2017). Two years of unintended consequences: Introducing an electronic health record system in a hospice in Scotland. Journal of Clinical Nursing, 26, 1414–1427. [DOI] [PubMed] [Google Scholar]
  53. Snowden, A. , & Martin, C. (2010a). Concurrent analysis : Towards generalisable qualitative research. Journal of Clinical Nursing, 20, 2868–2877. [DOI] [PubMed] [Google Scholar]
  54. Snowden, A. , & Martin, C. R. (2010b). Mental health nurse prescribing: A difficult pill to swallow? Journal of Psychiatric and Mental Health Nursing, 17, 543–553. [DOI] [PubMed] [Google Scholar]
  55. Snowden, A. , & Young, J. (2016). Gatekeeping: A typology and screening tool In The RCN international nursing research conference 2016. Edinburgh: RCN. [Google Scholar]
  56. Snowden, A. , Martin, C. R. , Jomeen, J. , & Hollins Martin, C. J. (2011). Concurrent analysis of choice and control in childbirth. BMC Pregnancy and Childbirth, 11, 40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Snowden, A. , Young, J. , White, C. , Murray, E. , Richard, C. , Lussier, M.‐T. , … Ross, E . (2015). Evaluating holistic needs assessment in outpatient cancer care: a randomised controlled trial‐ the study protocol. BMJ Open, 5 (e006840) https://doi.org/10.1136/bmjopen-2014-006840. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Steinhauser, K. E. , Clipp, E. C. , Hays, J. C. , Olsen, M. , Arnold, R. , Christakis, N. A. , … Tulsky, J.A. (2006). Identifying, recruiting, and retaining seriously‐ill patients and their caregivers in longitudinal research. Palliative Medicine, 20, 745–75. [DOI] [PubMed] [Google Scholar]
  59. Stevens, T. , Wilde, D. , Paz, S. , Ahmedzai, S. H. , Rawson, A. , & Wragg, D. (2003). Palliative care research protocols: a special case for ethical review? Palliative Medicine, 17, 482–490. [DOI] [PubMed] [Google Scholar]
  60. Stewart, D. W. , & Shamdasani, P. M. (1990). Focus groups. Theory and practice. London: Sage Publications. [Google Scholar]
  61. Stone, P. C. , Gwilliam, B. , Keeley, V. , Todd, C. , Kelly, L. C. , & Barclay, S. (2013). Factors affecting recruitment to an observational multicentre palliative care study. BMJ Supportive & Palliative Care, 3, 318–323. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Tan, H. , Wilson, A. , Olver, I. , & Barton, C . (2010). Recruiting palliative patients for a large qualitative study: some ethical considerations and staff dilemmas. Explore, 6, 159–165. [DOI] [PubMed] [Google Scholar]
  63. Treweek, S. , Mitchell, E. , Pitkethly, M. , Cook, J. , Kjeldstrøm, M. , Taskila, T. , … Jones, R. (2010). Strategies to improve recruitment to randomised controlled trials. Cochrane Database of Systematic Reviews (Online), 4, MR000013. [DOI] [PubMed] [Google Scholar]
  64. Watson, J. M. , & Torgerson, D. J. (2006). Increasing recruitment to randomised trials: A review of randomised controlled trials. BMC Medical Research Methodology, 6, 34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. White, C. , & Hardy, J. (2009). Attitudes of patients with advanced cancer toward research. Journal of Pain and Symptom Management, 38, e5–e6. [DOI] [PubMed] [Google Scholar]
  66. White, C. D. , Hardy, J. R. , Gilshenan, K. S. , Charles, M. A. , & Pinkerton, C. R. (2008). Randomised controlled trials of palliative care ‐ a survey of the views of advanced cancer patients and their relatives. European Journal of Cancer, 44(13), 1820–1828. [DOI] [PubMed] [Google Scholar]
  67. Witham, G. , Beddow, A. , & Haigh, C. (2013). Reflections on access: Too vulnerable to research? Journal of Research in Nursing, 20, 28–37. [Google Scholar]
  68. Woodward, V. , Webb, C. , & Prowse, M. (2007). The perceptions and experiences of nurses undertaking research in the clinical setting. Journal of Research in Nursing, 12, 227–244. [Google Scholar]

Articles from Nursing Open are provided here courtesy of Wiley

RESOURCES