Skip to main content
Primary Health Care Research & Development logoLink to Primary Health Care Research & Development
. 2018 Aug 2;20:e6. doi: 10.1017/S1463423618000488

Strategies, facilitators and barriers to implementation of evidence-based practice in community nursing: a systematic mixed-studies review and qualitative synthesis

Amy Mathieson 1,, Gunn Grande 2, Karen Luker 3
PMCID: PMC6476399  PMID: 30068402

Abstract

Aim

To appraise and synthesize empirical literature on implementation of evidence within community nursing. To explore the use of implementation theory and identify the strategies required for, and the barriers and facilitators to, successful implementation within this context.

Background

There is an international consensus that evidence-based practice can improve outcomes for people using health and social care services. However, these practices are not always translated into care delivery. Community nursing is a relatively understudied area; little is known about how innovations in practice are implemented within this setting.

Methods

Systematic mixed-studies review, synthesizing quantitative and qualitative research. The electronic databases AMED, PsycINFO, Ovid Medline, CINAHL Plus, ASSIA, British Nursing Index and EMBASE were used. Two grey literature databases were also searched: OpenGrey and EThOS. English language, peer-reviewed papers published between January 2010 and July 2017 were considered. Criteria included implementation of an innovation and change to practice within adult community nursing. An approach called Critical Interpretive Synthesis was used to integrate the evidence from across the studies into a comprehensible theoretical framework.

Results

In total, 22 papers were reviewed. Few studies discussed the use of theory when planning, guiding and evaluating the implementation of the innovation (n=6). A number of implementation strategies, facilitators and barriers were identified across the included studies, highlighting the interplay of both service context and individual factors in successful implementation.

Conclusion

Implementation is an expanding area of research; yet is challenged by a lack of consistency in terminology and limited use of theory. Implementation within community nursing is a complex process, requiring both individual and organizational adoption, and managerial support. Successful adoption of evidence-based practice however, is only possible if community nurses themselves deem it useful and there is evidence that it could have a positive impact on the patient and/or their primary carer.

Key words: community nursing, community/home care, evidence-based practice, implementation, systematic review

Introduction

For decades, evidence-based practice (EBP) has been an aspiration for health service providers. The World Health Organization (WHO) has stated that healthcare provision should be based on the best available evidence. Healthcare professionals are expected to engage with evidence and practice in line with it. Professional regulatory bodies such as the Nursing and Midwifery Council include the expectation that nurses deliver EBP in all settings (Brooke and Mallion, 2016; Mallion and Brooke, 2016). However, gaps still exist between research evidence, changes to practice and improved outcomes for patients (Wilson et al., 2010; Grimshaw et al., 2012).

Previous research, exploring nurses’ beliefs, skills and knowledge of EBP, has reported that nurses encounter various barriers to EBP implementation, resulting in a lack of engagement. Barriers frequently reported include lack of time, staff shortage, heavy patient caseload, family commitments, limited knowledge of EBP and negative beliefs toward it, and limited academic skills (Mallion and Brooke, 2016). Many publications however, fail to address why and how implementation processes have worked, or why attempts failed. This lack of concern with the process of change is another barrier to the application of best evidence in practice (Bryar and Bannigan, 2003). There have been calls by policy makers and researchers to use theory to explore these processes (Mcevoy et al., 2014).

The majority of nursing implementation science research has been conducted in acute hospital settings (Estabrooks et al., 2002; Lucero et al., 2009; Van Bogaert et al., 2009; Brooke and Mallion, 2016). Although care in the community has expanded globally, literature exploring implementation of EBP in this setting remains limited, including implementation strategies used by community nurses (Brooke and Mallion, 2016).

Lessons may be learnt from hospital and nursing home settings; however, community nursing is a unique setting that requires specific implementation strategies. Furthermore, it has been agreed that implementation studies in nursing are preoccupied with ‘education’ as a strategy including lectures and discussion sessions, feedback and reminders (van Achterberg, 2013); other potential strategies are seldom explored.

The aim of this review is to explore the use of implementation theory and identify the strategies required for, and the barriers and facilitators to, successful implementation within community nursing. The purpose is to add to the knowledge on effective implementation within this context.

In this paper, we use the term ‘implementation’ and ‘community nursing’. Internationally, community nursing is often referred to as ‘home care nursing’. In the United Kingdom, Australia and Sweden these nurses are referred to as ‘district nurses’. We define community nursing as the work of caring for people in their homes, rather than an institution. We define implementation as ‘[The] active and planned efforts to mainstream an innovation within an organization’ (Greenhalgh et al., 2004, p. 582). While dissemination is an important component in implementation science, this review is focused on the implementation only of innovations designed to enhance care.

Method

As the topic area of this review is context-sensitive, a design that provides a practical understanding of the phenomenon is required. The approach taken was therefore a systematic mixed-studies review and convergent qualitative synthesis (Pluye and Hong, 2014). To maximize transparency, where appropriate, we have reported our review in line with the PRISMA statement (Moher et al., 2009).

The standard systematic review steps were taken, whereby the reviewer (A.M.) identified, selected, appraised and synthesized qualitative, quantitative and mixed-methods studies; with all papers reviewed independently by the three authors. Authors discussed disagreements and a consensus was met. For pragmatic reasons, a time limit for the literature was imposed. To ensure all relevant literature within this time limit was captured, a number of databases were searched from different fields.

Search strategy

The search strategy (Figure 1) included papers published between January 2010 and July 2017 identified from the electronic databases AMED, PsycINFO, Ovid Medline, CINAHL Plus, ASSIA, British Nursing Index and EMBASE. The grey literature databases OpenGrey and EThOS were also searched. A Boolean search was conducted using the following terms ‘Implement*’; ‘Evidence-based Medicine’; ‘Evidence-based Practice’; ‘District Nurs*’; ‘Community Health Nurs*’; ‘Home Care Nurs*’ (Table 1). The search strategy identified a total of 660 titles. Retrieved articles were considered for inclusion if they were peer-reviewed primary research published in English and met the inclusion criteria of implementation within community nursing. This was restricted to adult general nursing. The scale on which the innovation (EBP) was implemented was not stipulated. Implementation within a children community nursing setting, and community mental health nursing studies in the absence of physical illness, were excluded. In total, 22 papers were identified as relevant.

Figure 1.

Figure 1

PRISMA flowchart of search strategy

Table 1.

Search key with Boolean operators

Search line Term
1 Implement*
2 Evidence-based Practice
3 Evidence Based Practice
4 Evidence-based Medicine
5 Evidence Based Medicine
6 OR/1-5
7 District Nurs*
8 Community Health Nurs*
9 Home Care Nurs*
10 OR/7-9
11 6 AND 10

A separate search was conducted in the Cochrane Database for Systematic Reviews to explore publications on the same subject matter to avoid unnecessary duplication.

Quality appraisal

The 22 included studies were appraised using the assessment template for disparate data developed by Hawker et al. (2002) (Box 1). This checklist consists of nine questions, each of which has four sub-categories, allowing for the calculation of a summed score indicating the methodological quality. Using this tool and following the appraisal prompts, each paper was rated on a scale from 36 (Good) to 4 (Very poor). The studies were independently assessed by at least two reviewers. Most studies were assessed to be of reasonable quality, with scores ranging from 20 to 33 (Table 2). Papers were not excluded based on quality assessment.

Box 1.

Assessment form (Hawker et al., 2002)

Author and Title:
Date:
Good Fair Poor Very poor Comment
1. Abstract and title
2. Introduction and aims
3. Method and data
4. Sampling
5. Data analysis
6. Ethics and bias
7. Findings and results
8. Transferability/generalizability
9. Implications and usefulness
Total

1. Abstract and title: Did they provide a clear description of the study?

2. Introduction and aims: Was there a good background and clear statement of the aims of the research?

3. Method and data: Is the method appropriate and clearly explained?

4. Sampling: Was the sampling strategy appropriate to address the aims?

5. Data analysis: Was the description of the data analysis sufficiently rigorous?

6. Ethics: Have ethical issues been addressed, and what has necessary ethical approvals gained?

7. Results: Is there a clear statement of findings?

8. Generalizability: Are the findings of this study transferable (generalizable) to the wider population?

9. Implications and usefulness: How important are these findings to policy and practice?

Table 2.

Summary of the included studies

Authors and year Country Innovation/type of intervention Research Design and Method Quality Score
Amacher et al. (2016) Switzerland Falls Prevention Programme (FPP) Mixed-methods: qualitative interviews followed by questionnaire Post-implementation 28
Andrew et al. (2013) UK The Dignity Care Pathway (DCP) Qualitative: focus groups Pre–post-implementation 22
Annells et al. (2011) Australia Best practice mental health screening and referral clinical pathway for generalist community nursing Mixed methods: evaluation surveys and focus groups Pre–post-implementation 26
Brennan et al (2010) USA Technology-enhanced practice (TEP): usual care supplemented with a web-based resources Quantitative: surveys. Post-implementation 26
Byron and Hoskins (2013) UK Verification of expected death (VOED) Policy Qualitative: semi-structured interviews Post-implementation 32
Doran et al. (2013) Canada A clinical information system (CIS) in a community setting Mixed methods: interviews; focus groups; and surveys Post-implementation 25
Haycock-Stuart and Kean (2013) UK Policy to shift location of care from secondary, acute care settings to primary, community care settings Qualitative: semi-structured interviews and focus groups Post-implementation 31
Joy et al. (2015) UK Foam dressing Quantitative: reduction range of dressings used, frequency of dressing changes, visits and overall cost Pre- and post-implementation 26
Kapp (2013) Australia Australian Wound Management Association (AWMA) Guidelines Quantitative: surveys and client profiles Pre–post-implementation 23
Murray et al. (2011) UK (1) Choose and Book (C&B) system in a hospital trust and the lead Primary Care Trust providing referrals to the hospital (2) Picture Archive and Communication System (PACS) in one acute hospital trust (3) Community Nursing Information System (CNIS) for district nurses (DNs) Qualitative: semi-structured interviews Post-implementation 32
Nilsson et al. (2010) Sweden An electronic messaging program via computers and mobile phones with an internet connection Qualitative: semi-structured interviews Pre–post-implementation 28
Nordmark et al. (2016) Sweden Discharge Planning Process (DPP) and information exchange through an electronic information system. Qualitative: observations; interviews; registered adverse events and system failures; web-based survey Post-implementation 30
Paquay et al. (2010) Belgium The Belgian Guidelines for Prevention of Decubitus Ulcers (BGPDU) Quantitative: case report forms Pre–post-implementation 32
Pare et al. (2011) Canada SyMO – software to plan and organize nursing activities in patients’ homes Mixed-methods: structured questionnaire, semi-structured interviews were conducted with nurses, and a postal questionnaire was sent to patients. Pre–post-implementation 28
Sherman et al. (2016) UK Case management within community nursing practice. Qualitative: focus groups. Pre-implementation 33
Smith et al. (2013) Sweden Preventive Home Visits (PHV) Quantitative: cluster-controlled trial Post-implementation 26
Tapper et al. (2012) Canada Tablet computers. Quantitative: online surveys Post-implementation/evaluation 20
Taylor et al. (2015) UK Telehealth to monitor patients with COPD and Chronic Heart Failure Qualitative: semi-structured interviews Post-implementation 31
Vabo et al. (2016) Norway Guideline for assessing individual needs and instructions for using the guideline, including nursing documentation routines and training; in the context of move to a common electronic health record (improved content and quality of nursing documentation) Qualitative: focus groups and interviews Post-implementation 31
Van der Plas et al. (2014) The Netherlands PaTz (Palliative Thuis Zorg – Palliative Care at Home) Mixed methods: questionnaires and focus groups Post-implementation 32
Whittemore et al. (2013) USA A modified diabetes prevention program (mDPP) provided by homecare nurses to adults of public housing communities at-risk for type 2 diabetes Mixed methods: secondary analysis of a cluster randomization pilot study; interviews Post-implementation 32
Wilcox et al. (2010) USA The Heart Healthy and Ethnically Relevant (HHER) Lifestyle Program Quantitative: provider/nurse and client encounters were audio-recorded Pre-implementation 29

Data abstraction and synthesis

Key areas of each of the included papers were extracted by A.M. including: research design and methods; innovation/type of intervention; use of theory; participants and setting; outcome measures; findings; implementation data; barriers/challenges; and facilitators. The three authors discussed the data extracted for all papers. All the extracted data were analyzed using the same synthesis method.

Since the included studies were heterogeneous regarding design and outcome, we used an interpretive rather an aggregate approach to synthesize the evidence, namely Critical Interpretive Synthesis (CIS) (Dixon-Woods et al., 2006). This approach was adopted to explore the factors shaping implementation within community nursing, and aimed to produce an empirically grounded framework, which can be used in practice (Dixon-Woods et al., 2006). Previous reviews that have used CIS have revealed the appropriateness of this approach for answering questions concerning the influence of context on effectiveness (Flemming, 2010a; 2010b); in this instance, the impact of context on the success or not of implementation, and effectiveness of certain strategies and facilitators.

The extracted data were initially analyzed thematically. Recurring themes were identified by examining the evidence, and concepts (implementation strategies, barriers and facilitators) were generated. Concepts were refined by comparing the framework to the data and exploring relationships between them (Dixon-Woods et al., 2006). To produce a synthesizing argument, the concepts across the studies were then critically examined in terms of similarities (reciprocal transition) and differences (refutational translation) (Pluye and Hong, 2014). Similar concepts were translated into each other, and contradictions between studies were explored, until the most adequate concepts to explain the phenomena were chosen (Dixon-Woods et al., 2006). This allowed a ‘line of argument’ to be built, which integrated the evidence across the studies into a framework comprising the most prominent implementation strategies, barriers and facilitators constructs, and relationships between them.

Results

Nine qualitative papers, seven quantitative and six mixed-method studies were identified (Table 2). ‘Post-implementation’ studies (n=13) evaluated implementation efforts and impact of the innovation. ‘Pre–post-implementation’ studies (n=7) planned implementation, implemented the innovation and evaluated efforts. The remaining two studies were pre-implementation. The majority of post-implementation papers reported on large-scale studies evaluating a change led by an organization. Many of these reported post hoc implementation strategies or organizational support strategies. The included pre–post-implementation studies were mostly collaborative research projects, whereby the research team worked with potential adopters at an organizational or community level. Implementation strategies reported in these papers were mostly researcher-led. Similarly, the two pre-implementation papers reported on researcher-led projects.

Only six of the studies discussed the use of theory when planning, guiding and evaluating the implementation. Tapper et al. (2012) and Andrew et al. (2013) both used theory when planning implementation. Tapper et al. (2012) used Powell-Cope et al.’s (2008) conceptual framework on patient care technology when selecting the innovation, considering factors that may impact implementation, and developing the questions for the online survey. Andrew et al. (2013) used the integrated knowledge transfer approach described by Graham (2007) to guide the collaborative research project to implement a palliative care intervention.

Murray et al. (2011), van der Plas et al. (2014), Nordmark et al. (2016), and Vabo et al. (2016) applied theory to the findings to explore factors that impacted implementation. For Murray et al. (2011) and Nordmark et al. (2016) this was Normalization Process Theory; used as a framework to analyze qualitative findings. Similarly, Vabo et al. (2016) discussed the study’s findings using the PARiHS framework. van der Plas et al. (2014) applied Petrie’s framework for inter-professional work to the findings (Petrie, 1976).

In addition to the general observations, implementation strategies, facilitators and barriers were identified (see online Supplementary File 1 for a summary) and synthesized. Implementation strategies are defined as techniques used for the adoption and sustainability of an innovation (Proctor et al., 2013), often before implementation. Facilitators ease the implementation process once underway and refer to support that occurs within the context (Stetler et al., 2006) including resources, culture and values (Kitson et al., 2008); and barriers inhibit. The reported barriers, with the exception of ‘organizational infrastructure and changes’, are the antithesis of the identified facilitators. The barriers and facilitators are therefore discussed in parallel. Figure 2 illustrates how the strategies, facilitators and barriers inter-link. The following sections present the result of the synthesis.

Figure 2.

Figure 2

Relationship between implementation strategies, facilitators and barriers

Implementation strategies

Training and support strategies

Training nurses on how to use the innovation before it is implemented contributed to successful adoption. Most of the studies discussed the importance of the nurses’ confidence in using the innovation, with inadequate training often stated as a barrier. This was particularly evident when the innovation was technological. Length of training across the studies varies. Joy et al. (2015) provided a two week training and education phase when exploring the implementation of a new wound dressing. In contrast, a 3 h course was offered to healthcare professionals in Vabo et al.’ study (2016) and one day course for the District Nurses in Sherman et al.’ project (2016). This one day course was later extended to two days, and was followed by a group discussion four weeks after, as implementation was unsuccessful. Evidence that the wound dressing was successfully adopted (Joy et al., 2015) suggests a long training period is a contributing factor to successful adoption. In addition, continued support after initial training, encouraged adoption (Annells et al., 2011; Tapper et al., 2012; Kapp, 2013). Continued support included support for staff from other staff members; ‘safe spaces’ for staff to share positive and negative experiences of using the innovation; telephone or face-to-face contact with the researchers; and management support and allocation of organizational resources. For example, nurses in Kapp’s study (2013) were provided with telephone and email support throughout implementation. Practice guidelines were successfully implemented and pressure risk screening became a well-adopted practice (Kapp, 2013).

The allocation of roles

A strategy used in seven of the studies was the allocation of roles, such as an implementation team, key implementers or individuals responsible for monitoring the implementation process. This included the appointment of nurses into employed positions (Kapp, 2013; Smith et al., 2013; Whittemore et al., 2013; Nordmark et al., 2016) and volunteers, whose involvement in the study was in addition to their day-to-day role (Taylor et al., 2015; Vabo et al., 2016). For instance, Nordmark et al. (2016) in their study exploring the implementation of discharge planning process (DPP) found that discharge planners were appointed, who had a clear role and legitimate time to perform the DPP. Discharge planners were engaged with their work task, became experts in the area and the quality of the DPP improved (Nordmark et al., 2016). Where voluntary ‘key nurse’ roles were used, these were able to support staff during the implementation, and connect potential adopters with the innovation and the research team to enable them to participate in the studies’ data collection (Taylor et al., 2015; Vabo et al., 2016). For example, Taylor et al. (2015) recruited a local lead collaborator in each of the participating sites. ‘Local champions’ also emerged once implementation had begun and facilitated implementation. Local champions were key enablers of adoption through their promotion of telehealth and the support they provided to other staff (Taylor et al., 2015). Support from local champions was provided after the initial training by offering information, advice and sharing positive experiences. Having a clear visible nurse leader in addition to the research team, positively contributed to implementation.

Facilitators

Evidence that the innovation is easy to use, cost-effective and will save time

Practical issues, such as saving clinical time, cost-effectiveness and ease of use were important considerations for community nurses when implementing an innovation. In Murray et al.’s (2011) study exploring the use of the Community Nursing Information System, District Nurses claimed the Personal Digital Assistant devices were cheap, robust and portable, allowing nurses to feel comfortable carrying them when visiting patients. Similarly, in Kapp’s study (2013), respondents found the electronic risk tool, part of the Australian Wound Management Association Guidelines, was easy to use, and implementers were satisfied with the length of time to complete the tool. In contrast, the nurses in Annells et al.’s study (2011) claimed they were very ‘time poor’ and therefore were not always able to use the ‘lengthy’ mental health screening and referral clinical pathway. Furthermore, the pathway required time to become accustomed to it, which arguably community nurses do not have. A recurring theme was the time restrictions experienced by community nurses due to the nature of their work and increased demands upon the service. This inhibited community nurses’ participation in research and their ability to implement the innovation. Thus evidence across the studies suggest if the innovation saves clinical time, nurses will be more likely to continue with its implementation and may be encouraged to use the innovation in the future. van der Plas et al. (2014), for example, found that the PaTz (an acronym for ‘PAlliatieve Truis Zorg’; palliative care at home) saved healthcare professionals’ time. General Practitioners and District Nurses worked as a team and time was spent more efficiently (van der Plas et al., 2014).

Ownership, flexibility and the autonomy to adapt the innovation

A ‘bottom-up’ approach, including early engagement and collaborative working, and the ability of community nurses to tailor the innovation to meet individual needs was an important facilitator (Brennan et al., 2010; Paquay et al., 2010; Andrew et al., 2013; Haycock-Stuart and Kean, 2013; Smith et al., 2013; Joy et al., 2015; Taylor et al., 2015; Vabo et al., 2016). This was evident in Haycock-Stuart and Kean’s (2013) study exploring the implementation of a policy to shift care from acute care settings to community care settings. They found that the current top-down approach was not successful as there was no ‘ownership’ of the policy from frontline staff. The ‘top-down approach’ was at odds with the grass root service organization and delivery in the community setting, causing resistance from staff (Haycock-Stuart and Kean, 2013). Haycock-Stuart and Kean (2013) suggests that policy implementation should be negotiated with frontline community nurses, as a ‘shared vision’ is important for successful implementation. This was evident in Andrew et al.’s study (2013), which explored the implementation of the Dignity Care Pathway (DCP). Focus groups were conducted before implementation to gain ‘context-specific evidence’, and to assess if the DCP ‘fitted with nurses’ practice’ (Andrew et al., 2013). Possibly as a result of this engagement, the authors found that the assessment tools within the DCP could be used flexibly to accommodate patients’ individual needs and was applicable in everyday practice. Furthermore, working closely with the research team supported a collaborative relationship with the implementers, which facilitated the sharing and solving of issues during the study.

Improves nurse–patient relations and the care of patients and their relatives

Evidence that the innovation improves nurse–patient relations and patient care was a contributing factor in community nurses’ decision to adopt it. This was a facilitator for 14 of the 22 studies. For example, Nilsson et al. (2010) found that District Nurses initially expressed concern with using the information and communication technology (ICT), and thought it may be difficult to manage if many patients used the technology at the same time. Once accustomed to the use of ICT, the District Nurses said ‘a routine’ using the messaging program helped them to organize their work and was ‘what the ill person needed’, positively contributing to their relationship with the patient (Nilsson et al., 2010). In contrast, in Vabo et al.’s (2016) action research project implementing improved nursing documentation, nurses felt the system forced them to focus on isolated aspects of care. This was incompatible with the healthcare professionals’ values and goals in providing holistic care. Nurses therefore reverted back to ‘old habits’, stating their preference to spending time with the patient instead of documenting (Vabo et al., 2016).

Pre-existing trusting nurse–patient relations

There is evidence that nurses’ experience and rapport with patients assisted with the successful implementation of an innovation. Annells et al. (2011) found that rapport and trust between nurses and clients contributed to the pathway use. The pathway was successfully implemented even though many of the nurses believed they were inadequately skilled to undertake the generalist nursing care of people with mental health problems (Annells et al., 2011). This could be attributed to the trusting relationships between the nurses and clients, which facilitated implementation and eased potential barriers. Similarly, Andrews et al. (2013) found that the experienced nurses’ main criteria, when deciding to introduce the Dignity Care Pathway to patients, included having an established rapport, knowing the patients’ understanding of their prognosis, and consideration of family dynamics. Experienced nurses were also able to decide when to introduce the pathway; implementation may have been difficult for less experienced nurses. This finding however, revealed that the innovation was only being used with a select group of patients. The innovation had not been mainstreamed within the organization, and instead highlights adoption on an individual level.

Contributes to professional development and meets organizational goals

Nine of the studies claimed that professional development associated with using the innovation – maintaining existing skill-sets, developing new skills and knowledge – and the innovation serving to meet organizational goals, encouraged community nurses to adopt it. In turn, the organization offered appropriate support to assist with its successful implementation. Doran et al. (2013) found that access to electronic resources supported nurses’ learning and enhanced knowledge; these were found to be associated with nurses’ willingness to use the BlackBerry to document patient outcomes through the CIS. Furthermore, positive attitude towards both the employer and their values increased nurses’ willingness to adopt CIS (Doran et al., 2013). The opportunity to learn, have access to resources and develop new skills appeals to community nurses, and may encourage them to implement an innovation if it supports them to do so. Byron and Hoskins (2013), when exploring the implementation of the ‘verification of expected death’ (VOED) policy, found that over half the nurses agreed that regular updates on VOED would help maintain skills and competency. Junior staff would also have the opportunity to learn from more experienced nurses. As a result, VOED had become part of an induction programme (Byron and Hoskins, 2013).

Improves working relations

For Murray et al. (2011), Nordmark et al. (2016), Smith et al. (2013), van der Plas et al. (2014) and Whittemore et al. (2013) improved working relations had a positive impact upon the implementation of the respective innovations. Nordmark et al. (2016) found that hospital, primary healthcare and community care providers meeting together at the Discharge Planning Conference (DCP) overcame organizational boundaries and discussing the DPP facilitated a collective view of the process. Similarly, van der Plas et al. (2014) found that General Practitioners and District Nurses worked well together when they met six weekly. During these meetings, practitioners saw each other as more equal partners and appreciated each other’s expertise (van der Plas et al., 2014). Both the innovation, and the process of implementation, improved working relations, which in turn facilitated the continued use of the innovation.

Barrier

Organizational infrastructure and changes

Organizational changes – restructuring and the decentralization of services – had a negative impact upon implementation. Murray et al. (2011) found that organizational change absorbed staff time and energy, distracting them from the e-health implementation. Possibly related to this organizational change was a perceived problem with leadership, including the disbanding of the dedicated implementation group after the first year and inadequate allocation of resources for training and support (Murray et al., 2011). Similarly, Taylor et al. (2015) found that the restructuring of community nursing teams, the integration of health and social care, and the creation of the new Clinical Commissioning Groups were all raised as barriers to the adoption of the new telehealth technologies. Staff described these changes as ‘unprecedented’ and ‘overwhelming’ (Taylor et al., 2015). As a result, adjustment to these changes was considered the priority. Similarly, Brennan et al. (2010), when exploring the implementation of technology-enhanced practice, found that the intervention was affected by infrastructure changes. A stable organization, as opposed to re-organization, therefore supports implementation within community nursing.

Discussion

General summary

The review has illustrated that community nurses’ decision to adopt an innovation appears to be motivated by a return on investment, including improved nurse–patient relations or patient care, contribution to professional development, or improved relations with other healthcare professionals. In addition, flexibility and the autonomy to adapt the innovation encouraged community nurses to adopt it. This mirrors community nurses’ working practices and satisfaction derived from organizing their own workload. Organizational infrastructure and change was an important barrier, with community nurses claiming they were preoccupied with, and prioritized, these changes.

Quality of the included studies varied. Across the qualitative studies, sample sizes are small, limiting generalizability. Authors of qualitative studies often compensated for the lack of external validity by adopting strategies to increase trustworthiness, such as member checking and triangulation. However, findings from the included qualitative studies in this review have been corroborated with results from the quantitative papers. Overall the quality of the included quantitative studies was higher than the qualitative or mixed-methods studies. Due to the nature of the research design, sample sizes are larger and there is greater external validity amongst the quantitative studies. For example, Sherman et al.’s (2016) study scored highly on Hawker et al.’s (2002) appraisal tool. Sherman et al. (2016) along with Annells et al. (2011) and Doran et al. (2013) all used validated and tested tools. In contrast, the surveys and tools used by Paquay et al. (2010), Tapper et al. (2012) and Kapp (2013) were untested and not validated.

Variation in the quality of studies, designs and samples implies implementation science in community nursing requires development. Authors using different terms to describe the same phenomena cause confusion. Implementation strategies in the literature are seldom labelled and researchers do not provide rationales for the strategies used. This review attempts to provide some harmony by presenting an overview and synthesis of strategies, barriers and facilitators.

‘Line of argument’: the complexity of implementation within community nursing

The identified barriers and facilitators paint a complex picture of implementation within community nursing and it does not appear to be a simple recipe of ‘do and don’t’. It is clear from the included studies, and may even be assumed, that community nursing is patient-focussed. Community nurses were therefore less likely to adopt the innovation if, by integrating it into their routine practice, existing nurse–client relations could be negatively affected. In addition, the trend across the quantitative studies to include patients as participants suggests that end-user adoption may influence implementation. Patients’ unwillingness to comply with EBP may discourage practitioners (Logan and Graham, 1998). This finding may be a result of selection bias, as papers were included if they reported on the implementation of an innovation designed to enhance care. If the innovation did not enhance care, implementation may be considered a ‘failure’. Yet our analysis also suggests that community nursing practice is driven by other factors, which may promote or inhibit implementation. These include meeting organizational goals and targets, by which community nurses’ practice is ultimately assessed; and professional development. A ‘good idea’ or evidence that the innovation improves care is therefore not enough and other conditions or facilitators are required. This underlines the importance of working in partnership with practitioners to identify research questions and develop interventions.

Training and an on-going education phase on how to use and integrate the innovation was a key facilitator found across the included papers. However, embedding this training through experience is challenging (Taylor et al., 2015). Continued support is needed, which can be difficult when managing a busy caseload. A lack of time is a widely reported barrier to engagement with, and implementation of, EBP. One solution may be to hold training outside of working hours, if attendance contributes to nurses’ revalidation (Johnston et al., 2016). Another is support from ‘local champions’ (Taylor et al., 2015). Taylor et al. (2015) found that local champions and nurses with substantial experiential knowledge facilitated shared learning and were able to troubleshoot issues with the adoption of the telehealth. Although researchers are able to offer support, clinical buy-in and drive from the nurses who have, or wish to, adopt the innovation, is required.

Giving nurses the flexibility to use and adapt the innovation, and the need for managers to be on board to allow the time and investment of resources to implement it, were both facilitators. Haycock-Stuart and Kean’s (2013) findings suggests there is a complex interplay between the values nurses place upon an innovation, their current skill set and preparation for integrating the innovation, both from frontline staff and managers. However, findings collectively from the included studies suggest that nurses make decisions as individuals. Context clearly plays a key role here. While community nurses deliver care, they also organize it and are often responsible for their caseload (Sales, 2013). Implementing an innovation is not an exception to this; nurses are an active component within the process, and it is arguably through the process of reflection and critical thinking that change occurs (Griffiths, 2003). As Doran et al. (2013) highlight, community nursing is independent in nature. As most of the work community nurses do is in patients’ homes and is not supervised by managers (Walshe and Luker, 2010), community nurses can organize their own workload and dedicate time to certain tasks. This could contribute to successful implementation or not, as community nurses have a degree of autonomy and can therefore decide to adopt an innovation. This may mean adoption in community nursing is rather individualistic and therefore haphazard.

Community nurses’ work however, is not conducted in isolation. Many of the studies included other healthcare settings or participants in their analysis, such as General Practitioners; secondary care settings; and manager (Annells et al., 2011; Murray et al., 2011; van der Plas et al., 2014; Taylor et al., 2015; Amacher et al., 2016; Vabo et al., 2016). This suggests community nurses’ interactions with other healthcare professionals, and their attitudes towards nurses’ changing practices, could act as a barrier or facilitator. Along with improvements to patient care and saving time, opportunities to work with other healthcare professionals and feeling a valued member of the team may be an acceptable ‘return on investment’ and encourage community nurses to adopt an innovation. There is also evidence that the wider organizational context can facilitate or inhibit the adoption of EBP. Working in a constantly changing environment makes mainstreaming an innovation difficult. As Taylor et al. (2015) found, other changes may take priority and render the introduction of another change impossible; highlighting the importance of timing when implementing an innovation. Furthermore, evidence from the included papers suggested innovations that required the re-organization of teams also resulted in resistance from adopters, which in turn created a barrier to implementation. The included papers, and literature elsewhere (Harrod et al., 2016; Johnston et al., 2016), revealed that others working in multi-disciplinary teams could act as a barrier. In order to implement an innovation within a multi-disciplinary team, adopters need to understand each other’s roles and workload (Harrod et al., 2016; Nordmark et al., 2016).

As discussed, adoption of an innovation is reliant on the decision of the community nurse. There is little evidence, however, to suggest that nurses introduce innovations themselves after engaging with EBP. This may be a result of a lack of availability of relevant research in primary care, lack of skills to appraise evidence, or the lack of awareness of change mechanisms (Bryar and Bannigan, 2003). In addition, the reactive nature of community nursing makes it difficult for nurses to plan and introduce changes, with practitioner making snap decisions in patients’ homes (Closs, 2003). Furthermore, in practice, implementation is trial and error and nurses may not have the confidence to trial the innovation. Ultimately, however, community nurses need support from the organization and/or senior colleagues. Managers are more likely to grant time, and support implementation efforts, if the innovation meets organizational goals, for example national targets, and if it is compatible with their values. This illustrates that evidence-based nursing not only depends on the availability of evidence, patient preferences and the clinical expertise of the nurse, but also the organizational resources available (Closs, 2003). This suggests that community nurses have more freedom to decide if they wish to engage with top-down implementation than to introduce an innovation without management instructions. Future implementation within the context of community nursing therefore requires a facilitated approach, acknowledging both top-down and bottom-up techniques.

Gaps in the literature

Continued support, including collaborative working and the use local champions, were identified to be both implementation strategies and facilitators, promoting the adoption of an innovation. The other identified implementation strategies and facilitators require further testing. Future research could evaluate how these facilitators could be used to effectively overcome barriers.

There is a lack of research based on rigorous conceptual frameworks. Theory is seldom used when implementing an innovation. There are a plethora of frameworks and theories relevant to implementation research that can be used to guide implementation processes and consider sustainability (Tabak et al., 2012; Wilson et al., 2017). There is a need to test theories in a community nursing context. Furthermore, more effort should be made to understand how sustainability of implementation can be achieved (van Achterberg, 2013). As a result of limited funding, follow-up periods after the introduction of new EBP are often short and implementation science researchers are required to work within the resources available to them. We therefore suggest that future research be undertaken around the continued adoption of EBP within community nursing; and the use of identified strategies to sustain a change of practice within this context.

Limitations

There are a number of limitations to this review, mainly relating to scope. Only English Language papers were reviewed and the quality of the papers varied. The included papers come from a wide range of countries with differing healthcare systems. However, by adopting a Critical Interpretive Synthesis approach we have attempted to be critical and clarify effective implementation strategies in a diverse and confused field. Due to inconsistency in reporting, labelling and defining these strategies have relied upon our interpretations and those of the authors’ of the included studies. In particular, the post hoc implementation strategies offered in the included studies are attempts by the authors to explain what did or did not work. There may be alternative explanations, and more appropriate names. More testing is therefore required.

Conclusion

This review reveals the importance of support strategies when implementing EBP in community, including regular meetings and updates from the researcher, the allocation of resources and managerial support. This included training and time to become familiar with the innovation. Furthermore, training must be embedded in practice and individual adoption is often influenced by the nurses’ actual or perceived skill-set and personal relationship with the innovation. More testing of the identified strategies and facilitators is required. The review findings support the emerging consensus that implementation research reports should describe an evaluation of its process (Hulscher et al., 2003; Sales, 2013); utilize theory; and explore sustainability of implementation.

Acknowledgements

This project was funded by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care (NIHR CLAHRC) Greater Manchester. The NIHR CLAHRC Greater Manchester is a partnership between providers and commissioners from the NHS, industry and the third sector, as well as clinical and research staff from the University of Manchester. The views expressed in this article are those of the author(s) and not necessarily those of the NHS, NIHR or the Department of Health and Social Care.

Authors’ Contribution

A.M., G.G. and K.L. contributed to the conceptualisation and study design. A.M. initially extracted and synthesized the data. Synthesis of the data was amended by G.G. and K.L. All authors contributed to drafting and revising the article, and approved the final manuscript. All authors have agreed on the final version and meet at least one of the following criteria (recommended by the ICMJE, http://icmje.org.ethical _1author.html): ∙ Substantial contributions to conception and design, acquisition of data or analysis and interpretation of the data; ∙ Drafting the article and revising it critically for important intellectual content.

Conflicts of Interest

None.

Supplementary material

For supplementary material accompanying this paper visit https://doi.org/10.1017/S1463423618000488.

S1463423618000488sup001.docx (36.5KB, docx)

click here to view supplementary material

References

  1. Amacher AE, Nast I, Zindel B, Schmid L, Krafft V Niedermann K (2016) Experiences of general practitioners, home care nurses, physiotherapists and seniors involved in a multidisciplinary home-based fall prevention programme: a mixed method study. BMC Health Services Research 16, 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Andrew J, Johnston B Papadopoulou C (2013) Community nurses’ participation in palliative care research: the Dignity Care Pathway. British Journal of Community Nursing 18, 326, 328–331. [DOI] [PubMed] [Google Scholar]
  3. Annells M, Allen J, Nunn R, Lang L, Petrie E, Clark E Robins A (2011) An evaluation of a mental health screening and referral pathway for community nursing care: nurses’ and general practitioners’ perspectives. Journal of Clinical Nursing 20, 214–226. [DOI] [PubMed] [Google Scholar]
  4. Brennan PF, Casper GR, Burke LJ, Johnson K, Brown R, Valdez RS, Sebern M, Perez O Sturgeon B (2010) Technology-enhanced practice for patients with chronic cardiac disease: home implementation and evaluation. Heart and Lung: Journal of Acute and Critical Care 39, S35–S46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Brooke JM Mallion J (2016) Implementation of evidence‐based practice by nurses working in community settings and their strategies to mentor student nurses to develop evidence‐based practice: a qualitative study. International Journal of Nursing Practice 22, 339–347. [DOI] [PubMed] [Google Scholar]
  6. Bryar R Bannigan K (2003) The process of change: issues for practice development In Bryar, R and Griffiths, J, editors. Practice Development in Community Nursing: Principles and Processes. London: Arnold. [Google Scholar]
  7. Byron S Hoskins R (2013) Implementing the ‘verification of expected death’ policy in clinical practice. British Journal of Community Nursing 18, 505–6, 508–511. [DOI] [PubMed] [Google Scholar]
  8. Closs SJ (2003) Evidence and community-based nursing practice In Bryar, R and Griffiths, J, editors. Practice Development in Community Nursing: Principles and Processes. London: Arnold. [Google Scholar]
  9. Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, Hsu R, Katbamna S, Olsen R, Smith L, Riley R Sutton AJ (2006) Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Medical Research Methodology 6, 35–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Doran DM, Reid-Haughian C, Chilcote A Bai YQ (2013) A formative evaluation of nurses’ use of electronic devices in a home care setting. Canadian Journal of Nursing Research 45, 54–73. [DOI] [PubMed] [Google Scholar]
  11. Estabrooks CA, Tourangeau AE, Humphrey CK, Hesketh KL, Giovannetti P, Thomson D, Wong J, Acorn S, Clarke H Shamian J (2002) Measuring the hospital practice environment: a Canadian context. Research in Nursing & Health 25, 256–268. [DOI] [PubMed] [Google Scholar]
  12. Flemming K (2010. a) Synthesis of quantitative and qualitative research: an example using Critical Interpretive Synthesis. Journal of Advanced Nursing 66, 201–217. [DOI] [PubMed] [Google Scholar]
  13. Flemming K (2010. b) The use of morphine to treat cancer-related pain: a synthesis of quantitative and qualitative research. Journal of Pain and Symptom Management 39, 139–154. [DOI] [PubMed] [Google Scholar]
  14. Graham ID (2007) Knowledge translation at CHIR. Retrieved 13 November 2017 from www.cihr-irsc.gc.ca/e/33747.
  15. Greenhalgh T, Robert G, Macfarlane F, Bate P Kyriakidou O (2004) Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Quarterly 82, 581–629. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Griffiths J (2003) Practice development: defining the terms In Bryar, R and Griffiths, J, editors. Practice Development in Community Nursing: Principles and Processes. London: Arnold. [Google Scholar]
  17. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ Squires JE (2012) Knowledge translation of research findings. Implementation Science 7, 50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Harrod M, Weston LE, Robinson C, Tremblay A, Greenstone CL Forman J (2016) “It goes beyond good camaraderie”: a qualitative study of the process of becoming an interprofessional healthcare “teamlet”. Journal of Interprofessional Care 30, 295. [DOI] [PubMed] [Google Scholar]
  19. Hawker S, Payne S, Kerr C, Hardey M Powell J (2002) Appraising the evidence: reviewing disparate data systematically. Qualitative Health Research 12, 1284–1299. [DOI] [PubMed] [Google Scholar]
  20. Haycock-Stuart E Kean S (2013) Shifting the balance of care? A qualitative study of policy implementation in community nursing. Journal of Nursing Management 21, 867–877. [DOI] [PubMed] [Google Scholar]
  21. Hulscher M, Laurant M Grol R (2003) Process evaluation on quality improvement interventions. Quality and Safety in Health Care 12, 40–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Johnston B, Coole C, Narayanasamy M, Feakes R, Whitworth G, Tyrell T Hardy B (2016) Exploring the barriers to and facilitators of implementing research into practice. British Journal of Community Nursing 21, 392–398. [DOI] [PubMed] [Google Scholar]
  23. Joy H, Bielby A Searle R (2015) A collaborative project to enhance efficiency through dressing change practice. Journal of Wound Care 24, 312 314–317. [DOI] [PubMed] [Google Scholar]
  24. Kapp S (2013) Successful implementation of clinical practice guidelines for pressure risk management in a home nursing setting. Journal of Evaluation in Clinical Practice 19, 895–901. [DOI] [PubMed] [Google Scholar]
  25. Kitson AL, Rycroft-Malone J, Harvey G, Mccormack B, Seers K Titchen A (2008) Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implementation Science 3, 1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Logan J Graham ID (1998) Toward a comprehensive interdisciplinary model of health care research use. Science Communication 20, 227–246. [Google Scholar]
  27. Lucero RJ, Lake ET Aiken LH (2009) Variations in nursing care quality across hospitals. Journal of Advanced Nursing 65, 2299–2310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Mallion J Brooke J (2016) Community-and hospital-based nurses’ implementation of evidence-based practice: are there any differences? British Journal of Community Nursing 21, 148–154. [DOI] [PubMed] [Google Scholar]
  29. Mcevoy R, Ballini L, Maltoni S, O’donnell CA, Mair FS Macfarlane A (2014) A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implementation Science 9, 1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Moher D, Liberati A, Tetzlaff J, Altman DG Group P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine 6, e1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Murray E, Burns J, May C, Finch T, O’donnell C, Wallace P Mair F (2011) Why is it difficult to implement e-health initiatives? A qualitative study. Implementation Science 6, 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Nilsson C, Skär L Söderberg S (2010) Swedish District Nurses’ experiences on the use of information and communication technology for supporting people with serious chronic illness living at home–a case study. Scandinavian Journal of Caring Sciences 24, 259–265. [DOI] [PubMed] [Google Scholar]
  33. Nordmark S, Zingmark K Lindberg I (2016) Process evaluation of discharge planning implementation in healthcare using normalization process theory. BMC Medical Informatics and Decision Making 16, 48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Paquay L, Verstraete S, Wouters R, Buntinx F, Vanderwee K, Defloor T Van Gansbeke H (2010) Implementation of a guideline for pressure ulcer prevention in home care: pretest post-test study. Journal of Clinical Nursing 19, 1803–1811. [DOI] [PubMed] [Google Scholar]
  35. Pare G, Sicotte C, Moreault MP, Poba-Nzaou P, Nahas G Templier M (2011) Mobile computing and the quality of home care nursing practice. Journal of Telemedicine and Telecare 17, 313–317. [DOI] [PubMed] [Google Scholar]
  36. Petrie HG (1976) Do you see what I see? The epistemology of interdisciplinary inquiry. Educational Researcher 5, 9–15. [Google Scholar]
  37. Pluye P Hong QN (2014) Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annual Review of Public Health 35, 29–45. [DOI] [PubMed] [Google Scholar]
  38. Powell-Cope G, Nelson AL Patterson ES (2008) Patient care technology and safety In Hughes, RG, editor. Patient safety and quality: an evidence-based handbook for nurses. Rockville: Agency for Healthcare Research and Quality. [PubMed] [Google Scholar]
  39. Proctor EK, Powell BJ Mcmillen JC (2013) Implementation strategies: recommendations for specifying and reporting. Implementation Science 8, 139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Sales AE (2013) Reflections on the state of nursing implementation science. International Journal of Nursing Studies 50, 443–444. [DOI] [PubMed] [Google Scholar]
  41. Sherman H, Soderhielm-Blid S, Forsberg C, Karp A Tornkvist L (2016) Effects of preventive home visits by district nurses on self-reported health of 75-year-olds. Primary Health Care Research & Development 17, 56–71. [DOI] [PubMed] [Google Scholar]
  42. Smith A, Mackay S Mcculloch K (2013) Case management: developing practice through action research. British Journal of Community Nursing 18, 452–458. [DOI] [PubMed] [Google Scholar]
  43. Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S Wallace CM (2006) Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science 1, 23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Tabak RG, Khoong EC, Chambers DA Brownson RC (2012) Bridging research and practice: models for dissemination and implementation research. American Journal of Preventive Medicine 43, 337–350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Tapper L, Quinn H, Kerry J Brown KG (2012) Introducing handheld computers into home care. Canadian Nurse 108, 28–32. [PubMed] [Google Scholar]
  46. Taylor J, Coates E, Brewster L, Mountain G, Wessels B Hawley MS (2015) Examining the use of telehealth in community nursing: identifying the factors affecting frontline staff acceptance and telehealth adoption. Journal of Advanced Nursing 71, 326–337. [DOI] [PubMed] [Google Scholar]
  47. Vabo G, Slettebo Å Fossum M (2016) Participants’ perceptions of an intervention implemented in an Action Research Nursing Documentation Project. Journal of Clinical Nursing 26, 983–993. [DOI] [PubMed] [Google Scholar]
  48. van Achterberg T (2013) Nursing implementation science: 10 ways forward. International Journal of Nursing Studies 50, 445–447. [DOI] [PubMed] [Google Scholar]
  49. Van Bogaert P, Meulemans H, Clarke S, Vermeyen K Van De Heyning P (2009) Hospital nurse practice environment, burnout, job outcomes and quality of care: test of a structural equation model. Journal of Advanced Nursing 65, 2175–2185. [DOI] [PubMed] [Google Scholar]
  50. van der Plas AGM, Martijn H, Pasman HRW, Schweitzer B, Duijsters M Onwuteaka-Philipsen BD (2014) PaTz groups for primary palliative care: reinventing cooperation between general practitioners and district nurses in palliative care: an evaluation study combining data from focus groups and a questionnaire. BMC Family Practice 15, 1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Walshe C Luker KA (2010) District nurses’ role in palliative care provision: a realist review. International Journal of Nursing Studies 47, 1167–1183. [DOI] [PubMed] [Google Scholar]
  52. Whittemore R, Rosenberg A, Gilmore L, Withey M Breault A (2013) Implementation of a diabetes prevention program in public housing communities. Public Health Nursing 31, 317–326. [DOI] [PubMed] [Google Scholar]
  53. Wilcox S, Parra-Medina D, Felton GM, Poston MB Mcclain A (2010) Adoption and implementation of physical activity and dietary counseling by community health center providers and nurses. Journal of Physical Activity and Health 7, 602–612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Wilson PM, Petticrew M, Calnan MW Nazareth I (2010) Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implementation Science 5, 91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Wilson PM, Sales A, Wensing M, Aarons GA, Flottorp S, Glidewell L, Hutchinson A, Presseau J, Rogers A Sevdalis N (2017) Enhancing the reporting of implementation research. Implementation Science 12, 13. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

For supplementary material accompanying this paper visit https://doi.org/10.1017/S1463423618000488.

S1463423618000488sup001.docx (36.5KB, docx)

click here to view supplementary material


Articles from Primary Health Care Research & Development are provided here courtesy of Cambridge University Press

RESOURCES