Designing and pilot testing of a leadership intervention to improve quality and safety in nursing homes and home care (the SAFE-LEAD intervention)

Abstract

Objective

To describe the design of a leadership intervention for nursing home and home care, including a leadership guide for managers to use in their quality and safety improvement work. The paper reports results from the pilot test of the intervention and describes the final intervention programme.

Design

Qualitative design, using the participation of stakeholders.

Methods

The leadership guide and intervention were designed in collaboration with researchers, coresearchers and managers in nursing homes and home care organisations, through workshops and focus group interviews. The pilot test consisted of three workshops with managers working on the leadership guide, facilitated and observed by researchers, and evaluated by means of observation and focus group interviews with the participants. The analysis combined the integration of data from interviews and observations with directed content analysis.

Setting

Norwegian nursing homes and home care services.

Participants

Managers at different levels in three nursing homes and two home care services, coresearchers, and patient and next-of-kin representatives.

Results

The managers and coresearchers suggested some revisions to the leadership guide, such as making it shorter, and tailoring the terminology to their setting. Based on their suggestions, we modified the intervention and developed learning resources, such as videos demonstrating the practical use of the guide. Evaluation of the pilot test study showed that all managers supported the use of the guide. They adapted the guide to their organisational needs, but found it difficult to involve patients in the intervention.

Conclusions

A participatory approach with stakeholders is useful in designing a leadership intervention to improve quality and safety in nursing homes and home care, although patient participation in its implementation remains difficult. The participatory approach made it easier for managers to adapt the intervention to their context and to everyday quality and safety work practice.

Strengths and limitations of this study.

• The main strength of this study is that the intervention design drew on input from researchers, coresearchers, future users of the Improving Quality and Safety in Primary Care—Implementing a Leadership Intervention in Nursing Homes and Home care intervention and patient and next-of-kin representatives, and several data sources.

• The sample of managers and units in the pilot test is limited. However, the feedback received during interviews and pilot testing of the intervention was consistent across the sample, and supported by the feedback received from the coresearchers.

• The intervention design needs to be made sustainable over time without researcher involvement, and patients should be more actively involved in its implementation.

Background

Translating research-based findings into practice in healthcare is difficult.^1–4 Improvement interventions too often fail, and management teams have to know how to implement evidence-based knowledge to facilitate quality improvement at the local service level.^{5 6} Quality improvement interventions may have multiple components designed to enable knowledge translation to foster change in the behaviour of people and organisational systems, and can target any or all of the quality domains (safety, effectiveness, efficiency, timeliness, equity and patient-centredness) where performance is unsatisfactory.⁷

The recent literature on intervention design emphasises the importance of using theory, acknowledging interventions as both social and technical, and the role of context.⁶ Perhaps the most important need highlighted in the literature is for a more active and collaborative design of the intervention, involving stakeholders such as service users, practitioners and researchers aiming to solve practical problems in a way that emphasises shared reflection and collective inquiry.^{3 6 8} More effort is needed to design an intervention that incorporates all of those elements.⁶

Leadership is central to a healthcare organisation’s effort to improve quality and safety.^9–14 A recent systematic review shows how disengaged leadership, leadership turnover, poor organisational culture and dysfunctional external relations are characteristic of healthcare organisations that are struggling with quality and safety.¹⁵ However, our knowledge of how best to design interventions to support healthcare managers with new tools and competence to diagnose and improve their organisational quality and safety challenges needs to be strengthened.^{12 16} In the Norwegian context, policy-makers have called for the development of stronger competence among managers in relation to quality and safety improvement, in addition to the leadership skills and tools to translate research-based knowledge into practice. Policy-makers and research funding bodies have paid special attention to the primary care setting in terms of nursing home and home care managers who need the tools and competence to achieve the goals of sound professional practice, reduced patient harm and improved service quality.^{17 18} Our study contributes to fill this knowledge and tool gap by designing a leadership intervention for nursing home and home care managers.

The Improving Quality and Safety in Primary Care—Implementing a Leadership Intervention in Nursing Homes and Home care study

The intervention described and pilot tested in this paper is part of a larger study titled ‘Improving Quality and Safety in Primary Care—Implementing a Leadership Intervention in Nursing Homes and Home care’ (SAFE-LEAD).¹⁶ The SAFE-LEAD study builds on the European Union seventh Framework Program funded project ‘Quality and Safety in Europe by Research’ (QUASER) conducted in hospitals, by applying research findings to Norwegian nursing homes and home care settings. The QUASER guide defines quality care as care that is clinically effective, safe and patient centred. Care coordination is central in the understanding of quality in the Norwegian primary care context and is incorporated into the SAFE-LEAD study’s conceptualisation of quality. The original QUASER guide¹⁹ is theoretically anchored in the Organising for Quality framework²⁰ and structured around eight common quality challenges: structure, politics, culture, education, emotions, technical and physical conditions, leadership, and external demands.¹⁹ It consists of a series of questions to stimulate reflection and an accompanying decision-aid menu of potential options, including empirical examples of possible quality and safety improvement solutions across macro, meso and micro system levels. The guide is designed to facilitate patient safety and quality improvement in clinical practice and service delivery, by giving managers a systematic way to identify the strengths and weaknesses of their improvement approach and reflect on what is required to develop quality improvement and patient safety efforts tailored to their needs.12 13 19 20

Based on the original QUASER-guide, the SAFE-LEAD study will develop, implement and evaluate a research-based leadership guide for the nursing home and home care context in Norway. This paper focuses on the design and modification of the leadership guide, and the form and content of a pilot intervention programme.¹⁶

Aim and research question

The aims of this paper were (1) to describe the design of the leadership intervention; (2) to conduct a pilot test of the intervention to ascertain the feasibility of the intervention design and receive input for modifications and (3) to describe the final intervention programme prior to implementation. The objectives of the pilot test were to receive information on the functionality of the leadership guide, the pedagogical approaches, and the structure and content of the intervention. Testing outcome measures was not an objective.¹⁶

The following research question was addressed: How can a leadership intervention for improving quality and safety be designed for implementation in nursing homes and home care contexts?

Methods

This SAFE-LEAD study has a mixed-methods design; this paper uses a combination of qualitative methods. To guide the design of the SAFE-LEAD intervention, we used the Medical Research Council’s (MRC) guidance framework for the development and evaluation of complex interventions.²¹ The MRC’s guidance views healthcare interventions as flexible, non-linear processes, giving equal attention to all phases (development, testing, evaluation and wider application). Also noteworthy is that while advocating the systematic development of interventions, it stresses the importance of context in implementation and allows for adaptation of an intervention to the local setting to ensure its success in practice.²¹

The Knowledge to Action framework² guided the development process. According to this framework, translating the leadership guide into practice requires an organisation to identify the problems it needs to solve; tailor the guide to its own settings and contexts; assess and address barriers to its use; implement the intervention; monitor the implementation and evaluate the outcomes.²² One part of the development process was the identification of contextual factors in the Norwegian nursing home and home care setting that can affect outcomes. These results will be published in a separate paper.

Data collection

In the following, we describe the data collection methods in the different phases of the development and pilot testing, the data sources (table 1), and the data analysis.

Table 1.

Overview of data collection activities and data sources

Phase	Method	Source/informant	Time/duration
Intervention development (leadership guide, workshop content)	English–Norwegian translation of leadership guide Modifications to guide	Professional translation company, researchers, coresearchers Monthly project meetings with researchers	November 2016 to October 2017. 12 months November 2016 to October 2017/ 1.5 hours x 12. Total:17 hours
	Two workshops in consortium for discussions of guide and workshop content	Seven coresearchers Seven researchers	April and September 2017 / 3 days x 7 hours: Total: 21 hours
	Three focus group interviews with managers to test the leadership guide	One home care services: (focus group: 1 n=4) Two nursing homes (focus group 2: n=5, focus group 3: n=2)	May to June 2017 / 1–1.5 hours. Total: 4.5 hours
Pilot test	Workshops with managers (n=3) with observations	One nursing home: 6 hours (n=3 managers+1 patient representative) One home care service: 6 hours (n=6 managers).	November 2017 to February 2018. Total: 12 hours
	Two focus group interviews with participants for evaluation and feedback on need for further changes	One nursing home (n=3 managers) One home care services (n=6 managers)	February 2018 / 1–1.5 hours. Total: 3 hours

Intervention development

The design of the intervention planned to include a 6-month intervention consisting of 3–4 workshops with manager teams working with the leadership guide. The workshops were scheduled in advance,¹⁶ but their content and structure, as well as the leadership guide, were developed in a participatory process.^{3 23} First, the QUASER Hospital Guide was translated from English to Norwegian by a professional translation service. Further language adjustments were conducted in collaboration with the project team (researchers with backgrounds in nursing, health psychology, safety science, engineering and health management), coresearchers in the project (nurse counsellors from different municipalities, patient and next-of-kin representatives) and future users (managers from nursing homes and home care). An important part of the development process was to adapt the leadership guide to the Norwegian nursing home and home care setting. The original QUASER guide is based on empirical findings from European hospitals. The SAFE-LEAD project developed a version that was adapted to Norwegian nursing homes and home care settings. The development process lasted from November 2016 to November 2017. There were several iterations before agreement was reached on the final version. This process comprised meetings with the project team and two workshops with coresearchers to obtain feedback on language, format and content. These arenas were also used to discuss the structure and content of the intervention workshops.

The leadership guide was refined based on coresearchers’ feedback, and in May 2017, we conducted three focus group interviews with potential users of the guide. The participants were managers, development nurses and nurses from two nursing homes (n=7) and one home care service (n=4), to test and receive feedback on the leadership guide. The focus group lasted for 60–90 min (table 1). The participants were given time to read the leadership guide and the interview guide beforehand. The interview guide contained questions about the content, structure and format of the leadership guide, in addition to what the managers considered important when using the guide in their daily quality and safety work (eg, amount and type of researcher involvement and facilitation, and training needs). The purpose of the focus group interviews was to elicit the participants’ thoughts about the clarity, usefulness and content of the leadership guide, and to identify learning support needs so that the guide could be used for quality improvement work. Based on the theory, literature, input from coresearchers and potential users, we designed the SAFE-LEAD intervention.

Pilot test

The pilot test evaluated the feasibility of the intervention. We conducted a process evaluation of the pilot test according to the study protocol¹⁶ focusing on guide functionality, pedagogical approach and intervention content, in order to asses needs for modifications.²⁴

The SAFE-LEAD intervention was pilot tested for feasibility in two organisations located in the same urban Norwegian municipality. The pilot test lasted 2–3 months (table 1). One coresearcher from the Centre for Development of Institutional and Home Care services (USHT) in the municipality recruited the study sites. All invited participants consented to participate. No one who had been invited declined. The organisations were one large nursing home and one large home care service. The same home care service site also participated in the focus group interviews in the development phase of the leadership guide, to assess if its suggested changes had improved the guide. One management team in each organisation participated in the workshops, which were conducted at their own workplace. The management team of the nursing home consisted of three managers and one patient representative. The management team from the home care services consisted of six managers. Each organisation held three workshops. During the workshops, one researcher facilitated discussion and one or two researchers observed and took notes. In addition to taking observational notes during the workshops, we conducted semistructured focus group interviews with the participants in both facilities after the final workshop to evaluate their experiences with the leadership guide, and with the intervention workshops during the pilot test period. The interview guide contained questions about (1) experiences with the leadership guide (eg, content, language, usefulness), (2) the workshop (eg, content, structure, usefulness, challenges, material received in advanced, web tool) and (3) experiences with their work processes in between workshops. We structured the workshop agendas around the three-step process in the leadership guide (figure 1). During all workshops, the researchers observed and took notes according to a guide based on the workshop agendas (eg, reflections concerning quality and safety work, challenges and goals, as well as work processes and progress).

Figure 1.

Three-step process.

Data analysis

The data analysis was inspired by Strøm and Fagermoen’s²⁵ approach to integrating data from interviews and observation collected during a year-long process of collaborative development. The key component of this strategy is the interweaving of observation and interview data derived from sequences of interactive situations, such as the intervention design process, and analysing them as a complete body of material. The data material was analysed before integration. In our study, all focus group interviews were tape-recorded and transcribed verbatim. The focus group data were all subjected to directed content analysis²⁶ according to the predefined categories of the leadership guide,²⁰ and according to training needs, and user experiences from the pilot test to enable evaluation of the intervention feasibility.²⁷ The field notes were transcribed and analysed in a more descriptive manner²⁸ that focused on sorting the contents of the field notes recorded during and after the consortium workshops and intervention workshops. The field notes were also analysed according to the functionality of the guide content in the development process, and according to intervention content and functionality during the pilot test. The aim of our integrative analysis was to produce a systematic, descriptive overview of discussions and decisions regarding the intervention development and content, the identified training needs and chronologically describe the results from the pilot test. In this way, we integrated the data sources collected over a 1-year period and described the process underlying the final intervention programme ready for implementation. All researchers and coresearchers collaborated in the process and during the data analysis, the preliminary research findings were discussed in consortium meetings to ensure trustworthiness.

Patient and public involvement statement

The user, patient and next-of-kin perspectives are key throughout the SAFE-LEAD project from project development, design, data collection, analysis, through the dissemination of results.¹⁶ The development process has consisted of workshops with the co-researchers in the SAFE-LEAD consortium ensuring sound user involvement with perspectives from patient representatives, next-of-kin representatives and Patient and User Ombudsman and perspectives from future users of the guide (managers in nursing home and home care services). Three nurse-counsellors from the USHT were recruited by their municipality which is a partner in the project. These three nurse-counsellors are employed as coresearchers, in addition to one head of a USHT who was not paid, but who participated in semiannual project meetings. In addition, one patient representative and one next-of-kin representative were recruited as coresearchers in the SAFE-LEAD project after startup, by the project manager. The Patient and User Ombudsman was recruited as partner in the project and was involved in the project development and application for funding. The Patient and User Ombudsman has an important role in the stakeholder network and in quality assurance of the intervention design and pilot testing. The recruitment of participants and study sites was conducted in collaboration with the three USHT coresearchers. Managers from nursing home and home care participated in the development of the leadership guide, intervention workshop content and pilot test. One patient from the nursing home study site participated in the pilot test.

Results

We now describe the intervention design process and the participatory approach. The results from the guide and workshops development process are presented, followed by results from the pilot test and the final adjusted intervention programme ready for full implementation in the SAFE-LEAD study.¹⁶

Phase 1: development of leadership guide and workshop content

Development of leadership guide

The leadership guide is built around a three-step process (figure 1) in which the organisations assess themselves on seven common quality challenges (figure 2). As illustrated in figure 2, both ‘patient’ (for nursing homes) and ‘user’ (for home care) are represented in the leadership guide.

Figure 2.

The seven challenges of quality improvement based on Bate et al.²⁰

The participants in the focus groups had several suggestions for the development of the leadership guide, which were in line with the input received from coresearchers in the project. Their suggested revisions were related to the structure, language and content of the guide. Table 2 summarises the feedback. The translation of the guide was an iterative working process. Coresearchers and users of the guide reported having difficulties with some of the language after translation because it did not fit the vocabulary used in everyday practice. Thus, language revisions were made as a part of the development process and modification of the guide to fit the nursing home and home care settings.

Table 2.

Guide elements changed in the development process

Guide element from the QUASER guide	Changes made in the SAFE-LEAD guide
Structure	· The guide was shortened from 152 to 70 pages.
	· Repetitions were deleted.
	· A table of contents was added.
	· Definitions of the quality challenges and a clear description of how the guide can be used were presented at the beginning of the guide.
	· Incorporated opportunity and space for adding self-selected goals in addition to the predefined ones.
Content	· Clearer definitions of the quality challenges, as well as some new labels (eg, ‘emotional challenge’ was changed to ‘engagement’).
	· In Norwegian, it was not appropriate to use ‘strategy,’ so it was changed to ‘goals.’
	· Removal of the leadership challenge (as this is inherent in all challenges).
	· Inclusion of patient /user at the centre of the seven challenges figure 2.

SAFE-LEAD, Improving Quality and Safety in Primary Care – Implementing a Leadership Intervention in Nursing Homes and Home care; QUASER, Quality and Safety in Europe by Research.

The managers and coresearchers concurred that the leadership guide should be shorter, more detailed and easier to read. Several changes were made to condense the guide. The original version included approximately 80 pages of examples of quality improvement work in European hospitals. These examples were not considered especially relevant for the nursing home and home care settings and were therefore removed. Removing duplications and condensing several paragraphs and definitions also shortened the guide.

Some of the original eight quality challenges did not fit the Norwegian context and vocabulary when translated from English, resulting in a rewording of some of the challenges and expansion or restriction of some of the definitions. For example, the participants in the focus group and the coresearchers argued that since care coordination is a key domain of the Norwegian quality and safety work and reforms on policy level, it merited inclusion as a quality challenge. The ‘political challenge’ was, therefore, changed to ‘care coordination and organisational politics.’ Furthermore, the ‘educational challenge’ was reworded to ‘competence,’ and the ‘emotional challenge’ to ‘engagement.’ The ‘leadership challenge,’ one of the eight challenges in the original QUASER-guide, was removed, because the managers and coresearchers viewed leadership as inseparable from the other challenges. An important issue in the feedback on the guide content was that the patient/user was lacking in the guide and in figures used for visualisation. Consequently, the patient/user received more attention in the leadership guide, in definitions and goals, and in the visual presentation of the seven challenges by being placed in the centre, symbolising that quality work improves service quality for the patients/users (figure 2).

The participants supported our idea of developing a web version of the guide in addition to the paper version. The participants believed that a web version could provide simple, digital and visual presentation of the work in the leadership guide. They added that a web version would be easier to use and could be readily updated without losing earlier versions. Based on the feedback, we developed a digital interactive version of the leadership guide with the same content as the paper version. The digital web version allows for data storage and visualisation of the guide and evaluation over time.

Development of workshop content

The coresearchers and managers who participated in the focus groups offered the following suggestions about the content of the intervention workshops:

• Introduction of the leadership guide by a researcher in the first workshop.

• Specific homework and preparation between workshops.

• Learning tools to ease the managers’ workload with the leadership guide (presentation of the guide and sample videos of the guide being used in practice).

It was suggested that the first workshop should start with one of the researchers introducing the leadership guide, to improve participants’ understanding of its purpose, and to encourage its use in quality work. They also wanted short videos demonstrating practical examples of the guide in use. Based on the training needs identified in the focus group interviews, we developed four videos as learning resources. The first is a 10 min studio lecture presentation of the leadership guide. One of the researchers introduces the guide. The three other videos, each lasting about 6 min, use actors to demonstrate the practical use of the guide. In each video, three actors portray managers from the home care service setting as they follow the three steps of the guide (figure 1). The videos cover the topics that were discussed in each of the first three workshops (assessment of quality challenges, setting goals, make action plans). All learning resources were emailed to the managers 1 week before the workshops and were available on the internet. The design of the video manuscripts was based on data and input from coresearchers’ experiences with the home care services, and on focus group interviews with managers who responded to the draft version of the leadership guide.

Based on the input from the coresearchers and the focus group interviews, we developed the content of the three workshops for pilot testing, including preparation of workshop agendas and homework between workshops. All workshops focused on managers’ self-evaluation of their quality and safety work. A team of researchers and coresearchers should facilitate reflexive group discussions among the teams in the workshops. This programme was designed to take place in three workshop sessions (2 hours each). The content of the three pilot tested workshops was as follows:

• Workshop 1: Introduced the leadership guide and web version, identified the quality challenges that the managers experienced in their quality work, and the challenges they believed needed the most attention.

• Workshop 2: Established goals and strategies to address the identified quality challenge(s), and to involve patients/users.

• Workshop 3: Developed action plans.

Before each workshop, participants were expected to have done some preparatory reading and watched the video for that workshop (1–3). The rationale was that managers are under time constraints, and by coming prepared to the workshops, the sessions could be more time-effective and productive. For each 2-hour workshop, the research team used the detailed agenda consisting of questions, discussions, reflections and feedback sessions. The research team met between workshops to discuss the implementation and to ensure consistent approaches and reflections about findings in the two organisations in the pilot test.

Phase 2: intervention pilot testing

In the following, we present the findings from the pilot test of the intervention and how it was evaluated.

The managers’ use of the leadership guide

Results from workshop observations and interviews from the pilot test showed that all managers in the nursing home and home care services were committed to and positive about using the guide and to start working with the quality challenges they identified as most relevant for their organisations.

I believe that a key part of our challenge, especially in the health service and for the nurses, is that we are so trained in suggesting specific actions and action should be implemented really fast… we are so action-oriented that we sometimes act before we have actually realized what the problem really is. So to take a step back and think about what our challenges really are is key, and then sometimes ask the ‘why, why, why’ questions… (Unit manager, nursing home).

In both organisations, the managers met between the workshops to collaborate on the guide, and to prepare for the next workshop. Managers in the nursing home included their employees in the quality improvement process between the workshops, as stipulated in the intervention programme. The home care organisation was undergoing reorganisation and found it more difficult to involve their employees. They needed the leadership guide to give them a sense of what quality work entails.

Moreover, results from the pilot test showed that managers in both organisations found the goals suggested in the guide too vague and difficult to operationalise. Observational data from workshops showed that managers from the home care services wanted to focus on next-of-kin involvement and a training programme for new employees, and struggled to meet one of the predefined goals. However, they appreciated the ability to use the guide to define their own goals, and consulted the predefined goals as needed. Furthermore, observation data showed that the home care managers found it important to evaluate their actions. One of their reflections during the workshop was that they were very eager to implement actions for different kinds of challenges but never followed up by evaluating them. Here, the leadership guide proved a useful evaluation tool. One of the home care managers described how the leadership guide helped them systematise their quality work:

I think it was very good at Step 1 [identification of quality challenges], that is where we haven’t had any system. It clarifies. Step 3 [defining action plans] is really how we already work, we do have interventions, action plans and goals—but I see the need for the systematization in the beginning. We too often jump right into actions, and we are not so good at sorting things out and see where it belongs (…). So I think we have not applied Step 1 that much before. (Home care manager).

Quality improvement tool for structure and system is important

Results from the observations and the focus group interviews showed that the use of the guide depended on how systematically the organisations were already working on quality improvement. This also affected the extent of researcher involvement in the organisations. In the nursing home, the managers already had a well-functioning system and an established plan for their quality work, and therefore considered it a ‘waste of time’ to make new action plans to fit the leadership guide. Managers from both organisations insisted that working with the guide increased their awareness of their quality work by presenting them with new concepts and opportunities for creating new ideas, giving them a good overview of their quality work, and helping them to evaluate their actions and current practice.

(…) it has raised awareness in a way. I think. You`ve got some new concept on things that you would not otherwise have had. (Unit manager, nursing home)

The results from both focus group interviews and observation showed that the managers found the seven quality challenges in the guide recognisable and informative. Managers were enthusiastic about the way in which the quality challenges gave them an overview of their organisation and quality work.

According to the managers in the pilot, the guide provided new systematics in their quality work, and they welcomed the explicit focus on patient and user-involvement. Results showed that the guide served as a checklist, and as a supplement to the quality improvement tools they already applied in their practice. In both organisations, the managers used only the web version of the guide. However, the managers stressed the need for a tutorial demonstrating its more technical capacities, such as data storage, exporting and importing of data.

Manager’s input on adjustments for final intervention design

In the focus group interviews, the managers suggested that additional development of the guide and intervention should clarify that the challenges overlapped with the goals. This means that working with one challenge or goal might have a spillover effect in the guide and vice versa. Furthermore, the managers struggled to make the goals more relevant and applicable to their own organisation. Unlike the action plans, the goals are overarching and therefore not measurable, and it was important for the managers that the researchers clarify this in the final intervention programme, to prevent managers from becoming frustrated when working with the goals. In addition, the managers found that the work on goals and action plans in the guide overlapped, and experienced this as an iterative rather than a linear process. Thus, they suggested that further development of the workshops should merge the themes in workshop 2 (goals) with workshop 3 (action plans) to allow them to work with both at the same time. The nursing home managers noted that involving a user representative (a resident) in the workshops was difficult, due to the patient’s reduced sight and hearing capabilities. They preferred to ask patients/users for their advice and involve them between rather than in workshops. The patients/users could then discuss their perceived challenges in the organisation and share their thoughts and experiences on more developed organisational goals and actions, as illustrated in this quote:

Yes, we should involve the patients between the workshops and get their feedback then. Then we could also approach several patients, instead of involving only one in the workshops. We could ask patients on every floor or several patients about one topic that we are concerned about. (Manager, nursing home).

Phase 3: final intervention design

Based on the results from the pilot test and discussions among project researchers and coresearchers, a final intervention programme consisting of four workshops was designed. The final intervention programme is illustrated in table 3. The following changes and adjustments from the pilot version of the intervention were made:

Table 3.

Final intervention programme

	Workshop 1 (Mnt1—2 hours)	Workshop 2 (Mnt2—2 hours)	Workshop 3 (Mnt3—2 hours)	Workshop 4 (Mnt6—2 hours)
Preparation	Videos and guide, tutorial on web tool	Video	Video	Check-up call before work shop 4
Introduction	Intro of the guide and web tool+identify quality challenges	Status of challenges and goals and reflection on action plan Presenting survey results	Status of challenges, goals, action plans	Status
Topic	Seven challenges, goals, user involvement, action plans	Goals and action plan and user involvement	Action plan	Sustainability
Approach	Self-diagnosis facilitated by researchers	Self-diagnosis facilitated by researchers	Self-diagnosis facilitated by researchers	Self-diagnosis facilitated by researchers
Discussion	What challenges have the organisation worked on? What challenges need more attention? Why did you choose this?	Discuss goals related to the challenges Focus on user involvement Consider possible actions	Discuss action plan and local adaptations Adjustment	Discuss promoting and inhibiting factors in local QI processes Adjustment Sustainability—what is needed in the organisation
Homework	Agreement on homework	Agreement on homework	Agreement on goals for ensuring sustainability	Close involvement from researchers in four units

The bold text specifies changes added after the pilot test.

• Merging of the themes in workshops 2 (goals) and 3 (action plans).

• Presentation of survey results (conducted in the study prior to the intervention) to give information on quality challenges as described by the employees.

• Adding a fourth workshop on sustainability.

• Check-up call between workshops 3 and 4.

• Development of a tutorial demonstrating the use of the web version of the leadership guide.

• Timing of intervention workshops, where workshops 1, 2 and 3 should be conducted in the first 3 months of the intervention, and workshop 4 should be conducted in the sixth and final month. The rationale was to be intensively involved in the beginning so that managers would be comfortable using the guide. The fourth and last workshop could then focus on sustainability.

• The intervention programme will be implemented in the SAFE-LEAD study and evaluated by survey measurement before and after the intervention period, and process evaluation over a 1-year period as described in the study protocol.¹⁶

Discussion

It is challenging to translate research-based findings into practice in healthcare settings.1–4 21 29 In this paper, we have described the design of the SAFE-LEAD intervention. Our study demonstrates the importance of stakeholder involvement in the design and development of a leadership intervention in nursing homes and home care. Our approach was influenced by participatory design^{3 23} and involved coresearchers (nurse counsellors from different municipalities, patient ombudsman, patient and next-of-kin representatives), and future users (managers from nursing homes and home care). The participatory design played a key role in translating and adapting English language QUASER hospital Guide to the Norwegian nursing home and home care setting. Moreover, using this design allowed consideration of the everyday context of nursing home and home care managers, thereby tailoring the intervention content to managers’ learning needs, time and challenges. In close collaboration with coresearchers and managers, the intervention was modified to fit the intended field of practice. This is consistent with previous research suggesting a more active intervention co-design involving stakeholders.3 6 8 30 31

Our study supports the findings of previous research, indicating that patient and user participation in interventions is difficult.^{30 32} In our results, we attribute this to the nature of the nursing home and home care context, such as reorganisation processes, lack of managerial capabilities and the difficulty of finding patients who are physically capable of participation in projects and interventions. However, the patient and user engagement has the potential to uncover unmet needs,^{30 32} and hence received stronger emphasis in our adapted guide than in the original QUASER guide.

Involving coresearchers and managers in the design process generated several suggestions on how to develop a leadership intervention that would be useful and feasible in their everyday practice. They requested short meetings and suggested instructional videos and examples of when and how the guide was used by other managers, as inspiration. Therefore, we designed the intervention programme with use of blended learning activities as suggested by Harris et al.²² Blended learning is a systematic combination of copresent (face to face) and technologically mediated interactions among students, teachers and learning resources.²² We found that blended learning activities offered managers a more flexible way of understanding and making the best use of the leadership guide. Furthermore, the managers appreciated the fact that they saved time by watching the learning videos while preparing for a workshop and performing other tasks.

The results from the intervention design process were consistent between the managers in the nursing home and home care contexts, regarding how the leadership guide and workshops should be best designed. However, there were differences in how the two management teams used the leadership guide and adapted it to their organisation’s needs and capabilities. Our study, therefore, supports earlier implementation research^{33 34} on the need for local adaptions in complex organisations. In line with our findings, previous research has shown that managers must be engaged in and capable of involving their management team and employees for optimal function of interventions designs.^35–38 We have, therefore, designed an intervention that has a clear description of the process and that accommodates the nursing home and home care contexts and the manager’s capabilities. However, despite this flexibility and adaptability, a detailed description of the intervention’s elements still allows for comparison between organisations. Therefore, workshop agendas, learning resources, guide content, workshop structure are similar, but still offer choices among the seven quality challenges and goals and actions plans for their specific context.

Strengths and limitations

The main strength of this study is the thorough intervention development process that involved researchers, coresearchers, future users of the SAFE-LEAD intervention (managers in nursing homes and home care services), and patient and next-of-kin representatives, and several data sources (ie, focus group interviews, observations, workshops). The data material is collected from many researchers and coresearchers who contributed to the development of the intervention. Observational data are, therefore, based on subjective interpretation from many researchers.

The study has several limitations. The data material is analysed consecutively in the intervention development process, resulting in a less systematic analysis. One nursing home located in a small, rural area had only two employees participating in the focus group in the development phase, due to sick leave and understaffing. The sample of managers and units in the pilot test is limited. However, the feedback received during focus group interviews and pilot testing of the intervention was consistent across the sample, and supported by the feedback we received from the coresearchers.

There is a challenge in the intervention design on how to make it sustainable over time without researcher involvement. Quality improvement tools can be beneficial for managers in nursing homes and home care, but the heavy workload in these organisations can make implementation of improvement tools difficult without additional support in the implementation.³⁹ Previous research shows greater chance of success with implementation if there is a stable working environment, enough personnel resources and a nursing home management that is positive to the intervention.⁴⁰

In the ‘Knowledge to Action’ framework, Straus et al ² suggest several factors that should be considered when developing sustainability-oriented action plans, such as ensuring the presence of systems to monitor progress, map the availability of financial and human resources, and managers responsible for monitoring progress and ensuring sustainability. Managers can use the leadership guide to monitor progress, and no financial resources are required for using the guide. The issue of sustainability will be discussed with the participating managers during implementation of the final intervention, and a sustainability-oriented plan will be made in collaboration with researchers and managers.¹⁶ In figure 3, we illustrate the logic model of the intervention programme and processes based on the Knowledge to Action framework.²

Figure 3.

Logic model of the SAFE-LEAD intervention programme translating knowledge into practice based on knowledge to action framework of Straus et al.² SAFE-LEAD, Improving Quality and Safety in Primary Care – Implementing a Leadership Intervention in Nursing Homes and Home care.

Conclusion

The findings of this study support the importance of involving stakeholders in the design of a leadership intervention. A leadership intervention for the improvement of quality and safety in nursing homes and home care contexts can be designed in a participatory approach involving stakeholders, although patient and user participation during the implementation remains a challenge. There is a need for further exploration of how patients and users can be involved in a leadership intervention and how managers can make the best use of patient and user experiences in managing quality and safety. The use of blended learning activities can be considered as a data-driven and bottom-up approach to tailor an intervention to the suggestions and educational needs identified by potential users in the development and pilot test phase. Our evaluation demonstrated that the intervention design made it easier for managers and their teams to incorporate the leadership guide into their everyday quality and safety work practice.