Skip to main content
BMJ Open logoLink to BMJ Open
. 2023 Sep 13;13(9):e074555. doi: 10.1136/bmjopen-2023-074555

Using co-creation focus groups to customise a remote multidomain programme designed to increase dementia literacy

Walter Wittich 1,, Edeltraut Kröger 2, Gabrielle Aubin 3, Asma Fadhlaoui 4, Nicole D Anderson 5,6, Nouha Ben Gaied 7, Inbal Itzhak 8, Sylvie Belleville 3,4; for the Canadian Consortium on Neurodegeneration (CCNA) CAN-THUMBS UP Study Group
PMCID: PMC10921908  PMID: 37709333

Abstract

Objectives

To adapt the content and functionalities of Brain Health PRO, a web-based multidomain program designed to increase dementia literacy, to the context and needs of users, providers and community organisations across Québec, Canada.

Design

Five consecutive qualitative co-creation focus group sessions 30–90 min in duration each, exploring potential barriers and facilitators to usability, accessibility, comprehensibility, participant recruitment and retention.

Setting

Virtual meetings.

Participants

A 15-member team based in Québec and Ontario, Canada, consisting of 9 researchers (including a graduate student and the project coordinator), representing occupational therapy, sensory rehabilitation, neuropsychology, psychology, health science and research methods, 3 informal caregivers of older adults living with cognitive decline and 3 members of the Federation of Quebec Alzheimer Societies.

Data analysis

Session recordings were summarised through both qualitative description and thematic analysis.

Results

The synthesised recommendations included adjustments around diversity, the complexity and presentation styles of the materials, suggestions on refining the web interface and the measurement approaches; it influenced aspects of participant recruitment, retention efforts and engagement with the content of Brain Health PRO.

Conclusions

Co-creation in dementia prevention research is important because it involves collaboration between researchers, community support and service providers, and persons with lived experience as care providers, in the design and implementation of clinical studies. This approach helps to ensure that the content and presentation of educational material is relevant and meaningful to the target population and those involved in its delivery, and it leads to a greater understanding of their needs and perspectives.

Keywords: qualitative research, patient participation, primary prevention, health education, aging, dementia


STRENGTHS AND LIMITATIONS OF THIS STUDY.

  • The involvement of service providers and persons with experience as care providers for individuals living with dementia strengthens the relevance of the recommendations.

  • The findings are supported by geographic diversity (urban and rural) across the province of Quebec, and an ample number of focus group sessions, resulting in data saturation.

  • The time available for participants to familiarise themselves with all aspects of Brain Health PRO was limited due to logistic reasons.

  • The findings may be influenced by the unique cultural context of a French language province within Canada, given that the sessions were held in French; however, this choice also supports the local priorities of the community partner and potential participants.

The challenges associated with dementia remain among the most urgent research and care priorities in the global health context,1 with the WHO estimating that the number of individuals living with dementia will rise to around 139 million in 2050.2 There is currently no cure for Alzheimer’s disease and related disorders, but research shows that up to 40% of dementia risk is attributable to modifiable factors such as physical inactivity, social isolation, sensory limitations and vascular health.3 Non-pharmacological interventions, targeting lifestyle and health management years before dementia onset, are therefore proposed as critical tools that could prevent a large proportion of dementia cases.4 Interventions targeting modifiable lifestyle variables may have a positive effect on cognition in older adults at risk for dementia, a finding that has led to several large prevention trials to be conducted around the world.5 Since the causes of neurocognitive disorders are likely multifactorial, most of these prevention trials rely on multidomain risk reduction programmes where different risk factors are targeted based on goal setting or risk profiles.6 7

Digital technologies during a pandemic

Lifestyle and environmental factors can have a noticeable effect on older adults’ brain and cognitive health.8 Conditions and behaviours that are known to be favourable to the brain (eg, physical activity, cognitive stimulation, social interaction, adequate sleep and mental health) have been severely challenged by the COVID-19 pandemic and the resulting confinement of older adults. Isolation, lack of cognitive and physical activity, stress and fear of contamination have increased their vulnerability leading to an urgent need to develop ways to better meet their cognitive health needs, especially during a pandemic.9–11 The use of new digital technologies has the potential to radically change the way in which older adults can be empowered to take care of their brain health, thereby creating conditions conducive to independence and quality of life.

Older adults have been shown to benefit from educational materials about dementia risk reduction, improving their knowledge of the disease, while also benefitting from improved mood and self-efficacy.12 The benefit of web-based educational programmes on dementia risks has been demonstrated in middle-aged adults,13 leading us to hypothesise that participation in an educational online programme could potentially engage participants in ways to promote their brain health. Such engagement could have a positive effect on risk reduction while also improving participants’ willingness and interest towards behavioural change in the context of their modifiable risk factors. To maximise the meaningful effect of such a programme, the conditions that facilitate their uptake need to be optimal, and we need to better understand the ways in which community partner organisations can contribute to their successful implementation. These variables are especially important in the context of regional circumstances that directly influence access and uptake, such as language or culture. In Canada, for example, all provinces are home to Indigenous populations, some regions operate predominantly in English (eg, British Columbia or Alberta), whereas others use mainly French (eg, Quebec) or are bilingual (eg, New Brunswick). Language also influences immigration patterns, making Quebec a unique environment within Canada.14

Favourable conditions for digital technology

Even though there is considerable variation in internet access and user skill among older adults,15 up to 81% of older adults in Quebec, Canada, have access to an internet connection, a number that has continuously grown over the last 5 years.16 A recent survey of 2026 older adults in Canada indicated that they substantially increased their use of technology and online services because of the COVID-19 pandemic.17 This includes social media, video calling, lifestyle apps and online activities. About two-thirds consider that technology can reduce the detrimental impact of COVID-19 on their life by reducing social isolation, maintaining their physical and mental health, and helping them to remain safe, independent and active.17 In this context, web-based delivery can be a powerful means of scaling dementia risk reduction programmes18 19 that would remain viable during and after a pandemic. It reduces geographic or mobility constraints and allows individuals who are isolated—due to health conditions, living in remote regions and/or the pandemic—to have access to scientific knowledge tailored to their needs. People can access the programme anytime according to their schedule. The web-based format contributes to sustainability because it allows for the addition of new modules, new information and/or modification of the content as science progresses. There are also features only available through a digital platform, such as using reminders and tailoring the programme to people’s risk profiles.

Challenges to the use and implementation of a web-based program

Although some studies have shown that older adults can benefit from online interventions,13 20 there are challenges in using and implementing these interventions. A major challenge is that technologies are not always well adapted to the needs and capacities of older adults, resulting in a low level of satisfaction, adherence and buy-in,21 and consequently, disappointing effects. This is particularly critical during the development of technologically based programmes for older adults, as technical constraints (eg, ease of use, ease of navigation) and content adaptation (eg, easy to understand, interesting) are among some of the important barriers/facilitators in the use of existing web-based prevention.18 19 21 A participatory approach, engaging users in co-creation during the development process, is therefore extremely important. Unfortunately, very few studies have used a participatory research approach involving older adults in the design of technology-based prevention programmes, and in measuring its usability and acceptability or acceptance.21

Another important challenge is linked to creating favourable conditions that optimise successful implementation in real life. Community organisations such as the Alzheimer Societies can be critical in communicating risk reduction programmes to older adults and promoting their uptake. Those organisations are frequently approached by older adults for information and often have programmes to help influence change toward dementia prevention. However, organisations need access programmes that are scientifically valid as well as adapted to their reality and constraints.22 Community organisations need to trust those programmes to encourage their use by their constituencies. It is now recognised that successful implementation and meaningful impact require collaborative efforts with all stakeholders from development to deployment of the technology and that users and community organisations must engage with researchers and developers throughout the process.22 In addition, participatory research is the ethically correct way of project planning, involving the people for whom the project is intended, right from its design: as they have a stake in it, they should have a say in it as well.23

Brain Health PRO

Over the last 2 years, our team has used a collaborative co-creation research process24–26 to develop Brain Health PRO,27 a user-friendly evidence-based online risk reduction programme tailored to Canadians.28 The Brain Health PRO programme, currently ongoing and available in English and French, is educational, interactive and designed for older adults at risk of cognitive decline. It offers practical solutions to challenges related to healthy brain ageing, information about neurocognitive disorders and tips and guidance on lifestyle changes that can reduce the risk of developing these diseases. Brain Health PRO promotes older adults’ ownership of their cognitive health, and its content was developed in collaboration with a Citizen Advisory Group composed of 9 older adults from across Canada, as well as 31 researchers from the Canadian Consortium on Neurodegeneration in Aging.29

The challenge

The content development for Brain Health PRO relied on co-creation with older adults. However, its development for a diverse population of older adults at risk of cognitive decline, as is the case in Québec, lacked involvement of community organisations, which is essential for sustainability. Therefore, our team aimed to optimise the adaptation and implementation of Brain Health PRO with the guidance of members of community organisations, given that their role in the implementation of Brain Health PRO was not part of its original development. The mission of community organisations, such as the Federation of Quebec Alzheimer Societies (FQAS), is to meet the needs of older adults living with Alzheimer’s and related diseases, as well as those of their caregivers. The prevention of neurocognitive disorders is a priority of the FQAS because people at risk for cognitive decline often turn to them for information and recommendations on prevention strategies. Currently, these organisations are not sufficiently equipped to meet these demands. Being able to benefit from a scientifically based risk reduction programme is therefore a major asset for them. However, to be successfully implemented, programmes need to be adapted to the local context of community organisations by considering users (older adults engaged in the programme), providers (here the staff and volunteers) and community factors (FQAS) to determine the important facilitators and barriers for using and scaling Brain Health PRO. Therefore, our aim was to adapt the content and functionalities of Brain Health PRO (which was cocreated with older adults for the general Canadian audience), to the context in the province of Quebec. The goal was to explore how Brain Health PRO could best be adjusted to the needs of a diverse group of local users, providers and the community partner organisation (managers within the FQAS) with their specific cultural, linguistic and geographical needs in mind.

Methods

The presentation of the methodology and results follow the Consolidated criteria for Reporting Qualitative research wherever applicable.30

Study design

To adapt Brain Health PRO, we used a co-creation process, a proactive strategy traditionally used by commercial enterprises to modify a product based on consumer feedback.31 The co-creation process is suitable for remote modalities and was therefore chosen to enable the research team to gather important feedback on the Brain Health PRO application and its potential dissemination across the province of Québec. Québec’s multicultural and multilingual realities create heterogeneous needs across its 17 administrative health regions. Access to necessary resources to complete the programme (eg, stable internet connection) also differs depending on the administrative regions. Therefore, the use of the co-creation process can assess which needs are general to the entire province versus those specific to certain parts of the province (ie, rural vs urban). Moreover, the co-creation process helps pinpoint facilitators and barriers in the usage of Brain Health PRO specific to our targeted population.

Patient and public involvement

Our co-creation approach specifically included individuals with personal experience as topic experts. The co-creation team comprised 15 members (14 women and 1 man), 9 of which came from the research team, including a graduate student and the project coordinator, and representing different disciplines, that is, occupational therapy, psychology, health science and research methods. The remaining members were three informal caregivers of seniors living with cognitive decline, and three members of the Alzheimer Society responsible for service delivery within this organisation (see table 1). The expert panel members attended between one and all of the five co-creation sessions, depending on their availabilities. All participants were based in either Québec or Ontario.

Table 1.

Participants’ perspectives and implications

Participant, n Perspectives Type of role(s)
1 (cohost) Research University professor, caregiver
2 Research University professor, caregiver
3 Research Clinical psychologist
4 Research Occupational therapist
5 Research Occupational therapist
6 (cohost) Research University professor, caregiver
7 Research PhD student
8 Informal caregiver Caregiver
9 Informal caregiver Lead of senior group, caregiver
10 Informal caregiver Volunteer, caregiver
11 Service delivery Alzheimer Society executive
12 Service delivery Alzheimer Society employee
13 Service delivery Alzheimer Society employee
14 Research Knowledge transfer and exchange specialist
15 Research Project manager

Recruitment

Recruitment and participation were only limited by the availabilities of potential participants, as everyone who was approached initially agreed to participate. Participants with a background in research were recruited by the two project leads (SB and WW). As for the participants from the FQAS and the informal caregivers, they were recruited through a team executive of the FQAS (NB). Participants needed to be able to express themselves either in French or English and have access to a computer with internet to join the remote meeting platform. Participants also needed to understand basic concepts related to dementia and its effects, have an interest in Brain Health PRO and have enough time to complete some assigned readings and to go through Brain Health PRO between the co-creation sessions.

Co-creation session format

Before the first session, all participants provided informed written consent, either in electronic or paper format. The co-creation process took part remotely, over a virtual video platform (Zoom Video Communications, San Jose, California). The meetings were conducted in French, with simultaneous translation into English for research team members who were unilingual or felt more comfortable with English. The five online co-creation sessions were held over a period of 6 months (October 2021–March 2022) and lasted between 30 and 90 min each. The sessions were organised by the project manager and hosted by two bilingual researchers (EK and WW) that were present to facilitate the discussion and the flow of ideas. They (one woman and one man) both have extensive experience in conducting qualitative research and leading focus group and consensus studies.32–36 Participants were encouraged to share their thoughts and ideas independently of potential budget limitations. The PhD student (GA) took field notes during each session. Between sessions, participants were given access to Brain Health PRO chapters so they could become familiar with the platform and begin reflecting on how it could be adapted to the population of Québec and to the needs of community organisations. They were also asked to access and interact with other parts of the Brain Health PRO experience, including the questionnaires for determining risk factors for dementia in potential participants.

Co-creation session content

To ensure a proper course of the sessions and make efficient use of the limited time of the participants, the project manager (AF) and the two hosts planned each session. The number of sessions was planned to accommodate the predetermined discussion topics. The first session opened with general introductions, an overview of Brain Health PRO, and the establishment of general communication and confidentiality rules. The two hosts ensured that the sessions were conducted in an environment of respect and active listening. The consolidated framework for advancing implementation science 37 identifies five domains of interest: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved and the process of implementation constructs for each domain. Our questions for the co-creation meetings emerged from these domains. Objectives and topics to be addressed were determined prior to each co-creation session and were previewed at the end of each prior session. A review of and reflection on relevant materials was assigned as homework for the upcoming session. The topics that were discussed over the sessions were: a general introduction to the structure and purpose of Brain Health PRO, including the interface, the gamification features, the notebook and the risk factor questionnaires; possibilities for adaptation of the visual and recorded audio materials used within Brain Health PRO to include a diverse population; potential interactive activities hosted by the FQAS; development of training/consultation activities for FQAS staff, peers and volunteers; refinement of dissemination/communication strategies specific to the target population; and streamline measurements for administrative and organisational issues that may arise during the implementation process. Participants were welcome to deviate from those topics if they felt like other aspects of Brain Health PRO needed to be discussed.

Data analysis

Together with the graduate students (GA), the two hosts of the sessions began the analysis process with condensation of the data contained in the video recordings and the field notes.38 They selected, focused and simplified the content of the data into bullet points (see online supplemental file 1), with specific attention on information relevant to the focus group questions. We used analytical questioning as our approach to analyse the data.39 Within this approach, data are explored in an inductive way, but with specific focus to extract information that answered the questions we were asking during the focus group interviews. At the same time, the analysis was open for the discovery of ideas that were relevant to the research goals, but that may not have been specifically addressed within the prepared questions. When such ideas emerged during the process, the analysis team revisited the data from previous focus groups to check whether information may have been missed before this new idea emerged.

Supplementary data

bmjopen-2023-074555supp001.pdf (81.8KB, pdf)

The results of this analysis were then grouped according to the topics of the research questions that corresponded with different aspects of the Brain Health PRO intervention, that is, (1) Brain Health PRO format and content, (introductory video, images, notebook), (2) technical aspects (the internet platform and technical assistance), (3) research-related questions (questionnaires at programme beginning, participant recruitment, data collection, contact between the research team and the participants, and other research issues), (4) aspects increasing participants’ adherence to the 1-year programme (gamification, contact among participants, interactive activities). To support scientific rigour, we ensured consensus among the three analysts regarding data condensation accuracy and data interpretation during the analysis process. The resulting topics were presented to participants in the last session to verify, through member checking,40 41 whether the synthesis accurately represented the session content, and whether any aspects could be more adequately addressed.

Results

The results of the co-creation meetings were numerous, varied and rich in reflecting different life experiences; many of them were ultimately used during the implementation process (see table 2 for an overview). As the represented FQAS offices were in different regions, we benefited from a diversity of perspectives and contexts that provided a rich and diverse picture of the needs, barriers and facilitators to the implementation of Brain Health PRO.

Table 2.

Overview of the resulting recommendations and the level of implementation in Brain Health PRO

Change types/suggestions Explanation
Brain Health PRO format and content. Diversity
Images should reflect different ethnic backgrounds, body images, inclusion of persons with handicaps, settings and landscape.
The content was revised to include more diversified images.
Notepad
Provide a hard-copy notepad. Assess the possibility for the notepad to be part of sponsors’ contribution.
A printable notepad was already available online; however, the team explored whether partners might provide access to a printed version. This is a possibility but could be determined locally as a function of the partners’ resource availabilities.
Glossary for technical terminology
Provide a brief description of terminology that participants may not be familiar with. Add a brief explanation of the issue identified in each chapter.
The research team will collect items from the Q/A section to construct Q&A document and identify the terms that could be defined.
Introduction video
Too long, too many details. Make shorter videos. Make them more engaging.
The initial introductory video was split into two shorter videos and their content was simplified to make them more accessible and engaging.
Gamification
Make gamification optional.
The gamification components are integrated into the web framework; as it would have been technically complex and costly to make it optional, the decision was made not to implement this suggestion.
Research aspects. Modifiable dementia risk factors questionnaires
Change the order of the questions, provide a more dynamic format, some questions are ambiguous, present them during different chapters of the programme. Questionnaires are too long.
It was not possible to change or shorten the questionnaires because they were based on validated questionnaires but some of the instructions were clarified.
Contact with participants
Provide personalised email providing feedback on progress.
Visual components (eg, speedometers measuring progress) already provide personalised feedback on the progress on lifestyle risk factors.
Adherence notifications (included in the gamification aspects) provide automated emails and reminders, should participants stops using the programme.
Interactive activities
Optional activities which could increase contact among participants, be cognitively engaging, provide an ability to probe more deeply into complex questions, and be designed to retain acquired new knowledge. Meetings could be virtual or in-person. Toolkit should be prepared for facilitators and format adapted to local constraints.
Monthly social activities facilitated by staff or volunteers from the Alzheimer Society will be provided on an optional basis. There will be a possibility for face to face and online. Training is provided and material is constructed by the research team including a tool kit for facilitators.
Data collection
Document the pattern in which participants complete the programme (eg, daily, condensed on 1 day per week, length of sessions).
The protocol includes the option to explore such aspects qualitatively at the end of the implementation.
Communication
Prepare and send newsletters.
One-page summary materials were prepared for the general programme, and each topic is available to be sent to participants and interested parties.
Video
Record short videos from expert on topics not covered by the programme.
As a first step, expert videos were prepared summarising the highlights of each existing topic and some tips. Each module already covered all the topics deemed necessary and relevant. Additional future topics will be explored after implementation of the current content is complete.

Brain Health PRO format and content

While the research-based content had already undergone revisions based on feedback from Citizen Advisors, its implementation in the province of Québec was envisioned. Team members suggested more diversity of the Brain Health PRO images, reflecting different ethnic backgrounds, body images, inclusion of persons with handicaps and different settings and landscapes of the province of Quebec. It was suggested that images should realistically reflect the life of all citizens and could thus help in recruiting and retaining participants. Images of proposed activities should be positive to increase programme adherence. As a digital notepad, integrated within the programme, already existed, a hard-copy notepad was suggested since Brain Health PRO regularly asks participants to reflect on life goals or experiences. Such a printed notepad could also serve as a motivational gift, financed through the community partners, sponsoring or donations. Brain Health PRO includes an introductory video which several members found too long, too detailed and complicated. They suggested to present the introductory material over more than 1 week, in a more engaging way, and to start quickly with the content chapters. They also suggested a glossary of technical terms used in the programme.

Technical aspects

The members stressed the importance of including a webmaster or another form of regular technical assistance as well as a Q&A page. While technical assistance was already included in Brain Health PRO, their comments stress the importance of maintaining this kind of support for the implementation phase of this project. They reiterated the need for existing features such as the ability to personalise the size and font colour of the text within the chapters. Given the breadth of the research project, members suggested a dynamic, short video explaining all the research aspects linked to the programme for participants of the implementation study and to provide links to research related to the programme.

Research aspects

Several ways to increase participant recruitment were suggested: using positive images from Brain Health PRO on recruitment material, existing partnerships with community organisations, word of mouth and reaching out to persons living in retirement homes. Suggestions were made to maintain contact with the study participants, that is, the possibility of personalised emails on participants’ progress, an online chat room and a short, engaging, recurrent newsletter, containing personal stories as well as highlights, successes and pitfalls.

Brain Health PRO has questionnaires embedded within the programme to determine the participant’s risk profile and additional ones used as outcome measures for the research project. Regarding the questionnaires used as study outcomes, members suggested to identify them more clearly, to present them after the questionnaires to determine the risk profile and in a more dynamic manner. They suggested to shorten the questionnaires or present questions in the form of tables. They suggested to explain concepts in the beginning of each chapter, to avoid ambiguous questions and to pay attention to participants’ sensitivity regarding questions on Alzheimer’s disease, to avoid or reduce test anxiety.

Improving participant adherence

Members suggested interactive activities as a promising means to increase participants’ adherence to, and effectiveness of, Brain Health PRO. They proposed cognitively engaging activities, personalised feedback, activities designed to retain new knowledge, and quizzes, texts, images and action plans. They also suggested activities to not be compulsory, to be presented early within the programme and to propose optional challenges. Members deemed contact and interaction among participants, as well as social activities an important means to increase programme adherence. They specifically suggested: online presentations, personal meetings, including persons with lived experiences, and meetings supported by local libraries or community halls.

When strong interest in personal meetings became apparent, details for such social activity meetings were proposed, enriched and discussed during the last two co-creation meetings. It was suggested that the FQAS as the principal partner organisation should identify and train group session moderators and organise this type of activity. The moderators would need training and guidance, and several types of activities were suggested. Discussions favoured an introductory meeting between a Brain Health PRO expert and the different facilitators, and in consecutive sessions, activities allowing a deepened understanding of the programme and means for its application. Several potential challenges and pitfalls for these meetings were mentioned. The length of the meetings was deemed critical: on one hand, older adults who often are also caregivers have limited time available; on the other hand, meetings, particularly in person, must be long enough to justify the effort to attend them. The number of meetings would also depend on their nature: a greater number of virtual meetings could be arranged than for meetings in person. Meetings should be based on Brain Health PRO chapters, but those should have been seen beforehand by the attendees: the order, however, in which they are seen may depend on a participant’s risk factors, interests and/or preferences. It was suggested to record short video clips by experts on specific topics of interest not covered in Brain Health PRO, for example, new treatments or self-treatments referenced in the general media or social media. Such recordings could be shown and discussed during the social activity meetings. Finally, two questions were raised: what is the minimum number of participants needed for an in-person-meeting, and will such meetings be an ongoing part of the programme or are they entirely optional? Two suggestions were unanimously accepted: (1) toolkits should be prepared for the moderators and (2) meeting content and modality should be adapted according to local or regional requirements. Finally, the benefit of gamification for programme adherence was discussed. Team members felt that perceiving progress in programme completion was more important than ‘game points’. It was suggested that the gamification interface be an optional feature for those wanting it rather than automatically provided. Winning of game points might need some explanation and contextualisation for programme participants who are not familiar with videogames.

Discussion

The purpose of this co-creation study was to adapt the content and functionalities of Brain Health PRO 28 to the context and needs of a diverse group of users and service providers in the Province of Quebec, Canada, including how it could be used by community organisation, such as the FQAS. To this end, we convened a group of 15 individuals with relevant experiences to participate in five online sessions, to benefit from their feedback, expertise and perspective. The resulting recommendations influenced aspects of participant recruitment, retention efforts and engagement with the content of Brain Health PRO before its launch.

Remote multidomain programmes, such as Brain Health PRO, that are designed to reduce dementia risk have taken on specific importance in the context of a pandemic, in addition to their utility for reaching persons in remote regions, or who are home-bound for mobility reasons. Even though the overall benefits of such programmes have previously been demonstrated,18 19 we chose a co-creation process to further optimise access and to customise the programme implementation to the regional culture, that is, to the province of Quebec, Canada. Co-creation in dementia prevention research involves collaboration among researchers, healthcare or service providers and persons with lived experience in the design and implementation of intervention studies. This approach helps to ensure that the study is relevant and meaningful to the target population of users and leads to a greater understanding of their needs and perspectives. Additionally, we believe that our co-creation approach will result in improved participant engagement with Brain Health PRO, especially through the adaptations to the needs of community organisations, facilitate recruitment and retention and may ultimately lead to better health outcomes for our participants and future users of this remote multidomain programme. By including all stakeholders in the process, co-creation helps to promote trust and transparency and contributes to the development of more effective and user-centred interventions.

As shown in table 2, several suggestions were made and subsequently implemented regarding the diversity of cultural, racial and body-type representation across images, the notepad feature, the creation of a glossary for technical terminology, the format of the introduction video and the gamification features. In addition, research aspects of the project were critically appraised, such as the questionnaire administration, personalising contact, as well as the creation, planning and delivery of the social activities to further engage participants with the material (for consolidation) and each other (to reduce social isolation). The development of these materials and their delivery strategies were specifically influenced by the needs and priorities of the community partner representatives. Given limitations in time and resources, the research team had to make strategic choices as to the level of implementation of these suggestions. The highest consensus was achieved on the development and incorporation of social activities, leading the team to develop a training programme and toolkit for staff members of the FQAS to lead monthly interactive in-person or remote sessions for participants. The FQAS recruited interested staff members across the different regions of Quebec to offer these sessions, depending on the interest of Brain Health PRO participants, as an optional activity. Additional suggestions were retained, such as the creation of an online chatroom, and a short, engaging, recurrent newsletter containing personal stories as well as highlights, successes and pitfalls; however, their conceptual development and implementation has been delayed until the current study phase is completed.

The generalisation of the specific results may be limited by the localised context in the province of Quebec, Canada; however, the data highlight the beneficial aspects of the co-creation process and the importance of taking the particular social and cultural context into account, in which the programme will be implemented. It is possible that additional team members, more extended access to all Brain Health PRO chapters, or supplemental meetings might have given rise to further suggestions for improvements; however, the time and financial constrictions of the project limited the team to the current data. In addition, the recruitment of participants was limited to individuals that expressed interest, resulting in the inclusion of only one man (a researcher with lived experience as a care provider) on the team. It is possible that increased representation by men may have resulted in additional gender-specific suggestions. Fortunately, the implementation of Brain Health PRO foresees a qualitative evaluation of the participants’ experience, as well as the experience of the members of the community organisation, where additional future refinements will be explored, together with the possible addition of items from the current study that have not yet been addressed. The next steps include the finalised implementation of the recommendations presented here, and the evaluation of the efficacy of Brain Health PRO to reduce dementia risk through targeted and personalised education aimed at influencing modifiable risk factors for the development of dementia.

Acknowledgments

We would like to express our thanks to the participants of the focus groups for their time, dedication and generosity. A special thanks goes to Karine Latulippe for her methodological advice.

Footnotes

Twitter: @WalterWittich, @EhlKroger

Collaborators: CCNA CAN-THUMBS UP Study Group—Block Authorship: Co-Principal Investigators: Howard Chertkow, Sylvie Belleville, Howard Feldman, Manuel Montero-Odasso, Haakon Nygaard; Steering Committee members: Nicole Anderson, Sarah Banks, Samir Das, Carol Evans, Guylaine Ferland, Joyla Furlano, Scott Hofer, Inbal Itzhak, Diane Jacobs, Pamela Jarrett, Andrew Lim, Chris McGibbon, Karen Messer, Carolyn Revta, Julie Robillard, Eric Smith, Mark Speechley, Jennifer Walker; Other Site Principal Investigators: Michael Borrie, Kenneth Rockwood; CTU Study Operations Team: Paul Brewster, Andrew Centen, Marc Cuesta, Senny Chan, January Durant, Tatiana Herold, Nellie Kamkar, Jody-Lynn Lupo, Yanina Sarquis-Adamson, Penelope Slack, Amal Trigui, Shahnaz Winer; BHPro Content Contributors: Fatim Ajwani, Anas Alrohimi, Nicole Anderson, Geneviève Arsenault-Lapierre, Gabrielle Aubin, Sylvie Belleville, Jennifer Bethell, Louis Bherer, Maude Bouchard, Mark Boulos, Jacqueline Burt, Asif Javed Butt, Richard Camicioli, Jennifer Campos, Julie Carrier, Alison Chasteen, Howard Chertkow, Rachel A. Crockett, Marc Cuesta, Danielle D’Amico, Véronique Daneault, Thanh Dang-Vu, Alex Desautels, Caroline Desrosiers, Shirley Dumassais, Emily Dwosh, Gillian Einstein, Margaret Fahnestok, Ryan Stanley Falck, Howard Feldman, Guylaine Ferland, Alexandra Fiocco, Christine Gagnon, Jean-François Gagnon, Liisa Galea, Aravind Ganesh, Nicole Gervais, Brigitte Gilbert, Nadia Gosselin, Catherine-Alexandra Grégoire, Tatiana Herold, Stephanie Huang, Catherine Hughes, Inbal Itzak, Atul Jaiswal, Raed Joundi, Heather Keller, Elizaveta Klekovkina, Kim Lasnier-Le Quang, Danielle Laurin, Teresa Liu-Ambrose, Marie-Céline Lorenzini, Dominique Lorrain, Kaljani Mahalingam, Sarantia Samantha Maltezos, Brooklyn Mankasingh, Roger Marple, Susan Marzolini, Samira Mehrabi, Paul Mick, Laura Middleton, Tatiyana Mollayeva, Manuel Montero-Odasso, Annabelle Moore, Aline Moussard, Reanne Mundadan, Kelly Murphy, Leigh-Anne M. Noltie, Haakon Nygaard, JB Orange, Emilie Parolin, Natalie Phillips, Kathy Pichora-Fuller, Lori Piquette, Jason Plaks, Ron Postuma, Avery Pratt, Maria Natasha Rajah, Helli Raptis, Kayla Regan, Anne Julien-Rocheleau, Marie Y. Savundranayagam, Penny Slack, Eric Smith, Mark Speechley, Kylie Sullivan, Munira Sultana, Fatima Tangkhpanya, Talar Tcherkezian, Anne-Julie Tessier, Lynn Valeyry Verty, Amanda Wagner, Walter Wittich, Stephanie Yamin, Anthonio Zadra; LORIS (Longitudinal Online Research and Imaging System) Team: Alan Evans, Samir Das, Rolando Acosta, Camille Beaudoin, Charlie Henri-Bellamare, Jessica Callegaro, Milad Heshmati, Zia Mohades, Pierre Pac Soo; Intervention Selection Team: Serge Gauthier, Howard Feldman, Barry Greenberg, Nathan Herrmann, Krista Lanctot, Joanne McLaurin, Haakon Nygaard, Paul Territo, Donald Weaver, Cheryl Wellington; Other Collaborators: Rida Abou-Haidar, Danielle Alcock, Quincy Almeida, Sarah Best, Korbin Blue, Isabella Celotto, Lauren Cole, Roger Dixon, Hiroko Dodge, Caroline Duchaine, Nada Elhayek, Thalia Field, Jason Haassenstab, Josée Hachee, Andrew Hamilton, Robin Hsiung, Lisa Madlesnky, Bill McIlroy, Lauren Moniz, Hanin Omar, Chris Pauley, Bryn Robinson, Ève Samson, Jenna Sands, Andrew Sexton, Sheetal Shajan, Sachie Sharma, Mariam Sidrak, Carol Thomas, Julia Truemner, Linda Yetman, Guangyong Zou. Citizen Advisors: François Boutin, Yves Boutot, Lise Daigle, Nita Goldband, Elaine Harris, Janet Finkelstein, Kateri Marchand, Lesley Miller, Lloyd Schneider; Service Providers: Katherine Siminovitch and the Genomics lab at Mount Sinai Hospital, Brian Mackie and Cogniciti, Brainiak, Leadhouse.

Contributors: Study conception and design: SB, WW, NDA and EK. Data collection: WW, EK, GA, AF and NB. All authors were involved in the analysis and interpretation of data. WW took the lead on drafting the manuscript. All authors reviewed the results, edited and approved the final version of the manuscript. WW, as guarantor, accepts full responsibility for the finished work and the conduct of the study, had access to the data, and controlled the decision to publish.

Funding: This work was supported by the Fonds de recherche du Québec—Société et culture (#301678). The (Brain Health Support Program)/(Synergic@Home) Study is funded by the Canadian Consortium on Neurodegeneration in Aging (CCNA) and its CAN-THUMBS UP Program. The Canadian Consortium on Neurodegeneration in Aging is supported by a grant from the Canadian Institutes of Health Research with additional funding from several partners. A substantial component of this funding for the CAN-THUMBS UP program derives from the Alzheimer’s Society of Canada CCNA partnership.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Contributor Information

for the Canadian Consortium on Neurodegeneration (CCNA) CAN-THUMBS UP Study Group:

Howard Chertkow, Sylvie Belleville, Howard Feldman, Manuel Montero-Odasso, Haakon Nygaard, Nicole Anderson, Sarah Banks, Samir Das, Carol Evans, Guylaine Ferland, Joyla Furlano, Scott Hofer, Inbal Itzhak, Diane Jacobs, Pamela Jarrett, Andrew Lim, Chris McGibbon, Karen Messer, Carolyn Revta, Julie Robillard, Eric Smith, Mark Speechley, Jennifer Walker, Michael Borrie, Kenneth Rockwood, Paul Brewster, Andrew Centen, Marc Cuesta, Senny Chan, January Durant, Tatiana Herold, Nellie Kamkar, Jody-Lynn Lupo, Yanina Sarquis-Adamson, Penelope Slack, Amal Trigui, Shahnaz Winer, Fatim Ajwani, Anas Alrohimi, Nicole Anderson, Gabrielle Aubin Geneviève Arsenault-Lapierre, Sylvie Belleville, Jennifer Bethell, Louis Bherer, Maude Bouchard, Mark Boulos, Jacqueline Burt, Asif Javed Butt, Richard Camicioli, Jennifer Campos, Julie Carrier, Alison Chasteen, Howard Chertkow, Rachel A. Crockett, Marc Cuesta, Danielle D’Amico, Véronique Daneault, Thanh Dang-Vu, Alex Desautels, Caroline Desrosiers, Shirley Dumassais, Emily Dwosh, Gillian Einstein, Margaret Fahnestok, Ryan Stanley Falck, Howard Feldman, Guylaine Ferland, Alexandra Fiocco, Christine Gagnon, Jean-François Gagnon, Liisa Galea, Aravind Ganesh, Nicole Gervais, Brigitte Gilbert, Nadia Gosselin, Catherine-Alexandra Grégoire, Tatiana Herold, Stephanie Huang, Catherine Hughes, Inbal Itzak, Raed Joundi, Heather Keller, Elizaveta Klekovkina, Kim Lasnier-Le Quang, Danielle Laurin, Teresa Liu-Ambrose, Marie-Céline Lorenzini, Dominique Lorrain, Kaljani Mahalingam, Sarantia Samantha Maltezos, Brooklyn Mankasingh, Roger Marple, Susan Marzolini, Samira Mehrabi, Paul Mick, Laura Middleton, Tatiyana Mollayeva, Manuel Montero-Odasso, Annabelle Moore, Aline Moussard, Reanne Mundadan, Kelly Murphy, Leigh-Anne M. Noltie, Haakon Nygaard, JB Orange, Emilie Parolin, Natalie Phillips, Kathy Pichora-Fuller, Lori Piquette, Jason Plaks, Ron Postuma, Avery Pratt, Maria Natasha Rajah, Helli Raptis, Kayla Regan, Anne Julien-Rocheleau, Marie Y. Savundranayagam, Penny Slack, Eric Smith, Mark Speechley, Kylie Sullivan, Munira Sultana, Fatima Tangkhpanya, Talar Tcherkezian, Anne-Julie Tessier, Lynn Valeyry Verty, Amanda Wagner, Walter Wittich, Stephanie Yamin, Anthonio Zadra, Alan Evans, Samir Das, Rolando Acosta, Camille Beaudoin, Charlie Henri-Bellamare, Jessica Callegaro, Milad Heshmati, Zia Mohades, Pierre Pac Soo, Serge Gauthier, Howard Feldman, Barry Greenberg, Nathan Herrmann, Krista Lanctot, Joanne McLaurin, Haakon Nygaard, Paul Territo, Donald Weaver, Cheryl Wellington, Rida Abou-Haidar, Danielle Alcock, Quincy Almeida, Sarah Best, Korbin Blue, Isabella Celotto, Lauren Cole, Roger Dixon, Hiroko Dodge, Caroline Duchaine, Nada Elhayek, Thalia Field, Jason Haassenstab, Josée Hachee, Andrew Hamilton, Robin Hsiung, Lisa Madlesnky, Bill McIlroy, Lauren Moniz, Hanin Omar, Chris Pauley, Bryn Robinson, Jenna Sands Ève Samson, Andrew Sexton, Sheetal Shajan, Sachie Sharma, Mariam Sidrak, Carol Thomas, Julia Truemner, Linda Yetman, Guangyong Zou, François Boutin, Yves Boutot, Lise Daigle, Nita Goldband, Elaine Harris, Janet Finkelstein, Kateri Marchand, Lesley Miller, Lloyd Schneider, and Katherine Siminovitch

Data availability statement

Data are available upon reasonable request. A complete list of all themes and comments is available in Appendix 1. Access to the complete recording and transcripts of the focus group sessions is possible through the research team, pending additional ethics approval.

Ethics statements

Patient consent for publication

Consent obtained directly from patient(s)

Ethics approval

This study involves human participants. Ethics approval was obtained through the institutional review board of the Comité d’éthique de la recherche vieillissement-neuroimagerie du Centre intégré universitaire de santé et de services sociaux du sud de l’ile de Montréal (#CER VN 21-22-16). Participants gave informed consent to participate in the study before taking part.

References

  • 1. Gauthier S, Webster C, Servaes S, et al. World Alzheimer Report 2022 - Life after diagnosis: Navigating treatment, care and support. London, England: Alzheimer’s Disease International, 2022. Available: https://www.alzint.org/resource/world-alzheimer-report-2022/ [Google Scholar]
  • 2. World Health Organization . Global action plan on the public health response to dementia 2017 - 2025. Geneva, Swotzerland, 2017. Available: https://www.who.int/publications/i/item/global-action-plan-on-the-public-health-response-to-dementia-2017---2025 [Google Scholar]
  • 3. Livingston G, Huntley J, Sommerlad A, et al. Dementia prevention, intervention, and care: 2020 report of the lancet Commission. Lancet 2020;396:413–46. 10.1016/S0140-6736(20)30367-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Livingston G, Sommerlad A, Orgeta V, et al. Dementia prevention, intervention, and care. Lancet 2017;390:2673–734. 10.1016/S0140-6736(17)31363-6 [DOI] [PubMed] [Google Scholar]
  • 5. Kivipelto M, Mangialasche F, Snyder HM, et al. World-wide FINGERS network: A global approach to risk reduction and prevention of dementia. Alzheimer’s & Dementia 2020;16:1078–94. 10.1002/alz.12123 Available: https://onlinelibrary.wiley.com/toc/15525279/16/7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Clare L, Nelis SM, Jones IR, et al. The Agewell trial: a pilot randomised controlled trial of a behaviour change intervention to promote healthy ageing and reduce risk of dementia in later life. BMC Psychiatry 2015;15:25. 10.1186/s12888-015-0402-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Ngandu T, Lehtisalo J, Solomon A, et al. A 2 year Multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet 2015;385:2255–63. 10.1016/S0140-6736(15)60461-5 [DOI] [PubMed] [Google Scholar]
  • 8. World Health Organization . Vieillir en Restant Actif: cadre d’ orientation. 2002. Available: https://apps.who.int/iris/handle/10665/67758
  • 9. Belleville S, Ansaldo AI, Aubertin-Leheudre M, et al. n.d. Vieillir Durant et Après le grand confinement. Revue de Neuropsychologie;12:161–3. 10.1684/NRP.2020.0559 [DOI] [Google Scholar]
  • 10. Whitehead BR, Torossian E. Older adults' experience of the COVID-19 pandemic: A mixed-methods analysis of stresses and joys. Gerontologist 2021;61:36–47. 10.1093/geront/gnaa126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Sepúlveda-Loyola W, Rodríguez-Sánchez I, Pérez-Rodríguez P, et al. Impact of social isolation due to COVID-19 on health in older people, mental and physical effects and recommendations. J Nutr Health Aging 2020;24:938–47. 10.1007/s12603-020-1469-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Fitzsimmons S, Buettner LL. Health promotion for the mind, body, and spirit: a college course for older adults with dementia. Am J Alzheimers Dis Other Demen 2003;18:282–90. 10.1177/153331750301800504 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Anstey KJ, Bahar-Fuchs A, Herath P, et al. Body brain life: A randomized controlled trial of an online dementia risk reduction intervention in middle-aged adults at risk of Alzheimer’s disease. Alzheimers Dement (N Y) 2015;1:72–80. 10.1016/j.trci.2015.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Oakes L, Warren J. Language, citizenship and identity in Quebec. In: Citizenship and Identity in Quebec. London: Palgrave Macmillan UK, 2007. 10.1057/9780230625495 [DOI] [Google Scholar]
  • 15. Hargittai E, Piper AM, Morris MR. From Internet access to Internet skills: Digital inequality among older adults. Univ Access Inf Soc 2019;18:881–90. 10.1007/s10209-018-0617-5 [DOI] [Google Scholar]
  • 16. CEFRIO . Les Aînés Connectés au Québec. NETendances 2019;10:1–14. [Google Scholar]
  • 17. AGE-WELL . COVID-19 has significantly increased the use of many technologies among older Canadians: poll, . 2022. Available: https://agewell-nce.ca/archives/10884
  • 18. Wesselman LM, Hooghiemstra AM, Schoonmade LJ, et al. Web-based Multidomain lifestyle programs for brain health: comprehensive overview and meta-analysis. JMIR Ment Health 2019;6:e12104. 10.2196/12104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. O’Connor E, Farrow M, Hatherly C. n.d. Randomized comparison of mobile and web-tools to provide dementia risk reduction education: use, engagement and participant satisfaction. JMIR Mental Health;1:e4. 10.2196/mental.3654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Richard E, Moll van Charante EP, Hoevenaar-Blom MP, et al. Healthy ageing through Internet counselling in the elderly (HATICE): a multinational, randomised controlled trial. Lancet Digit Health 2019;1:e424–34. 10.1016/S2589-7500(19)30153-0 [DOI] [PubMed] [Google Scholar]
  • 21. Wesselman LMP, Schild A-K, Coll-Padros N, et al. Wishes and preferences for an online lifestyle program for brain health-A mixed methods study. Alzheimers Dement (N Y) 2018;4:141–9. 10.1016/j.trci.2018.03.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Garnett A, Northwood M. Recruitment of community-based samples: experiences and recommendations for optimizing success. Can J Nurs Res 2022;54:101–11. 10.1177/08445621211060935 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Nguyen T, Graham ID, Mrklas KJ, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? learning from experts in the field. Health Res Policy Syst 2020;18:35. 10.1186/s12961-020-0539-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Graham ID, Harrison MB. Illustrating the knowledge to action cycle. knowledge translation in health care: moving from evidence to practice. 2013:249–62. 10.1002/9781118413555 Available: https://www.wiley.com/en-us/Knowledge+Translation+in+Health+Care%3A+Moving+from+Evidence+to+Practice%2C+2nd+Edition-p-9781118413548 [DOI]
  • 25. Gagliardi AR, Berta W, Kothari A, et al. Integrated knowledge translation (IKT) in health care: a Scoping review. Implement Sci 2016;11:38. 10.1186/s13012-016-0399-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Kothari A, McCutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: A response to recent commentaries. Int J Health Policy Manag 2017;6:299–300. 10.15171/ijhpm.2017.15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Feldman HH, Belleville S, Nygaard HB, et al. Protocol for the brain health support program study of the Canadian therapeutic platform trial for Multidomain interventions to prevent dementia (CAN-THUMBS UP): A prospective 12-month intervention study. J Prev Alz Dis 2023. 10.14283/jpad.2023.65 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Belleville S, Nygaard HB, Bherer L, et al. The brain health support program: A web-based interactive platform to increase dementia literacy and awareness regarding lifestyle factors in at-risk individuals. Alzheimer’s & Dementia 2020;16. 10.1002/alz.042603 Available: https://onlinelibrary.wiley.com/toc/15525279/16/S10 [DOI] [Google Scholar]
  • 29. Chertkow H, Borrie M, Whitehead V, et al. The comprehensive assessment of neurodegeneration and dementia: Canadian cohort study. Can J Neurol Sci 2019;46:499–511. 10.1017/cjn.2019.27 [DOI] [PubMed] [Google Scholar]
  • 30. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32- item checklist for interviews and focus group. Int J Qual Health Care 2007;19:349–57. 10.1093/intqhc/mzm042 [DOI] [PubMed] [Google Scholar]
  • 31. Durugbo C, Pawar K. A unified model of the Co-creation process. Expert Syst Appl 2014;41:4373–87. 10.1016/j.eswa.2014.01.007 [DOI] [Google Scholar]
  • 32. Fraser S, Beeman I, Southall K, et al. Stereotyping as a barrier to the social participation of older adults with low vision: a qualitative focus group study. BMJ Open 2019;9:e029940. 10.1136/bmjopen-2019-029940 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Wittich W, Jarry J, Hobler F, et al. Consensus on the use of sensory screening techniques for older adults with cognitive impairment: a reactive Delphi study. Alzheimer’s & Dementia 2018;14. 10.1016/j.jalz.2018.06.1894 [DOI] [Google Scholar]
  • 34. Wittich W, Jarry J, Höbler F, et al. Agreement on the use of sensory screening techniques by nurses for older adults with cognitive impairment in long-term care: A mixed-methods consensus approach. BMJ Open 2019;9:e027803. 10.1136/bmjopen-2018-027803 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Kröger E, Tourigny A, Morin D, et al. Selecting process quality indicators for the integrated care of vulnerable older adults affected by cognitive impairment or dementia. BMC Health Serv Res 2007;7:195. 10.1186/1472-6963-7-195 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Kröger E, Wilchesky M, Marcotte M, et al. Medication use among nursing home residents with severe dementia: identifying categories of appropriateness and elements of a successful intervention. J Am Med Dir Assoc 2015;16:S1525-8610(15)00254-6. 10.1016/j.jamda.2015.04.002 [DOI] [PubMed] [Google Scholar]
  • 37. Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50. 10.1186/1748-5908-4-50 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Miles MB, Huberman AM, Saldaña J. Introduction. In: Qualitative Data Analysis: A Methods Sourcebook. SAGE Publications, Inc, 2014. [Google Scholar]
  • 39. Paillé P, Mucchielli A. L’Analyse par Questionnement Analytique. In: Colin A, ed. L’analyse qualitative en sciences humaines et sociales. Collection U. 2021: 245–68. [Google Scholar]
  • 40. Carlson JA. Avoiding traps in member checking. Qualitative Report 2010;15:1102–13. Available: http://www.nova.edu/ssss/QR/QR15-5/carlson.pdf [Google Scholar]
  • 41. Birt L, Scott S, Cavers D, et al. Member checking: A tool to enhance trustworthiness or merely a nod to validation Qual Health Res 2016;26:1802–11. 10.1177/1049732316654870 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2023-074555supp001.pdf (81.8KB, pdf)

Data Availability Statement

Data are available upon reasonable request. A complete list of all themes and comments is available in Appendix 1. Access to the complete recording and transcripts of the focus group sessions is possible through the research team, pending additional ethics approval.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES