Skip to main content
Research Involvement and Engagement logoLink to Research Involvement and Engagement
. 2024 Jul 11;10:72. doi: 10.1186/s40900-024-00604-z

Exploring barriers and solutions to consumer involvement in health service research using a nominal group technique

Laura Ryan 1,, Rachel Wenke 1,2,3, Joan Carlini 4,5, Kelly A Weir 6,7, Margaret Shapiro 4, Noela Baglot 4, Georgia Tobiano 8,9, Sally Sargeant 10, Laetitia Hattingh 1,11,12
PMCID: PMC11241927  PMID: 38992779

Abstract

Background

Consumer involvement in health research is when patients, their families and caregivers work with researchers on research projects. Despite the growing expectation for health services to facilitate the involvement of consumers in research, the practical integration of this approach is an ongoing process, with limited research conducted into how Australian health services can support this practice. This study explored consumer perspectives on the barriers and solutions to enabling consumer involvement in research within an Australian tertiary hospital and health service, and staff perspectives on the solutions to facilitating consumer involvement. A prior survey had identified barriers to consumer involvement from the staff perspective. The broad aim was to inform the development of a framework to help promote consumer involvement in research within the health service.

Methods

A Nominal Group Technique (NGT) was utilised with groups comprised of health service consumers and staff. Three health consumers were co-researchers in the full life-cycle of this study and are included as authors.

Results

Ten consumers and 14 staff participated across three sessions ranging from one to three hours. For consumers, barriers to their involvement were grouped into seven domains: (1) lack of connection with researchers/research projects, (2) low research literacy, (3) structural barriers, (4) lack of acknowledgement, (5) implementation challenges, (6) inadequate information provision, and (7) representation concerns. Solutions to enabling involvement were grouped into five domains: (1) support to connect with researchers/research projects, (2) adequate information provision, (3) incentive for involvement, (4) acknowledgement, and (5) balanced representation. Staff ideas for solutions were grouped into five domains: (1) support to connect with consumers, (2) support to involve consumers, (3) access to funds to remunerate consumers, (4) more time to involve consumers, and (5) staff training.

Conclusion

Through an NGT methodology, this study delivered a nuanced comprehension of perspectives on involving consumers in research from both health service consumers and staff. These findings serve as a foundation for identifying strategies that foster enhanced and refined relationships between consumers and researchers, advancing the collaborative landscape in health research. The findings from this project offer valuable strategies for researchers to better engage consumers in research and for consumer groups to enhance their involvement. Additionally, these insights could be used by other health services to advocate for essential resources.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40900-024-00604-z.

Keywords: Consumer and community engagement, Hospitals, Health research, Patient and public involvement, Patient participation

Plain language summary

Consumer involvement in health research is when patients, their families, and caregivers work with researchers on research projects. While there is a growing expectation for health services to promote the involvement of consumers in health service research, it is still a work in progress, especially in Australia, where there hasn’t been much research done on this topic. This study looked at what consumers and staff at an Australian hospital thought would hinder or help consumers to become involved in health research. The study used a method called the Nominal Group Technique (NGT), where groups of staff and consumers met for sessions ranging from one to three hours to share and prioritise their ideas. Consumers thought that barriers to their involvement included difficulty connecting with researchers or projects, not knowing much about research, and personal barriers to involvement (such as lack of childcare). They believed that better connection with researchers, information, incentives for involvement, and ensuring everyone’s voices are heard were possible solutions. Staff also had ideas for solutions, like providing support to connect with consumers and more time for research activities. Overall, this study describes what consumers and staff think about working together on research. These findings can help develop strategies for building relationships between consumers and researchers, advancing collaborative efforts in health research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40900-024-00604-z.

Background

Consumer involvement in research describes the process by which consumers (patients, family, friends, and caregivers) are involved in generating knowledge [1, 2]. Terms related to consumer involvement vary and need more consistency within the field. In the United Kingdom and Canada, ‘patient and public involvement’ (PPI) and public engagement are commonly used [36]. In Australia, where this study is conducted, ‘consumer and community involvement’, ‘consumer involvement’ and ‘consumer engagement’ are widely adopted terms. These terms are used by the federal government [7], national research councils and bodies [8, 9], national health funding bodies [10], academic organisations [1113], non-government agencies [1416], and some Australian consumers themselves [17]. Furthermore, the Cochrane Institute also uses the term consumer and community involvement [18]. Given the absence of a universally accepted term among consumers, patients, researchers, and other stakeholders, this paper opts to use the term ‘consumer involvement’ based on local usage. This term aligns with the focus of the study on health service consumers. It is also recognised by some esteemed international bodies in the field of evidence-based medicine and healthcare [18]. When discussing consumer involvement, we refer to the more engaged levels of the International Association for Public Participation’s (IAP2) Spectrum: involve, collaborate, and empower. These levels require two-way dialogue and a higher degree of involvement [19].

Whilst, theoretically, institutions such as health services favour involving consumers in research, many are still contemplating how to support their staff and consumers to work together on projects in practice [20]. This is especially pertinent within the Australian context, as seen by recent endeavours to align with the evolving landscapes of consumer involvement in other countries [12, 20, 21]. Although Australian consumers and researchers have made progress in incorporating consumer voices and lived experiences into the health research field [2], more research is needed on how health services in Australia can facilitate collaboration between consumers and researchers. Over the last decade, the INVOLVE framework has guided The National Health Service in the United Kingdom in involving consumers in research [22, 23]. In contrast, Australian hospital and health services, which state governments fund, lack both state and national initiatives to support consumer involvement in research at the health service level. In a recent systematic review of relevant frameworks, out of the 65 frameworks identified, only one was Australian [1]. Consequently, studies that focus on involving consumers in research within the Australian health service context are both significant and timely.

A framework is proposed as an essential first step in demonstrating a commitment to involving consumers in research and setting out an approach for organisations to assist consumers and staff in working together on research projects [1, 21]. Although various frameworks exist, there lacks a singular framework universally applicable to all contexts [1]. Given the distinct resources, research cultures, and capabilities of health services and their consumers, health services must formulate a tailored framework for their specific circumstances [1]. This study reports on the work undertaken as part of the development of a consumer involvement framework for research in an Australian health service. Specifically, it reports on how the Nominal Group Technique (NGT) was used with groups of health service consumers and staff to identify and prioritise key barriers and solutions to consumers being involved in research at the health service. The findings from this project offer valuable insights for consumer groups and researchers on improving consumer engagement in health research, as well as supporting other health services in developing their own strategic approaches to involving consumers in research.

Accumulating over four decades of scholarship, the scientific community has universally acknowledged consumer involvement as an indispensable facet of high-quality research [2]. Although the merits of involving consumers in research are firmly established, research shows that further work is needed to facilitate successful relationships [2]. The involvement of consumers improves the quality, relevance, and impact of research projects [2427]. Additionally, it helps build trust in the scientific process through greater accountability and transparency [26]. It can also be argued that researchers who exclude consumers and community members from the research process are preventing the consumers from having a voice in the development of knowledge about them. This can be seen as an infringement of their rights, emphasising the imperative for inclusive and participatory research practices [28, 29]. Nonetheless, these advantages and rights-based rationale do not automatically translate into widespread acceptance or practical implementation of consumer involvement in research. For example, one of the key critiques of involving consumers in research is the tendency for tokenistic engagement, where consumers are included superficially without genuinely integrating their input or addressing their concerns, leading to limited impact on the research outcomes [30].

Research is needed to ascertain whether and how consumers and researchers wish to engage in meaningful collaboration [31]. Evidence indicates that health consumers and researchers are motivated to work together [24, 25, 32, 33]. The need for consumers to be involved in research is reinforced by research councils and requirements by major funding bodies for consumer engagement in research [8, 10, 34]. However, the specific methods through which consumers and researchers prefer to work together are not well-documented. What is evident is the existence of numerous obstacles that hinder the establishment of effective relationships [20, 3539]. Addressing these gaps in knowledge necessitates a comprehensive understanding of the perspectives of both consumers and researchers concerning the challenges and opportunities entailed in working together.

It is vital to understand local barriers and solutions to successful relationships via the lens of both consumers and health service staff. Gaining insight into these perspectives is paramount for fostering meaningful relationships between these key stakeholders [1, 21]. From consumer standpoints, understanding barriers allows for the identification of issues that impact their active involvement in research processes, ensuring that their voices are heard. Simultaneously, discerning solutions from the consumer perspective aids in tailoring relevant initiatives to meet their needs and expectations, enhancing engagement and inclusivity [40, 41]. On the other hand, delving into the perspectives of health service staff provides essential insights into opportunities that influence practice [20, 33]. By clarifying and prioritising the barriers and synthesising viable solutions, a framework to support consumers and researchers in working together can be developed informed by empirical realities. A framework will enable navigation of the dynamic landscape to promote research interaction and foster productive relationships between consumers and researchers.

This study was part of a multi-stage project to develop a consumer involvement framework for a hospital and health service. The first stage involved a survey to understand staff perceptions, including barriers to involving consumers in their research, which was reported separately. This paper reports on the second stage, which explored consumer and staff perspectives towards consumers being involved in research at the health service using an NGT. The research questions were:

  1. What barriers to being involved in research do health service consumers view as important for the health service to address?

  2. What solutions do health service consumers view as important for increasing or improving their involvement in research at the health service?

  3. What solutions do health service staff view as important for increasing or improving the involvement of consumers in research at the health service?

Methods

Consumer involvement

Consumer involvement in this study is systematically reported in alignment with the Guidance for Reporting Involvement of Patients and the Public (GRIPP2) checklist [42], available as a supplementary item 1. Three health service consumers actively participated throughout the full project life cycle. Recruitment of consumers to the project team occurred through the health service’s Consumer Advisory Group (comprised of current and former patients, family and caregivers). Participation eligibility was contingent on meeting specific criteria, including awareness of the ‘consumer involvement’ concept and context, a willingness to share lived experiences, and the capacity to provide feedback. This study involved the consumers in conceptualisation, design, data collection (they facilitated the NGT groups), analysis and reporting phases. They are all named authors of this paper. Furthermore, the study had an advisory group of five community-based consumer involvement experts who convened at crucial stages in the research process, providing guidance throughout the project.

Study design

NGT is a facilitated, structured group decision-making method for producing and prioritising ideas within a group context [43, 44]. It enabled the participant groups to explore a topic equitably by allowing all participants to contribute and prioritise ideas [39, 40]. Three NGT sessions were undertaken (one with consumers and two with staff).

Study setting

The setting was a public hospital and health service in a metropolitan area in Australia that delivers a broad range of secondary and tertiary health services across four hospital sites (including one tertiary, training, and research hospital), two health precincts, and two community health centres. The health service caters to over 665,500 residents in the region. Despite employing multiple researchers and clinician-researchers, there is currently no structured and consistent process across the health service to track the number of researchers or consumers undertaking research activities. The initial phase of this study focused on gaining a clearer understanding of consumer involvement in research within the health service and is reported separately.

Participants

For the consumer sessions, participants were over 18 years old and confident speaking English. Additionally, they needed to have received services at the health service where this study took place or be family, friends, or carers of a current or previous health service patient. The aim was to recruit between eight and 10 participants per group in accordance with NGT group size recommendations [45, 46]. For the staff sessions, participants were health service staff working in research and/or as health professionals (e.g. researchers, project officers, physicians, nursing and midwifery, allied health, pathology, and laboratorians). Staff were excluded if they were not in a research or health professional/clinical management role (e.g. business, legal, administrative, or environmental workers).

Recruitment

Advertisements inviting consumers and staff to participate were distributed electronically via the health service’s communication platforms (including social media, the intranet, and the health service’s digital news) and the Consumer Advisory Group. The health service’s Consumer Advisory Group consists of about 20 members representing the community to improve the health service by participating in committees, working groups and research – in co-researcher positions. The recruitment adverts provided a brief overview of the project, and interested parties could use a QR code or email the research team to express their interest and receive more information. Invitation emails were also disseminated through consumer and professional networks, and the research team promoted the project in relevant consumer and staff forums. Furthermore, staff who responded to a recent survey (undertaken in stage one of this project) and consented to be contacted regarding further relevant research opportunities were invited to participate.

When prospective participants indicated their interest in the project, they were sent a Microsoft Form where they could provide demographic data (e.g. their professional discipline for staff participants) and indicate their interest and availability to attend one of two group sessions. They also stipulated their preferred meeting mode (online or in person in a meeting room at the health service). The research team invited prospective participants to a session based on their preferences. Fourteen prospective consumer participants responded to the promotional material, from which 10 participated in the study. One was ineligible since they had not received care at the health service where this study occurred. The other three prospective consumer participants did not respond to further communications from the research team. Of 20 prospective staff participants who responded to the promotional material, 14 participated in the study. Four prospective staff participants did not participate as they were unavailable to attend the group sessions, and two did not respond to further communications from the research team.

Consent

Participation in this study was voluntary. Prospective participants were emailed a Participant Information and Consent Form (PICF). The PICF contained information about the project, research team, what participation involved, risks and benefits of involvement, and the withdrawal procedure. Consumer participants were offered a gift voucher of $120 for participating and paid parking at the hospital in line with the Health Consumers Queensland Guidelines [47]. Staff participants did not receive remuneration as the session was conducted during their rostered working hours. Written consent was provided, and no one who participated in the NGT sessions requested to withdraw from the study.

NGT session facilitators

Each session was facilitated by three members of the research team:

  • Facilitator 1: The main person who guided the group through the process.

  • Facilitator 2: The person who supported Facilitator 1 and kept track of time.

  • Facilitator 3: The scribe, who recorded ideas, kept score, and confirmed the final vote.

For the consumer session, Facilitator 1 was a consumer researcher, and Facilitator 2 was a staff researcher. This arrangement was reversed for the staff sessions. Before the NGT sessions, a facilitator training session was held to ensure that all parties were confident in the process and to support consistency across the sessions. The facilitators were also provided a guide and a running sheet to assist them in their roles.

NGT session procedure

All sessions followed four essential NGT steps: (1) silent generation of ideas by each individual, (2) round robin, with recording of ideas, (3) structured and time-limited discussion of ideas, and (4) selection and ranking of the ideas to create a list of five prioritised ideas (voting) [43, 4850]. Further details about the process can be found in Table 1. During the voting phase, participants prioritised their top five ideas by assigning points on their worksheets. They awarded 5 points to their most crucial idea, 4 points to the next, and so forth [50]. These worksheets were collected and compiled during the session. The results were displayed on a Microsoft Excel spreadsheet, showing which ideas received the most votes (in terms of points and number of voters). Although the aim was to identify five prioritised ideas (during the voting step) in response to each question, where there was an equal number of votes for an idea, both were included – meaning that in some cases, there were more than five prioritised ideas. All groups were recorded using the Microsoft Teams recording function, allowing researchers the option to review discussions as necessary.

Table 1.

Structure of NGT group sessions

Task Description of task Time for staff groups (minutes) Time for consumer group (minutes)
Introduction Introduction to the topic, purpose of the study, and explanation of the agenda provided. 10 15
Silent generation of ideas Participants were provided with the NGT guide. Participants read the question and wrote down their ideas individually for each question without any form of discussion. 10 10
Sharing ideas There was a round robin where each participant shared an idea with the group. The process was repeated until all ideas were shared. Participant ideas were typed into a Microsoft Excel spreadsheet and displayed on the screen so all participants could see them. 10 15
Group discussion A collaborative dialogue where terms and ideas were clarified (removed, grouped, separated, renamed) as required. 10 15
Silent voting Each participant privately voted to rank the ideas in order of importance (1?5) in response to each question. 10 10
Discussion of vote Votes were collated and presented to the group. There was an opportunity for the group to discuss the outcome of the vote. 5 15
Conclusion Final comments, and participants were thanked for their time and the meeting was concluded. 5 10

The following sections outline some key distinctions regarding the data collection process for consumer and staff participants.

Consumer session

There was one consumer session that lasted three hours and had a 15-minute break. The following two questions were posed: (1) ‘What is difficult for you about getting involved in research at the health service?’ and (2) ‘What would help you get involved in research at the health service?’. One week before the consumer session, participants were sent an NGT worksheet with these questions on which to reflect. The session started with a presentation defining consumer involvement in research and showed a short case study video. The presentation also outlined the purpose of the study and the plan for the session.

Staff sessions

There were two staff NGT sessions, which were held on two separate days. Each session lasted one hour. The same question was posed at both sessions: ‘What would help you to partner with consumers in your research at the health service?’ One week before the staff session, participants were sent an NGT worksheet with the question to reflect on and a list of key barriers to involving consumers in research at the health service. This list was generated through the survey conducted in stage one of this project [51]. The session started with a brief presentation that defined consumer involvement in research, explained the purpose of the study, presented the key barriers to involving consumers in research at the health service, and explained the plan for the session.

Data processing and analysis

While thematic analysis can be applied to NGT results to gain deeper insights, we chose not to conduct it in this instance to maintain the focus on the prioritisation of data-driven domains as per the original NGT method [43, 48]. Results from the consumer group were reviewed by two researchers. The prioritised ideas (barriers to and solutions for partnering with researchers) were labelled to reflect domains in the data. The decision was made to abstain from amalgamating these domains, as it was deemed more methodologically robust to present the data in its original form without additional manipulation. This approach aimed to preserve the integrity and authenticity of the data, reflecting a commitment to transparency, comprehensive representation, and adherence to the NGT method with a single group [43, 48].

Results from the staff groups were aggregated and analysed separately from the consumer group [52]. Two researchers grouped and labelled the prioritised staff ideas (solutions for partnering with consumers) under umbrella domains, and scores for all issues under the same umbrella domain were combined. Domains were subsequently ranked in order of highest importance according to their combined scores. If scores for two or more umbrella domains were equal, the domain more frequently identified as one of the top five perceived solutions for participants across the three NGT sessions ranked higher.

Results

Consumer session

Ten consumer participants attended this session (five in person and five online). In response to the first question: ‘What is difficult for you about getting involved in research at the health service?’, 24 ideas were identified during the silent generation stage. These were refined to 15 ideas during the discussion. Ideas, domains, and ranking details can be found in Table 2.

Table 2.

Consumer group – barriers

Domain (Barriers) Details Total score Number of votes Ranking
Lack of connection Not knowing how to connect with research opportunities/researchers. 40 8 1
Low research literacy The language used in research is not understandable to consumers. 21 7 2
Structural barriers Not having access to support to be involved, e.g. child care, disability access, parking, travel, interpreters. 14 5 3
Lack of acknowledgement Consumers not being valued and heard. 14 4 3
Poor implementation of relevant guidelines Researchers not following consumer involvement in research guidelines, e.g. Health Consumer Queensland Guidelines. 9 4 4
Inadequate information Not knowing the time commitment for a project. 9 3 4
Representation concerns Issues with make-up of research team which impact consumers being able to contribute in valuable way. 8 4 5

Seven barriers were prioritised during the voting stage, which led to the identification of seven key domains: (1) lack of connection with researchers and research projects, (2) low research literacy, (3) structural barriers, (4) lack of acknowledgement, (5) implementation challenges, (6) inadequate information provision, and (7) representation concerns.

Domain 1: Lack of connection with researchers and research projects

Participants felt a key barrier to getting involved in research at the health service was not knowing what research opportunities were available or who was conducting research at the health service. This lack of information hindered their ability to actively pursue and apply for research opportunities.

Domain 2: Low research literacy

Participants experienced difficulty comprehending the specific research-orientated language that researchers often used, which deterred their involvement in research. Low research literacy dissuaded their participation and hindered their ability to make meaningful contributions to research projects.

Domain 3: Structural barriers

Participants expressed that certain individuals and groups might be prevented from participating in research due to an absence of essential support elements, such as childcare services, disability accommodations, parking facilities, travel provisions, and interpreter services, thereby highlighting the importance of addressing these factors.

Domain 4: Lack of acknowledgement

Participants reflected on previous experiences participating in health service projects more generally and felt that in these situations, they had not been valued or heard, which led them to feel less inclined to be involved in health service research.

Domain 5: Poor implementation of relevant guidelines

Participants thought a lack of adherence to approved guidelines (e.g. Health Consumers Queensland Guidelines [16]) regarding the treatment of consumers involved in health projects was a barrier to involvement. Participants had some awareness of these guidelines and had previously experienced situations where they were not followed. Examples included experiences where they had not felt genuinely part of the team, had not received training, been remunerated for their time, or had not been involved during the project’s conceptualisation. They found this to be a hindrance to further engagement in research.

Domain 6: Inadequate information provision

Participants reported that they were frequently not given sufficient information to enable them to make an informed decision about whether they wanted to be involved in a project. For example, participants were not always provided with the project’s timeframe, expectations, and potential impact, leading to a lack of incentive to work on research projects.

Domain 7: Representation concerns

Participants emphasised the significance of achieving a balanced representation of both consumers and researchers within a project to foster equitable opportunities for participation. They believed that an imbalance, such as a predominantly researcher-centric team rather than a mix of researchers and consumers, could pose a barrier to their meaningful engagement in the project.

In response to the question: ‘What would help you to get involved in research at the health service?’, 24 ideas were generated during the silent generation stage. The list was refined to 10 ideas during the discussion. Six solutions were prioritised during the voting stage that led to the identification of five domains: (1) support to connect with researchers and research projects, (2) adequate information provision, (3) incentive for involvement, (4) acknowledgement, and (5) balanced representation. Ideas, domains, and ranking details can be found in Table 3.

Table 3.

Consumer group – solutions

Domain (Solutions) Details Total score Number of votes Ranking
Support to connect Widely communicate information about research projects, e.g. website, newsletter, ability to sign up, outcomes of previous projects. 46 10 1
Adequate information provision Detailed information about the project for interested consumers that is in plain English and culturally appropriate. 18 5 2
Incentive Getting information that consumer involvement will improve future outcomes and patient care. 18 6 2
Acknowledgement Knowing that researchers respect and value consumer involvement, e.g. involving consumers from conception to end of a project. 16 6 3
Balanced Representation Making sure to have a balance of consumers for a specific project that is representative of the community. 15 6 4
Incentive Guarantee that consumers who are involved in the project will receive a final report. 13 7 5

Domain 1: Support to connect with researchers and research projects

Participants stressed the importance of broadly disseminating opportunities for research involvement to enhance engagement. They provided examples, such as utilising newsletters and a website for communication purposes. Additionally, they recommended publicising the outcomes of projects that involved consumers to generate interest in consumer involvement.

Domain 2: Adequate information provision

Access to project information was deemed crucial for facilitating consumer involvement in research. Participants expressed a preference for comprehensive project details presented in accessible and culturally sensitive language. This would empower them to make a well-informed decision regarding their willingness to participate in projects. Some information discussed included project and researcher details, project timelines, consumer role descriptions, and potential project outcomes.

Domain 3: Incentive

Participants reported that having a thorough understanding of the project’s potential impact before committing to involvement would enhance their willingness to participate. Knowing their involvement would lead to positive outcomes for other health service consumers was seen as a stimulus for involvement. Furthermore, participants felt it was important to provide evidence on project outcomes as it would serve as an additional motivator, encouraging consumers to engage in research activities in the future.

Domain 3: Acknowledgement

Participants believed that feeling valued and respected by researchers would lead to further interest in being involved in research projects. They provided an illustrative example, suggesting that involving consumers during the conceptualisation phase of the project could be a way to achieve this goal.

Domain 4: Balanced representation

Participants thought a balanced representation of consumers within the team composition would incentivise their engagement in research. Additionally, they proposed that the team’s composition reflect the broader community to ensure a representative structure.

Staff sessions

Fourteen staff participants attended one of two sessions, seven in each session. In each session, four participants attended in person, and three attended online. Participants included medical, nursing, and allied health professionals. Demographic information can be found in Table 4. In response to the question: ‘What would help you to partner with consumers in your research at the health service?’, the groups developed the following ideas:

Table 4.

Demographics for staff participants

Professional discipline # of participants across both sessions
Medical 1
Nursing and midwifery 3
Allied health 3
Research 3
Dual position (researcher and clinician) 1
Other 2

*One participant did not provide their professional discipline

  • Staff Group 1: 22 ideas were asserted during the silent generation stage, refined to 21 ideas during the discussion. Seven solutions were prioritised, of which four key domains were identified: (1) support to connect with consumers, (2) more time to involve consumers, (3) access to funds to remunerate consumers, and (4) staff training.

  • Staff Group 2: 13 ideas were generated during the silent generation stage, refined to 10 ideas during the discussion. Five solutions were prioritised during the voting stage, which led to two key domains being identified: (1) support to involve consumers and (2) support to connect with consumers.

Ideas, domains, and ranking details can be found in Tables 5, 6 and 7. The amalgamated domains across the two staff sessions provided five domains, prioritised in the following order: (1) support to connect with consumers, (2) support to involve consumers in research, (3) access to funds to remunerate consumers, (4) more time to involve consumers in research, and (5) training for staff.

Table 5.

Staff Group 1

Group 1
Domain
(Solutions)
Details Total score Number of votes Ranking
Support to connect Dedicated online platforms for consumers and researchers to partner/share ideas. 15 3 1
Support to connect Advertising campaign to enrol consumers who are interested in research. 14 4 2
Access to funds Remuneration for consumers (travel, time etc.). 10 5 3
More time More time for research which involves consumers. 10 2 3
Staff training Training for staff. 9 3 4
Support to connect Engaging with relevant stakeholders/community groups, to assist consumers to be involved. 7 2 5
Support to connect Platform/portal pool of consumers who are interested in being involved in research. 7 2 5

Table 6.

Staff Group 2

Group 2
Domain
(Solutions)
Details Total score Number of votes Ranking
Support to involve Resources for mentorship/support/clarity/matching to help guide researchers around the process of involvement. 24 5 1
Support to involve Network for mentorship/support/clarity/matching to help guide researchers around the process of involvement. 23 5 2
Support to connect Having an information brochure or guidance document in inpatient/outpatient areas about how consumers can get involved in research. 12 5 3
Support to connect Consider what language is being used when recruiting consumers – capturing the “why”. 11 4 4
Support to involve Support with writing grants when involving consumers. 10 5 5

Table 7.

Combined themes and scores

Domain
(Solutions)
Details Total score Number of votes Combined Ranking
Support to connect Dedicated online platforms for consumers and researchers to partner/share ideas. 15 3 1
Advertising campaign to enrol consumers who are interested in research. 14 4
Platform/portal pool of consumers who are interested in being involved. 7 2
Having an information brochure or guidance document in inpatient/outpatient areas about how consumers can get involved in research. 12 5
Consider what language is being used when recruiting consumers – capturing the “why”. 11 4
Total 59 18
Support to involve Resources for mentorship/support/clarity/matching to help guide researchers around the process of involvement. 24 5 2
Network for mentorship/support/clarity/matching to help guide researchers around the process of involvement. 23 5
Support with writing grants when involving consumers. 10 5
Total 57 15
Access to funds Remuneration for consumers (travel, time, etc.). 10 5 3
More time More time for research which involves consumers. 10 2 4
Staff training Training for staff. 9 3 5

Domain 1: Support to connect with consumers

The most significant solution identified across the two staff groups was support for connecting with consumers. This support included the development of online tools for consumer registration and connection, facilitating idea and interest sharing, and team formation. Participants also identified the need to disseminate promotional material to attract and inform consumers about research (either online or physical material in public areas of the hospital). Language consideration in promotional materials was deemed important to communicate the benefits of involvement and effectively attract consumers.

Domain 2: Support to involve consumers in research

Support involved resources and a network for staff to access mentorship, guidance, and assistance with relevant processes. The types of support discussed included support in connecting with and engaging consumers, e.g., when writing grant applications. Also, participants mentioned the benefit of support in matching consumers with researchers.

Domain 3: Access to funds to remunerate consumers

Participants expressed the need to compensate consumers for their time and reimburse them for associated costs with involvement (such as parking). They also expressed the view that the absence of local funding sources to compensate consumers necessitated the establishment of a pathway for securing funding.

Domain 4: More time to involve consumers in research

Participants highlighted the importance of allocating more time to in-house projects to involve consumers. Reflecting on experiences, participants noted that projects that involved consumers tended to take longer. More time for projects was deemed necessary to enhance their capacity for effective consumer collaborations.

Domain 5: Training for staff

Participants indicated that staff lack understanding of how to involve consumers and that training would be beneficial. During the group session, there was little discussion about the specific areas of training needs.

Discussion

This study involved health service consumers and staff who identified and prioritised multiple challenges and solutions for forming research collaborations at the health service. From the viewpoint of consumers, several obstacles to participating in research were identified. These include difficulties in knowing about ongoing projects, challenges encountered during the research process, such as the imbalance between consumers and researchers, and a lack of motivation to stay involved due to feeling undervalued. The consumers and staff suggested various solutions; these included improving access to information and connection with each other, providing support and training for staff, following relevant guidelines for consumer involvement, and taking actions to ensure consumers feel appreciated and are actively engaged, such as allocating more time for their involvement, remunerating them for their time and ensuring balanced representation in research teams.

Most barriers raised by consumers were addressed by solutions suggested by either the consumers or the staff during the NGT sessions. However, some key barriers were not explicitly addressed, including consumers’ lack of research literacy and structural barriers to engagement, such as lack of childcare services. Whilst general considerations can be made, such as providing education to enhance research literacy and resources to remove structural barriers, further research is needed to better understand how to effectively address these barriers.

Our findings regarding staff perceptions of solutions for involving consumers in research align with previous studies that have explored staff perspectives on solutions and facilitators in similar contexts [2, 20, 21, 33]. Notably, our study contributed to the existing literature on this subject by revealing the hierarchy of importance among staff concerning these solutions. Staff reported assistance in connecting with consumers to be the most beneficial solution for facilitating the involvement of consumers in their research. The need to support staff to connect with consumers for research projects is well documented [20, 21, 40]. However, the literature on the challenges researchers encounter in connecting with consumers lacks specificity. For example, a qualitative study conducted in 2016 involving medical research academics found difficulties researchers face in identifying suitable consumers, including issues like stigma, resulting in consumer hesitancy to engage [40]. However, there was insufficient detail regarding recruitment methods and the specific ways these challenges were observed or experienced. For instance, were researchers facing challenges in drawing individuals to the project or encountering difficulties transitioning interested parties into research partners?

Furthermore, various methods are available to provide support for connecting consumers with researchers, such as the creation of a consumer registry [21], assistance in identifying stakeholder groups [53], guidance on how to recruit consumer co-researchers generally [54] and specific consumer groups [55]. However, again, there is limited research into the efficacy of these proposed solutions. Research that aims to understand these matters more deeply may be vital in providing tailored support to mitigate the challenges.

Barriers to involving consumers in research from the consumer perspective have been documented in the literature [2, 25, 32, 41]. Paradoxically, consumers identified the primary obstacle to working with researchers as a lack of awareness regarding research opportunities. Despite previous studies outlining various challenges, such as power differentials, resource constraints, and procedural complexities [2], both consumers and staff in our study identified a lack of connection to each other as the main barrier. Since both consumers and staff view connection issues as a crucial challenge to be addressed, it underscores the importance of the health service in formulating improved strategies to establish connections between consumers and staff.

Staff in our study viewed lack of access to funds as a barrier to involving consumers. However, this was not the case for the consumer participants. Whilst non-adherence to pertinent guidelines (which included remunerating consumers for their time) was perceived as problematic, lack of compensation or remuneration was not explicitly recognised as a barrier to engagement. This observation is particularly intriguing considering the existing documented emphasis placed on ensuring consumers are duly compensated for their time in pertinent guidelines [9, 10, 47]. Although there are numerous advantages to compensating consumers, such as ensuring consumers are not financially disadvantaged by their involvement, ameliorating power imbalances and providing equitable opportunities [5658], the financial incentives may be less important than other factors for some consumers. This claim is further supported when examining the solutions prioritised by the consumers, where participants identified research impact as a crucial incentive for their involvement in research activities. Motivations for consumer involvement can broadly be categorised into intrinsic and extrinsic factors. Intrinsic motivations stem from personal fulfilment, a desire to contribute to healthcare improvement, and a sense of purpose in making a difference [5]. These motivations often drive consumers to participate without seeking external rewards and are closely tied to their values and personal goals.

These findings were reflected in a recent survey of Canadian consumers, underscoring the predominance of intrinsic motivations, with self-fulfilment and a desire to enhance healthcare services emerging as primary reasons for engaging in health service projects [5]. Promoting research opportunities in consideration of what motivates consumers is viewed as being integral to successful recruitment [5]. Additionally, it is suggested that tailoring the role of consumers in health service projects according to their motivations can enhance their engagement and effectiveness [59]. Each consumer possesses unique, evolving, or multiple motivations. Understanding this complexity is pivotal for fostering strong connections between researchers and consumers. Self-Determination Theory may offer a valuable framework to understand this notion, as it emphasises that individuals are driven by intrinsic needs such as autonomy, competence, and relatedness [60]. In healthcare research, consumers’ intrinsic motivations, such as meaningful contribution, competence enhancement, and connection to healthcare outcomes, often outweigh extrinsic factors like financial compensation.

Our findings regarding the solutions for involving consumers in research correlate with a recent narrative systematic review, where similar individual enablers were identified, including the provision of accessible and culturally appropriate project information, the value of building mutual understanding and respect, and the recommendation to include a minimum of two consumers on the project team to prevent intimidation and isolation and to maximise involvement [2]. Our study reinforces these important solutions to successful collaborations. Nevertheless, there exists a disparity between the expressed needs of consumers for engaging in research and the response from health researchers. The barriers to implementing these solutions remain unclear. Furthermore, our findings stressed the importance of researchers effectively demonstrating to consumers the value they contribute to a project by outlining how their involvement will impact patient outcomes and by keeping consumers informed of the outcome of studies. It is plausible that some communication deficiencies need to be addressed. However, there is also the possibility that researchers are engaging with consumers in a superficial manner, signalling the necessity for researchers to evaluate how consumers can offer more meaningful contributions to projects.

Finally, some of the consumer participants drew on negative experiences of being involved in previous projects at the health service where the study took place, and this shaped their perspectives on factors that would hinder or facilitate working with researchers. Examples included not feeling their contributions were valued and not receiving final reports or details regarding a project’s outcomes. These unfavourable past experiences acted as a deterrent to their continued involvement. Although this barrier to consumer involvement is not a novel consideration [59], it emphasises the significance of devising evaluative methods to comprehend the experiences and concerns of consumers engaged in research projects. Whilst some efforts have been made in this space [9, 61], further work is required to develop mechanisms that mitigate the risk of deterring consumers from future involvement in such projects.

Strengths and limitations

One notable strength of this study is the active involvement of consumers throughout the entire research life cycle, which included facilitating the NGT sessions. The participation of consumers in guiding the NGT sessions may have contributed to mitigating perceived power imbalances and enhancing the safety of all participants, particularly the consumer participants. A limitation of this project is the absence of additional demographic data collection for the consumer participants, which restricts our ability to critically appraise our findings in this setting. A further limitation of the study was that the research team intended to undertake a second group session with consumers but could not achieve this within the timeframe due to recruitment difficulties. A final limitation is that the methods deployed for recruiting participants may have excluded people with emerging English language or literacy skills.

Conclusion

This study highlights key barriers to consumer involvement in research at an Australian health service and proposes solutions to overcome them. It underscores the importance of facilitating connections between consumers and research staff and calls for further research into these challenges to support the development of tailored solutions. The findings have informed the development of a framework to enhance consumer involvement in research within the health service. Beyond the immediate context, these insights could help researchers engage consumers more effectively and assist consumer groups to strategise their involvement. Additionally, the findings could support other health services in advocating for resources by demonstrating the necessity for such investment.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1 (15.4KB, docx)
Supplementary Material 2 (415.8KB, pdf)

Acknowledgements

We acknowledge and pay respects to the people of the Yugambeh language region of the Gold Coast and all their descendants both past and present. We also acknowledge the many Aboriginal people from other regions, as well as the Torres Strait and South Sea Islander people who now live in the local area where this project took place. We would like to thank the consumers and staff who participated in this study which enabled us to do this work.

Author contributions

All the named authors (LR, LH, JC, KW, MS, NB, MC, GT, RM, SR, SS and RW) were involved in conceptualising and designing the study. LR, LH, RW, MS and NB collected the data. LR and LH analysed the data. All the named authors contributed to the interpretation of the data. LR drafted the manuscript with input from LH, JC, KW, and RW. All authors reviewed the manuscript and gave approval for the final version of the manuscript.

Funding

This research was made possible thanks to the generous support provided by a Small Research Project Grant from the Gold Coast Health Study, Education, Research Trust Account (SERTA) and the Health Translation Queensland Microgrant Program.

Data availability

Data available on request due to privacy/ethical restrictions.

Declarations

Ethics approval and consent to participate

Ethical approval was obtained from the Gold Coast Hospital and Health Service (GCHHS) and the Health Research Ethics Committee (HREC/2023/QGC/94895). Research governance approval was given by the Gold Coast Hospital and Health Service (SSA/2023/QGC/94895). Written informed consent was obtained from all participants who took part in this research.

Consent for publication

We confirm that the study participants have provided consent for the study findings to be published in academic journals. Participants were informed that any information shared would be deidentified to protect their privacy and confidentiality.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Greenhalgh T, Hinton L, Finlay T, Macfarlane A, Fahy N, Clyde B, et al. Frameworks for supporting patient and public involvement in research: systematic review and co-design pilot. Health Expect. 2019;22(4):785–801. doi: 10.1111/hex.12888. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Anderst A, Conroy K, Fairbrother G, Hallam L, McPhail A, Taylor V. Engaging consumers in health research: a narrative review. Aust Health Rev. 2020;44(5):806–13. doi: 10.1071/AH19202. [DOI] [PubMed] [Google Scholar]
  • 3.Devonport TJ, Nicholls W, Johnston LH, Gutteridge R, Watt A. It’s not just ‘What’ you do, it’s also the ‘Way’ that you do it: patient and public involvement in the Development of Health Research. Int J Qual Health Care. 2018;30(2):152–6. doi: 10.1093/intqhc/mzx177. [DOI] [PubMed] [Google Scholar]
  • 4.Holmes L, Cresswell K, Williams S, Parsons S, Keane A, Wilson C, et al. Innovating public engagement and patient involvement through strategic collaboration and practice. Res Involv Engagem. 2019;5:30. doi: 10.1186/s40900-019-0160-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.McCarron TL, Noseworthy T, Moffat K, Wilkinson G, Zelinsky S, White D, et al. Understanding the motivations of patients: a co-designed project to understand the factors behind patient engagement. Health Expect. 2019;22(4):709–20. doi: 10.1111/hex.12942. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Liabo K, Boddy K, Bortoli S, Irvine J, Boult H, Fredlund M, et al. Public involvement in health research: what does ‘good’ look like in practice? Res Involv Engagem. 2020;6:11. doi: 10.1186/s40900-020-0183-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Cancer Australia and Cancer Voices Australia. National Framework for Consumer Involvement in Cancer Control. Canberra, ACT; 2011.
  • 8.National Health and Medical Research Council. Guidelines for Guidelines: Consumer involvement. 2018 [ https://www.nhmrc.gov.au/guidelinesforguidelines/plan/consumer-involvement.
  • 9.Australian Clinical Trials Alliance. Why involve consumers? Australian Clinical Trials Alliance. 2023 [ https://involvementtoolkit.clinicaltrialsalliance.org.au/toolkit/understanding/why-involve-consumers/.
  • 10.Australian Government Department of Health and Aged Care. Medical Research Future Fund Consumer Reference Panel 2023 [ https://www.health.gov.au/committees-and-groups/medical-research-future-fund-consumer-reference-panel.
  • 11.The University of Sydney. Community engagement: Our contributions to the community 2024 [ https://www.sydney.edu.au/medicine-health/industry-and-community/community-engagement.html.
  • 12.Gunatillake T, Shadbolt C, Gould D, Lam M, Hearst MG, Vleeskens C, et al. Embedding consumer and community involvement within an established research centre: moving from general recommendations to an actionable framework. Res Involv Engagem. 2020;6(1):64. doi: 10.1186/s40900-020-00241-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.The University of Queensland. What is consumer and community involvement in research? 2024 [ https://clinical-research.centre.uq.edu.au/get-involved/consumers.
  • 14.Australian Health Research Alliance. Consumer and Community Involvement in Health and Medical Research: An Australia-wide Audit. 2018.
  • 15.Cancer Council New South Wales. Involving consumers in research 2024 [ https://www.cancercouncil.com.au/cancer-information/cancer-treatment/clinical-trials/cancer-research-in-australia/involving-consumers-in-research/.
  • 16.Health Consumers Queensland. Consumer and community engagement framework 2017. Brisbane; 2017.
  • 17.Champion Health Agency. Services CHA provides to stakeholders 2024 [ https://www.championhealthagency.com/services-to-stakeholders-from-management.
  • 18.Cochrane. Cochrane consumer engagement and involvement framework to 2027 2023 [ https://consumers.cochrane.org/sites/consumers.cochrane.org/files/uploads/inline-files/Cochrane%20consumer%20engagement%20and%20involvement%20framework%20to%202027_1.pdf.
  • 19.International Association for. Public Participation (IAP2). Quality Assurance Standard. Australasia2015.
  • 20.Ayton D, Braaf S, Jones A, Teede H, Gardam M, Bergmeier H, et al. Barriers and enablers to consumer and community involvement in research and healthcare improvement: perspectives from consumer organisations, health services and researchers in Melbourne, Australia. Health Soc Care Community. 2022;30(4):e1078–91. doi: 10.1111/hsc.13515. [DOI] [PubMed] [Google Scholar]
  • 21.Miller CL, Mott K, Cousins M, Miller S, Johnson A, Lawson T, et al. Integrating consumer engagement in health and medical research - an Australian framework. Health Res Policy Syst. 2017;15(1):9. doi: 10.1186/s12961-017-0171-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.INVOLVE . Public involvement in research: values and principles framework. Eastleigh: INVOLVE; 2015. [Google Scholar]
  • 23.Barber R, Boote JD, Cooper CL. Involving consumers successfully in NHS research: a national survey. Health Expect. 2007;10(4):380–91. doi: 10.1111/j.1369-7625.2007.00457.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Beighton C, Victor C, Carey IM, Hosking F, DeWilde S, Cook DG, et al. I’m sure we made it a better study… experiences of adults with intellectual disabilities and parent carers of patient and public involvement in a health research study. J Intellect Disabil. 2019;23(1):78–96. doi: 10.1177/1744629517723485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Synnot AJ, Cherry CL, Summers MP, Stuckey R, Milne CA, Lowe DB, et al. Consumer engagement critical to success in an Australian research project: reflections from those involved. Aust J Prim Health. 2018;24(3):197–203. doi: 10.1071/PY17107. [DOI] [PubMed] [Google Scholar]
  • 26.Modigh A, Sampaio F, Moberg L, Fredriksson M. The impact of patient and public involvement in health research versus healthcare: a scoping review of reviews. Health Policy. 2021;125(9):1208–21. doi: 10.1016/j.healthpol.2021.07.008. [DOI] [PubMed] [Google Scholar]
  • 27.Shen S, Doyle-Thomas KAR, Beesley L, Karmali A, Williams L, Tanel N, et al. How and why should we engage parents as co-researchers in health research? A scoping review of current practices. Health Expect. 2017;20(4):543–54. doi: 10.1111/hex.12490. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Wicks P, Richards T, Denegri S, Godlee F. Patients’ roles and rights in research. BMJ (Online) 2018;362:k3193–k. doi: 10.1136/bmj.k3193. [DOI] [PubMed] [Google Scholar]
  • 29.Boote J, Telford R, Cooper C. Consumer involvement in health research: a review and research agenda. Health Policy. 2002;61(2):213–36. doi: 10.1016/S0168-8510(01)00214-7. [DOI] [PubMed] [Google Scholar]
  • 30.Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement. BMJ Qual Saf. 2016;25(8):626–32. doi: 10.1136/bmjqs-2015-004839. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Gill SD, Gill M. Partnering with consumers: national standards and lessons from other countries. Med J Aust. 2015;203(3):134–6. doi: 10.5694/mja14.01656. [DOI] [PubMed] [Google Scholar]
  • 32.Marks S, Mathie E, Smiddy J, Jones J, da Silva-Gane M. Reflections and experiences of a co-researcher involved in a renal research study. Res Involv Engagem. 2018;4:36. doi: 10.1186/s40900-018-0120-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Carlini J, Muir R, McLaren-Kennedy A, Grealish L. Researcher Perceptions of Involving Consumers in Health Research in Australia: a qualitative study. Int J Environ Res Public Health. 2023;20(10):5758. doi: 10.3390/ijerph20105758. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.National Health and Medical Research Council. Statement on consumer and community involvement in health and medical research. 2016.
  • 35.Ocloo J, Garfield S, Franklin BD, Dawson S. Exploring the theory, barriers and enablers for patient and public involvement across health, social care and patient safety: a systematic review of reviews. Health Res Policy Syst. 2021;19(1):8. doi: 10.1186/s12961-020-00644-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Vindrola-Padros C, Eyre L, Baxter H, Cramer H, George B, Wye L, et al. Addressing the challenges of knowledge co-production in quality improvement: learning from the implementation of the researcher-in-residence model. BMJ Qual Saf. 2019;28(1):67–73. doi: 10.1136/bmjqs-2017-007127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Happell B, Gordon S, Bocking J, Ellis P, Roper C, Liggins J, et al. Chipping away: non-consumer researcher perspectives on barriers to collaborating with consumers in mental health research. J Ment Health. 2019;28(1):49–55. doi: 10.1080/09638237.2018.1466051. [DOI] [PubMed] [Google Scholar]
  • 38.Bird D, Culley L, Lakhanpaul M. Why collaborate with children in health research: an analysis of the risks and benefits of collaboration with children. Arch Dis Child Educ Pract Ed. 2013;98(2):42–8. doi: 10.1136/archdischild-2012-303470. [DOI] [PubMed] [Google Scholar]
  • 39.Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1):89. doi: 10.1186/1472-6963-14-89. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.McKenzie A, Bulsara C, Haines H, Hanley B, Alpers K. Barriers to community involvement in health and medical research - researchers perspectives on consumer and community involvement in research: a qualitative study. The University of Western Australia School of Population Health, Telethon Kids Institute and The University of Notre Dam; 2016.
  • 41.McKenzie A, Bowden J, Zalcberg JR, Conroy K, Fallon-Ferguson J, Jesudason S, et al. A snapshot of consumer engagement in clinical trials in Australia: results of a national survey of clinical trial networks and research organisations. Res Involv Engagem. 2022;8(1):3. doi: 10.1186/s40900-022-00338-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Res Involv Engagem. 2017;3:13. doi: 10.1186/s40900-017-0062-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Van de Ven AH, Delbecq AL. The nominal group as a research instrument for exploratory health studies. Am J Public Health. 1972;62(3):337–42. doi: 10.2105/AJPH.62.3.337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Manera K, Hanson CS, Gutman T, Tong A. Handbook of Research Methods in Health Social Sciences. Singapore: Springer Singapore; 2019. pp. 737–50. [Google Scholar]
  • 45.Olsen J. The nominal group technique (NGT) as a Tool for Facilitating Pan-disability Focus groups and as a New Method for quantifying changes in qualitative data. Int J Qualitative Methods. 2019;18:160940691986604. doi: 10.1177/1609406919866049. [DOI] [Google Scholar]
  • 46.Roth PL, Schleifer LLF, Switzer FS Nominal group technique - an aid in implementing TQM. CPA J (1975) 1995;65(5):68. [Google Scholar]
  • 47.Health Consumers Queensland. Recruiting: Paying consumers 2024 [ https://www.hcq.org.au/paying-consumers/.
  • 48.Cardona M, Sav A, Michaleff ZA, Thomas ST, Dobler CC. Alignment of doctors’ understanding of treatment burden priorities and chronic heart failure patients’ experiences: a nominal group technique Consultation. Patient Prefer Adherence. 2023;17:153–65. doi: 10.2147/PPA.S385911. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Dening KH, Jones L, Sampson EL. Preferences for end-of-life care: a nominal group study of people with dementia and their family carers. Palliat Med. 2013;27(5):409–17. doi: 10.1177/0269216312464094. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016;38(3):655–62. doi: 10.1007/s11096-016-0257-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Ryan L, Hattingh L, Carlini J, Weir KA, Shapiro M, Baglot N, et al. Consumer and community involvement in public hospital research: a cross-sectional survey of health service staff. Manuscript submitted for publication; 2024.
  • 52.McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, et al. Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcomes Res Method. 2014;14(3):92–108. doi: 10.1007/s10742-014-0121-1. [DOI] [Google Scholar]
  • 53.Concannon TW, Grant S, Welch V, Petkovic J, Selby J, Crowe S, et al. Practical Guidance for Involving Stakeholders in Health Research. J Gen Intern Med. 2019;34(3):458–63. doi: 10.1007/s11606-018-4738-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Western Australia Health Translation Network. Involving Consumers in Health and Medical Research: A practical handbook for organisations, researchers, consumers and funders 2021 [cited 2024. https://wahtn.org/wp-content/uploads/2021/09/WAHTN-CCI-Handbook_29092021.pdf.
  • 55.Frankena TK, Naaldenberg J, Cardol M, Garcia Iriarte E, Buchner T, Brooker K, et al. A consensus statement on how to conduct inclusive health research. J Intellect Disabil Res. 2019;63(1):1–11. doi: 10.1111/jir.12486. [DOI] [PubMed] [Google Scholar]
  • 56.Jurkowski JM, Mills LLG, Lawson HA, Bovenzi MC, Quartimon R, Davison KK. Engaging low-income parents in Childhood Obesity Prevention from Start to Finish: a Case Study. J Community Health. 2013;38(1):1–11. doi: 10.1007/s10900-012-9573-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Saunders C, Crossing S, Girgis A, Butow P, Penman A. Operationalising a model framework for consumer and community participation in health and medical research. Aust New Z Health Policy. 2007;4(1):13. doi: 10.1186/1743-8462-4-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Robinson L, Newton J, Dawson P. Professionals and the public: power or partnership in health research? J Eval Clin Pract. 2012;18(2):276–82. doi: 10.1111/j.1365-2753.2010.01572.x. [DOI] [PubMed] [Google Scholar]
  • 59.Todd AL, Nutbeam D. Involving Consumers in Health Research: what do consumers say. Public Health Res Pract. 2018;28(2). [DOI] [PubMed]
  • 60.Ryan RM, Vansteenkiste M. Self-determination theory: metatheory, methods, and meaning. In: Ryan RM, editor. The oxford handbook of self-determination theory. Oxford University Press; 2023. pp. 3–30.
  • 61.Boivin A, L’Espérance A, Gauvin FP, Dumez V, Macaulay AC, Lehoux P, et al. Patient and public engagement in research and health system decision making: a systematic review of evaluation tools. Health Expect. 2018;21(6):1075–84. doi: 10.1111/hex.12804. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material 1 (15.4KB, docx)
Supplementary Material 2 (415.8KB, pdf)

Data Availability Statement

Data available on request due to privacy/ethical restrictions.


Articles from Research Involvement and Engagement are provided here courtesy of BMC

RESOURCES