Skip to main content
HRB Open Research logoLink to HRB Open Research
letter
. 2021 Jan 28;4:11. [Version 1] doi: 10.12688/hrbopenres.13205.1

Twelve months into a feasibility trial: reflections on three experiences of public and patient involvement in research

Robert Joyce 1, Christopher P Dwyer 1, Sinéad M Hynes 1,a
PMCID: PMC8320708  PMID: 34381956

Abstract

In this Open Letter we present reflections from three different perspectives on the integration of public and patient involvement (PPI) in a research trial. We reflect on the experience of having a patient employed as a contract researcher, with no prior research experience, on a feasibility trial of cognitive rehabilitation in multiple sclerosis. This Open Letter is written by the PPI research team member with reflections from a researcher on the trial and the principle investigator. We will discuss some of the changes made and the impacts that have been resulted from of PPI input into the trial. We focus on PPI involvement in participant recruitment, the development of trial material, integration of PPI along the research cycle, and collaboration. We hope that this Open Letter will encourage principle investigators and groups to include PPI members as part of the research team and help patients and members of the public understand what the experience of PPI members is like.

Keywords: public and patient involvement, PPI, involvement, multiple sclerosis

Disclaimer

The views expressed in this article are those of the authors. Publication in HRB Open Research does not imply endorsement by the Health Research Board of Ireland.

Introduction

Patient and public involvement (PPI) can be considered a relatively new method of enhancing health-related research programs. Though research on the practice has highlighted the benefits of this integration over the past five to ten years, the literature is lacking with respect to the personalised experience(s) of PPI member involvement. The following reflections present personalised accounts of a PPI member’s experience of working with a research team during their development of a randomised controlled trial for a cognitive occupation-based program for people with multiple sclerosis (COB-MS). We present three different perspectives: the patient, the post-doctoral researcher, and the principle investigator.

Patient perspective

Every fortnight, our research team (principal investigator [PI], the post-doc and the research assistants) meet to discuss progress on the COB-MS Trial. This meeting keeps everyone updated and also allocates tasks for the upcoming weeks and months. My role at these meeting is to be the voice of the patient.

At these meetings there are many examples of how I share my lived experience of multiple sclerosis (MS). In this letter I chose two examples. The first highlighting the different knowledge areas of the team members, and the second demonstrating access into the patient community.

Knowledge scope

At one of these meetings, the PI said they had prepared the Patient Participant Manual for the study and they had a sample of the booklet. It was beautiful. For me it looked like something I would be proud to have in my bookcase or even on the coffee table. The production values were excellent. As a person with MS for 28 years, however, looking at this as a tool for making the intervention more effective for the participants, I knew it was only fit for the bin. Of course, I shared my opinion with the team - highlighting that it would not lie flat on the table, the pages were too slippery, and the gloss made it difficult to see what was written on the pages.

It surprised the team. At no stage did they realise the document they had produced would not be suitable for people like me, and why should they? No one else had my lived experience. Even though they knew all about MS, its symptoms and prognosis, they never lifted a book with MS hands.

Once they recovered from the surprise, we got down to the secondary benefit of having the patient at the table - I could share what I needed to make the manual more suitable. Some of the things I suggested were the importance of the type of paper, the binding, location of the page numbers, font and spacing – plus extras like a pouch for loose pages and extra forms (just in case). We then shared this format, along with the original, with the Patient Advisory Panel. They agreed with my opinion and added a few more suggestions.

What a success and a perfect example of why research should have a patient or potential recipient of a new therapy involved at all stages of the research. The researcher doesn’t know what they don’t know; and it is only through having the input of someone with the lived experience at the table they will know if they are going down the wrong path.

Access to the community

At another meeting, we were discussing the recruitment of participants to the trial. This is always difficult, from what I am told, and when we had a small response to our initial press release, we began to talk about how else we can get in front of more people with MS.

Leaflets and posters in MS Society and GP offices was a start. Utilising my connection with a local radio station (Connemara FM), I did an interview about the study, my role in it and the type of people we needed. This brought in a few more people and revealed the power of the ‘patient story’. Subsequently, I used my connections within the MS community to get interviews with local and national press (e.g. Irish Independent, Irish Examiner and Farmers Journal, to name a few), as well as radio in areas we needed more participants.

The impact on recruitment was immediate. Within several weeks, we had enough to start the next stage of the trial and prepared to start the therapy. Why was this successful? I believe when you hear or read of someone who is going through a similar experience to your own, you form a bond, a camaraderie, which strengthens the trust you have in the message they share. I am one of them; and if I believe in it, then, perhaps, it will work for them, too.

Embedded patient collaboration

Imagine an architect only asking the user of the building when the structure is nearly complete, where to locate the light switches, meanwhile none of the doors are wide enough for the user’s wheelchair. The recipient of the product, service, or therapy must be part of the process.

Developing anything new, which should have a long and useful life needs to be a collaborative venture – with all the stakeholders at the table, sharing equal status. We need more than engagement or participation, as these are additions to research, and not essential parts of the process. We need to be collaborators; patients don’t want to be there just to tick the box – we want to be there from the start, taking part in every decision.

The COB-MS program is about to be delivered to participants and the new manual will be used, which we hope will show people receiving the intervention that the research team understands what it is like to have MS and our particular needs.

I have shared two examples in this letter of how patient involvement has altered the course of this study. Some were small changes – and others bigger; but each one demonstrates to the participants in the trial that we understand what it is like to have MS. Every action is looked at through the lens of someone with the illness, who knows the role it plays in their daily experience. The challenge is how to measure the impact of each one of these on the trial.

In the last few months, this trial has also had to face the complication of the COVID-19 pandemic and its impact on research. I am an active part of the MS community here in Ireland, as well as in the UK and USA. I knew since its arrival the impact it would have on our study. Delivering the intervention in person would be an immense challenge. Online delivery would be the only route for most people with MS, because of the increased risk for this patient cohort.

Based on this knowledge, the team started to prepare for the possibility of changing the delivery method. We met with the PPI Advisory Panel to get their opinion and they agreed with the change. Moreover, the panel shared its experience of online therapies and groups, which helped us design the new format. This was combined with recommendations made in past, relevant research regarding how to use online platforms like that we are now using to deliver the program.

Once again, because a patient is ‘at the table’, it is possible to pre-empt potential challenges. We are also invested in the project, as we need it to be a success; and so, we can also provide concrete recommendations on how to proceed. We want and need to be collaborators. There for every decision, ensuring the focus remains on the patient first, with the goal of a better quality of life for those who receive the therapy.

Post-doctoral researcher experience

I’ve been conducting research with human participants for about 15 years now and one thing I can say about it is that recruitment is always a tricky process – especially when recruiting a very specific cohort, such as people living with MS. Consistent with previous efforts to recruit for other interventions, the research team and I proposed to advertise the trial through relevant newsletters and websites for people living with MS (e.g. MS Ireland), through occupational therapists working with us to deliver the intervention, as well as posters and information leaflets posted in relevant clinics. Being cognisant of the modern world, we also made a point to advertise through social media. We also developed a press release for our trial through our university’s PR department, in the hope that either local or national press might pick our study up. Though we garnered fair interest through referrals from specific societies and services, unfortunately, we didn’t gain much interest in light of our press release. It seemed something was missing.

As I believe now, that ‘something missing’ was, in fact, a story to tell. Perhaps, from a researcher’s standpoint, the most important thing to convey about participating in an intervention, like COB-MS, is a general idea about who the program is for, what is involved, how it might help and how to make contact. Though this method is straight to the point, truth be told, it probably lacks that ‘human’ touch in which people can more easily ‘connect’ with the message – much like a story.

When our PPI member volunteered to take over the lead of advertising our study, the message ceased to be about the randomised nature of allocating participants, eligibility criteria or even about the outcome measures. All of that could be discussed later. For now, it was just about a single person with MS, telling their story – and when other people with MS heard that story (or even people who knew someone with MS – the message was shared), a connection was made and we started receiving emails and phone calls.

To be clear, our research team didn’t do anything wrong when we initially advertised the intervention. Indeed, the research team went about it much the same any other research team might. However, it’s not about what we did; rather, what we didn’t do sooner – and that’s giving the advertisement reins to our PPI from the very start. Sure, our PI or post-doc could have persevered to get on the radio or an interview for a paper; but that probably wouldn’t have done much to boost our sample either… because we don’t have MS. So, we don’t have that story to tell or the ability to connect with potential participants in that way; and that’s why PPI is so important to research programs like COB-MS.

Principal investigator experience

I believe that there are ethical reasons why patients should be included in the planning, design, and implementation of research. Within the scientific community, researchers tend to have strong opinions on the topic of PPI in research ( Boivin et al., 2018). Though I have always valued PPI involvement in research, my “involvement” with PPI had been at somewhat of a distance before the COB-MS trial.

The effectiveness of PPI is strongest when people with lived experience of the condition being studied are involved as research partners ( Crocker et al., 2018). When writing the funding application for the COB-MS feasibility trial, I wanted to be sure that there was a strong PPI through the trial. Though I anticipated that it might be a challenge to have a PPI member as a contract researcher, I believed that it would be key for this feasibility trial to have an experience-based expert contributing to decisions about the trial. It can be a challenge when expectations, values and assumptions of researchers and PPI members do not match and this can impact on the experience of both parties ( O’Shea et al., 2019) but this can be addressed through discussion and compromise (most of the time!).

PPI members as experts of their own condition, have experience that is invaluable in the design and running of clinical trials, as well as being aware of the needs, worries, and expectations of participants. Our PPI members are experience-based experts who contribute knowledge that is complementary to that of researchers on the trial ( Karazivan et al., 2015) and have led to us making changes in a number of key areas. Two I will discuss here are 1) development of our participant handbook, and 2) participant recruitment. Having already read the reflections of the PPI contributor and the postdoc I will give my perspective (PI on the trial) of these examples.

The participant handbook

The content of the handbook (which details the intervention) was developed prior to the beginning of the trial. Part of this process involved discussion. Feedback and focus groups with key stakeholders- in this case occupational therapists and people with MS. Once we updated and formatted the handbook, I was happy to get it printed off and ready for participants. A sample of the handbook was brought to the research team meeting for approval. Time had been put into the design and layout so I had not anticipated any issues with it. The researchers were happy with it, but it was our PPI contributor who immediately spotted a number of important issues that needed to be addressed before we printed the batch for our participants. Given the changes suggested, we decided to have a meeting with our wider PPI panel where we brought samples and discussed key issues that needed to be changed or included in the final version. These issues would not have been spotted were it not for the PPI member. The handbook is now being successfully used by participants in the trial and informal feedback has been very positive.

Participant recruitment

As we were recruiting participants, there were some geographical areas that we were finding it difficult to recruit from. We did a call through the MS Society and through the occupational therapists working in the area but were unable to recruit adequate numbers in some areas. Our PPI member decided to get involved in the recruitment process and took it upon themselves to do interviews for radio and print media, with a specific focus on the difficult to recruit areas. This input allowed people listening to hear the experience of someone living with the same condition and explain the research in a way that is meaningful and understandable to them. This effect on recruitment has been reported elsewhere with PPI interventions having a modest but significant increase the odds of participant enrolment ( Crocker et al., 2018; Domecq et al., 2014). There are still barriers that exist to recruiting under-served communities in research and clinical research has for the most part failed to adequately address this issue. Involving PPI members from these under-served communities could be a way of trying to increase the diversity of our participants ( Smits et al.., 2020). The INCLUDE roadmap, developed by the NIHR ( NIHR, 2020) provides an overview of the stages of the research process where researchers can act to include more diverse groups of people, particularly those defined as “under-served”. This is a goal that we have for future PPI work in MS.

There are those who feel that in order to be taken seriously, we must evaluate involvement as we do other research processes, though this view is being debated more recently. If PPI is viewed as a part of the research process then maybe there is not the same need to measure its impact and we would be better served capturing the negative and positive aspects of the process instead ( Russell et al., 2020). One clear reflection is that by having a strong PPI input we have never forgotten why we are doing the research we are doing, and how it might impact the lives of those we are serving through our research.

Data availability

No data are associated with this article.

Acknowledgements

We would like to thank the wider PPI advisory group to the COB-MS trial and PPI Ignite at NUI Galway for their ongoing support throughout the trial. Thank you also to MS Ireland for their continued support throughout.

Funding Statement

Health Research Board, Ireland [DIFA-2018-027].

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 3 approved with reservations]

References

  1. Boivin A, Richards T, Forsythe L, et al. : Evaluating patient and public involvement in research. BMJ. 2018;363: k5147. 10.1136/bmj.k5147 [DOI] [PubMed] [Google Scholar]
  2. Crocker JC, Ricci-Cabello I, Parker A, et al. : Impact of patient and public involvement on enrolment and retention in clinical trials: systematic review and meta-analysis. BMJ. 2018;363: k4738. 10.1136/bmj.k4738 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Domecq JP, Prutsky G, Elraiyah T, et al. : Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89. 10.1186/1472-6963-14-89 [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Karazivan P, Dumez V, Flora L, et al. : The patient-as-partner approach in health care: a conceptual framework for a necessary transition. Acad Med. 2015;90(4):437–441. 10.1097/ACM.0000000000000603 [DOI] [PubMed] [Google Scholar]
  5. National Institute for Health Research: Improving inclusion of under-served groups in clinical research: Guidance from the NIHR INCLUDE project.UK: National Institute for Health Research.2020; (Accessed 09.10.2020). Reference Source [Google Scholar]
  6. O'Shea E, Ogbebor F, Queally M, et al. : Knowledge of public patient involvement among health economists in Ireland: a baseline audit [version 1; peer review: 2 approved]. HRB Open Res. 2019;2:4. 10.12688/hrbopenres.12896.1 [DOI] [Google Scholar]
  7. Russell J, Fudge N, Greenhalgh T: The impact of public involvement in health research: what are we measuring? Why are we measuring it? Should we stop measuring it? Res Involv Engagem. 2020;6:63. 10.1186/s40900-020-00239-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Smits DW, van Meeteren K, Klem M, et al. : Designing a tool to support patient and public involvement in research projects: the Involvement Matrix. Res Involv Engagem. 2020;6:30. 10.1186/s40900-020-00188-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
HRB Open Res. 2021 Apr 9. doi: 10.21956/hrbopenres.14354.r29061

Reviewer response for version 1

Ingrid Klingmann 1

This open letter aims at presenting a practical example for successful engagement of a patient living with the disease into the academic research team from the perspective of the patient, the PhD researcher and the principal investigator. The structure of the open letter enables the presentation of these different experiences. The format of an open letter is different from that of a typical research publication with introduction, material and methods, results, discussion and conclusions. But also this open letter would benefit from a discussion section that would reflect the presented experiences individually and in their entirety. The description of the "successes" are not really aligned: the PhD researcher seems to have no appreciation of the patient's contribution to the improvement of the handbook; the PI does not comment on why the patient's contribution to the handbook enabled considerable improvements to a version that originally had already patient input. And there is no discussion of the fact that all three authors present different reasons why the patient's involvement in recruitment efforts was successful. And there is no critical discussion about what could have been done better in that collaboration or a recommendation to the reader on what to avoid. Ideally, this could have resulted in joint conclusions from the three authors. 

There are some few spelling errors, an important one is the varying spelling of the PI which should read "principal investigator".

And the open letter would benefit from a few more citations in the introduction or the discussion on the current state of knowledge and thinking about patients with various levels of knowledge about the two aspects: living with the disease and clinical research methodology and the types of tasks they can most efficiently contribute to.

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Partly

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Clinical research, medicines development sciences, ethics, patient engagement.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

HRB Open Res. 2021 Jul 14.
Sinéad Hynes 1

Many thanks for your review and comments on our open letter. We considered each, in turn, and have amended the manuscript in light of these considerations. Other, specific comments and questions we answer here.

Comment 1: This open letter would benefit from a discussion section that would reflect the presented experiences individually and in their entirety. The description of the "successes" are not really aligned: the PhD researcher seems to have no appreciation of the patient's contribution to the improvement of the handbook; the PI does not comment on why the patient's contribution to the handbook enabled considerable improvements to a version that originally had already patient input. And there is no discussion of the fact that all three authors present different reasons why the patient's involvement in recruitment efforts was successful.

Response 1: A discussion section has been added to more comprehensively reflect the experiences of the individual team members. 

Comment 2: There is no critical discussion about what could have been done better in that collaboration or a recommendation to the reader on what to avoid. Ideally, this could have resulted in joint conclusions from the three authors. 

Response 2: Many thanks for this comment, consistent with Reviewers 1 and 2’s comments, we have included discussion of challenges and have made important additions to the discussion to clarify the team members’ perspectives.

Comment 3: There are some few spelling errors, an important one is the varying spelling of the PI which should read "principal investigator".

Response 3: All spelling and typographical errors have been amended.

Comment 4: And the open letter would benefit from a few more citations in the introduction or the discussion on the current state of knowledge and thinking about patients with various levels of knowledge about the two aspects: living with the disease and clinical research methodology and the types of tasks they can most efficiently contribute to.

Response 4: A variety of relevant citations are included, where appropriate, including: Boivin  et al. (2018), Crocker  et al. (2018), Domecq  et al. (2014), O’Shea  et al. (2019), Russell  et al. (2020) and Smits et al. (2020). In keeping with the focus of the manuscript we have kept a reflective and accessible approach to the manuscript which is written by PPI member. For this reason, we chose to only include the most relevant citations.

HRB Open Res. 2021 Mar 23. doi: 10.21956/hrbopenres.14354.r29060

Reviewer response for version 1

Marie-Luise Dierks 1, Jonas Lander 2

This open letter is a valuable and novel way of sharing experiences about PPI so we guess its indexing will be an important contribution to the field.

We have a few bullet point comments for the beginning of the letter:

  • It would be good to be clearer in the Intro what you mean by “PPI member”, only patient/public or all involved in the process?

  • Why are personalised experiences important in research about PPI, what do they contribute to the debate?

  • What are “production values”?

  • Can you provide a short explanation about a logical structure for this letter, i.e. who discusses which aspect and how do they complement each other?

The writing and ideas in each of the 3 perspectives seem fine and logical, we don’t have much to add here.

The conclusion, however, could be slightly improved, you do mention the aspect of PPI evaluation, but we don’t see an overall conclusion from the 3 perspective, e.g. the most positive but also negative aspects of your PPI, i.e. were there things that were challenging, that caused disagreement, workload, etc.? Also, can you think again about your overall message to those planning PPI, what do you want them to do (Not sure if this has already been made clear so far).

Does the article adequately reference differing views and opinions?

Yes

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Partly

Is the rationale for the Open Letter provided in sufficient detail?

Partly

Reviewer Expertise:

Patient Public Involvement in medical research, I’m not an expert for MS.

We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however we have significant reservations, as outlined above.

HRB Open Res. 2021 Jul 14.
Sinéad Hynes 1

Many thanks for your review and comments on our open letter. We considered each, in turn, and have amended the manuscript in light of these considerations. It is our hope this letter will help both researchers and patients to see the value of including the patient integration throughout the research programme’s lifespan. With this in mind – as well as your valuable comments, we have added more content to the letter to highlight what we mean by PPI in the trial. Patients and their representative organisation have been involved in every aspect of the study, including this letter. We have amended the letter to include some of the challenges faced by researchers and patients to provide more balance. Your comment about having conclusions from each perspective has also made the document richer; highlighting the different viewpoints. Other, specific comments and questions we answer here.

Comment 1: It would be good to be clearer in the Intro what you mean by “PPI member”, only patient/public of all involved in the process?

Response 1: On Page 2 we have included the following text: “The patient is a common thread throughout the trial. Upon grant application, the MS Society of Ireland and the PPI Ignite project were advisors on how best to incorporate PPI. This led to the employment of an Assistant Researcher living with MS (from here on described as an Embedded Patient Researcher [EPR]), a Patient Advisory Panel and patients being members of the Trial Steering Committee and Trial Management Committee.”

Comment 2: Why are personalised experiences important in research about PPI, what do they contribute to the debate?

Response 2: Introduction and the reflection has now addressed this query, thank you. We have included at the end of the document a Reflection section which clarifies the importance of personal experiences in the context of PPI: “Introducing patient involvement in research is gathering pace internationally. This trial has significant input of patients at all stages. The writers of this letter acknowledge integrating PPI can have bureaucratic obstacles, but by sharing these challenges, how they have been overcome, and the positive impact on the trial of integrating the patient in all stages, we hope more research will focus on collaboration with the ultimate beneficiaries of the trial.”

Comment 3: What are “production values”?

Response 3: Production values referred to the quality of the patient handbook developed for the trial. This line has been reworded to enhance clarity.

Comment 4: Can you provide a short explanation about a logical structure for this letter, i.e. who discusses which aspect and how do they complement each other?

Response 4: Trial teams are comprised of people coming from different backgrounds, which leads to unique perspectives on events. The writers of this Open Letter felt it would be constructive to share the actual experience of the patient, the post-doc researcher and the PI, individually. By sharing these unique experiences it should help the wider discussion of PPI and how it impacts research behaviour. As a patient, it is helpful to know why the other team members contribute to the team discussions in a particular manner. Equally, the researchers need to understand the impact of this experience on an Embedded Patient Researcher.

Comment 5: The conclusion, however, could be slightly improved, you do mention the aspect of PPI evaluation, but we don’t see an overall conclusion from the 3 perspective, e.g. the most positive but also negative aspects of your PPI, i.e. were there things that were challenging, that caused disagreement, workload, etc.? Also, can you think again about your overall message to those planning PPI, what do you want them to do (Not sure if this has already been made clear so far).

Response 5: Many thanks for this comment, consistent with Reviewer 1’s comment, we have included discussion of challenges and have made important additions to the concluding section to clarify individual perspectives and our cumulative message.

HRB Open Res. 2021 Mar 4. doi: 10.21956/hrbopenres.14354.r28911

Reviewer response for version 1

David Evans 1

This is an interesting and informative open letter, detailing the experience of patient and public involvement (PPI) in a feasibility trial from the perspective of a patient employed as a contract researcher, a post-doc researcher and the principal investigator. The letter is valuable in providing convincing reflections of the benefits to the research of the patient member's involvement. My only question is whether the authors have avoided reflection on any difficulties or challenges they may have faced in employing a patient as a contract researcher. Having done so myself on several projects, I have experienced both similar benefits to those described here, but inevitably I have also experienced challenges. They have ranged from bureaucratic obstacles in terms of organisational HR, finance and research governance policies, through to team dynamics. I would be surprised if the authors experienced no challenges whatsoever in these regards, and if they did, it would be helpful if they reflected on these as well as the clear benefits of this PPI. If they really experienced no challenges, then it would be good just to document this.

Does the article adequately reference differing views and opinions?

Partly

Are all factual statements correct, and are statements and arguments made adequately supported by citations?

Yes

Is the Open Letter written in accessible language?

Yes

Where applicable, are recommendations and next steps explained clearly for others to follow?

Yes

Is the rationale for the Open Letter provided in sufficient detail?

Yes

Reviewer Expertise:

Patient and public involvement in health services research.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

HRB Open Res. 2021 Jul 14.
Sinéad Hynes 1

Many thanks for your review and comments on our open letter. We appreciate the feedback. To address the question from your review, the open letter has now been amended to include challenges faced on pages 4 -7.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    No data are associated with this article.


    Articles from HRB Open Research are provided here courtesy of Health Research Board Ireland

    RESOURCES