Abstract
Plain English summary
Patient and public involvement (PPI) improves the quality of health research and ensures that research is relevant to patients’ needs. Though PPI is increasingly evident in clinical and health services research, there are few examples in the research literature of effective PPI in translational and laboratory-based research. In this paper, we describe the development and evaluation of PPI in a multi-centre European project (EuroTEAM – Towards Early biomarkers in Arthritis Management) that included both translational and laboratory-based and psychosocial research. We found that although most PPI in EuroTEAM was centred around the psychosocial research, there were examples of PPI in the laboratory studies. As the project evolved, researchers became better at accommodating PPI and identifying PPI opportunities. It was generally agreed that PPI had a positive impact on the project overall, particularly on public engagement with the research. We concluded that the inclusion of both psychosocial and laboratory-based research in the same project facilitated PPI across all aspects of the research. In future projects, we would try to specify individual PPI activities in more detail at the project-planning stage, and better accommodate patient partners who are not native speakers of English.
Abstract
Background
Patient and public involvement (PPI) enhances research quality and relevance and is central to contemporary health policy. The value of PPI has been recognised in rheumatology research, though there are limited examples of PPI in basic and translational science. The EU FP7 funded ‘EuroTEAM’ (Towards Early biomarkers in Arthritis Management) project was established to develop biomarker-based approaches to predict the future development of rheumatoid arthritis and incorporated psychosocial research to investigate the perceptions of ‘at risk’ individuals about predictive testing, and to develop informational resources about rheumatoid arthritis (RA) risk. Patient involvement was central to EuroTEAM from the inception of the project. The objective of this paper is to describe the development of PPI in EuroTEAM, formatively assess the impact of PPI from the perspectives of researchers and patient research partners (PRPs), reflect on successes and lessons learned, and formulate recommendations to guide future projects.
Methods
Two mixed-methods surveys (for PRPs and researchers) and a teleconference were undertaken to assess the impact of PPI on individual work packages and on EuroTEAM overall.
Results
There was consensus about the positive impact of PPI on the research and on the experiences of those involved. In particular, the positive impact of PPI on the personal development of researchers, and on effective public engagement with EuroTEAM research were highlighted. Researchers described adapting their practice in future projects to facilitate PPI. Spin-off projects and ongoing collaborations between PRPs and researchers reflected the value of PPI to participants. PPI was more frequently integrated in psychosocial research, though examples of PPI in laboratory/translational science were also described. PRPs asked for more opportunities to contribute meaningfully to basic scientific research and for more extensive feedback on their contributions.
Conclusions
The findings were used to formulate recommendations to guide effective involvement of patients in future similar projects, including identifying specific training requirements for PRPs and researchers, the identification of PRP focused tasks/deliverables at the project planning stage, and supporting access to involvement for all PRPs. Importantly, the distinctive multidisciplinary approach of EuroTEAM, incorporating both basic science and psychosocial research, facilitated patient involvement in the project overall.
Keywords: Patient and public involvement, Evaluation, Translational research
Background
Patient-centred approaches are integral to contemporary health policy. Consequently, patient and public involvement (PPI) have become increasingly important in health research and service evaluation [1]. PPI has been defined as research being carried out “‘with’ or ‘by’ members of the public rather than ‘to’, ‘about’ or ‘for’ them” [2]. It is a central theme of the National Institute for Health Research (NIHR) in the United Kingdom, and evidence of active engagement with PPI is now a requirement for many funding bodies, including the European Union’s Horizon 2020 (H2020) funding stream. H2020 guidelines state that “Patients and citizens must be involved in the entire process, from the design of research programmes to the dissemination and implementation of results relating to wellbeing, health, social care, public health, and society” [3].
The involvement of patients in decisions that ultimately affect them has been accepted as beneficial to health research in a number of ways [4]. PPI enhances research quality, efficiency, and transparency, and helps ensure that public benefit is the key focus of the work undertaken. Consultation with those affected by research outcomes has augmented research relevance and validity, and facilitated wider dissemination and engagement with research from patients / members of the public. Patients have become involved with delivering research goals in several ways, at all stages of the research process. For example, they have contributed to priority setting, supported grant applications, advised on clinical trial design, provided feedback on patient facing documents, prepared lay summaries and supported other forms of research dissemination. Patients’ experience of living with a disease has brought additional and unique perspectives [5].
There has been a growing appreciation of the benefits of PPI within rheumatology research [6, 7]. For example, patients have contributed to: the development of questionnaires to assess help-seeking behaviours in patients with new onset rheumatoid arthritis (RA) [8] and hypothetical reactions to the symptoms of RA amongst members of the public [9]; the development of interview schedules [10–12]; systematic reviews [13–15]; generating research ideas [16]; rheumatology conferences [17] and the development of international research recommendations [18–20].
Effective PPI has fostered the development of ongoing, mutually advantageous relationships between researchers and patient research partners (PRPs) [21, 22]. However, maximising achievement of PPI goals has considerable resource implications. Funding may be required to compensate patients for their time and expenses, provide experienced staff to coordinate PPI and deliver appropriate training for researchers and PRPs. Researchers need to invest time into the development of resources to support meaningful patient involvement, such as lay summaries, glossaries and background information on key project elements [23]. Without resource allocation to support PPI, patient involvement risks becoming tokenistic [24, 25].
Whilst PPI has become increasingly commonplace in clinical and health services research, it has been less frequently integrated with early phase translational and laboratory based research [26, 27]. Although patients and researchers agree on the benefits of PPI in pre-clinical translational research in the context of rheumatology, associated challenges include communication between researchers and patients about scientific concepts and terminology and limited access to and awareness of PPI opportunities [28–30].
A further challenge associated with PPI is the difficulty in evaluating its impact [23]. Whilst there have been calls for more robust quantitative assessment of the impact of PPI on research quality, it has been argued that it is also important to capture the experiential, contextual impact of PPI on both researchers and patient research partners [31].
This paper describes the development and formative evaluation of the impact of PPI in a European Union FP7 funded translational research project, EuroTEAM - Towards Early biomarkers in Arthritis Management, which ran from 2012 to 2016. The aim of this multidisciplinary project was to develop new biomarker-based approaches to predict the development of RA in people who do not yet have the disease. RA is a chronic inflammatory disease affecting the joints and internal organs, and is associated with a reduced life expectancy of around 10 years. Early treatment of RA is associated with better clinical outcomes. If uncontrolled, this painful condition can lead to irreversible joint erosion and disability [32]. Improved prediction of RA development would facilitate early treatment and the development of preventive interventions.
An innovative aspect of the EuroTEAM project was that it encompassed both laboratory based science that addressed the identification of predictive biomarkers [33–39] and psychosocial research, that explored the perspectives of potential end-users of predictive tests for RA, and how disease related risk information could be communicated effectively to those at risk of developing RA in the future [40–44]. In order to ensure the quality and relevance of the research and to facilitate effective translation and dissemination of the research findings, PPI was considered an essential part of EuroTEAM from its inception. PPI was specifically funded and supported by the management team.
The objective of this paper is to describe the development of PPI in the EuroTEAM project, and the results of two mixed-methods surveys, undertaken towards the end of the project to capture the perspectives of both researchers and patients on the impact of PPI on this research. Our secondary objective is to reflect on the findings of this evaluation to identify good practice and areas for improvement to inform effective PPI in future projects of this kind.
Methods
Patient research partner involvement and EuroTEAM
The EuroTEAM project was a multidisciplinary collaboration between 16 partners across Europe [Table 1a]. The consortium comprised of 13 universities and 3 small/medium enterprises (SMEs) led by the University of Birmingham. EuroTEAM contained 5 work packages (WPs): genetic biomarkers (WP1), blood biomarkers (WP2), tissue biomarkers (WP3), dissemination and user integration (WP4), and project management (WP5). WPs 1–3 comprised of laboratory-based studies to identify biomarkers predictive of future RA development. The focus of WP4 was psychosocial research to elucidate the perspectives of individuals with an elevated risk of developing RA in the future (first degree relatives of existing RA patients and individuals with clinically suspect joint symptoms) [45]. The aim was to capture this group’s thoughts about being ‘at risk’, their acceptance of predictive testing and preferences for risk communication. A further objective of WP4 was the development and evaluation of informational material for individuals at risk of developing RA.
Table 1.
Geographical distribution of EuroTEAM a) consortium partners and b) patient research partners (PRPs)
| Country | Number of organizations |
|---|---|
| 1a) EuroTEAM consortium partner organizations: | |
| Austria (Medical University of Vienna) | 1 |
| Germany (Charité, Universitätsklinikum Erlangen, Orgentec) | 3 |
| Iceland (deCODE) | 1 |
| The Netherlands (LUMC, AMC, Arthrogen) | 3 |
| Sweden (Karolinska Institutet, KTH, Uppsala Universitet) | 3 |
| Switzerland (University of Zurich) | 1 |
| United Kingdom (University of Birmingham, University of Leeds, University of Glasgow, University of Manchester) | 4 |
| Country | Number of PRPs |
| 1b) EuroTEAM PRPs: | |
| Estonia | 1 |
| Germany | 1 |
| The Netherlands | 1 |
| Romania | 2 |
| Sweden | 1 |
| United Kingdom | 3 |
During the early planning stages of EuroTEAM, several national RA organisations and patient groups in a range of European countries [Table 2] were approached in order to seek endorsement of the project, provide advice and support for the funding application, and to identify potential PRPs. Additional PRPs were recruited via clinician researchers and PRPs’ own networks, resulting in a panel of 9 PRPs; 8 patients with a diagnosis of RA and 1 person whose first-degree relative had RA [Table 1b]. PRP activity was co-ordinated by a research group manager and PRPs were compensated for travel/subsistence expenses incurred.
Table 2.
European patient organisations approached to identify potential patient research partners
| Organisation | Website |
|---|---|
| Swedish Rheumatism Association | www.reumatikerforbundet.org |
| National Rheumatoid Arthritis Society (UK) | www.nras.org.uk |
| Deutsche Rheuma-Liga | www.rheuma-liga-berlin.de |
| Rheuma Nederland (Netherlands) | https://reumanederland.nl/ |
| EULAR - PARE (European League Against Rheumatism - People with Arthritis / Rheumatism across Europe) | www.eular.org/pare.cfm |
PRPs contributed to a number of research activities over the 4 year project, with participation being voluntary at all times. Research activities with active patient partner involvement included:
Attending and contributing to annual scientific meetings and regular teleconferences
Development of a glossary resource (WP1–4)
Contributing to a meta-synthesis of qualitative literature on public perceptions of predictive testing [13, 14] (WP4)
Contributing to the development of interview schedules (including question setting) and the interpretation of qualitative data [12, 46] (WP4)
Contributing to the development of informational resources for those at risk (WP4)
Evaluating a web-based platform for the communication of risk information (WP4)
Developing a questionnaire for patients undergoing a lymph node biopsy procedure (WP3)
Developing informational resources for patients about RA such as the ‘Metaphor Project’ (a collaboration between Eva C Johansson (PRP) and Dr. Heidi Wähämaa from the Karolinska Institutet) exploring the communication of scientific concepts via the use of metaphors and visual representations
Contributing to the project website (e.g. providing news items and reports, creating subtitles for videos) (WP4)
Developing lay summaries of EuroTEAM methods and findings (e.g. lay summary of metabolomics in EuroTEAM) (WP2)
Developing posters for dissemination at the European League Against Rheumatism (EULAR) Congress (WP1–4)
Training for PRPs was provided on an ad-hoc basis for specific research activities (e.g. analysis and interpretation of qualitative data) [14]. Annual project meetings included a day focused specifically on PRPs, where presentations were delivered by the researchers in lay language. No formal training for researchers was provided, however EULAR patient involvement reference cards were utilised by some consortium members [47]. Many researchers adapted to accommodate PRP needs as the project evolved, due to increased mutual understanding. For example, lay summaries were incorporated into research presentations, and frequent short breaks were introduced at annual meetings to avoid PRPs sitting for long periods. Reporting of patient involvement is summarized in Additional file 3.
Evaluation of PPI in EuroTEAM
Towards the end of the EuroTEAM project, two surveys (one for PRPs and another for researchers; Additional files 1 and 2, respectively) were developed to evaluate the impact of PPI in EuroTEAM. The surveys included Likert-type response scales and free text responses and asked respondents to evaluate the impact of PPI in WPs1–3 and WP4 separately, as well as the impact of PPI on the project as a whole. The design and content of the surveys themselves were developed in collaboration with PRPs to ensure they were understandable and comprehensive. The surveys were distributed in April 2016 via email to all 9 PRPs and 51 researchers [Table 3]. Email reminders were sent out to non-responders after 2 weeks. Responses were collated and summarised descriptively. The frequency with which each response category was chosen was summed for Likert-type scales, and descriptive thematic analysis of free text responses was undertaken by RB and MF. A teleconference was held with PRPs and researchers to review and interpret the survey findings and their implications for future projects. Two PRPs also contributed to the preparation of this manuscript.
Table 3.
Survey recipients
| Country | Number of people who received the survey |
|---|---|
| 3a) EuroTEAM researchers: | |
| Austria (Medical University of Vienna) | 4 |
| Germany (Charité, Universitätsklinikum Erlangen, Orgentec) | 7 |
| Iceland (deCODE) | 1 |
| The Netherlands (LUMC, AMC, Arthrogen) | 8 |
| Sweden (Karolinska Institutet, KTH, Uppsala Universitet) | 7 |
| Switzerland (University of Zurich) | 4 |
| United Kingdom (University of Birmingham, University of Leeds, University of Glasgow, University of Manchester) | 20 |
| 3b) EuroTEAM PRPs: | |
| Estonia | 1 |
| Germany | 1 |
| The Netherlands | 1 |
| Romania | 2 |
| Sweden | 1 |
| United Kingdom | 3 |
Results
Respondents
Sixty-six per cent (6 out of 9) of PRPs and 29% (15 out of 51) of researchers completed the surveys. All the PRPs who responded were female. Two were aged between 30 and 39 years, two aged 50–59 years and two were aged between 60 and 69 years.
Eleven of the 15 researchers were female. Four were aged between 30 and 39 years, eight were aged 40–49 years, two were 50–59 years and one was aged between 60 and 69 years). Fourteen were from academic institutions, one was from an SME. Six were clinical researchers, nine were non-clinical researchers.
Survey for patient research partners
The quantitative results of the survey for PRPs are summarized in Table 4. All of the PRP respondents reported that their involvement had a positive overall impact on the EuroTEAM project. This was mainly described in terms of the effect of their involvement on researchers’ perspectives and ability to communicate with members of the public:
“A present, physical reminder of the lay aspects of communication and the patient perspective.”
Respondents stated they had made a large or moderate positive contribution to WP4, and described being involved in specific research activities:
“Contribution at coding and summarizing activity, study protocol, leaflet/brochures for patients, dissemination (in the future), feedback questionnaires, video transcript, writing an article in PARE [People with Arthritis/Rheumatism in Europe)] e-Breakthrough, EuroTEAM website”
The majority of the PRPs thought they had made a minor or moderate positive contribution to WPs 1–3, with one PRP reporting a larger contribution
“I think we made a large contribution to the lymph node biopsy questionnaire for WP3, but for WP1 and WP2 maybe not so much, apart from the overall impact.”
Most of the PRPs found they had a moderate understanding of EuroTEAM from the outset. Half of the PRPs said there were about the right number of assignments for them, whereas half stated that there were too few assignments. All agreed that the assignments were of an appropriate level of difficulty and that they received suitable levels of information about them, however some respondents mentioned that more contextual information or specific training and feedback would have been useful. Half of the respondents stated that they had received too little feedback on the outcome of their contributions to this project:
“When introducing a completely new skill – e.g. coding – perhaps more training, and feedback, would be helpful”
All respondents agreed that the glossary resource was either very useful or extremely useful, and that PRP involvement in EuroTEAM was well co-ordinated. PRP contributions were reported to have been welcomed by researchers and fairly acknowledged:
“We were welcomed and included in the team. We were listened to with respect. We were included in setting recommendations for future work.”
Most PRPs mentioned that their contribution to meetings was very or extremely well supported, although one reported that there had been a moderate amount of support. Some described how this support evolved over the project:
“By the end of the project, with PRPs in the room, the researchers automatically featured some lay language in their presentations, avoiding the need for separate briefing: by this stage the PRPs themselves were also more familiar with the scientific concepts and language of the project. So we all learnt together.”
For many respondents, building relationships with researchers was one of the most valuable aspects of participating in EuroTEAM:
“Enjoyed opportunity to talk to researchers and especially encouraging young researchers to interact with patients.”
In particular, PRPs valued being treated as respected equal partners in the research process …
“Never felt patronised but always valued.”
… and found that their involvement with EuroTEAM had had a positive impact on them personally:
“A definite positive impact. Very informative and challenging in a good way. I’ve definitely grown as a person through the work and meeting all the people in the consortium”.
Such interactions between researchers and PRPs also led to the development of innovative spin-off collaborations:
“The Metaphor project showed pure imagination.”
All respondents to the survey for PRPs were either very interested or extremely interested in contributing to future projects as a PRP. When asked how PRP involvement could have been improved in EuroTEAM, some described accessibility issues relating to accommodation provided at annual project meetings, and several made suggestions to support communication between researchers and PRPs, such as: the need for short breaks during meetings; more materials in lay language; more feedback on project progress and the outcome of PRPs contributions; lay summaries and printouts of slides used in presentations; consideration of non-native English speakers’ needs during teleconferences and face to face meetings.
Table 4.
Quantitative results of the survey for patient research partners (PRPs; N = 6)
| Q1. What kind of impact has PRP involvement had on EuroTEAM overall? | |||||||
| Extremely negative impact | Negative impact | Slightly negative impact | No impact | Slightly positive impact | Positive impact | Extremely positive impact | |
| Number (%) of PRPs | 0 | 0 | 0 | 0 | 0 | 6 (100%) | 0 |
| Q2. How much do you feel you have been able to contribute positively to WPs 1–3? (WP1 genetics, WP2 blood, WP3 tissue) | |||||||
| No contribution at all | Minor contribution | Moderate contribution | Large contribution | Extremely large contribution | |||
| Number (%) of PRPs | 0 | 3 (50%) | 2 (33%) | 1 (17%) | 0 | ||
| Q3. How much do you feel you have been able to contribute positively to WP4 (dissemination & user integration)? | |||||||
| No contribution at all | Minor contribution | Moderate contribution | Large contribution | Extremely large contribution | |||
| Number (%) of PRPs | 0 | 0 | 3 (50%) | 3 (50%) | 0 | ||
| Q4. How well did you feel you understood the objectives, methods and outcomes of EuroTEAM? | |||||||
| Did not understand at all | Understood a little | Moderate understanding | Understood a lot | Understood everything | |||
| Number (%) of PRPs | 0 | 0 | 5 (83%) | 1 (17%) | 0 | ||
| Q5. How did you feel about the number of assignments for PRPs in EuroTEAM? | |||||||
| Far too few assignments | Too few assignments | About the right number of assignments | Too many assignments | Far too many assignments | |||
| Number (%) of PRPs | 0 | 3 (50%) | 3 (50%) | 0 | 0 | ||
| Q6. How did you feel about the level of difficulty of the assignments for PRPs in EuroTEAM? | |||||||
| Far too difficult | Too difficult | About the right level of difficulty | Too easy | Far too easy | |||
| Number (%) of PRPs | 0 | 0 | 6 (100%) | 0 | 0 | ||
| Q7. How did you feel about the amount of information you received about assignments for PRPs in EuroTEAM? | |||||||
| Far too little information | Too little information | About the right amount of information | Too much information | Far too much information | |||
| Number (%) of PRPs | 0 | 0 | 6 (100%) | 0 | 0 | ||
| Q8. How useful did you find the glossary for PRPs? | |||||||
| Not at all useful | Not very useful | Moderately useful | Very useful | Extremely useful | |||
| Number (%) of PRPs | 0 | 0 | 0 | 5 (83%) | 1 (17%) | ||
| Q9. How welcome did you feel your opinions were? | |||||||
| Not at all welcome | Not very welcome | Moderately welcome | Very welcome | Extremely welcome | |||
| Number (%) of PRPs | 0 | 0 | 0 | 4 (67%) | 2 (33%) | ||
| Q10. How well was PRP involvement co-ordinated? | |||||||
| Not at all well- coordinated | Not very well- coordinated | Moderately well-coordinated | Very well- coordinated | Extremely well-coordinated | |||
| Number (%) of PRPs | 0 | 0 | 0 | 1 (17%) | 5 (83%) | ||
| Q11. How did you feel about the amount of feedback you received on the outcome of your contribution to assignments for PRPs? | |||||||
| Far too little feedback | Too little feedback | About the right amount of feedback | Too much feedback | Far too much feedback | |||
| Number (%) of PRPs | 1 (17%) | 2 (33%) | 3 (50%) | 0 | 0 | ||
| Q12. How did you feel about how fairly your contributions to the EuroTEAM project have been acknowledged? | |||||||
| Not at all fairly | Not very fairly | Moderately fairly | Very fairly | Extremely fairly | |||
| Number (%) of PRPs | 0 | 0 | 0 | 3 (50%) | 3 (50%) | ||
| Q13. How well did you feel your contribution to EuroTEAM meetings was supported? | |||||||
| Not at all well supported | Not very well supported | Moderately well supported | Very well supported |
Extremely well supported |
|||
| Number (%) of PRPs | 0 | 0 | 1 (17%) | 2 (33%) | 3 (50%) | ||
| Q14. How interested are you in contributing to future research projects as a PRP? | |||||||
| Not at all interested | Not very interested | Moderately interested | Very interested | Extremely interested | |||
| Number (%) of PRPs | 0 | 0 | 0 | 2 (33%) | 4 (67%) | ||
Some also identified missed opportunities for dissemination:
“I think the PRPs themselves could have written (or should write) an abstract about their experiences and submit it for the PARE sessions at the EULAR congress.”
Survey for researchers
The quantitative results of the survey for researchers are summarised in Table 5. Respondents had varying levels of previous experience of working with PRPs, ranging from none to extensive experience, however the majority of researchers reported no prior experience. All respondents were in agreement that PRP involvement had a positive impact on EuroTEAM:
“The patient research partners have not only given an insight into what it actually entails to have RA and which aspects they feel we need to address in our research, they have contributed enormously to the project, both intellectually and practically. It has made the project’s outcomes more valuable to the RA community, relatives and friends as well as the research community.” (non-clinical researcher, academic institution)
“The respect which was shown for PRPs (for example, mini pauses) created an overall kind and positive atmosphere. PRP presence reminds us why we do research. For non-clinical scientists it is really important to meet patients – for some scientists EuroTEAM might have been the first time?” (non-clinical researcher, academic institution)
Several researchers recounted that they had learnt a great deal from their involvement with PRPs, particularly in relation to their ability to engage with the public about their research:
“I personally learned a lot about how to translate scientific terminology into understandable language to meet the demands of a lay audience. It was advantageous for the project that the patient focus sometimes differed from the scientific/medical focus.” (communications manager, SME)
Of the five respondents who were most involved in WP2, one mentioned that PRPs had not been able to contribute positively to this work package:
“The PRPs were very interested in our research, but did not/could not contribute to the research questions, methods or interpretation of the results.” (clinical researcher, academic institution)
Another said that PRPs had been able to make a minor contribution, whereas another stated that PRPs had contributed moderately and two found that PRPs had been able to make a large contribution to this work package.
Table 5.
Quantitative results of the survey for researchers (N = 15)
| Q1. How much experience of working with PRPs did you have before your involvement with EuroTEAM? | |||||||
| No experience at all | Slight experience |
Moderate experience |
A good deal of experience |
Extensive experience |
|||
| Number (%) of researchers | 7 (46.7%) | 2 (13.3%) | 2 (13.3%) | 2 (13.3%) | 2 (13.3%) | ||
| Q2a. Which WP have you been most involved with? | |||||||
|
WP1 (genetic biomarkers) |
WP2 (blood biomarkers) |
WP3 (tissue biomarkers) |
WP4 (user integration) | ||||
| Number (%) of researchers | 0 | 5 (33.3%) | 4 (26.7%) | 6 (40.0%) | |||
| Q2b. How much do you feel that PRPs have been able to contribute positively to this WP? | |||||||
|
No contribution at all |
Minor contribution |
Moderate contribution |
Large contribution |
Extremely large contribution |
|||
| Number (%) of researchers | 2 (13.3%) | 2 (13.3%) | 1 (6.7%) | 7 (46.7%) | 3 (20.0%) | ||
| Related WP |
WP2 (1) WP3 (1) |
WP2 (1) WP3 (1) |
WP2 (1) |
WP2 (2) WP3 (2) WP4 (3) |
WP4 (3) | ||
| Q3a. Which other WPs have you been involved with (if any)?1 | |||||||
|
WP1 (genetic biomarkers) |
WP2 (blood biomarkers) |
WP3 (tissue biomarkers) |
WP4 (user integration) | ||||
| Number (%) of researchers | 2 (40%) | 0 (0%) | 2 (40%) | 1 (20%) | |||
| Q3b. How much do you feel that PRPs have been able to contribute positively to this WP? | |||||||
|
No contribution at all |
Minor contribution |
Moderate contribution |
Large contribution |
Extremely large contribution |
|||
| Number (%) of researchers | 2 (40%) | 1 (20%) | 1 (20%) | 0 (0%) | 1 (20%) | ||
| Related WP | WP1 (2) | WP3 (1) | WP3 (1) | N/A | WP4 (1) | ||
| Q4. What kind of impact do you think PRP involvement has had on EuroTEAM overall? | |||||||
| Extremely negative impact |
Negative impact |
Slightly negative impact |
No impact |
Slightly positive impact |
Positive impact |
Extremely positive impact |
|
| Number (%) of researchers | 0 | 0 | 0 | 0 | 2 (13.3%) | 6 (40%) | 7 (46.7%) |
| Q5. Did you have any practical experience of working with patients within EuroTEAM? | |||||||
| Yes | No | ||||||
| Number (%) of researchers | 10 (66.7%) | 5 (33.3%) | |||||
15 of the 15 respondents were involved with more than one work package
Of the four respondents who were most involved in WP3, one found that the PRPs had not been able to contribute positively, others stated that PRPs had made a minor (N = 1) or large (N = 2) contribution to this work package.
Amongst the six respondents who were most involved in WP4, there was agreement that PRPs had been able to make a large (N = 3) or extremely large (N = 3) contribution:
“Their contribution has been very substantial … They have been involved with the coding and analysis of interviews. They have been an integral part of the development of the resources for people at risk of RA. PRPs have been instrumental in the development of the information resources we developed for people at risk of RA.” (non-clinical researcher, academic institution)
Five of the 15 researchers had been involved in more than one work package. Two of these had additionally been involved in WP1, and reported that PRPs had not been able to make a positive contribution at all, two had also been involved in WP3 and reported that PRPs had made a minor or moderate contribution. One researcher had additional involvement in WP4 and reported that PRPs had made an extremely large contribution to that work package.
The majority of PRP involvement was perceived to be focused around the psychosocial research carried out in WP4 and researchers sometimes found it difficult to identify meaningful ways to involve patients in other work packages:
“All work packages and research projects should have had input from PRPs and perhaps this should have been implemented earlier on. It should be an integral part of all the research carried out from the very beginning. In some of the more basic research this might be difficult on a practical level, but lay summaries of the findings at various stages are a minimum.” (non-clinical researcher, academic institution)
Those who actively involved PRPs found it very rewarding. For example:
“I had direct talks with patients followed by email correspondence in developing lay summaries of technologies. These were overwhelmingly positive, with positive involvement of the patients and a good and worthwhile contribution to the refinement of informational sources.” (non-clinical researcher, academic institution)
“Close involvement with the partners with producing lay summary of metabolomics technologies to augment a broader understanding.” (non-clinical researcher, academic institution)
When asked how PRP involvement in EuroTEAM had affected how they would involve PRPs in future projects, several researchers indicated that their perception of PPI had evolved throughout the project:
“Before working on EuroTEAM I was always somewhat wary of the idea of working with patients on research – I worried that they wouldn’t understand our work and that their direction would move research away from basic science to outcomes that aren’t the sort of thing I can do. However, I was mistaken. They are brilliant, enthusiastic and very supportive!” (non-clinical researcher, academic institution)
In addition, it was mentioned that PRPs could have a greater role in setting the research agenda:
“It would have been interesting to hear what individual PRPs think about the ongoing research and get their input on which kind of research they think we should prioritise and focus on. This would increase our insights (especially non-clinical researchers) what RA patients experience as a big health issues affecting their daily life.” (non-clinical researcher, academic institution)
Others described gaining insight that would change their approach in future projects, and highlighted that they would endeavour to find more meaningful ways for PRPs to be involved in basic scientific research:
“I would be more proactive in identifying tasks for PRPs to get involved with in the context of biological research studies to allow for their better integration into these projects.” (clinical researcher, academic institution)
“Try to find ways of asking for very specific, as well as general feedback on research.” (non-clinical researcher, academic institution)
It was also suggested that facilitating small-scale meetings alongside annual project meetings might facilitate communication between researchers and PRPs:
“Discussions on a personal level with PRPs present at the annual meeting happened during coffee/lunch breaks or dinner. Sometimes it was a bit hard to start a conversation and for the junior researchers it might not always have been clear, who the PRPs were and what they could talk about. Maybe this could be more guided somehow. Maybe by introducing a kind of speed date session for researchers and PRPs at the start of the project? Guided by the EULAR reference cards?” (non-clinical researcher, academic institution)
Some researchers believed that PPI should be incorporated into basic training for all researchers:
“I think that PRPs could (should?) be included as part of the PhD education:
To practice how to communicate with lay people
To meet a “real patient”, not only working with patient samples”
(non-clinical researcher, academic institution)
Some researchers mentioned that as a direct result of their positive experiences of working with PRPs in EuroTEAM, they had gone on to include PRPs in other projects:
“From EuroTEAM we recruited our “own” PRP to our research group … Overall, she has been a very important link between our rheumatologists and non-clinical PhD students and post-docs... Our group meetings are not only about cells and molecules anymore, we have also patient-orientated discussions with our rheumatologists.” (non-clinical researcher, academic institution)
“The involvement of PRPs was very important for my personal development. In the past I had no idea on how to contact them (as a non-clinical researcher) and how we could together bring research to a higher level. For me a new door has opened, and currently I am in contact with PRPs to discuss my future research proposal.” (non-clinical researcher, academic institution)
Discussion
These findings demonstrate the positive impact of PPI on a multi-centre, multidisciplinary European translational research project that incorporated both laboratory/translational science and psychosocial research. PRPs and researchers who completed the surveys reported that the involvement of PRPs in the project enhanced the research and their own experience of participating in this project. Both groups described the value of building ongoing relationships between patients and researchers and interactively developing their own knowledge and communication skills in ways that were not only personally rewarding but also facilitated effective public engagement and dissemination of the research findings. The development of innovative spin-off projects and ongoing future collaborations between PRPs and researchers reflected the value of PPI to those involved.
There was agreement between all respondents that the PRPs were able to make significant positive contributions to the psychosocial research and dissemination activities associated with WP4, but several reported that PRPs were less able to make a meaningful contribution to the laboratory-based research undertaken in WPs1–3. However, there were examples of effective patient contributions to these work packages that were valued by researchers and PRPs, such as the development of a questionnaire for patients undergoing a lymph node biopsy procedure, lay summaries of metabolomics studies, and lay posters of EuroTEAM findings, which were presented at the European League against Rheumatism (EULAR) Annual Meeting 2016. Several researchers mentioned that in future, they would actively try to identify specific (rather than general) ways in which patients could contribute to laboratory-based projects and dissemination of project results. It is possible that laboratory-based researchers’ awareness of PPI and confidence to implement it in their own research increased in response to proximity with the PPI activity that developed in WP4. In this respect, the distinctive multidisciplinary structure of EuroTEAM facilitated the evolution of PPI in this project. Moving towards more integrative, interdisciplinary models may further enhance PPI by developing common ground that is conducive to collaboration between patients and researchers.
The challenges associated with the involvement of patients in early stage translational science could be at least partly be addressed by appropriate training for researchers about the benefits of PPI and how to identify opportunities and overcome barriers to useful PRP involvement. This could be further supported at the project planning stage by incorporation of deliverables and/or milestones that specifically relate to activities involving PRPs, such as the development of lay progress reports. However, it may be difficult to specify in advance the extent to which patients are able or willing to be involved. It is important to avoid imposing heavy workloads or tight deadlines on patients who may have limited availability and are continuously managing the impact of a chronic condition on their lives, which may also be busy with work, family or other commitments. It is important that patients do not feel pressurised to contribute to research activities unwillingly in order to satisfy research objectives or funders’ requirements.
A further issue raised was that PRPs thought that they would have benefitted from more direct feedback on the outcome or impact of their contributions to research activities, and ongoing progress of research studies within the project. Researchers may not always have been aware of the extent to which feedback could be provided to PRPs, or have had the time needed to provide such feedback. These findings align with recent work to clarify the kinds of feedback needed by public contributors to research [48]. These issues could also be addressed, in collaboration with PRPs, at the project planning stage. Training may be required (for both researchers and PRPs) and resources allocated to support the development of effective PPI, especially where local or institutional infrastructure or funding to support such activities is insufficient or absent. It was suggested in the current evaluation and elsewhere [28] that PPI related training could be integrated into basic training for research students. It is not difficult to imagine that funding bodies will increasingly expect institutional infrastructure, as well as project-specific capacity to support such PPI facilitators to be demonstrated, to ensure research relevance and impact.
Strengths and limitations
A strength of the surveys described here was the use of both quantitative and qualitative methods, which facilitated formative empirical assessment of the impact of PPI on the EuroTEAM project, and captured the experiential and contextual impact from the perspectives of the researchers and PRPs involved. The impact of PPI can be framed in terms of impact on the research itself or impact on the stakeholders involved [31, 49]. For example, some of the researchers in the present survey described how they had gained knowledge about RA from the patients’ expertise, and how they would alter their practice to facilitate PPI and dissemination in future projects as a direct result of their participation in EuroTEAM.
A second strength of the surveys was that they were developed in collaboration with PRPs, to ensure that the questions included were comprehensive from their perspective. PRPs also contributed to the interpretation of the survey results and the preparation of this manuscript, ensuring that their viewpoints were fully and fairly represented. A further strength was the pan-European nature of both PRPs and researchers.
A limitation of the surveys was that the respondents are unlikely to be representative. PRPs were mostly active members of patient organisations and therefore fully engaged with the promotion of patient representation and involvement. However, this can be said of most patients who are actively involved in research and is not specific to this study. Not all PRPs/researchers responded to the survey, and the response rate was particularly low amongst researchers, despite email reminders. With low participant numbers, the utility of the quantitative approach beyond formative evaluation was limited. Furthermore, as surveys were returned via email, respondents were identifiable. It is therefore possible that the results were susceptible to social desirability bias, or that those who responded were more likely to be proactively engaged with PPI and favourable towards the involvement of PRPs in a project of this kind.
The notion of representativeness of PRPs is a matter of ongoing debate [50]. Self-selected patient representatives often develop considerable research expertise in their own right, and this empowers them to contribute meaningfully to the research process. However, this could also be considered to detract from their position as representatives of the experience of lay people [28]. Ensuring that patients from all social groups have equal access to PPI is challenging, and the ability of patients at different stages of a disease to participate is likely to be variable, though they may have very different perspectives on research priorities.
We conducted this formative evaluation of PPI towards the end of the project, but note that PPI practice adapted throughout in response to PRPs needs and feedback on specific elements, such as annual scientific meetings. More formal, iterative assessment of PRP satisfaction throughout the project lifecycle could have supported this adaptive process [28].
Conclusions and recommendations
There was consensus among PRPs and researchers about the positive impact of PPI on EuroTEAM. These findings suggest that PPI can be usefully incorporated in future projects of this kind, and that barriers and facilitators to the implementation of effective PPI in this context should be identified and addressed. On the basis of these findings, it is possible to make the following recommendations, which we hope will guide future projects:
Initiatives to support communication between researchers and patients, such as glossaries and advance lay summaries of research presentations were highly valued and could usefully be incorporated and further developed in future projects.
The unusual multidisciplinary structure of EuroTEAM facilitated patient involvement in the project overall. Further research is needed to define the ways in which multi- and interdisciplinary research can enhance PPI.
Additional training would have been useful for both researchers and PRPs to support effective PPI and the development of mutually advantageous relationships. For example, identification of opportunities for meaningful PPI, awareness of PRP needs, providing feedback and developing communication skills.
It would have been useful to identify specific tasks/areas for development with PRPs at the project planning stage and to consider including such activities as deliverables/milestones where feasible.
Regular opportunities for feedback on the impact of PRPs contribution to specific research activities, and on the progress of the project overall, was highly valued, and could also have been specified at the project planning stage.
Equality of access to patient representation could have been addressed more effectively, both when planning PRP recruitment and throughout the project; for example by facilitating awareness and access to PPI to all patients, not just those who are active members of patient organisations; providing translation services and support for non-native speakers; and supporting research involvement for individuals with particular literacy or mobility/access needs.
Supplementary information
Additional file 1. Survey for patient research partners (PRPs).
Additional file 2. Survey for researchers.
Acknowledgements
The authors would like to thank all of the EuroTEAM patient research partners (Mircia Dobrin, Marie Fincher, Tiina Jasinski, Eva C. Johansson, Hayley Rose, Diana Skingle, Susan Thomas, Daniela Winkels, and Codruta Zabalan) and the University of Birmingham Rheumatology Research Patient Partnership: www.birmingham.ac.uk/r2p2
Abbreviations
- EULAR
European League Against Rheumatism
- EuroTEAM
EU FP7 funded collaborative project – Towards Early biomarkers in Early Arthritis
- H2020
Horizon 2020 (EU funding stream)
- NIHR
National Institute for Health Research
- PARE
People with Arthritis / Rheumatism in Europe
- PPI
Patient and public involvement
- PRP
Patient research partner
- RA
Rheumatoid arthritis
- SMEs
Small / medium enterprises
- WP
Work package
Authors’ contributions
CB and KR were Principal Investigators for EuroTEAM, incorporating patient and public involvement (PPI) from the outset. RS, BS and KB supported the development of PPI in EuroTEAM and RB was project manager and PPI coordinator. MF, GS, KR, DS and EJ developed the evaluation exercise. All authors contributed to the interpretation of the findings of the evaluation and to the writing of this manuscript, which was led by RB and MF. All authors approved the final version of this manuscript.
Funding
The research leading to these results was funded within the FP7 HEALTH programme under the grant agreement FP7-HEALTH-F2–2012-305549 (EuroTEAM).
CDB & KR receive support from the NIHR Birmingham Biomedical Research Centre and the Research into Inflammatory Arthritis Centre Versus Arthritis: grant number 20298.
CM was an NIHR funded academic clinical lecturer.
This paper presents independent research supported by the NIHR Birmingham Biomedical Research Centre based at the University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
Availability of data and materials
The data collected during the evaluation exercise described in this paper are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This paper reports the development and evaluation of a patient advisory group. Patient research partners acted as specialist advisors, and were involved in the planning and conduct of this research and in the development of this manuscript as authors. All participants in the EuroTEAM project were provided with information about the purpose of this evaluation exercise, and both patient partners and researchers contributed to the development of the survey reported here. Completion and return of the survey was voluntary for both EuroTEAM researchers and patient research partners. Formal ethical approval is therefore not needed for research of this kind, in line with National Institute for Health Research (NIHR) INVOLVE policy.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s40900-020-0178-7.
References
- 1.Mockford C, Staniszewska S, Griffiths F, Marx SH. The impact of patient and public involvement on UK NHS health care: a systematic review. Int J Qual Health Care. 2012;24(1):28–38. doi: 10.1093/intqhc/mzr066. [DOI] [PubMed] [Google Scholar]
- 2.INVOLVE website – what is public involvement in research? http://www.invo.org.uk/posttypefaq/what-is-public-involvement-in-research
- 3.EU Horizon 2020 Advice for 2018–2020 of the Horizon 2020 Advisory Group for Societal Challenge 1, "Health, Demographic Change and Well-being", https://ec.europa.eu/research/health/pdf/ag_advice_report_2018-2020.pdf (see page 9).
- 4.de Wit M, Kirwan JR, Tugwell P, Beaton D, Boers M, PBrooks SC, Conaghan PG, D’Agostino MA, Hofstetter C, Hughes R, Leonge A, Lyddiatt A, March L, May J, Montie P, Richards P, Simon LS, Singh JA, Strand V, Voshaar M, Bingham CO, III, Gossec L. Successful Stepwise Development of Patient Research Partnership: 14 Years’ Experience of Actions and Consequences in Outcome Measures in Rheumatology (OMERACT). The Patient – Patient Centered Outcomes Research. 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Stewart R, Liabo K. Involvement in research without compromising research quality. J Health Serv Res Policy. 2012;17(4):248–251. doi: 10.1258/jhsrp.2012.011086. [DOI] [PubMed] [Google Scholar]
- 6.Hewlett S, de Wit M, Richards P, Quest E, Hughes R, Heiberg T, Kirwan J. Patients and professionals as research partners: Challenges, practicalities and benefits. Arthritis Care Res. 2006;55(4):676–680. doi: 10.1002/art.22091. [DOI] [PubMed] [Google Scholar]
- 7.Kirwan John R., de Wit Maarten P. T., Bingham Clifton O., Leong Amye, Richards Pamela, Tugwell Peter, Voshaar Marieke, Gossec Laure. Commentary: Patients as Partners: Building on the Experience of Outcome Measures in Rheumatology. Arthritis & Rheumatology. 2016;68(6):1334–1336. doi: 10.1002/art.39678. [DOI] [PubMed] [Google Scholar]
- 8.Stack RJ, Mallen CD, Deighton C, Kiely P, Shaw KL, Booth A, Kumar K, Thomas S, Rowan I, Horne R, Nightingale P, Herron-Marx S, Jinks C. DELAY Study Syndicate, K Raza. The development and initial validation of a questionnaire to measure help-seeking behaviour in patients with new onset rheumatoid arthritis. Health Expect. 2015;18(6):2340–2355. doi: 10.1111/hex.12203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Simons G, Belcher J, Morton C, Kumar K, Falahee M, Mallen CD, Stack RJ, Raza K. Symptom recognition and perceived urgency of help-seeking for rheumatoid arthritis and other diseases in the general public: a mixed method approach. Arthritis Care Res. 2017;69(5):633–641. doi: 10.1002/acr.22979. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Simons G, Mason A, Falahee M, Kumar K, Mallen CD, Raza K, Stack RJ. Qualitative Exploration of illness perceptions of rheumatoid arthritis in the general public. Musculoskelet Care. 2017;15(1):13–22. doi: 10.1002/msc.1135. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Simons G, Mallen CD, Kumar K, Stack RJ, Raza K. A qualitative investigation of the barriers to help-seeking among members of the public presented with symptoms of new-onset rheumatoid arthritis. J Rheumatol. 2015;42(4):585–592. doi: 10.3899/jrheum.140913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Stack RJ, Stoffer M, Englbrecht M, Mosor E, Falahee M, Simons G, Smolen J, Schett G, Buckley CD, Kumar K, Hansson M, Hueber A, Stamm T, Raza K. Perceptions of risk and predictive testing held by the first-degree relatives of patients with rheumatoid arthritis in England, Austria and Germany: a qualitative study. BMJ Open. 2016;6(6):e010555. doi: 10.1136/bmjopen-2015-010555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bayliss Kerin, Raza Karim, Simons Gwenda, Falahee Marie, Hansson Mats, Starling Bella, Stack Rebecca. Perceptions of predictive testing for those at risk of developing a chronic inflammatory disease: a meta-synthesis of qualitative studies. Journal of Risk Research. 2016;21(2):167–189. doi: 10.1080/13669877.2015.1119183. [DOI] [Google Scholar]
- 14.Bayliss K, Starling B, Raza K, Johansson EC, Zabalan C, Moore S, Skingle D, Jasinski T, Thomas S, Stack R. Patient involvement in a qualitative meta-synthesis: Lessons learnt. Res Involvement Engagement. 2016;2:18. doi: 10.1186/s40900-016-0032-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Shea B, Santesso N, Qualman A, Heiberg T, Leong A, Judd M, Robinson V, Well G, Tugwell P, the Cochrane Musculoskeletal Consumer Group Consumer-driven health care: building partnerships in research. Health Expecations. 2005;8(4):352–359. doi: 10.1111/j.1369-7625.2005.00347.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tiwana R, Rowland J, Fincher M, Raza K, Stack RJ. Social interaction at the onset of rheumatoid arthritis and their influence on help-seeking behaviour: A qualitative exploration. Health Psychol. 2015;20(3):648–661. doi: 10.1111/bjhp.12134. [DOI] [PubMed] [Google Scholar]
- 17.de Wit MPT, Koelewijn-van Loon MS, Collins S, Abma TA, Kirwan J. “If I Wasn’t This Robust”: Patients’ expectations and experiences at the outcome measures in rheumatology conference 2010. The Patient. 2013;6(3):179–187. doi: 10.1007/s40271-013-0017-0. [DOI] [PubMed] [Google Scholar]
- 18.Gerlag D, Raza K, van Baarsen LGM, Brouwer E, Buckley CD, Burmester GR, Gabay C, Catrina AI, Cope AP, Cornelis F, Rantapää Dahlqvist S, Emery P, Eyre S, Finckh A, Gay S, Hazes JM, van der Helm-van Mil A, Huizinga TWJ, Klareskog L, Kvien TK, Lewis C, Machold KP, Rönnelid J, van Schaardenburg D, Schett G, Smolen JS, Thomas S, Worthington J, Tak PP. EULAR recommendations for terminology and research in individuals at risk of rheumatoid arthritis: report from the Study Group for Risk Factors for Rheumatoid Arthritis. Ann Rheum Dis. 2012;71(5):638–641. doi: 10.1136/annrheumdis-2011-200990. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.de Wit MPT, Berlo SE, Aanerud GJ, Aletaha D, Bijlsma JW, Croucher L, Da Silva JAP, Glüsing B, Hewlett S, Jongkees M, Magnusson D, Scholte-Voshaar M, Richards P, Ziegler C, Abma TA. European league against rheumatism recommendations for the inclusion of patient representatives in scientific projects. Ann Rheum Dis. 2011;70:722–726. doi: 10.1136/ard.2010.135129. [DOI] [PubMed] [Google Scholar]
- 20.Kirwan JR, Minnock P, Adebajo A, Bresnihan B, Choy E, de Wit M, Hazes M, Richards P, Saag K, Suarez-Almazor M, Wells G, Hewlett S. Patient perspective: fatigue as a recommended patient centered outcome measure in rheumatoid arthritis. J Rheumatol. 2007;34(5):1174–1177. [PubMed] [Google Scholar]
- 21.Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B, Erwin P, Eton D, Sloan J, Asi N, Dabrh AMA, Murad MH. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89. doi: 10.1186/1472-6963-14-89. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Bagley HJ, Short H, Harman NL, Hickey HR, Gamble CL, Woolfall K, Young B, Williamson PR. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involvement Engagement. 2016;2:15. doi: 10.1186/s40900-016-0029-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, Suleman R. A Systematic Review of the Impact of Patient and Public Involvement on Service Users, Researchers and Communities. Patient. 2014;7(4):387–395. doi: 10.1007/s40271-014-0065-0. [DOI] [PubMed] [Google Scholar]
- 24.Buck D, Gamble C, Dudley L, Preston J, Hanley B, Williamson PR, Young B. The EPIC Patient Advisory Group From plans to actions in patient and public involvement: qualitative study of documented plans and the accounts of researchers and patients sampled from a cohort of clinical trials. BMJ Open. 2014;4(12):e006400. doi: 10.1136/bmjopen-2014-006400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement a narrative review. BMJ Qual Saf. 2016;25(8):626–632. doi: 10.1136/bmjqs-2015-004839. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Dobbs T, Whitaker I. Patient and public involvement in basic science research – are we doing enough? The BMJ opinion (blog), 11. 2016. [Google Scholar]
- 27.Callard F, Rose D, Wykes T. Close to the bench as well as the bedside: involving service users in all phases of translational research. Health Expect. 2012;15(4):389–400. doi: 10.1111/j.1369-7625.2011.00681.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pollock Judith, Raza Karim, Pratt Arthur G., Hanson Helen, Siebert Stefan, Filer Andrew, Isaacs John D., Buckley Christopher D., McInnes Iain B., Falahee Marie. Patient and researcher perspectives on facilitating patient and public involvement in rheumatology research. Musculoskeletal Care. 2016;15(4):395–399. doi: 10.1002/msc.1171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.McCarthy J, Guerin S, Wilson AG, Dorris E, Salsberg J. Facilitating public and patient involvement in basic and preclinical health research. PLoS One. 2019;14(5):e0216600. doi: 10.1371/journal.pone.0216600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Baart I, Abma T. Patient participation in fundamental psychiatric genomics research: a Dutch case study. Health Expect. 2011;14(3):240–249. doi: 10.1111/j.1369-7625.2010.00634.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Staley K. “Is it worth doing?” measuring the impact of patient and public involvement in research. Res Involvement & Engagement. 2015;1:6. doi: 10.1186/s40900-015-0008-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Smolen JS, Landewé R, Bijlsma J, Burmester G, Chatzidionysiou K, Dougados M, Nam J, Ramiro S, Voshaar M, van Vollenhoven R, Aletaha D, Aringer M, Boers M, Buckley CD, Buttgereit F, Bykerk V, Cardiel M, Combe B, Cutolo M, van Eijk-Hustings Y, Emery P, Al Finckh CG, Gomez-Reino J, Gossec L, Gottenberg JE, Hazes JMW, Huizinga T, Jani M, Karateev D, Kouloumas M, Kvien T, Li Z, Mariette X, McInnes I, Mysler E, Nash P, Pavelka K, Poór G, Richez C, van Riel P, Rubbert-Roth A, Saag K, Silva J, Stamm T, Takeuchi T, Westhovens R, de Wit M, van der Heijde D. EULAR recommendations for the management of rheumatoid arthritis: with synthetic and biological disease-modifying antirheumatic drugs: 2016 update Annals of the Rheumatic Diseases. 2017. [DOI] [PubMed] [Google Scholar]
- 33.Ytterberg AJ, Joshua V, Reynisdottir G, Tarasova NK, Rutishauser D, Ossipova E, Hensvold AH, Eklund A, Sköld CM, Grunewald J, Malmström V, Jakobsson PJ, Rönnelid J, Padyukov L, Zubarev RA, Klareskog L, Catrina AI. Shared immunological targets in the lungs and joints of patients with rheumatoid arthritis: identification and validation. Ann Rheum Dis. 2015;74:1772–1777. doi: 10.1136/annrheumdis-2013-204912. [DOI] [PubMed] [Google Scholar]
- 34.Juarez M, Bang H, Hammar F, Reimer U, Dyke B, Sahbudin I, Buckley CD, Fisher B, Filer A, Raza K. Identification of novel anti-acetylated vimentin antibodies in patients with early inflammatory arthritis. Ann Rheum Dis. 2016;75(6):1099–1107. doi: 10.1136/annrheumdis-2014-206785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Maijer KI, Ri Noort A, de Hair MJH, van der Leij C, van Zoest KPM, Choi IY, Gerlag DM, Maas M, Tak PP, Tas SW. Nuclear Factor-κB–inducing Kinase Is Expressed in Synovial Endothelial Cells in Patients with Early Arthritis and Correlates with Markers of Inflammation: A Prospective Cohort Study. J Rheumatol. 2015;42(9):1573–1581. doi: 10.3899/jrheum.150245. [DOI] [PubMed] [Google Scholar]
- 36.Catrina AI, Svensson CI, Malmström V, Schett G, Klareskog L. Mechanisms leading from systemic autoimmunity to joint-specific disease in rheumatoid arthritis. Nat Rev Rheumatol. 2017;13:79–86. doi: 10.1038/nrrheum.2016.200. [DOI] [PubMed] [Google Scholar]
- 37.Ospelt C, Bang H, Feist E, Camici G, Keller S, Detert J, Kramer A, Gay S, Ghannam K, Burmester GR. Carbamylation of vimentin is inducible by smoking and represents an independent autoantigen in rheumatoid arthritis. Ann Rheum Dis. 2017;76:1176–1183. doi: 10.1136/annrheumdis-2016-210059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Rech J, Hueber AJ, Finzel S, Englbrecht M, Haschka J, Manger B, Kleyer A, Reiser M, Cobra JF, Figueiredo C, Tony HP, Kleinert S, Wendler J, Schuch F, Ronneberger M, Feuchtenberger M, Fleck M, Manger K, Ochs W, Schmitt-Haendle M, Lorenz HM, Nuesslein H, Alten R, Henes J, Krueger K, Schett G. Prediction of disease relapses by multibiomarker disease activity and autoantibody status in patients with rheumatoid arthritis on tapering DMARD treatment. Ann Rheum Dis. 2016;75:1637–1644. doi: 10.1136/annrheumdis-2015-207900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Krishnamurthy A, Joshua V, Haj Hensvold A, Jin T, Sun M, Vivar N, Ytterberg AJ, Engström M, Fernandes-Cerqueira C, Amara K, Magnusson M, Wigerblad G, Kato J, Jiménez-Andrade JM, Tyson K, Rapecki S, Lundberg K, Catrina SB, Jakobsson PJ, Svensson C, Malmström V, Klareskog L, Wähämaa H, Catrina AI. Identification of a novel chemokine-dependent molecular mechanism underlying rheumatoid arthritis-associated autoantibody-mediated bone loss. Ann Rheum Dis. 2016;75:721–729. doi: 10.1136/annrheumdis-2015-208093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Bayliss K, Raza K, Simons G, Falahee M, Hansson M, Starling B, Stack R. Perceptions of predictive testing for those at risk of developing a chronic inflammatory disease: a meta-synthesis of qualitative studies. J Risk Res. 2018;21(2):167–189. doi: 10.1080/13669877.2015.1119183. [DOI] [Google Scholar]
- 41.Falahee M, Simons G, Raza K, Stack R. Healthcare professionals’ perceptions of risk in the context of genetic testing for the prediction of chronic disease: a qualitative meta-synthesis. J Risk Res. 2018;21(2):129–166. doi: 10.1080/13669877.2016.1153503. [DOI] [Google Scholar]
- 42.Stack RJ, Stoffer M, Englbrecht M, Mosor E, Falahee M, Simons G, Smolen J, Schett G, Buckley CD, Kumar K, Hansson M, Hueber A, Stamm T, Raza K. Perceptions of risk and predictive testing held by the first-degree relatives of patients with rheumatoid arthritis in England. Austria and Germany: a qualitative study BMJ Open. 2016;6:e010555. doi: 10.1136/bmjopen-2015-010555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Falahee M, Simons G, Buckley CD, Hansson M, Stack RJ, Raza K. Patients’ perceptions of their relatives’ risk of developing rheumatoid arthritis and of the potential for risk communication, prediction and modulation. Arthritis Care Res. 2017;69(10):1558–1565. doi: 10.1002/acr.23179. [DOI] [PubMed] [Google Scholar]
- 44.Mosor E, Stoffer-Marx M, Steiner G, Raza K, Stack R, Simons G, Falahee M, Skingle D, Dobrin M, Schett G, Englbrecht M, Smolen J, Kjeken I, Hueber A, Stamm T. I would never take preventive medication! Perspectives and information needs of people who underwent predictive tests for rheumatoid arthritis. Arthritis Care Res. 2019, epub ahead of print 2 Feb 2019. 10.1002/acr.23841. [DOI] [PMC free article] [PubMed]
- 45.van Steenburgen HW, Aletaha D, Beaart-van der Voorde LJJ, El B, Codreanu C, Combe B, Fonseca JE, Hetland ML, Humby F, Kvien TK, Niedermann K, Nuño L, Oliver S, Rantapää-Dahlqvist S, Raza K, van Schaardenburg D, Schett G, De Smet L, Szücs G, Vencovský J, Wiland P, de Wit M, Landewé RL, van der Helm-van Mil AHM. EULAR definition of arthralgia suspicious for progression to rheumatoid arthritis. Ann Rheum Dis. 2017;76(3):491–496. doi: 10.1136/annrheumdis-2016-209846. [DOI] [PubMed] [Google Scholar]
- 46.Falahee Marie, Simons Gwenda, Buckley Christopher D., Hansson Mats, Stack Rebecca J., Raza Karim. Patients' Perceptions of Their Relatives' Risk of Developing Rheumatoid Arthritis and of the Potential for Risk Communication, Prediction, and Modulation. Arthritis Care & Research. 2017;69(10):1558–1565. doi: 10.1002/acr.23179. [DOI] [PubMed] [Google Scholar]
- 47.EULAR PARE (People with Arthritis / Rheumatism in Europe) booklet – Patient Involvement in Research: A way to success https://www.eular.org/myUploadData/files/Reference_cards_explained_Booklet_pages_23-08-13_1.pdf
- 48.Mathie E, Wythe H, Munday D, Millac P, Rhodes G, Roberts N, Smeeton N, Poland F, Jones J. Reciprocal relationships and the importance of feedback in patient and public involvement: a mixed methods study. Health Expect. 2018;21:899–908. doi: 10.1111/hex.12684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Staley K. Changing what researchers 'think and do': Is this how involvement impacts on research? Res For All. 2017;1(1):158–167. doi: 10.18546/RFA.01.1.13. [DOI] [Google Scholar]
- 50.Martin GP. ‘Ordinary people only’: knowledge, representativeness, and the publics of public participation in healthcare. Soc Health Illness. 2008;30:35–54. doi: 10.1111/j.1467-9566.2007.01027.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1. Survey for patient research partners (PRPs).
Additional file 2. Survey for researchers.
Data Availability Statement
The data collected during the evaluation exercise described in this paper are available from the corresponding author on reasonable request.