Abstract
Patients’ experiences of their diagnosis, condition, and treatment (including the impact on their lives), and their experiences surrounding expectations of care, are becoming increasingly important in shaping healthcare systems that meet the evolving needs and priorities of different patient communities over time; this is an ongoing goal of all healthcare stakeholders. Current approaches that capture patient experiences with data are fragmented, resulting in duplication of effort, numerous requests for information, and increased patient burden. Application of patient experience data to inform healthcare decisions is still emerging and there remains an opportunity to align diverse stakeholders on the value of these data to strengthen healthcare systems. Given the collective value of understanding patient experiences across multiple stakeholder groups, we propose a more aligned approach to the collection of patient experience data. This approach is built on the principle that the patients’ experiences are the starting point, and not just something to be considered at the end of the process. It must also be based on meaningful patient engagement, where patients are collaborators and decision makers at each step, thereby ensuring their needs and priorities are accurately reflected. The resulting data and evidence should be made available for all stakeholders, to inform their decision making and healthcare strategies in ways that meet patient priorities. We call for multi-stakeholder collaboration that will deliver healthcare systems and interventions that are better centered around and tailored to patient experiences, and that will help address patients’ unmet needs.
Keywords: Patient experience data, Patient-focused healthcare, Collective value patient experience
Introduction
Healthcare systems aim to improve the health of populations, and to transform the lives of patients. Research increasingly demonstrates that patient-centered (or patient-engaged) care achieves the best outcomes, and there is a global movement toward this model of healthcare [1–4]. Crucially, this type of care concentrates not only on important clinical outcomes but also on improvements in wider outcomes that patients say matter to them, and which may not have previously been given the prominence they deserve. Outcomes of interest to patients include improvements in health-related quality of life or functional outcomes, patient, caregiver, and family experiences, healthcare resource utilization, and care provider satisfaction. Concepts of engagement, communication, quality, and safety are fundamental matters for healthcare that drive decisions in healthcare systems around the world, and they all converge in the experience dialogue [5]. To achieve desired goals of treatment, all segments of healthcare and all stakeholder groups need to understand and learn from patient perspectives and experiences, and to use these insights to develop strategy and inform decision making. The research that leads to, and results from, these insights must be designed and implemented in partnership with patients. Patient engagement can optimize research by ensuring it reflects the needs and priorities of patients in a way that is least burdensome to them [6]. This article focuses on the collective value of patient involvement and proposes an approach to healthcare systems that starts with the patient experience and is co-created with patients.
Patient Experience and Patient Experience Data
Meaningful patient perspectives can be collected and contextualized into data for use by stakeholders across healthcare systems. These data cover the entire patient (and caregiver and/or family) experience of being diagnosed with, living with, or being treated for a disease or condition; they also incorporate the “customer” experience of using a healthcare system. Patient experience data (commonly referred to as PED but PXD will be used in this article) have been defined as, “data that are collected by any persons and are intended to provide information about patients’ experiences with a disease or condition. PXD can be interpreted as information that captures patients’ experiences, perspectives, needs, and priorities related to (but not limited to): (1) the symptoms of their condition and its natural history; (2) the impact of the condition on their functioning and quality of life; (3) their experience with treatments; (4) input on which outcomes are important to them; (5) patient preferences for outcomes and treatments; and (6) the relative importance of any issue as defined by patients” [7]. This definition is intentionally broad and includes patient survey data, patient-reported experience measures (PREMs), patient-reported outcome measures (PROMs), patient focus groups or meeting reports, patient registry data, patient preference data, clinical outcome assessment (COA) data collected as part of clinical trials, and natural history study data. PXD therefore aims to provide information that fully captures patients’ experiences, perspectives, needs, and priorities, which can then be used by stakeholders to co-create research with patient communities and inform healthcare decisions. Essentially, it is the holistic patient experience of both non-clinical and clinical outcomes as well as the process of partnering with patients that are the cornerstones of this endeavor; these are more important than the data collected or the users of the data.
It should be noted that simply gathering or using PXD is not necessarily synonymous with being patient-engaged. For example, the term “PROMs” implies that the questionnaires are capturing what is most important to patients and that they have even been developed with their input, when this is seldom the case. There is now a drive to design PROMs with patients involved throughout the process; however, there are many in routine use that are well validated but that do not capture the exact nature of outcomes that patients have identified as priorities for them. These PROMs mostly encapsulate what the clinicians and researchers thought were important to patients at the time of developing the questions [8, 9]. The Consensus-based Standards for the Selection of Health Measurement Instruments criteria is an initiative that highlights the need for, and importance of, PROMs that are based on patient input [10, 11]. In addition, programs such as the COMET initiative have emphasized the need to select appropriate outcomes for clinical trials that are relevant to all stakeholders, including patients [12].
Furthermore, patients’ experiences and expectations change as they move through different stages of their disease, possibly dealing with additional comorbidities and changing life circumstances. Standards of care evolve also. While this article goes on to argue that it is important to avoid duplication of efforts in gaining PXD, this does not mean that collection of data is only performed once; rather, it should be an ongoing process and revisited as needed, to reflect the evolving patient experience.
Patients would work with data scientists, (biostatisticians, bioinformatics, quality analysts, clinimetricians) and, in the case of medical technology and device industry, development teams to ensure data are both usable and patient-centered/patient-driven. Scientists ensure data are scientifically and ethically sound by applying their professional expertise in statistical design and methodology; patients ensure that data that are most important to the community is prioritized for collection and is ethically collected in the least burdensome way possible. This means patients must be included early in study design, from the study concept stage and at every step of the process as part of the study team.
Patients must also be included as part of the study team in creating new clinical outcomes assessments, developing and deploying surveys, selecting clinical outcomes assessments, developing new devices including feasibility and usability studies, monitoring the data, interpreting the data from a community perspective, and ensuring the results of the study are disseminated in the community in lay summaries. This may mean training patients in understanding issues around data in research and care, and training researchers and clinicians in patient engagement. It is likely that data will be more usable through this collaborative approach because the study was well designed from a community perspective. Ideally, if the study is less burdensome to the community and research teams, and more focused on community priorities, there would be less missing or poor-quality data.
Furthermore, not every condition has a patient organization and some (nascent) organizations may be very small and minimally funded. As such, collaboration is key as capabilities may differ across conditions. There may also be many patients wanting to contribute to advance research and development who are not "activated" patients and part of a patient organization. A systematic approach to involving patients, increasing co-creation, sharing lessons learned and emerging best practices from each stakeholder perspective and the value derived from upstream work to downstream impact is essential to support an ongoing, dynamic, and adaptable process of PXD collection and use.
The Collective Value of PXD Across Diverse Health Stakeholder Groups
There is a common need for PXD that informs evidence-based decision making among diverse groups of stakeholders; however, information is collected individually rather than collectively, and not usually in partnership with patients. An approach to develop and collect PXD in a collaborative manner would result in a collective value of that data for all stakeholders in the healthcare system, and this is recognized globally. For example, in the UK, the National Institute for Health and Care Excellence has acknowledged the significance of patient preference studies in informing health technology assessments (HTAs) [13]. There is growing evidence of the impact that patient involvement can have on HTA deliberations, such as providing context, new information, and reassurance [14, 15]. The importance of working alongside patients to improve the methods by which their input is gathered and considered for HTA discussions has also been highlighted [16]. The US Food and Drug Administration (FDA) has described the patient perspective as “critical” for regulatory decision making and has established Patient-Focused Drug Development public meetings to hear directly from patients and their families, caregivers, and patient advocates [17]. The Canadian Agency for Drugs and Technologies in Health (CADTH) has had a long-standing commitment to incorporate patient and public perspectives in HTA; it provides regular examples of how patient input had a tangible impact on CADTH reviews, providing much-needed feedback that documents the value of these efforts [18]. These insights are used to inform healthcare system decision making, including funding decisions and prioritization.
The FDA has also noted the benefits of engaging with patients to design and conduct research [19]. The richness of this type of qualitative data can be valuable if collected robustly and could be used by different stakeholders, thereby preventing duplication of effort. Another example is that of the James Lind Alliance and its use of Priority Setting Partnerships that bring together patients, caregivers, and clinicians to agree key priorities for future research [20].
The collective value of PXD is reflected by the increasing requests for and use of these data across different healthcare stakeholder groups, such as patient advocacy organizations, regulators, HTA organizations, and pharmaceutical companies [19, 21, 22]. Although the PXD can be used by different stakeholders and for a variety of purposes, the methods, range, and type of questions that need to be asked to gather the data are overwhelmingly similar. PXD questions focus on core themes that look at patient experiences with the burden and impact of their condition and their treatment (e.g., emotional, psychosocial, employment, family, and other effects), as well as their expectations for better health outcomes (Table 1). Broader, more holistic PXD is also gathered by different organizations. For example, the UK conducts an annual National Cancer Patient Experience Survey covering the entire patient journey and the patient experience of cancer care. It asks how patients felt they were treated and listened to, whether they had their diagnosis or care explained in an understandable way, and what the care environment and care staff attitudes were like [23]. In addition, tools such as the Accountable Health Communities Screening Tool used in the United States, capture social determinants of health, based on the understanding that lifestyle issues (such as housing instability, transportation/access issues, and food insecurity) also impact health and health outcomes [24].
Table 1.
Common themes | PXD requests from different stakeholder groupsa [19, 21, 22, 25] |
---|---|
Burden and impact of disease/condition |
What are the signs and symptoms patients experience and how do these affect their day-to-day functioning and quality of life? How does this condition affect the day-to-day lives of people living with it in terms of challenging symptoms and activities that patients find difficult or unable to do? What are the aspects of the condition that are most important for patients to control? What disease effects matter most to patients that might be addressed by a medical therapy? What is the course of their disease over time, including the effect of the disease on patients’ day-to-day function and quality of life over time, and the changes that patients experience in their symptoms over time? |
Burden and impact of treatment/trials |
What are patients’ experiences with the treatments for their disease? How well do current medicines help patients manage this condition? What are the benefits/risks of current treatments, both in the short and long term? What is the burden of treatment (including the effect of treatment on activities of daily living and functioning) and/or the burden of participating in clinical studies? What treatment burdens matter most to patients that might be addressed by a medical therapy? What would be the best way to measure these disease or treatment burdens/effects in a clinical trial? What would be the most appropriate endpoints to use in clinical trials (and robust enough to inform regulatory decision making)? What is a clinically meaningful change in an endpoint from a patient perspective? How to define meaningful change in a patient over time? |
Expectations for new (and current) treatments |
What are the patient expectations of benefits? What are the potential QoL improvements and/or health outcomes? What aspects of patient needs or expectations could the new treatment potentially address? What are the potential impacts on caregivers and family such as potential reduced dependency and emotional and psychosocial impacts? What are acceptable trade-offs of benefits and risks (i.e., patient preference)? What methods and approaches could be used to identify which treatment benefits would be most desirable to obtain and which risks would be most important to avoid, or to explore what patients might consider to be acceptable trade-offs of increased expected harm(s) for a specified increase in expected benefit with a new medicinal product? What are patient attitudes towards uncertainty? What are patient views on unmet medical needs and available treatment options? |
Emotional, psychosocial, employment, family, and other effects [25] |
How are patients feeling in terms of pain or discomfort, feeling low or worried, limited in what they can do, requiring help from others? How are patients feeling in general? How well do patients look after themselves? Have patients learned to live with what has happened? Thinking about way of life, such as education, feeling valued for what they do, being happy where they live, having enough money to cope—how do patients feel? Thinking about family and friends, having people to talk to, having someone to confide in, having people who will help—how do patients feel? How often do patients feel left out, alone, or lonely? How safe do patients personally feel at home and outside of home? |
aExamples from regulators, health technology assessment organizations, and pharmaceutical companies, as well as PROMs or PREMs
PREMs Patient-reported experience measures, PROMs Patient-reported outcome measures, PXD Patient experience data, QoL Quality of life
There have been calls for clarity and direction for the collection and use of PXD; this has led to the development of guidance for PXD, further demonstrating its growing importance in healthcare decision making. For example, Ensuring Value in Research (an international body comprised of organizations that fund health-related research or establish funding policy) has produced guidance that focuses on increasing the value of research, which includes patients when referring to the “meaningful involvement of those who will use and be affected” by the research [26]. Another venture is the European-wide PREFER program, a public private partnership research project under the Innovative Medicines Initiative, which aims to provide recommendations to support guidelines for industry, regulatory bodies, and HTA organizations on how and when to assess and include patient preferences in medicines development [27]. The Scottish Medicines Consortium has issued guidance for patient group partners who want to submit evidence to them; the guidance can be incorporated into the overall discussions about the clinical benefits and cost-effectiveness of new medicines [21]. Patients and patient advocacy organizations have also called for PXD collection to be streamlined and harmonized. They recognize there is a need to lessen the burden on the patient community of repeating information to multiple stakeholders, and to reduce the overuse of resources dedicated to the repeated collection of the same information for pre-competitive purposes.
Starting PXD Collection Based on Stakeholder Perspective is not Appropriate
Despite the goal of achieving more patient-engaged healthcare and the similarities in the types of data being requested by different stakeholders, in general, current approaches to PXD do not have the patient at their center and lack stakeholder alignment. Instead, strategies are developed from each stakeholder’s perspective in silos and then “backfilled” with PXD by each stakeholder. Although there are efforts to develop a more harmonized approach, these are generally aimed at achieving alignment within one stakeholder group, for example from a regulatory point of view [22], rather than alignment that traverses several groups. In these cases, patient partners work with a stakeholder to put patient community needs and priorities at the forefront, but this partnership needs to be replicated for multiple stakeholders, and this puts intense resource and capacity expectations on the patient community.
There are several unwarranted consequences of a stakeholder-centric and fragmented approach to PXD. First, if healthcare systems are to be patient-focused and the aim of health interventions is to transform their lives, it is essential to identify from patients themselves what their expectations are. Capturing the human experience (including non-clinical perspectives) and using it to identify how the healthcare system can improve the individual and shared experiences of patients is key to patient-engaged healthcare. Secondly, each stakeholder group will have their own perspective; for example, regulators see challenges and solutions through a different lens to HTA organizations. As a consequence, stakeholders may inadvertently bring their own assumptions to the development of PXD (deprioritizing the patient perspective as less important) and overlook concepts that matter to patients. Thirdly, siloed approaches and a lack of collaboration mean that different stakeholders are asking for the same kind of PXD, thus causing duplication of effort and repetitive (and potentially onerous) requests to patients. Calls to reduce waste in research are numerous [28–30] and applicable to the current disjointed approach to PXD. Lastly, siloed and stakeholder-centric approaches that start from the perspective of each different stakeholder group lead to the generation of separate pieces of PXD (adding to inefficient use of healthcare system resources), which are biased by stakeholder views and lead to misaligned understanding of the true patient experience. This could subsequently impact healthcare decisions and systems that may be based on inaccurate PXD. For these reasons, all decisions in stakeholder groups should be made with the full understanding and consideration of the patient experience.
Evolving from Stakeholder-Centric to Holistic and Patient-Engaged PXD
Different stakeholders have a shared need for the same information around the patient experience (Fig. 1). Common themes include how the patient was treated (e.g., with kindness, compassion, empathy, dignity, or respect), physical comfort (e.g., adequate and timely pain control), emotional support (e.g., being able to discuss anxieties and fears), communication (e.g., listening, explaining clearly, education, information), involvement of family and friends (e.g., opportunities for them to talk with the healthcare team), promptness (e.g., delays, cancellations, responsiveness, waiting times), organization (e.g., management of the service, co-ordination of care, continuity and transition, efficiency, reliability), and environment (e.g., safety, cleanliness, quietness, facilities) [31–36]. This collective value of PXD across diverse healthcare stakeholder groups provides opportunities for integration. In practical terms, where there is overlap or repetition in the PXD requested, stakeholders should work together, including with patients, to ensure that information that is of interest across stakeholders is only collected once (or as few times as possible) and is shared, to meet all stakeholders’ needs.
Although this may not always be possible in all situations, every effort should be made to identify synergies and minimize duplication. Where there is overlap in PXD, one way in which gaining consensus across disease could be approached could be through professional societies working with patients to set data standards that are acceptable to all stakeholders. In this case, it would be important to ensure it is a truly international collaboration with representative stakeholders driving the development of standards and methodologies.
Mutual Benefits of a More Collaborative Approach to the Collection and Use of PXD
An aligned approach for the type of PXD and methods of collection would provide several opportunities for quality improvement; for example, by identifying and replicating best practice, or for benchmarking to help reduce unwarranted variation in the quality-of-service delivery. Lee et al. have proposed a model for designing a healthcare service based on the patient experience [43].
These shared needs for the same PXD (currently gathered in a repetitive and duplicative manner) highlight the requirement for a more collaborative and streamlined approach. Rather than working in vertical, unlinked silos, PXD should be thought of as “user agnostic”—having value and relevance for diverse healthcare stakeholders. Disparate but complementary PXD efforts should be brought together and PXD placed firmly at the center of healthcare systems so that insights from patient experiences drive healthcare strategy and improvements (rather than developing strategy that is not driven by patient experience insights, as is currently the case) (Fig. 1). A benefit of collaborative stakeholder working is that the whole will be greater than the sum of its parts, which means that what is achieved will be more accurate, of better quality and use fewer resources.
Leveraging PXD to inform healthcare decision making will benefit the whole healthcare system and help to address current misalignment between what patients need and what they receive. Developing a collaborative approach to defining and collecting PXD would deliver healthcare systems that are focused on improving outcomes that are most meaningful to patients and not only those valued by other stakeholders. For example, it was patient preference data that led to the development of a subcutaneous formulation of the traditionally intravenous drug rituxan [44]. Rituxan Hycela® was approved by the FDA in 2017 and may be the first instance of a “Patient Experience” section being included in a drug’s label [45]. PXD was also integrated into a new drug application (NDA) for a novel antidepressant; its inclusion contributed to the FDA’s decision to approve the application [46]. In June 2021, the European Medicines Agency (EMA) proposed guidelines for incorporating patient experience to better inform regulatory decision making [47], meaning that, like the FDA, it recognizes the importance of developing a PXD strategy early in medicines and devices development. Although around 70% of NDAs include PXD [37], not all PXD are created equal; many tools that capture patient experience have not been developed in partnership with patients [48] and the validity and reliability of different tools vary [49]. Tools or metrics to evaluate the impact of health-related conditions on patients should also consider immediate and longer-term impact. For example, the measure of absenteeism in the workplace does not fully capture, and may therefore underestimate, the impact of health on work [50]. Absenteeism also fails to capture negative career consequences such as having to work part time, enforced role change, or lost job opportunities. For PXD to be meaningful, actionable, supportive, and informative, it must be co-created with patients.
It would also be valuable to collaborate with the patient community on the data collection, or for the patient community to collect the data. While patient communities often use validated tools for data collection, some may need capacity building or training to achieve robust data collection capability. Similar to calls for data sharing amongst research teams, calls for data sharing amongst patient groups and patient advocacy organizations should be made. To reach diverse and underserved communities, a collaborative approach that uses multiple data collection methods that best meet community needs would be optimal. One example of patient community data collection is the National Kidney Foundation Patient Network registry in the United States combines data from electronic health records and patient-centered data [51]. The registry’s online platform has been designed to allow people with kidney disease to enter their own health information, which ensures that insights and data captured are truly reflective of the patients’ experiences.
It is important to acknowledge that there are shared challenges to the multi-stakeholder collaborative collection and use of PXD, including those involving culture, process, and lack of infrastructure and tools for PXD [37, 52–55]. However, by understanding the mutual benefit of PXD across diverse stakeholders, some of these challenges can be addressed. For example, identifying commonalities means that the risk and burden of generating PXD are shared across groups with the knowledge that other stakeholders will also value and use the PXD. In terms of process and operational aspects, cost and resource efficiencies can be gained by reducing duplication of effort and taking a more aligned approach to PXD. There is also the potential to improve the quality of PXD by having a more holistic and truly patient-engaged approach and precompetitive consortia would be ideally placed to address this, especially across multiple studies within a disease group or condition. Regardless of the existing barriers, it is neither desirable nor sustainable to continue developing medicines and medical devices that do not demonstrate that they meet the needs of patients. Just as effective use of PXD that is meaningful to patients can yield tangible benefits, failure to put patients at the center of healthcare decisions can have consequences. For example, the medical profession’s failure to acknowledge that women and men have different experiences with heart disease has led to women receiving suboptimal treatment and reporting poorer outcomes, including worse quality of life and more physical and psychological disability [56–59].
Limitations of PXD
Despite its potential, PXD is not a magic bullet. For example, PXD covering work-related experiences, such as being able to work at all or working full time, do not reflect that many contributing factors that affect a person’s ability to work, e.g., societal attitudes, equality regulations, and laws, lie outside the area of influence of a drug or device. Health and illness are not dichotomous states, and some patients may never return to full health. The reality is that for most long-term conditions, the goal is improved management, reduction of symptoms, and prevention of future harms. These improvements may not equate to increased capacity or ability to work.
A further issue is data security, especially as PXD may be highly sensitive and personal. Despite anonymization or pseudonymization, there have been high-profile breaches of health data security [60] or use of algorithms to re-identify individuals [61]; incidents like these make people wary of who might have access to PXD (e.g., medical insurance, policing, or benefits agencies) and for what reasons. However, even with these concerns, many patients seem willing to disclose their data for the greater good as long as it can be shared safely [62–66]. Ongoing communication with patient communities about perspectives on data security is critical as the technology advances, to ensure data capture and storage methods are driven by patient preferences and rights. Additional consideration should be given to working with patient communities whose data have been misused or underdeveloped in the past, causing harm to communities that already experience health inequities due to systems that perpetuate disparities in care. The potential for security issues and undesirable uses of PXD will need to be carefully assessed, with safeguards put into place that are robust enough to withstand the political variations of privacy rights and other regulations across the world.
With advances in technology comes the ability to collect a multitude of data points, and this is another area for consideration. Just because vast amounts of data can be collected, it does not necessarily mean that it should be. It is important that sectors across healthcare have a clear and well-explained rationale for each data point that is being collected, what they will potentially do with the data point, and how it will potentially converge with other data points.
Finally, large data sets of PXD must accurately represent the patient population. Like most research, PXD has historically tended to lack demographic and disease-state/experience diversity, often reflecting only a subset of a population that is white and wealthy. Additionally, PXD that is self-reported and captured electronically risks ignoring communities that do not have internet access, digital, or technological devices, or technological literacy. Working with representative populations from a given patient community and including them as equal decision makers in the PXD development, as well as creating systems that allow those populations to easily contribute PXD, will be imperative to ensuring the data truly reflects whole patient communities and can be applied to improving healthcare equitably.
What Does “Good” PXD Look Like?
There is a collective, shared value for PXD in the healthcare system and there are mutual benefits to be gained from collaboration. The next logical step is to identify an aligned set of needs and a roadmap to jointly and fairly collect high-quality PXD, without duplication of effort, for diverse stakeholder groups and multiple purposes. This should be driven with quality patient engagement [67] to ensure that the data collected are patient-engaged, meaningful, representative of diverse patient populations, fit-for-purpose, and, consequently, of value to multiple stakeholders. Sharing a PXD repository that is integrated and accessible across all stakeholders removes duplication and begins to build the capability of developing PXD in a synergistic and holistic way. There have been suggestions for how a repository of PXD could be captured using open sources of information but there are significant technical and logistical challenges that would need to be addressed [68–70].
By taking a patient-engaged approach to PXD, we can assess the usefulness of existing tools (e.g., PREMs, PROMs, COAs), and identify gaps that are not currently measured, thereby prioritizing the development of new tools that can more accurately capture the breadth of patient experiences. It would also be beneficial to streamline and standardize the number and different types of tools that are used by identifying common underlying constructs [71, 72]. These tools should be carefully assessed for validity and reliability and also be regularly assessed and updated to meet current trends and needs within a patient population. [73–75]. The approach should also incorporate feedback mechanisms to ensure that how the PXD is used, and the impact of that use, is communicated to patients and that patient feedback is used to further improve how PXD is collected, stored, and employed. In addition, as healthcare improves due to better understanding of patient needs, expectations and practices will change and patient experiences will evolve. Patient feedback will be crucial to understanding and adapting to this evolving landscape (Fig. 2).
Call to Action: Multi-stakeholder Collaboration and Partnership with Patients to Deliver High-Quality PXD
The range of stakeholders involved in healthcare interventions and systems means that multi-stakeholder collaboration is essential for the collection of PXD (in partnership with patients), which should be done as few times as possible and for multiple purposes. We call for all stakeholders to work together to co-develop a methodological roadmap for, and implementation of, an integrated approach to PXD. This framework would empower the whole system to address the unmet needs of patients more efficiently, holistically and consistently. We also call for the co-production and establishment of a shared and accessible repository for PXD and for increased high-quality patient engagement in PXD approaches. Such engagement should follow established (and freely available) guidance for meaningful co-production and collaboration with patients, including adherence to well-defined quality criteria for patient engagement [67].
The current call to action is not from a lone voice. The EMAs Regulatory Science Strategy to 2025 called for global alignment on the methodology used to gather PXD and patient contribution to medicines development [76]. Others have highlighted an “urgent need” for global co-operation and collaboration of HTA and research organizations to fulfill the potential of PXD in HTAs [77]. There are also patient-led collaborative efforts to support the development and use of PXD to broader applications and for a repository approach to PXD. For example, the US National Health Council is leading an initiative for the development of patient-engaged core impact sets [78] and is creating a Patient Experience Mapping Toolbox [79]. In the UK, UseMyData promotes a more central collection of patient data (focused on hospital data and statistics) that can be used for varying purposes [80].
Conclusions
In summary, there is a shared goal to improve healthcare and outcomes that are important to patients, and an increased awareness that the best way to deliver this is to work in partnership with patients. By working with patient communities, we can truly portray their diverse perspectives and experiences, and by collaborating across stakeholder groups (integrated with patients), we can capture the insights and information we need to transform healthcare.
Acknowledgements
We thank all workstream members for their insights and contribution to the development of this paper including: Sandra Lamy (Gilead, UK), Precious McCowan, MS (End-Stage Renal Disease Network of Texas), Alexandra Moutet (UCB), and Erica Spies (EMD Serono Research & Development Institute, Inc.).
Author Contributions
All authors contributed to the conceptualization and development of the manuscript through collaborative meetings. IS drafted the manuscript and all authors reviewed and provided substantial and comprehensive feedback on each draft of the manuscript. All authors read and approved the final manuscript.
Funding
Teleconferences and meetings for manuscript development were organized by Patient Focused Medicines Development. Authors did not receive payment for their contribution to development of the manuscript. A document describing the governance structure of Patient Focused Medicines Development (including funding, membership and the decision-making process of the organization) is available at: https://patientfocusedmedicine.org/wp-content/uploads/2017/05/PFMD-Governance-with-annexes-.pdf. Medical writing support was provided by Ify Sargeant of Twist Medical and funded by Patient Focused Medicines Development.
Declarations
Conflict of interest
JS was an employee of Takeda at the time of manuscript preparation and is now an employee of Legacy Health Strategies, LLC. All other authors declare that they have no conflicts of interest. The views and opinions by the authors here do not reflect the opinions of their respective organizations. They reflect personal accounts from the varied expertise and perspectives. KD (UEA), is supported by the National Institute for Health and Care Research (NIHR) Applied Research Collaboration East of England (NIHR ARC EoE) at Cambridge and Peterborough NHS Foundation Trust. The views expressed are those of the author[s] and not necessarily those of the NIHR or the Department of Health and Social Care.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.World Health Organization. WHO global strategy on people-centred and integrated health services: interim report. World Health Organization; 2015. https://apps.who.int/iris/bitstream/handle/10665/155002/WHO_HIS_SDS_2015.6_eng.pdf. Accessed November 11, 2021.
- 2.Gluyas H. Patient-centred care: improving healthcare outcomes. Nurs Stand. 2015;20:50–57. doi: 10.7748/ns.30.4.50.e10186. [DOI] [PubMed] [Google Scholar]
- 3.Santana MJ, Manalili K, Jolley RJ, et al. How to practice person-centred care: a conceptual framework. Health Expect. 2018;21:429–440. doi: 10.1111/hex.12640. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Santana MJ, Ahmed S, Lorenzetti D, et al. Measuring patient-centred system performance: a scoping review of patient-centred care quality indicators. BMJ Open. 2019;9:e023596. doi: 10.1136/bmjopen-2018-023596. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wolf PhD JA. Patient experience: a return to purpose. Patient Exp J. 2017;4:1–4. [Google Scholar]
- 6.Modigh A, Sampaio F, Moberg L, et al. The impact of patient and public involvement in health research versus healthcare: a scoping review of reviews. Health Policy. 2021;125:1208–1221. doi: 10.1016/j.healthpol.2021.07.008. [DOI] [PubMed] [Google Scholar]
- 7.PFDD. Patient-Focused Drug Development Glossary. 2018. https://www.fda.gov/drugs/development-approval-process-drugs/patient-focused-drug-development-glossary. Accessed November 25, 2021.
- 8.Trujols J, Portella MJ, Iraurgi I, et al. Patient-reported outcome measures: are they patient-generated, patient-centred or patient-valued? J Ment Health. 2013;22:555–562. doi: 10.3109/09638237.2012.734653. [DOI] [PubMed] [Google Scholar]
- 9.Wiering B, de Boer D, Delnoij D. Patient involvement in the development of patient-reported outcome measures: a scoping review. Health Expect. 2017;20:11–23. doi: 10.1111/hex.12442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mokkink LB, De Vet HC, Prinsen CA, et al. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1171–1179. doi: 10.1007/s11136-017-1765-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Beelen LM, van Dishoeck AM, Tsangaris E, et al. Patient-reported outcome measures in lymphedema: a systematic review and COSMIN analysis. Annal Surg Oncol. 2020;28:1–3. doi: 10.1245/s10434-020-09346-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Williamson PR, Altman DG, Bagley H, et al. The COMET handbook: version 10. Trials. 2017;18:1–50. doi: 10.1186/s13063-017-1978-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bouvy JC, Cowie L, Lovett R, et al. Use of patient preference studies in HTA decision making: a NICE perspective. Patient. 2020;13:145–149. doi: 10.1007/s40271-019-00408-4. [DOI] [PubMed] [Google Scholar]
- 14.Single AN, Facey KM, Livingstone H, et al. Stories of patient involvement impact in health technology assessments: a discussion paper. Int J Technol Assess Health Care. 2019;35:266–272. doi: 10.1017/S0266462319000552. [DOI] [PubMed] [Google Scholar]
- 15.Livingstone H, Verdiel V, Crosbie H, et al. Evaluation of the impact of patient input in health technology assessments at NICE. Int J Technol Assess Health Care. 2021;37:e33. doi: 10.1017/S0266462320002214. [DOI] [PubMed] [Google Scholar]
- 16.Rasburn M, Livingstone H, Scott SE. Strengthening patient outcome evidence in health technology assessment: a coproduction approach. Int J Technol Assess Health Care. 2021;37:12. doi: 10.1017/S0266462320002202. [DOI] [PubMed] [Google Scholar]
- 17.PFDD. FDA-led Patient-Focused Drug Development (PFDD) Public Meetings. https://www.fda.gov/industry/prescription-drug-user-fee-amendments/fda-led-patient-focused-drug-development-pfdd-public-meetings. 2021. Accessed November 24, 2021.
- 18.CADTH. Impact of patient involvement. https://cadth.ca/impact-patient-involvement-0. 2021. Accessed November 24, 2021.
- 19.PFDD. Collecting Comprehensive and Representative Input Guidance for Industry, Food and Drug Administration Staff, and Other Stakeholders. June 2020. https://www.fda.gov/media/139088/download. 2020 Accessed November 11, 2021.
- 20.James Lind Alliance: Priority Setting Partnerships. https://www.jla.nihr.ac.uk/about-the-james-lind-alliance/about-psps.htm. Accessed January 31, 2022.
- 21.SMC. Scottish Medicines Consortium (SMC) Guide for Patient Group Partners. https://www.scottishmedicines.org.uk/media/5616/guide-for-patient-group-partners-2017.pdf. 2017. Accessed October 12, 2021.
- 22.ICH. International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) reflection paper on proposed ICH guideline work to advance patient focused drug development. 2020 https://www.ema.europa.eu/en/documents/scientific-guideline/ich-reflection-paper-proposed-ich-guideline-work-advance-patient-focused-drug-development_en.pdf. Accessed October 12, 2021.
- 23.NCPES. National Cancer Patient Experience Survey. https://www.ncpes.co.uk/. Accessed November 24, 2021.
- 24.Billioux A, Verlander K, Anthony S, et al Standardized screening for health-related social needs in clinical settings: the accountable health communities screening tool. NAM Perspectives. 2017 May 30.
- 25.Benson T. Measure what we want: a taxonomy of short generic person-reported outcome and experience measures (PROMs and PREMs) BMJ Open Qual. 2020;9:e000789. doi: 10.1136/bmjoq-2019-000789. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ensuring Value in Research (EVIR). Guiding principles. https://evir.org/our-principles/. Accessed October 14, 2021.
- 27.IMI-PREFER. https://www.imi-prefer.eu/. Accessed October 14, 2021.
- 28.Gillies K, Chalmers I, Glasziou P, et al. Reducing research waste by promoting informed responses to invitations to participate in clinical trials. Trials. 2019;20:1–4. doi: 10.1186/s13063-018-3101-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Glasziou P, Chalmers I. Research waste is still a scandal—an essay by Paul Glasziou and Iain Chalmers. BMJ. 2018;363:k4645. doi: 10.1136/bmj.k4645. [DOI] [Google Scholar]
- 30.Macleod MR, Michie S, Roberts I, et al. Biomedical research: increasing value, reducing waste. Lancet. 2014;11(383):101–104. doi: 10.1016/S0140-6736(13)62329-6. [DOI] [PubMed] [Google Scholar]
- 31.Jenkinson C, Coulter A, Bruster S. The picker patient experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14:353–358. doi: 10.1093/intqhc/14.5.353. [DOI] [PubMed] [Google Scholar]
- 32.Valentine NB, Bonsel GJ, Murray CJ. Measuring quality of health care from the user’s perspective in 41 countries: psychometric properties of WHO’s questions on health systems responsiveness. Qual Life Res. 2007;16:1107–1125. doi: 10.1007/s11136-007-9189-1. [DOI] [PubMed] [Google Scholar]
- 33.Rothman AA, Park H, Hays RD, et al. Can additional patient experience items improve the reliability of and add new domains to the CAHPS® hospital survey? Health Serv Res. 2008;43:2201–2222. doi: 10.1111/j.1475-6773.2008.00867.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Benson T, Potts HW. A short generic patient experience questionnaire: howRwe development and validation. BMC Health Serv Res. 2014;14:499. doi: 10.1186/s12913-014-0499-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Hu G, Chen Y, Liu Q, et al. Patient experience of hospital care in China: major findings from the Chinese patient experience questionnaire survey (2016–2018) BMJ Open. 2019;9:e031615. doi: 10.1136/bmjopen-2019-031615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kemp K, McCormack B, Chan N, et al. Correlation of inpatient experience survey items and domains with overall hospital rating. J Patient Exp. 2015;2:29–36. doi: 10.1177/2374373515615977. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.FDA. Assessment of the Use of Patient Experience Data in Regulatory Decision-Making. https://www.fda.gov/media/150405/download. 2021. Accessed October 14, 2021.
- 38.van Overbeeke E, Forrester V, Simoens S, et al. Use of patient preferences in health technology assessment: perspectives of Canadian. Belgian German HTA Represent Patient. 2021;14:119–128. doi: 10.1007/s40271-020-00449-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wale JL, Thomas S, Hamerlijnck D, et al. Patients and public are important stakeholders in health technology assessment but the level of involvement is low – a call to action. Res Involv Engagem. 2021;7:1. doi: 10.1186/s40900-020-00248-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Rand L, Dunn M, Slade I, et al. Understanding and using patient experiences as evidence in healthcare priority setting. Cost Eff Resour Alloc. 2019;17:20. doi: 10.1186/s12962-019-0188-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Maxwell E. Patient feedback: how effectively is it collected and used? Nurs Times. 2020;116(12):27–29. [Google Scholar]
- 42.Kieffer CM, Miller AR, Chacko B, et al. FDA reported use of patient experience data in 2018 drug approvals. Ther Innov Regul Sci. 2020;54:709–716. doi: 10.1007/s43441-019-00106-1. [DOI] [PubMed] [Google Scholar]
- 43.Lee D. A model for designing healthcare service based on the patient experience. Int J Health Manage. 2019;12:180–188. [Google Scholar]
- 44.Rummel M, Kim TM, Aversa F, et al. Preference for subcutaneous or intravenous administration of rituximab among patients with untreated CD20+ diffuse large B-cell lymphoma or follicular lymphoma: results from a prospective, randomized, open-label, crossover study (PrefMab) Ann Oncol. 2017;28:836–842. doi: 10.1093/annonc/mdw685. [DOI] [PubMed] [Google Scholar]
- 45.Rituxan Hycela PI. https://www.accessdata.fda.gov/drugsatfda_docs/label/2017/761064s000lbl.pdf. Accessed October 14, 2021.
- 46.Katz EG, McNulty P, Levitan B, et al. U.S. food and drug administration's patient-focused drug development initiative: experience with integration of patient-experience data in a new drug application for esketamine nasal spray plus a newly initiated oral antidepressant for treatment-resistant depression. Ther Innov Regul Sci. 2021 doi: 10.1007/s43441-021-00340-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.ICH. ICH reflection paper – proposed ICH Guideline work to advance patient focused drug development. 2021. https://www.ema.europa.eu/en/documents/scientific-guideline/ich-reflection-paper-proposed-ich-guideline-work-advance-patient-focused-drug-development-pfdd_en.pdf. Accessed December 15, 2021.
- 48.Small N, Ong BN, Lewis A, et al. Co-designing new tools for collecting, analysing and presenting patient experience data in NHS services: working in partnership with patients and carers. Res Involv Engagem. 2021;7:1–8. doi: 10.1186/s40900-021-00329-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Beattie M, Murphy DJ, Atherton I, et al. Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Syst Rev. 2015;4:1–21. doi: 10.1186/s13643-015-0089-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Wynne-Jones G, Buck R, Varnava A, et al. Impacts on work absence and performance: what really matters? Occup Med. 2009;59:556–562. doi: 10.1093/occmed/kqp125. [DOI] [PubMed] [Google Scholar]
- 51.NKF Registry. National Kidney Foundation (NKF) Patient Network registry. https://www.kidney.org/nkfpatientnetwork. Accessed December 23, 2021.
- 52.Gleeson H, Calderon A, Swami V, et al. Systematic review of approaches to using patient experience data for quality improvement in healthcare settings. BMJ Open. 2016;6:e011907. doi: 10.1136/bmjopen-2016-011907. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Flott KM, Graham C, Darzi A, et al. Can we use patient-reported feedback to drive change? The challenges of using patient-reported feedback and how they might be addressed. BMJ Qual Saf. 2017;26:502–507. doi: 10.1136/bmjqs-2016-005223. [DOI] [PubMed] [Google Scholar]
- 54.Cummings J. Learning and leading in the experience age. Patient Exp J. 2017;4:5–6. doi: 10.35680/2372-0247.1221. [DOI] [Google Scholar]
- 55.Chambers M, LeMaster J. Collecting and using patient experience data: caution, commitment and consistency are needed. Health Expect. 2019;22:1–2. doi: 10.1111/hex.12863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Dewan P, Rørth R, Jhund PS, et al. Differential impact of heart failure with reduced ejection fraction on men and women. J Am Coll Cardiol. 2019;73:29–40. doi: 10.1016/j.jacc.2018.09.081. [DOI] [PubMed] [Google Scholar]
- 57.Okunrintemi V, Valero-Elizondo J, Patrick B, et al. Gender differences in patient-reported outcomes among adults with atherosclerotic cardiovascular disease. J Am Heart Assoc. 2018;7:e010498. doi: 10.1161/JAHA.118.010498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Liakos M, Parikh PB. Gender disparities in presentation, management, and outcomes of acute myocardial infarction. Curr Cardiol Rep. 2018;20:1–9. doi: 10.1007/s11886-018-1006-7. [DOI] [PubMed] [Google Scholar]
- 59.Nanna MG, Wang TY, Xiang Q, et al. Sex differences in the use of statins in community practice: patient and provider assessment of lipid management registry. Circ Cardiovasc Qual Outcomes. 2019;12:e005562. doi: 10.1161/CIRCOUTCOMES.118.005562. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Seh AH, Zarour M, Alenezi M, et al. Healthcare data breaches: insights and implications. Healthcare (Basel) 2020;8:133. doi: 10.3390/healthcare8020133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Rocher L, Hendrickx JM, De Montjoye YA. Estimating the success of re-identifications in incomplete datasets using generative models. Nat Commun. 2019;10:3069. doi: 10.1038/s41467-019-10933-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.O’Brien EC, Rodriguez AM, Kum HC, et al. Patient perspectives on the linkage of health data for research: Insights from an online patient community questionnaire. Int J Med Inform. 2019;127:9–17. doi: 10.1016/j.ijmedinf.2019.04.003. [DOI] [PubMed] [Google Scholar]
- 63.Kalkman S, van Delden J, Banerjee A, et al. Patients’ and public views and attitudes towards the sharing of health data for research: a narrative review of the empirical evidence. J Med Ethics. 2022;48:3–13. doi: 10.1136/medethics-2019-105651. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Watts G. Data sharing: keeping patients on board. Lancet Digit Health. 2019;1(7):e332–e333. doi: 10.1016/S2589-7500(19)30163-3. [DOI] [Google Scholar]
- 65.Spencer K, Sanders C, Whitley EA, et al. Patient perspectives on sharing anonymized personal health data using a digital system for dynamic consent and research feedback: a qualitative study. J Med Internet Res. 2016;18:e5011. doi: 10.2196/jmir.5011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Haug CJ. Whose data are they anyway? Can a patient perspective advance the data-sharing debate? N Engl J Med. 2017;376:2203–2205. doi: 10.1056/NEJMp1704485. [DOI] [PubMed] [Google Scholar]
- 67.Deane K, Delbecque L, Gorbenko O, et al. Co-creation of patient engagement quality guidance for medicines development: an international multistakeholder initiative. BMJ Innov. 2019;5:43–55. doi: 10.1136/bmjinnov-2018-000317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Greaves F, Ramirez-Cano D, Millett C, et al. Harnessing the cloud of patient experience: using social media to detect poor quality healthcare. BMJ Qual Saf. 2013;22:251–255. doi: 10.1136/bmjqs-2012-001527. [DOI] [PubMed] [Google Scholar]
- 69.Walsh L, Hyett N, Juniper N, et al. The use of social media as a tool for stakeholder engagement in health service design and quality improvement: a scoping review. Digit Health. 2021;7:2055207621996870. doi: 10.1177/2055207621996870. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Khanbhai M, Anyadi P, Symons J, et al. Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review. BMJ Health Care Inform. 2021;28:e100262. doi: 10.1136/bmjhci-2020-100262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Gonzalez AI, Kortlever JT, Rijk L, et al. Is there a correlation between the patient-doctor relationship questionnaire and other patient-reported experience measures? Patient Exp. J. 2020;7:44–50. doi: 10.35680/2372-0247.1399. [DOI] [Google Scholar]
- 72.Withers KL, Puntoni S, O'Connell S, et al. Standardising the collection of patient-reported experience measures to facilitate benchmarking and drive service improvement. Patient Exp. J. 2018;5:16–24. doi: 10.35680/2372-0247.1268. [DOI] [Google Scholar]
- 73.Bull C, Byrnes J, Hettiarachchi R, Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. 2019;54:1023–1035. doi: 10.1111/1475-6773.13187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Simon TA, Khouri MS, Kou TD, et al. Realizing the potential of the patient perspective. Patient Prefer Adherence. 2020;14:2001–2007. doi: 10.2147/PPA.S257355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.De Rosis S, Cerasuolo D, Nuti S. Using patient-reported measures to drive change in healthcare: the experience of the digital, continuous and systematic PREMs observatory in Italy. BMC Health Serv Res. 2020;20:1–7. doi: 10.1186/s12913-020-05099-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.EMA. Reinforcing patient relevance in evidence generation. 2019. https://www.ema.europa.eu/en/documents/presentation/presentation-ema-regulatory-science-2025-reinforcing-patient-relevance-evidence-generation-feedback_en.pdf. Accessed October 14, 2021.
- 77.Staniszewska S, Söderholm WS. Mind the evidence gap: the use of patient-based evidence to create “complete HTA” in the twenty-first century. Int J Technol Assess Health Care. 2021;37:E46. doi: 10.1017/S026646232100012X. [DOI] [PubMed] [Google Scholar]
- 78.NHC PC-CIS. Advancing the development of patient-centered core impact sets (PC-CIS) blueprint. https://nationalhealthcouncil.org/pc-cis-blueprint/. Accessed October 14, 2021.
- 79.NHC Toolbox. patient experience mapping toolbox. https://nationalhealthcouncil.org/additional-resources/patient-journey-mapping-toolbox/. Accessed October 14, 2021.
- 80.UseMyData. https://www.usemydata.org/index.php. Accessed January 27, 2022.