Skip to main content
ESMO Gastrointestinal Oncology logoLink to ESMO Gastrointestinal Oncology
. 2025 Aug 26;9:100224. doi: 10.1016/j.esmogo.2025.100224

Patient-Reported Experience Measures (PREMs) in patients with metastatic colorectal cancer undergoing treatment supported by feedback auditing: the EPIC study

A Sartore-Bianchi 1,2,3,†,, F Toscano 4,, DP Bernasconi 3,5,, A Curaba 1,2, P Colombo 4, C Mazzali 4, A Piantelli 4, A Dotti 4, D Tedesco 4, K Bencardino 2, A Amatu 2, F Tosi 2, E Bonazzina 2, F Villa 2, V Gori 1,2, D Piscazzi 1,2, AG Agostara 1,2, G Calvanese 1,2, G Saporetti 4,‡,§, S Siena 1,2,§
PMCID: PMC12836717  PMID: 41647969

Abstract

Background

Patient-reported experience measures (PREMs) offer an objective measure of the patient experience by investigating various fields of the care pathway. We analyzed PREMs in patients with metastatic colorectal cancer (mCRC) undergoing anticancer therapy integrating an auditing process to allow corrective actions.

Materials and methods

This is a prospective, observational, monocentric study with a four-phase sequential design: phase I validation of the PREMs questionnaires in five-level Likert item format in Italian; phase II administration of questionnaires at T0 (0-30 days since the start of oncology care), T1 (30 days-6 months), T2 (6-12 months), T3 (>12 months); phase III analysis of results during quality audits and implementation of strategies to improve care pathways; phase IV re-administration and results compared with phase II.

Results

PREMs were tested for validity in 47 patients (phase I of the EPIC study). In phase II, 102 patients were enrolled, 150 questionnaires were administered and 142 returned (94.6%). Sixteen questions grouped in four areas (information about care path, contacts and accessibility, patient needs, health care awareness monitoring) were analyzed. A high proportion of patients were concerned about their future/possibility of relapse at T1 (61.6%/58.3%) and T2 (62.5%/63.7%). After the implementation of a checklist for clinicians (phase III), in phase IV, 74 patients were enrolled and the proportion of patients concerned about their future/possibility of a relapse decreased at T1 (35.7%/25%) and T2 (31.3%/43.4%).

Conclusions

PREMs evaluation is feasible in the setting of mCRC. A checklist for clinicians tailored after an ad hoc audit improved results about patients’ concerns about their future and possibility of relapse.

Key words: PREMs, metastatic colorectal cancer, healthcare pathway, feedback auditing, checklist

Graphical abstract

graphic file with name ga1.jpg

Highlights

  • Key objective: We analyzed PREMs in patients with mCRC under treatment integrating an auditing process to allow corrective actions.

  • Knowledge generated: PREMs evaluation is feasible with high response rate. A tailored checklist for clinicians after an ad hoc audit improved results.

  • Relevance: PREMs supported by auditing processes allow monitoring the quality of care and foster evolution towards patient-centric care in mCRC.

Introduction

In the evaluation of health care quality, the perspective and experience of the patient play a pivotal role.1, 2, 3 Traditional clinical metrics like mortality rates often fall short in capturing this perspective.4 Over the past decade, Patient-Reported Measures (PRMs), which encompass data provided directly by patients, have gained prominence.5, 6, 7, 8, 9, 10, 11 These include patient-reported outcome measures (PROMs), assessing health-related quality of life and symptoms, and patient-reported experience measures (PREMs), which gauge patients’ experiences with health care.9,12,13 PROMs are designed to capture the perspectives of patients on various aspects of their health, including their quality of life, physical abilities, and specific symptoms related to their condition or treatment.6,14, 15, 16 On the other hand, PREMs provide objective insights into user experiences, focusing on relational and functional aspects of care (e.g. accessibility of services, waiting times for appointments, attention to pain, involvement in care decision making, information provided by health care providers, and promptness of assistance).17, 18, 19, 20, 21, 22 While concerns exist about their credibility,23 patient experience measures have demonstrated their value as strong indicators of health care quality.24 Thus, incorporating PREMs into health care performance assessment can identify areas for improvement and foster a real-time connection between patients and their care team, ultimately enhancing patient comfort and engagement.17,25,26

Due to the multifactorial nature of the oncological journey, it is becoming increasingly important to develop personalized pathways, because each patient is unique and this is reflected both in a patient’s response to medical treatments and in the way of reacting in the disease stages.27 Several studies demonstrate that the adoption of PREMs in oncology is increasing,28 facilitated by international initiatives like the Cancer Patient Experience Survey (CPES)29 and the Consumer Assessment of Healthcare Providers and Systems (CAHPS).30,31 In view of the complexity that characterizes the oncological field, as reported by the evidence review conducted by Saunders et al.,28 it is necessary to adopt measures of evaluation of PREMs specific to the type of cancer. This shows that some PREMs questionnaires that are valid for one context may not be valid for another.

In clinical medicine, the audit process is a systematic and critical analysis of the quality of medical care, including the procedures used for diagnosis and treatment, the use of resources, and the resulting outcome and quality of life for the patient.32 Audits are essential in maintaining and improving the standard of patient care. They involve a cycle of measuring performance against established standards and implementing changes to improve compliance with these standards. The integration of an audit process in the context of PREMs can be particularly vital. Indeed, it would allow health care providers to continually assess and enhance the patient experience based on direct feedback from patients. More in detail, after the collection of PREMs data and a performance analysis to identify areas where the patient experience meets the set standards and where there are gaps or shortcomings, specific changes or interventions can be designed and implemented, ranging from staff training in communication skills to changes in the scheduling system to reduce waiting times. Finally, after implementing changes, a re-audit is essential. New PREMs data can be collected to assess the impact of the changes on patient experience, evaluating whether the implemented changes have led to improvements in the areas previously identified as lacking. Along these lines, the audit process in conjunction with PREMs can be cyclical. Based on the findings of the re-audit, further changes can be made, followed by subsequent re-audits, ensuring ongoing improvement in patient experience and care quality.

This integration of an audit process with PREMs can be particularly beneficial in the treatment and management of diseases with complex care pathways, such as colorectal cancer (CRC). CRC stands as the third most frequently diagnosed cancer globally and represents the third leading cause of cancer-related death in both males and females.33 Over the past four decades, the 5-year relative survival rate for CRC has increased from 50% to 65% due to significant progress in detection methods, treatments, and surgical procedures.34 While metastatic CRC (mCRC) poses substantial challenges, developments in targeted therapies and enhanced surgical interventions have extended the life expectancy of patients.35, 36, 37, 38, 39 The heightened survival rate, combined with an aging population, has led to a notable rise in cancer survivors, ∼10% of whom are living with metastatic cancer.34,40,41 Patients affected by mCRC, receiving the most advanced cancer treatments, face a wide range of psychological, emotional, and practical difficulties. Therefore, it is essential to understand how the treatment impacts the patient’s overall experience, with the aim of implementing improvement strategies to make the patient care journey more tolerable.

Rationale and objectives

To date, there are no available data on the experiences of patients undergoing oncological therapy for mCRC, and the application of an audit process to improve PREMs in cancer patients has not been tested.

The primary objective of this study was to assess the quality of cancer care as perceived by patients with mCRC using a standardized PREM tool, with the goal of identifying areas of strength and potential improvement within the oncology care pathway. The secondary objective was to assess the impact of corrective strategies guided by the audit process on PREM results.

Materials and methods

The EPIC trial is a single-center, observational study targeting patients aged ≥18 years with mCRC receiving oncological therapy at the Niguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Milan, Italy. The study adopts a four-phase sequential design (Figure 1). Phase I focused on questionnaire validation and assessment of face validity (Supplementary Figure S1, available at https://doi.org/10.1016/j.esmogo.2025.100224). In Phase II, the questionnaire was administered and the results were analyzed. Phase III consisted of quality audits aimed at identifying areas for improvement and developing corrective measures, including the design of a checklist for clinicians. Finally, in Phase IV, the questionnaire was re-administered after the planned interventions, and the results were compared with the pre-audit baseline.

Figure 1.

Figure 1

EPIC Study design. PREMs, Patient-Reported Experience Measures.

The validated PREM questionnaire consists of a paper-based survey in Italian of 16 questions with a response in five-level Likert scale format: ‘strongly disagree, disagree, neutral, agree, strongly agree’.

For patient recruitment, the questionnaire was administered to those scheduled for same-day visit or next-day therapy, after discussing with medical staff and signing the informed consent form for participation in the study. The PREM questionnaire was given at four timepoints during oncology care, each corresponding to a specific phase: T0 (0-30 days from the start of treatment), T1 (30 days-6 months), T2 (6-12 months), and T3 (>12 months). Patients were also required to complete a personal information form, providing details such as sex, age, education level, citizenship, region of residence, occupation, and social status, including caregiver support.

Statistical analysis

Data from the questionnaires were inputted into the REDCap database42 by authorized personnel. Descriptive analyses were performed, calculating the frequency distribution of responses to each question, comparing the results between questionnaires administrated before and after the implementation of quality audits and separately for each timepoint. Due to the absence of a single primary outcome of interest and the fact that the sample size was not calculated a priori to reach a target power, the statistical analysis conducted is purely descriptive, avoiding inferential evaluations. The analysis was conducted using R version 4.3.2.

Ethical considerations

The study obtained approval from the Ethics Committee of Grande Ospedale Metropolitano Niguarda, Milan, Italy, (identification code NCT44201072021) and all patients signed informed consent for participating to the study.

Results

Preparation of the PREM questionnaire (phase I)

Starting with the questionnaire models available in literature, a PREM questionnaire was tailored to the oncological context of mCRC. For surveys to be reliable and applicable in clinical practice, their validation is crucial.22 The EPIC study questionnaire has been developed based on PREM models1,2,20,43 and more specifically on the PREMs developed by the Sant’Anna School of Advanced Studies in Pisa.44 In the pre-testing phase, focus groups involving staff from the Department of Oncology and the Department of Quality and Clinical Risk at Grande Ospedale Metropolitano Niguarda, along with a team of dietitians, psychologists, and PREMs experts, were conducted to identify issues in cancer patient treatment. The subsequent questionnaire was assessed by health care professionals, non-health care staff, a linguistic expert, and some patients at Grande Ospedale Metropolitano Niguarda to refine it (Supplementary Figure S1, available at https://doi.org/10.1016/j.esmogo.2025.100224). For the ‘face-validity’, the PREM questionnaire was administered to a pool of patients along with an additional brief questionnaire, consisting of a translation in Italian of the tool proposed by Burns et al. in 200845 to investigate the completeness, clarity, and level of understanding of the items of the questionnaire. These processes led to the development of the EPIC PREM questionnaire (Supplementary Material S1, https://doi.org/10.1016/j.esmogo.2025.100224). For the purpose of subsequent analyses regarding the impact of the audit, we selected the sixteen most relevant questions, as judged through the focus groups, grouped in four areas (information about care path, contacts and accessibility, patient needs, and health care awareness monitoring) in order to facilitate corrective actions (Table 1).

Table 1.

Selected items from the PREMs questionnaire, organized into four thematic areas to guide the development of a clinician checklist for targeted corrective actions.

Area 1 - Information about care path
Q1 I received clear information about the therapy
Q2 I received clear information about the side effects
Q3 I received clear information about possible problems and complications
Q4 I received clear information about next steps of care path
Q5 I received clear advice on habits and lifestyles to lead (e.g. physical activity, nutrition, smoking)
Area 2 - Contacts and accessibility
Q6 I received clear information about who to contact in case of need
Area 3 - Patient needs
Q7 At my first oncology visit or during treatment, the health care staff did everything they could to control my pain
Q8 It is important at this time to be followed up nutritionally as well
Q9 The assistance of a psychologist during the course of treatment would be helpful
Q10 The oncologist helped to deal with fears and anxieties about my health condition
Q11 I do not have concerns related to the side effects of the therapy
Q12 I do not have concerns related to the future
Q13 I do not have concerns related to possible relapse
Q14 I am not afraid of death
Q15 I do not have concerns related to economic aspects
Area 4 – Health care awareness monitoring
Q16 I gathered information on the internet about the possible effects of the cancer therapy I will undergo/have undergone

PREMs, Patient-Reported Experience Measures.

Administration of PREMS questionnaires (phase II)

During the period from July 2021 to January 2023, 102 patients enrolled from the outpatient service; among them, 5 (4.9%) did not continue participation due to death.

The sociodemographic and clinical characteristics of the population are reported in Table 2. The median age was 63 years, ranging from 33 to 85 years, with a majority of male participants (57%). Additionally, Table 2 reports the type of clinical presentation (de novo or recurrent disease) and the ongoing therapy at the time of first data collection. The most common treatments were chemotherapy combined with anti-epidermal growth factor receptor (EGFR) or anti-vascular endothelial growth factor (VEGF) agents, reflecting the majority of enrolled patients in first-line (L1).

Table 2.

Baseline characteristics of patients enrolled before and after the adoption of the checklist

Variables Pre-checklist n = 102 Post-checklist n = 74
Median age (range), years 63 (33-85) 61 (30-84)
Sex, n (%)
 Female 44 (43) 31 (41, 89)
 Male 58 (57) 43 (58, 11)
Social status, n (%)
 Living alone 14 (14) 9 (12)
 Living with caregiver 88 (86) 65 (88)
Level of education, n (%)
 No answer 2 (2) 0
 Less than high school (HS) 41 (40) 22 (30)
 HS or college 36 (35) 31 (42)
 University or more 23 (23) 21 (28)
Type of occupation, n (%)
 No answer 1 (1) 1 (1)
 Housewife 8 (8) 6 (8)
 Unemployed 3 (3) 4 (5)
 Temporary or atypical worker 1 (1) 1 (1)
 Permanent worker 21 (21) 18 (24)
 Self-employed 24 (23) 17 (23)
 Retired 41 (40) 23 (31)
 Other 3 (3) 4 (5)
Extension of disease at presentation n (%)
 De novo metastatic 56 (55) 38 (51)
 Recurrent/metachronous metastatic 46 (45) 36 (49)
Type of oncological treatment n (%)
 Chemotherapy + anti-EGFR agent 47 (46) 36 (48)
 Chemotherapy + anti-VEGF agent 34 (33) 26 (35)
 Immunotherapy 3 (3) 1 (2)
 Chemotherapy alone 2 (2) 2 (3)
 TKI (regorafenib, trifluridine-tipiracil) 7 (7) 3 (4)
 Clinical trial 9 (9) 6 (8)

EGFR, epidermal growth factor receptor; TKI, tyrosine kinase inhibitor; VEGF, vascular endothelial growth factor.

A total of 150 questionnaires were administrated and 142 returned. The response rate was 94.6%. The distribution of questionnaires across the prespecified timepoints was as follows: 31 at T0, 37 at T1, 25 at T2, and 49 at T3 (Table 3). Regarding the treatment line ongoing at the time of questionnaire administration, this was described as L1, second-line (L2), third-line (3L), and more than three lines of therapy (>L3). At T0, the majority of questionnaires were administered to patients in the L1 (71%), gradually decreasing to 39% at T3 (Table 3).

Table 3.

Distribution of PREMs questionnaires according to: whether the questionnaire was administered before or after the adoption of the checklist; the time of administration of the questionnaire; the ongoing line of treatment for mCRC at the time of questionnaire administration [categorized as follows: first-line (L1), second-line (L2), third-line (3L), and more than three lines of therapy (>L3)]

Phase II
Pre-checklist
Phase IV
Post-checklist
T0 T1 T2 T3 T0 T1 T2 T3
L1n (%) 22 (71) 25 (67) 8 (47) 14 (39) 15 (88) 26 (90) 22 (67) 11 (42)
L2n (%) 2 (6) 4 (11) 5 (29) 4 (11) 1 (6) 2 (7) 10 (30) 11 (42)
L3n (%) 2 (6) 1 (3) 0 (0) 4 (11) 1 (6) 1 (3) 0 2 (8)
>L3n (%) 5 (16) 7 (19) 4 (24) 14 (39) 0 0 1 (3) 2 (8)
NA 8 13 1
Total 31 37 25 49 17 30 33 26

mCRC, metastatic colorectal cancer; PREMs, patient-reported experience measures.

The distribution of responses to the selected questions for the four different areas (information about care path, contacts and accessibility, patient needs, and health care awareness monitoring) (Table 1) is reported in Figure 2A-D for each timepoint T0, T1, T2 and T3, respectively. At all timepoints, the majority of patients were satisfied (strongly agree or agree) with the information received about the care path (Q1-Q5) and with who to contact in case of need (Q6). Pain control (Q7) was judged inadequate by 40% (at T1 and T3) to 50% (at T0 and T2) of patients. At all timepoints, 60%-85% of patients considered it useful to be followed from a nutritional point of view (Q8) but a minority (10%-30%) believed that the assistance of a psychologist during the course of treatment could be helpful (Q9). Around 60% of patients believed that the oncologist helped to deal with fears and anxieties about the health condition (Q10) and this proportion was roughly constant across all timepoints. The most common concerns (Q11-Q15) were about the future (Q12) and the possibility of relapse of the disease (Q13), especially at time T1 (61.6% and 58.3%, respectively) and T2 (62.5% and 63.7%, respectively). Finally, a low proportion of patients declared they did or were willing to gather information on the internet about the possible effects of the cancer therapy (Q16) at T0 (16.1%) but this percentage increased to nearly 30%-35% at timepoints T1, T2 and T3.

Figure 2.

Figure 2

Figure 2

Comparison of the responses to questions Q1-Q16 between the first (pre-checklist) and the second (post-checklist) administration of the questionnaire at time T0 (A), T1 (B), T2 (C), and T3 (D). In each panel, one stacked bar plot for each question is shown representing the percentage of each answer (Likert scale) given by patients. To ease the visual comparison between the results to each question, bars related to positive answers (‘Strongly agree’, ‘Agree’) are faced upward the zero line while bars related to neutral or negative answers are faced downwards. The full text of each question is provided in Table 1.

Quality audit and design of an ad hoc checklist (phase III)

In phase III of the study, the results were discussed within the Division of Quality and Risk Management, focusing on underperforming areas and on identifying potential corrective strategies to be applied for improving the results. An audit was then performed with the staff of doctors and nurses of the Division of Oncology. This led to the development of a ‘checklist to be implemented in daily clinical use for health care practitioners, aiming to highlight crucial areas in patients’ perception of care that might necessitate refinement (Figure 3).

Figure 3.

Figure 3

Checklist developed through the audit process to improve PREMs. Items are grouped according to the main topics from the questionnaire. This checklist serves as a structured guide for health care professionals to ensure comprehensive communication and support throughout the patient’s treatment journey.

Re-administration of PREMS questionnaires and assessment of the impact of the audit and checklist (phase IV)

After the adoption of the checklist in the daily clinical routine of the health care staff (from July 2023 to March 2024), 74 patients were enrolled from the outpatient service, of which 21 came from phase II of the study. In this phase, a total of six patients did not continue due to death (8.10%).

A total of 106 questionnaires were administrated and 106 were returned; the distribution of questionnaires at the different timepoints was as follows: 17 at T0, 30 at T1, 33 at T2, and 26 at T3. The response rate was 99%.

Baseline patients’ characteristics and distribution of patients according to the ongoing line of treatment for mCRC at the time of questionnaire administration were similar to those observed in phase II (Tables 2 and 3).

Within each timepoint, we compared the responses between phase II and phase IV, before and after quality audits and distribution of the checklist to the medical staff (Figure 2). At T0, the percentage of patients who expressed concerns about the side-effects of the therapy (35.5% pre-checklist versus 17.6% post-checklist), about death (46.7% versus 43.3%) and about economic aspects (24.1% versus 6.7%) decreased after the adoption of the checklist. At T1, an improvement was observed in the percentage of patients who expressed concerns about their future (61.6% versus 35.7%), about the possibility of a relapse of the disease (58.3% versus 25%) and about economic aspects (17.7% versus 7.2%). At T2, again a decrease in the percentage of patients who expressed concerns about their future (62.5% versus 31.3%) and about the possibility of a relapse of the disease (63.7% versus 43.4%) were observed as well as in the percentage of patients who are concerned about economic aspects (15% versus 6.3%). No relevant improvements were observed in any areas at T3.

Dichotomous analysis of responses

For the dichotomous analysis of responses, timepoint 1 (T1) was chosen as the most representative for the number of patients included (n = 37) and because the reference timing (i.e. 30 days to 6 months) is indicative of patients in the middle of their treatment journey. In T1 there is a higher rate of negative responses, which should be interpreted also in the light of the classification employed for defining positive results, including only answers with the highest satisfaction (e.g. ‘completely satisfied’) and not intermediate results (e.g. ‘somehow satisfied’) in ≥75% of patients. A similar cutoff was used in a recent publication.46 In essence, by setting these high cutoff thresholds, the intention was to raise the bar for what constitutes a positive response, thereby highlighting areas that may be falling short of the desired level of patient satisfaction. While this approach may result in a greater number of negative responses, it serves the purpose of identifying specific areas of concern more effectively. To assess the patients’ evolving perception of their care journey over time, we conducted an ‘intra-patient journey’ analysis by comparing the results at T1 versus T3. This revealed a higher rate of negative responses at T3 compared with T1 in the ‘care path’ and ‘health care awareness monitoring’ domains. However, it is important to note that the results may be influenced by the difference in sample size between the two timepoints. Furthermore, an observation of the ongoing treatment line at the time of questionnaire completion reveals a significant difference between the results at T1 and T3. Notably, a majority of the T1 questionnaire belongs to patients at early stages of treatment (78% in L1-2), while at T3, 50% of patients are in the advanced stages of the disease (L3, >L3). This emphasizes that T3 patients are predominantly in advanced disease stages, having undergone prior treatment, suggesting a potentially unfavorable prognosis and a heavier burden of disease.

Open-ended questions

Given the significant potential for insightful revelations that can be gleaned from open-ended questions, we decided to integrate three of them into our survey: ‘What has positively struck you during this phase of your care journey?’; ‘What has negatively impacted you during this phase of your care journey?’; ‘Would you like to highlight someone who has positively impressed you in the way they have supported you?’. While the close-ended questions primarily address factual elements of the care experience, the open-ended comments focus on patients’ personal and emotional journey through cancer treatment and its impact on their well-being.2,47

The analysis of open-ended questions from our PREM questionnaire revealed insights into response patterns across the timepoints. The first question had a high response rate of 85%, while the second had a 60% response rate, suggesting difficulty in eliciting negative feedback. The third question maintained a consistent 78% response rate throughout the study period, indicating sustained engagement.

Overall, the response rate to the open-ended questions is high, revealing a strong interest among patients in expressing their feedback about their care experience in their own words, and bringing out relevant themes that may not be captured in closed-ended questions. A preliminary analysis of free-text answers revealed significant patterns, with patients positively highlighting staff empathy, prompt assistance, and caregiver support, while expressing concerns about waiting times, appointment communication, physician rotation, and the need for additional psychological and nutritional support. A forthcoming analysis is planned in line with existing literature trends.2

Discussion

The available evidence demonstrates that the patient experience positively correlates with clinical outcomes and patient safety. This underscores the importance of incorporating PREM tools into clinical practice to optimize health care quality.26 Starting with the questionnaire models available in literature, we tailored a PREM questionnaire to the oncological context of mCRC, integrating an auditing process to allow corrective actions for improvement.

As in other recent publications,1,46 but differently from some previous studies,48,49 we observed a very high response rate to the survey (94.7%), despite the length of the questionnaire. This indicates that the invitation to participate was well received, highlighting the importance for patients to have the opportunity to share their opinions about their care experience. In our patient population, 84.7% of participants were living with a caregiver, underscoring the relevance of an external support. In contrast, 15.3% reported living alone, highlighting the need for tailored approaches to address the differing experiences and needs of this minority group. These findings stress the importance of considering social support systems and living arrangements when evaluating cancer care experiences, indicating potential implications for patient outcomes and well-being.50

Many patients completed the questionnaire in the hospital, often during treatment, while others did so at home. The accuracy of on-site feedback may be affected by patients’ suboptimal physical or emotional distress, possibly affecting the quality-of- care feedback; moreover, time constraints of administrative and clinical procedures may hinder the completion of the questionnaire.13,19 On the other hand, on-site completion ensured a higher response rate, enhancing questionnaire monitoring effectiveness. There is no definitive and universal optimal timing for completion of the questionnaire.4 To maximize accessibility, we chose a paper-based survey, but considering the prevalence of digital tools and social media, providing both paper and electronic formats could engage several generations, aligning with recommendations for multiple administration modalities to ensure access for vulnerable populations.4 A critical issue which emerged during the administration of questionnaires was the administrative burden related to patient selection procedures, questionnaire delivery, and retrieval. Data collection from the perspective of care providers and health care organizations requires considerable time, professional dedication, and institutional support, presenting challenges due to the associated costs and resource demands.17,51 The pivotal role of physicians in the routine collection of patient-reported measures underscores the need to engage colleagues early, while leadership support and appropriate management structures further contribute to improved performance.43 In our experience, engaging a wider range of medical, psychological, nursing, and administrative staff significantly increased enrollment and feedback rates, fostering team building and potentially enhancing outcome improvement strategies through collaborative result discussions.

Our study innovatively integrated quality audits to identify areas for improvement, allowing for corrective actions. In particular, in phase III of the study, health care providers have been engaged in discussions regarding potential strategies for improvement, and a checklist to be implemented in daily clinical practice was conceived. The latter was designed and divided into four areas of interest, corresponding to the four main areas identified during the analysis of the results, each of them comprising the items with the lowest performance in the PREM analysis. We found that a checklist, accessible to the medical staff of the outpatient service, appeared to be a practical, user-friendly, and readily accessible tool that can be integrated into daily workflow without significantly burdening medical activities. It enabled a quick reference to the key patient-related topics or items to consider in order to enhance the patient care experience and could be swiftly accessed by medical and nursing staff during patients’ scheduled visits to the outpatient service. The comparison of PREM results between phase II and phase IV showed changes in patients’ concerns after adopting the checklist. Overall, there was a significant reduction in patients’ concerns about various aspects at T0, T1, and T2, with no significant changes observed at T3. No relevant improvements were indeed observed in any areas at T3, possibly because at this timepoint (>12 months) patients were in a more advanced stage of the disease, and thus less positively impacted by corrective actions for a better communication of the treatment plan. This reveals how essential it is to pay close attention to the needs of patients early in their care journey, as these may increase with the progression of the disease, thus suggesting to clinicians and health care systems the need to intensify efforts to improve the quality of care provided with particular attention to later stages of the disease.

We acknowledge some limitations of the study. Despite the pre-post design which allowed us to evaluate the efficacy of the audit process, the study remains explorative and for this reason data were analyzed only using descriptive statistical methods. The sample size was indeed not calculated a priori based on statistical power analyses and with the aim of evaluating a prespecified hypothesis. It should be also acknowledged that the study began accrual in July 2021 when the COVID-19 pandemic was still a major health problem, potentially affecting patients’ perceptions of their clinical care and introducing heterogeneity at least for those who were included in the beginning compared with patients enrolled in subsequent months.

In conclusion, the EPIC study highlights the feasibility and utility of implementing PREMs in the management of mCRC. Through a structured auditing process, we demonstrated that the integration of PREMs into clinical practice provides valuable insights into patient experiences and identifies actionable areas for improving care quality. Notably, the adoption of a tailored checklist significantly reduced patients’ concerns about their future, potential disease relapse, and the economic implications of treatment, particularly in the earlier stages of their treatment journey. Despite these promising results, the study revealed persistent challenges, particularly at advanced disease stages where the effectiveness of corrective actions diminished. This underscores the need for adaptive interventions that address the evolving needs of patients throughout their care journey. Moreover, the high response rate achieved reinforces the willingness of patients to share their experiences, emphasizing the importance of their voice in shaping patient-centered care strategies. The study was exclusively focused on PREMs, thus, neither clinical outcomes nor PROMs were taken into consideration. As future perspectives, the integration of digital tools could enhance accessibility and reduce administrative burdens, enabling real-time data collection and analysis. Additionally, incorporating artificial intelligence to analyze open-ended responses may further illuminate nuanced aspects of patient experiences. Longitudinal studies are warranted to evaluate the sustained impact of PREMs and the checklist on long-term outcomes, including patient satisfaction and quality of life.

Acknowledgements

The authors thank the colleagues of the working groups of the Sant’Anna School of Advanced Studies, Pisa, for their support in the construction of the PREM questionnaire: Francesca Ferrè.

Funding

This work was funded by the Italian Ministry of Health [grant number NET-2016-02363853-4] (Project CARE-NETS) Bando della Ricerca Finalizzata 2016, and supported by the Lombardy Region, Italy.

Disclosure

SS is an advisory board member for Amgen, Bayer, Bristol-Myers Squibb, CheckmAb, Clovis, Daiichi-Sankyo, Merck, Roche-Genentech, and Seattle Genetics. ASB is an advisory board member for Amgen, Bayer, Novartis, Pierre-Fabre, and Servier. All other authors have declared no conflicts of interest.

Supplementary data

Supplementary Figures and Tables
mmc1.pdf (185.2KB, pdf)
EPIC questionario
mmc2.pdf (6MB, pdf)

References

  • 1.Rudolph C., Petersen G.S., Pritzkuleit R., Storm H., Katalinic A. The acceptance and applicability of a patient-reported experience measurement tool in oncological care: a descriptive feasibility study in northern Germany. BMC Health Serv Res. 2019;19:786. doi: 10.1186/s12913-019-4646-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Arditi C., Walther D., Gilles I., et al. Computer-assisted textual analysis of free-text comments in the Swiss Cancer Patient Experiences (SCAPE) survey. BMC Health Serv Res. 2020;20:1029. doi: 10.1186/s12913-020-05873-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Øvretveit J., Zubkoff L., Nelson E.C., Frampton S., Knudsen J.L., Zimlichman E. Using patient-reported outcome measurement to improve patient care. Int J Qual Health Care. 2017;29:874–879. doi: 10.1093/intqhc/mzx108. [DOI] [PubMed] [Google Scholar]
  • 4.Martin D., Alberti P., Wigmore S.J., Demartines N., Joliat G.R. Pancreatic cancer surgery: what matters to patients? J Clin Med. 2023;12:4611. doi: 10.3390/jcm12144611. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Porter M.E., Larsson S., Lee T.H. Standardizing patient outcomes measurement. N Engl J Med. 2016;374:504–506. doi: 10.1056/NEJMp1511701. [DOI] [PubMed] [Google Scholar]
  • 6.U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79. doi: 10.1186/1477-7525-4-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Williams K., Sansoni J., Morris D., Grootemaat P., Thompson C. Patient-reported Outcome Measures. Health Qual Life Outcomes. 2016 [Google Scholar]
  • 8.OECD . OECD Publishing; Paris: 2025. Does Healthcare Deliver? Results from the Patient-Reported Indicator Surveys (PaRIS) [Google Scholar]
  • 9.Desomer A, Van den Heede K, Triemstra M, et al. Belgian Health Care Knowledge Centre (KCE); Brussels: 2018. Use of patient-reported outcome and experience measures in patient care and policy [short report]https://kce.fgov.be/sites/default/files/2021-11/KCE_303C_Patient_reported_outcomes_Short_Report_0.pdf KCE Reports 303. Available at. Accessed March 9, 2025. [Google Scholar]
  • 10.Roussel C., Chassany O., Durand-Zaleski I., et al. Place of patient-reported outcomes & experiences measurements (PROMS/PREMS) in the assessment and pricing of health technologies in France. Therapies. 2022;77:103–115. doi: 10.1016/j.therap.2022.01.016. [DOI] [PubMed] [Google Scholar]
  • 11.Haute Autorité de Santé Quality of care as perceived by patients – PROMs and PREMs indicators. 2022. https://www.has-sante.fr/jcms/p_3324079/en/quality-of-care-as-perceived-by-patients-proms-and-prems-indicators Available at.
  • 12.Fitch M.I., Coronado A.C., Schippke J.C., Chadder J., Green E. Exploring the perspectives of patients about their care experience: identifying what patients perceive are important qualities in cancer care. Support Care Cancer. 2020;28:2299–2309. doi: 10.1007/s00520-019-05057-9. [DOI] [PubMed] [Google Scholar]
  • 13.van der Wees P.J., Nijhuis-van der Sanden M.W.G., Ayanian J.Z., Black N., Westert G.P., Schneider E.C. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 countries. Milbank Q. 2014;92:754–775. doi: 10.1111/1468-0009.12091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Weldring T., Smith S.M.S. Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs) Health Serv Insights. 2013;6:61–68. doi: 10.4137/HSI.S11093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.LeBlanc T.W., Abernethy A.P. Patient-reported outcomes in cancer care - hearing the patient voice at greater volume. Nat Rev Clin Oncol. 2017;14:763–772. doi: 10.1038/nrclinonc.2017.153. [DOI] [PubMed] [Google Scholar]
  • 16.Graupner C., Kimman M.L., Mul S., et al. Patient outcomes, patient experiences and process indicators associated with the routine use of patient-reported outcome measures (PROMs) in cancer care: a systematic review. Support Care Cancer. 2021;29:573–593. doi: 10.1007/s00520-020-05695-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Minvielle E., Fierobe A., Fourcade A., et al. The use of patient-reported outcome and experience measures for health policy purposes: a scoping review in oncology. Health Policy. 2023;129 doi: 10.1016/j.healthpol.2022.12.010. [DOI] [PubMed] [Google Scholar]
  • 18.Coulter A. Can patients assess the quality of health care? Br Med J. 2006;333:1–2. doi: 10.1136/bmj.333.7557.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Fujisawa R., Klazinga N.S. Measuring patient experiences (PREMS): progress made by the OECD and Its member countries between 2006 and 2016. 2017. https://econpapers.repec.org/paper/oecelsaad/102-en.htm Available at.
  • 20.Kingsley C., Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. 2017;17:137–144. [Google Scholar]
  • 21.Beattie M., Murphy D.J., Atherton I., Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Syst Rev. 2015;4:97. doi: 10.1186/s13643-015-0089-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Bull C., Byrnes J., Hettiarachchi R., Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. 2019;54:1023–1035. doi: 10.1111/1475-6773.13187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Manary M.P., Boulding W., Staelin R., Glickman S.W. The patient experience and health outcomes. N Engl J Med. 2013;368:201–203. doi: 10.1056/NEJMp1211775. [DOI] [PubMed] [Google Scholar]
  • 24.Moens M., Goudman L., van de Velde D., et al. Personalised rehabilitation to improve return to work in patients with persistent spinal pain syndrome type II after spinal cord stimulation implantation: a study protocol for a 12-month randomised controlled trial—the OPERA study. Trials. 2022;23:974. doi: 10.1186/s13063-022-06895-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Denis F., Basch E., Septans A.L., et al. Two-year survival comparing web-based symptom monitoring vs routine surveillance following treatment for lung cancer. JAMA. 2019;321:306–307. doi: 10.1001/jama.2018.18085. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Doyle C., Lennox L., Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3 doi: 10.1136/bmjopen-2012-001570. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lopes-Júnior L.C., Veronez L.C. Personalized care for patients with cancer in the precision-medicine era. Int J Environ Res Public Health. 2023;20:3023. doi: 10.3390/ijerph20043023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Saunders C., Carter D.J., Jordan A., Duffield C., Bichel-Findlay J. Cancer patient experience measures: an evidence review. J Psychosoc Oncol. 2016;34:200–222. doi: 10.1080/07347332.2016.1157717. [DOI] [PubMed] [Google Scholar]
  • 29.NHS Digital The National Cancer Patient Experience Survey (CPES) [Internet]. NDRS. https://digital.nhs.uk/ndrs/our-work/ncras-work-programme/the-national-cancer-patient-experience-survey-cpes Available at.
  • 30.Centers for Medicare & Medicaid Services (CMS) Consumer Assessment of Healthcare Providers & Systems (CAHPS) [Internet]. CMS. https://www.cms.gov/data-research/research/consumer-assessment-healthcare-providers-systems Available at.
  • 31.Agency for Healthcare Research and Quality . AHRQ; Rockville, MD: 2020. CAHPS Cancer Care Survey [Internet]https://www.ahrq.gov/cahps/surveys-guidance/cancer/index.html Available at. Accessed August 18, 2025. [Google Scholar]
  • 32.Earl-Slater A., Wilcox V. Audit: an exploration of two models from outside the health care environment. J Eval Clin Pract. 1997;3:265–274. doi: 10.1046/j.1365-2753.1997.t01-1-00003.x. [DOI] [PubMed] [Google Scholar]
  • 33.Sung H., Ferlay J., Siegel R.L., et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71:209–249. doi: 10.3322/caac.21660. [DOI] [PubMed] [Google Scholar]
  • 34.Siegel R.L., Wagle N.S., Cercek A., Smith R.A., Jemal A. Colorectal cancer statistics, 2023. CA Cancer J Clin. 2023;73:233–254. doi: 10.3322/caac.21772. [DOI] [PubMed] [Google Scholar]
  • 35.Kopetz S., Chang G.J., Overman M.J., et al. Improved survival in metastatic colorectal cancer is associated with adoption of hepatic resection and improved chemotherapy. J Clin Oncol. 2009;27:3677–3683. doi: 10.1200/JCO.2008.20.5278. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Piawah S., Venook A.P. Targeted therapy for colorectal cancer metastases: a review of current methods of molecularly targeted therapy and the use of tumor biomarkers in the treatment of metastatic colorectal cancer. Cancer. 2019;125:4139–4147. doi: 10.1002/cncr.32163. [DOI] [PubMed] [Google Scholar]
  • 37.Saltz L.B. Top advances of the year in colorectal cancer. Cancer. 2022;128:2236–2239. doi: 10.1002/cncr.34185. [DOI] [PubMed] [Google Scholar]
  • 38.Biller L.H., Schrag D. Diagnosis and treatment of metastatic colorectal cancer: a review. JAMA. 2021;325:669–685. doi: 10.1001/jama.2021.0106. [DOI] [PubMed] [Google Scholar]
  • 39.Morris V.K., Kennedy E.B., Baxter N.N., et al. Treatment of metastatic colorectal cancer: ASCO Guideline. J Clin Oncol. 2023;41:678–700. doi: 10.1200/JCO.22.01690. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Argilés G., Tabernero J., Labianca R., et al. Localised colon cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2020;31:1291–1305. doi: 10.1016/j.annonc.2020.06.022. [DOI] [PubMed] [Google Scholar]
  • 41.Cervantes A., Adam R., Roselló S., et al. Metastatic colorectal cancer: ESMO Clinical Practice Guideline for diagnosis, treatment and follow-up. Ann Oncol. 2023;34:10–32. doi: 10.1016/j.annonc.2022.10.003. [DOI] [PubMed] [Google Scholar]
  • 42.Vanderbilt University REDCap (Research Electronic Data Capture) [Internet]. Nashville, TN: Vanderbilt University. https://www.project-redcap.org/ Available at.
  • 43.Lungu D.A., Pennucci F., De Rosis S., Romano G., Melfi F. Implementing successful systematic Patient Reported Outcome and Experience Measures (PROMs and PREMs) in robotic oncological surgery—the role of physicians. Int J Health Plann Manage. 2020;35:773–787. doi: 10.1002/hpm.2959. [DOI] [PubMed] [Google Scholar]
  • 44.Ferrè F., De Rosis S., Murante A.M., et al. Systematic and continuous collection of patient-reported outcomes and experience in women with cancer undergoing mastectomy and immediate breast reconstruction: a study protocol for the Tuscany Region (Italy) BMJ Open. 2021;11 doi: 10.1136/bmjopen-2020-042235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Burns K.E., Duffett M., Kho M.E., et al. A guide for the design and conduct of self-administered surveys of clinicians. CMAJ. 2008;179:245–252. doi: 10.1503/cmaj.080372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Tremblay D., Roberge D., Touati N., Maunsell E., Berbiche D. Effects of interdisciplinary teamwork on patient-reported experience of cancer care. BMC Health Serv Res. 2017;17:218. doi: 10.1186/s12913-017-2166-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cunningham M., Wells M. Qualitative analysis of 6961 free-text comments from the first National Cancer Patient Experience Survey in Scotland. BMJ Open. 2017;7 doi: 10.1136/bmjopen-2016-015726. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Baruch Y., Holtom B.C. Survey response rate levels and trends in organizational research. Hum Relat. 2008;61:1139–1160. [Google Scholar]
  • 49.Asch D.A., Jedrziewski M.K., Christakis N.A. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50:1129–1136. doi: 10.1016/s0895-4356(97)00126-1. [DOI] [PubMed] [Google Scholar]
  • 50.Brodar K.E., Carlisle V., Tang P.Y., Fisher E.B. Identification and characterization of peer support for cancer prevention and care: a practice review. J Cancer Educ. 2022;37:645–654. doi: 10.1007/s13187-020-01861-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Donaldson M.S. Taking PROs and patient-centered care seriously: incremental and disruptive ideas for incorporating PROs in oncology practice. Qual Life Res. 2008;17:1323–1330. doi: 10.1007/s11136-008-9414-6. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Figures and Tables
mmc1.pdf (185.2KB, pdf)
EPIC questionario
mmc2.pdf (6MB, pdf)

Articles from ESMO Gastrointestinal Oncology are provided here courtesy of Elsevier

RESOURCES