Abstract
Context
Immune-checkpoint inhibitors (ICI) have shown significant benefits for overall survival across various cancer types. Patient-reported outcomes (PROs) are assessed in clinical trials as a measure of efficacy. However, it remains unclear to what extent current PRO instruments capture symptoms specific to ICI toxicities. We conducted a systematic review to identify the use and content validity of PRO instruments in ICI clinical trials in oncology.
Methods
Literature was retrieved from PubMed, Embase, PsycINFO, Medline and CINAHL databases. Articles presenting ICI clinical trials’ PRO results, clinical trial study protocols, and conference abstracts stating the use of PRO measures were assessed. We evaluated the validity of identified instruments by comparing their symptom-related content with the adverse events reported in each ICI clinical trial.
Results
From database inception until January 2020, we identified 191 ICI clinical trials stating the use of PRO measures of which 26 published PRO results. The cancer-specific EORTC QLQ-C30 and the generic EQ-5D questionnaires were the most widely used instruments, often in combination with disease-specific PROs. Instruments used to report PRO symptom-related toxicities covered 45% of the most frequently reported AEs, whereas 23% of AEs were partially covered and 29% were not covered at all. Of non-covered AEs, 59% referred to the dermatologic system. Partially covered AEs related to endocrine and specific types of pain.
Conclusion
Despite the high frequency of symptom-related toxicities related to ICI, these events are only partially covered (or not addressed) by current PRO instruments, even when combined. Further research is needed to develop new strategies to tailor PRO instruments to specific ICI toxicities.
Keywords: Adverse events, Clinical trial, Immune-checkpoint inhibitors, Oncology, Patient-reported outcomes, Symptoms
Introduction
Immune-checkpoint inhibitors (ICIs) have shown significant clinical benefit by improving treatment response and survival rates for different cancer patient populations [1]. ICIs are associated with specific toxicities related to inflammatory or autoimmune responses - known as immune-related adverse events (irAEs) that affect different organs and systems [2]. These irAEs result from broad and unspecific immune over-activation [3]. In most cases, toxicities are reversible with corticosteroid or additional immunosuppressant treatment but some rare and potentially life-threatening irAEs have been reported [3]. Early recognition of irAEs and timely management is essential to reduce morbidity and mortality [4].
In clinical trials (CTs), the Common Terminology Criteria for Adverse Events (CTCAE) is the most widely used method to report toxicities [5]. Of these, 10% focus on symptomatic adverse events (AEs) amenable to patient self-report [6]. Thus, clinicians are often required to evaluate subjective patient experiences – resulting in potential underreporting of AEs [7, 8].
Patient-reported outcomes (PROs) are defined as “any report of the status of a patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else” [9]. Several studies demonstrate that compared to clinician report, PROs are more concordant with patient overall health status and result in earlier detection of symptom occurrence and severity [10, 11]. Thus, patient-reported symptom assessment that incorporates items relevant to ICIs may facilitate early AE detection and may provide complementary data to support decision-making.
The overall aim of the study was to identify and categorize the types and combination of PRO instruments used in CTs involving cancer patients receiving ICI therapy (ICI-CTs), and to assess their frequency of use. To further examine the content validity of the PRO instruments, we identified and compared the most frequent AEs reported in ICI-CTs with published PRO results.
Methods
Literature search
This systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [12] and the protocol was prospectively registered with PROSPERO (registration number: CRD42018090912). A literature search was performed in PubMed, Embase, PsycINFO, Medline and CINAHL databases using search terms adapted to the respective database. We used broad parameters employing controlled vocabulary (MeSH/Emtree preferred and related concepts) as well as specific keywords related to three constructs: (1) ICI terms (e.g. FDA-approved ICI), (2) PRO terms and (3) oncology and immunotherapy terms (Table S1 in the Supplementary Information). To ensure a comprehensive search strategy, we used the CT identification number from selected conference abstracts and CT study protocols to find additional CTs with published PRO results. The search was conducted from database inception to June 26, 2017 and updated on January 22, 2020. Articles written in English, French, Spanish, and German were included.
Selection criteria
Four pairs of reviewers (SCL, SR, LM, DBL, ME, NK, AC, AA) screened titles and abstracts following a predefined list of inclusion/exclusion criteria (Table S2). A Cohen’s kappa test was performed in order to ensure consistency between reviewers (κ = 0.81). Full texts of publications and conference abstracts were obtained and reviewed independently by two pairs of reviewers (SCL, SR, KR, LM) to identify articles for final analysis. Disagreements were resolved by discussion to reach consensus.
Types of publications included
Three types of publications were included (Fig. 1). Full-text articles with PRO results served to evaluate the reporting of PRO in ICI-CTs. CT study protocols and conference abstracts were used to assess the use and combination of PRO instruments in ICI-CTs and to identify additional full-text articles reporting on PRO results in ICI-CTs.
Data extraction
Reviewers (SR, LM, KR, DFL) completed a structured, online form using Distiller SR, to extract data from each full-text article including study and ICI-CT characteristics, analysis, results, study conclusions, and information about the PRO instruments used in the study (Table S3). Second reviewers (SCL and DS) verified the extracted data. For CT study protocols and conference abstracts, the following data were extracted: first author, publication year, study characteristics (name of the clinical trial/study, CT identifier, start year, cancer type, and number of participants), PRO endpoints, and name of the PRO instrument(s). Collected information was completed and verified across sources: clinicaltrials.gov/EudraCT, published CT protocol (when available), and primary CT publication (Table S4).
Categorization, combination and frequency of use of PRO instruments
Identified PRO instruments for all ICI-CTs were grouped into categories based on the focus of the measure (e.g. generic, cancer-specific, disease/tumor-specific, symptom-specific, item bank/single items, or other) and their frequency of use and combination were subsequently analyzed. The Cochrane checklist for describing and assessing PROs in CTs [13] was applied to the full-text articles presenting PRO results to assess measurement properties of the PRO instruments and PROs reporting (Table S5).
Comparison of PRO symptom content and most frequent reported AEs
We examined the content validity of PRO instruments used in the full-text articles reporting PRO results by comparing the extent to which the symptom-related content of identified PRO instruments (Table S7) aligned with the ten most frequent AEs reported in their respective CT study publication (Tables S8). A panel of experts including oncologists, advanced practice oncology nurses, and oncology nursing researchers reviewed and, through consensus, agreed on the differentiation of complex AEs into multi-symptoms that can be reported by patients (Table S9). AEs were considered ‘covered’ when the item matched all corresponding symptoms contained in the PRO instrument. Conversely, items were considered ‘not covered’ when PRO instruments did not include the corresponding symptom. Multi-symptom AEs were considered ‘partially covered’ when at least two of the symptoms pre-defined (Table S9) were contained in the PRO instrument(s). Coverage of the most frequently reported AEs (for each ICI-CT arm) were calculated and reported as a percentage.
Results
The search yielded 5295 records. After removing duplicates and screening titles and abstracts, 398 publications remained. Subsequent full-text assessment identified 27 articles reporting ICI-CTs PRO results, 319 conference abstracts, and 9 published CT study protocols. An additional article reporting PRO results was identified through conference abstracts and was included in the final analysis (total articles n = 28) (Fig. 1). Detailed review of articles, CT study protocols, and conference abstracts identified 191 ICI-CTs. We found information on PRO instruments for 156 of these ICI-CTs (Figure S1 and Table S4).
Categorization, combination and frequency of use of PRO instruments in ICI-CTs
The number, categorization, and combination of PRO instruments for each of the 156 ICI-CTs is shown in Fig. 2 and supplementary Table S4. Data review and analysis of the 156 ICI-CTs showed an increase over the years of the number of ICI-CTs stating the use or measurement of PROs in publications or conference abstracts (Fig. 2a). The peak was reached in 2015, with 32 ICI-CTs, followed by a plateau in the consecutive years. In the same period of time an increase of ICI-CTs can be observed (Figure S1).
Of the 156 ICI-CTs, 35 used one instrument, 68 used two instruments, 41 used three instruments, and 12 used four or five instruments (Fig. 2c and Table S4). Among the 68 ICI-CTs using two instruments, 16 paired generic with cancer-specific, 10 paired generic with disease/tumor-specific, 39 paired cancer-specific and disease/tumor-specific, and the rest (n = 3) combined a disease/tumor or cancer-specific with a symptom-specific questionnaire (n = 1), a treatment-specific (n = 1), or selected items (n = 1). In studies using three instruments, combining generic, cancer-specific, and disease-specific questionnaires was the most commonly used approach (n = 30/41). The other 11 ICI-CTs combined generic or cancer-specific instruments with disease-specific and symptoms or single item from item-libraries. Of the 12 ICI-CTs that used four or five instruments, most of them combined generic, cancer-specific and disease/tumor-specific with either symptom questionnaires or single items selected from item libraries such as the Patient Reported Outcomes Measurement Information System (PROMIS), the PRO version of the CTCAE (PRO-CTCAE), or the European Organisation for Research and treatment of Cancer (EORTC) (Fig. 2c).
The cancer-specific EORTC Quality of Life Questionnaire Core 30 (EORTC QLQ-C30) was the most widely used PRO instrument (112/156, 72%), followed by the generic health EuroQol 5 Dimension Scale (EQ-5D) (72/156, 46%) (Fig. 2b).
Focusing on the evolution of the use of PROs over time, we observe two main periods. Between 2004 and 2013, few studies used single instruments with the majority (8/15) of studies using two instruments. Between 2014 and 2019 (n = 141), we observe a higher variability in the number of instruments used (Fig. 2a).
Articles reporting on PRO results
From the 28 full-text articles reporting PRO results, one discussed associations between biomarkers and PRO results, 18 reported PRO results alone, and seven presented safety and efficacy data from the main ICI-CT together with PRO results. For two of the latter, additional full-text manuscripts on PRO results alone were published. Thus, the 28 publications referred to 26 individual ICI-CTs on lung carcinoma (n = 11) [14–24], melanoma (n = 6) [25–30], renal cell carcinoma (n = 3) [31–33], urothelial carcinoma (n = 2) [34, 35], Hodgkin’s lymphoma (n = 1) [36, 37], head and neck carcinoma (n = 1) [38, 39], Merkel cell carcinoma (n = 1) [40], and cervical and vaginal carcinoma (n = 1) [41] (Table S5). With regard to measured PRO concepts, all publications reported on health-related quality of life (HRQoL) or global health status (GHS) as assessed by the cancer-specific EORTC QLQ-C30 (17/26) and/or the generic EQ-5D (15/26). Eleven publications additionally included the measure of disease-related symptoms, and another four added a function assessment. In general, the selection of the PRO instrument(s) was justified based on previous use and validation in similar patient populations - either general cancer patients or disease-specific populations (Table S5). Only one publication [40] re-validated the instrument in the study population and the psychometric results have been published elsewhere [42].
Overall, most of the publications reported differences between groups in terms of “clinically meaningful deterioration”, “clinically meaningful improvement”, “clinically relevant”, “stable”, “minimal change”, “statistically significant”, or “significant difference” (Table S5). The primary reasons for attrition and missing PRO data were disease progression and AEs (15/26) (Table S6).
Content validity of PRO instruments
The use of the Cochrane checklist (Table S5) revealed a lack of coverage of common ICI-related AEs. We extracted the symptom-related content of each PRO instrument used in each of the 26 ICI-CTs identified (Table S7), followed by the extraction of the AEs reported in the main CT publication (Table S8). We then charted the ten most frequent AEs (any grade) reported in the respective ICI-CTs denoting which AEs were covered by PRO instruments employed in the corresponding study (Fig. 3). In total, almost half of the AEs (142/299, 47%) were covered by PRO instrument(s) employed in the ICI-CTs, even when used in combination. Nearly a third of AEs reported in ICI-CTs were not covered by the PRO instrument(s) (86/299, 29%). Among ‘not covered’ AEs, 51/86 (59%) were dermatologic in nature (e.g. rash, pruritus, vitiligo, dry skin). Further, multi-symptom AEs were partially covered in 71/299 (24%) of which 34% (24/71) related to a specific type of pain (e.g. headache, arthralgia, myalgia) and 28% (20/71) were endocrine-related (e.g. hypothyroidism, hyperthyroidism, hypophysitis).
Discussion
This systematic review examines the use of PRO instruments in clinical trials of FDA-approved ICI (up to January 2020). Our analysis reveals the cancer-specific EORTC QLQ-C30 and the generic EQ-5D questionnaires are the most widely used PRO instruments (72% and 46%, respectively) - either alone or in combination with disease-specific instruments. Although we observed an increase in the stated use of PRO measurements in ICI-CTs, reaching a peak in 2015, this should be seen in the global context of ICI development and the increase in ICI-CTs over the years. HRQoL or QoL are the most frequent measured concepts and only one third of the articles included additionally disease-specific symptom measures. Furthermore, our results indicate that the used PRO instruments did not include items specifically relating to ICI treatment-related symptoms. These results raise important concerns about the comprehensiveness of current instruments and the measurement of relevant PROs in the context of ICI-CTs. Similar conclusions have been drawn in other recently reported studies of PROs in ICI-CTs [43, 44]. However, the rigorous approach used in our review offers new, more detailed, and compelling insights about the use and content validity of PRO instruments in ICI-CTs. First, we provide a more comprehensive assessment of the aggregate content of PRO instruments in relation to frequent AEs by identifying and categorizing all the PRO instruments used in each ICI-CT (Fig. 3). In contrast, Hall et al. [44] only examined PRO instruments related to symptoms contained in the EORTC questionnaire. Secondly, our study examined the full spectrum of AEs reported in each ICI-CT (Fig. 3) as opposed to King-Kallimanis et al., who limited their examination to eight pre-selected symptoms for anti-PD-1/PD-L1 agents [43].
The use of PROs in CTs has grown in the last decade and PROs are recommended as important endpoints for trials [9, 45]. However, the availability of validated questionnaires and use of the most suitable instruments remains a challenge urging caution when interpreting HRQoL data in ICI-CTs [46–48]. A recent review of studies that led to the approval of ICIs identified several methodological problems with PRO measurement. Specifically, general HRQoL measures might lack sensitivity to provide a comprehensive assessment of the impact that ICI therapies have on patients [49]. For instance, some studies report no differences in HRQoL of ICI-treated patients despite relatively frequent grade 3–4 toxicity. Broadly, ICI-CTs results suggest a stable or overall increased HRQoL yet specific ICI treatment-related symptoms and AEs are not adequately assessed by existing PRO tools. In our study, we identified that dermatologic, endocrine, and specific types of pain are among the most reported ICI-related problems regardless of cancer type/diagnosis. Despite the frequency of such events, these AEs are only partially covered if at all by currently applied PRO instruments.
Studies included in this analysis often employed a combination of different PRO instruments (e.g. generic and cancer-specific, cancer-specific with disease-specific and/or symptom-specific questionnaires). The advantage of generic instruments is their broad applicability for evaluating general aspects of HRQoL independent of the specific diagnosis. However, generic instruments tend to lack responsiveness for detecting deterioration in specific health contexts. Disease- or symptom-specific instruments may be more acceptable and responsive to detecting changes but have limited generalizability for identifying unanticipated events across different populations [13]. In the present review, studies employed PRO instruments based on the intended measure (e.g. to detect changes in HRQoL, GHS, specific disease-related symptoms). Closely examining ICI-related toxicities revealed a unique profile - independent of cancer diagnosis [50–52]. This observation challenges the practice of choosing PRO instruments based on the population rather than treatment type. In other words, both cancer-specific tools and generic HRQoL questionnaires designed for traditional chemotherapies may not capture symptoms and toxicities specific to ICI therapies. Following this line of thought, Kluetz and colleagues have suggested the individual measurement of symptomatic adverse events, physical function, and disease-related symptoms. These three concepts are highly relevant to HRQoL and may better reflect the therapy’s effect on the patient and the patient’s disease [53]. An alternative approach to the traditional static instruments is the use of item libraries or computerized adaptive testing with content and symptom-items adapted for ICI treatments such as the National Cancer Institute PRO-CTCAE, PROMIS or the EORTC item library [6, 54–56]. Recently, efforts have been undertaken to develop such ICI specific modules [57].
Our study highlights the general underreporting of PRO results. Of 3231 ICI-CTs registered in the period between 2004 and 2019, only 191 (6%) had a published statement (study protocol, conference abstract) about the measurement of PROs, of which only 26 had a full-text article on PRO results. This finding aligns with the results from a recent systematic evaluation of PROs in cancer trials by Kyte et al. [58]. Importantly, PROs inform and facilitate treatment decision-making in clinical practice. As such, systematic PRO collection, analysis and reporting are highly relevant and should be considered a priority. This delay in PRO reporting is at odds with recommendations from both the European and American oncology societies (ESMO and ASCO) to incorporate such measures in clinical trials as read-outs for treatment benefit evaluation [59, 60].
Conclusion
Our systematic review on the use of PROs in ICI-CTs identifies variability in the use of instruments and gaps in existing instruments for addressing symptomatic toxicities that are ICI treatment-related. Further work is needed to develop novel strategies that permit the more comprehensive and systematic collection of PRO data specific to ICI treatments to inform and support drug labelling and clinical decision-making.
Supplementary information
Acknowledgements
The authors thank Nitin Khanna (NK), Anne Clayton (AC), and Amina Alizzi (AA) for their contribution to the reviewing process. Editorial support was provided by Andrew Dwyer.
Abbreviations
- ICI
Immune-checkpoint inhibitor
- CT
Clinical trial
- ICI-CT
Immune-checkpoint inhibitor clinical trial
- AE
Adverse event
- irAE
Immune-related adverse event
- CTCAE
Common Terminology Criteria for Adverse Events
- PRO
Patient-reported outcome
- EMA
European Medicines Agency
- FDA
Food and Drug Administration
- EORTC QLQ-C30
European Organisation for Research and treatment of Cancer Quality of Life Questionnaire Core 30
- EQ-5D
Euroqol 5 dimension
- FACT
Functional Assessment of Cancer Therapy
- FACIT
Functional Assessment of Chronic Illness Therapy
- FKSI
FACT-Kidney Symptom Index
- SDS
Symptom Distress Scale
- FKSI
FACT-Kidney Symptom Index
- HRQoL
Health-related quality of life
- GHS
Global health status
- PRO-CTCAE
Patient-Reported Outcomes Common Terminology Criteria for Adverse Events
- PROMIS
Patient-Reported Outcomes Measurement Information System
- ESMO
European Society for Medical Oncology
- ASCO
American Society of Clinical Oncology
Authors’ contributions
Study concept and design: SCL, DBL and ME. Acquisition, analysis, or interpretation of data: all authors. Drafting of the manuscript: SCL. Critical revision of the manuscript for important intellectual content: All authors. Study supervision: SCL, DBL, ME. The authors read and approved the final manuscript.
Funding
This work was supported by the Institute of Higher Education and Research in Healthcare (IUFRS) of the Faculty of Biology and Medicine at the University of Lausanne (Switzerland) and the Canadian Centre of Excellence in Oncology Advanced Practice Nursing (OAPN), Juravinski Hospital and Cancer Centre. Additional support comes from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement [No 793592].
Availability of data and materials
Protocols from the clinical trial identified and/or links to the clinical trial registration as well as individual clinical trial information are provided in Supplementary Information.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
SCL and ME received honoraria from Vifor Pharma and research grants from Roche and Bristol Meyers Squibb; RJ serves on advisory boards for Novartis, Pfizer, and Roche. DS has received investigator initiated funding from MERCK and Astra Zenica. All other authors declare no competing interest.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary information accompanies this paper at 10.1186/s41687-020-00210-z.
References
- 1.Ribas A, Wolchok JD. Cancer immunotherapy using checkpoint blockade. Science. 2018;359(6382):1350–1355. doi: 10.1126/science.aar4060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Marrone KA, Ying W, Naidoo J. Immune-related adverse events from immune checkpoint inhibitors. Clinical Pharmacology and Therapeutics. 2016;100(3):242–251. doi: 10.1002/cpt.394. [DOI] [PubMed] [Google Scholar]
- 3.Postow MA, Sidlow R, Hellmann MD. Immune-related adverse events associated with immune checkpoint blockade. The New England Journal of Medicine. 2018;378(2):158–168. doi: 10.1056/NEJMra1703481. [DOI] [PubMed] [Google Scholar]
- 4.Friedman CF, Proverbs-Singh TA, Postow MA. Treatment of the immune-related adverse effects of immune checkpoint inhibitors: A review. JAMA Oncology. 2016;2(10):1346–1353. doi: 10.1001/jamaoncol.2016.1051. [DOI] [PubMed] [Google Scholar]
- 5.U.S. Department of Health and Human Services N.I.H. National Cancer Institute . Common terminology criteria for adverse events (CTCAE) version 5.0. 2017. [Google Scholar]
- 6.Basch E, Reeve BB, Mitchell SA, Clauser SB, Minasian LM, Dueck AC, et al. Development of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE) Journal of the National Cancer Institute. 2014;106(9):dju244. doi: 10.1093/jnci/dju244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Fromme EK, Eilers KM, Mori M, Hsieh YC, Beer TM. How accurate is clinician reporting of chemotherapy adverse effects? A comparison with patient-reported symptoms from the quality-of-life questionnaire C30. Journal of Clinical Oncology. 2004;22(17):3485–3490. doi: 10.1200/JCO.2004.03.025. [DOI] [PubMed] [Google Scholar]
- 8.Di Maio M, Basch E, Bryce J, Perrone F. Patient-reported outcomes in the evaluation of toxicity of anticancer treatments. Nature Reviews. Clinical Oncology. 2016;13(5):319–325. doi: 10.1038/nrclinonc.2015.222. [DOI] [PubMed] [Google Scholar]
- 9.U.S. Department of Health and Human Services Food and Drug Administration F.D.A. Guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims. 2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Atkinson TM, Ryan SJ, Bennett AV, Stover AM, Saracino RM, Rogak LJ, et al. The association between clinician-based common terminology criteria for adverse events (CTCAE) and patient-reported outcomes (PRO): a systematic review. Support Care Cancer. 2016;24(8):3669–3676. doi: 10.1007/s00520-016-3297-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Basch E. Patient-reported outcomes - harnessing patients’ voices to improve clinical care. The New England Journal of Medicine. 2017;376(2):105–108. doi: 10.1056/NEJMp1611252. [DOI] [PubMed] [Google Scholar]
- 12.Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700. doi: 10.1136/bmj.b2700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Donald L Patrick, Gordon H Guyatt, Catherine Acquadro, & on behalf of the Cochrane Patient Reported Outcomes Methods Group (2011) Chapter 17: patient-reported outcomes. Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011], (The Cochrane Collaboration).
- 14.Brahmer JR, Rodriguez-Abreu D, Robinson AG, Hui R, Csoszi T, Fulop A, et al. Health-related quality-of-life results for pembrolizumab versus chemotherapy in advanced, PD-L1-positive NSCLC (KEYNOTE-024): A multicentre, international, randomised, open-label phase 3 trial. The Lancet Oncology. 2017;18(12):1600–1609. doi: 10.1016/S1470-2045(17)30690-3. [DOI] [PubMed] [Google Scholar]
- 15.Mazieres J, Kowalski D, Luft A, Vicente D, Tafreshi A, Gumus M, et al. Health-related quality of life with carboplatin-paclitaxel or nab-paclitaxel with or without pembrolizumab in patients with metastatic squamous non-small-cell lung cancer. Journal of Clinical Oncology. 2020;38(3):271–280. doi: 10.1200/JCO.19.01348. [DOI] [PubMed] [Google Scholar]
- 16.Reck M, Brahmer J, Bennett B, Taylor F, Penrod JR, DeRosa M, et al. Evaluation of health-related quality of life and symptoms in patients with advanced non-squamous non-small cell lung cancer treated with nivolumab or docetaxel in CheckMate 057. European Journal of Cancer. 2018;102:23–30. doi: 10.1016/j.ejca.2018.05.005. [DOI] [PubMed] [Google Scholar]
- 17.Reck M, Taylor F, Penrod JR, DeRosa M, Morrissey L, Dastani H, et al. Impact of nivolumab versus docetaxel on health-related quality of life and symptoms in patients with advanced squamous non-small cell lung cancer: results from the CheckMate 017 study. Journal of Thoracic Oncology. 2018;13(2):194–204. doi: 10.1016/j.jtho.2017.10.029. [DOI] [PubMed] [Google Scholar]
- 18.Reck M, Schenker M, Lee KH, Provencio M, Nishio M, Lesniewski-Kmak K, et al. Nivolumab plus ipilimumab versus chemotherapy as first-line treatment in advanced non-small-cell lung cancer with high tumour mutational burden: patient-reported outcomes results from the randomised, open-label, phase III CheckMate 227 trial. European Journal of Cancer. 2019;116:137–147. doi: 10.1016/j.ejca.2019.05.008. [DOI] [PubMed] [Google Scholar]
- 19.Spigel DR, McCleod M, Jotte RM, Einhorn L, Horn L, Waterhouse DM, et al. Safety, efficacy, and patient-reported health-related quality of life and symptom burden with nivolumab in patients with advanced non-small cell lung cancer, including patients aged 70 years or older or with poor performance status (CheckMate 153) Journal of Thoracic Oncology. 2019;14(9):1628–1639. doi: 10.1016/j.jtho.2019.05.010. [DOI] [PubMed] [Google Scholar]
- 20.Barlesi F, Garon EB, Kim DW, Felip E, Han JY, Kim JH, et al. Health-related quality of life in KEYNOTE-010: A phase II/III study of pembrolizumab versus docetaxel in patients with previously treated advanced, programmed death ligand 1-expressing NSCLC. Journal of Thoracic Oncology. 2019;14(5):793–801. doi: 10.1016/j.jtho.2019.01.016. [DOI] [PubMed] [Google Scholar]
- 21.Hui R, Ozguroglu M, Villegas A, Daniel D, Vicente D, Murakami S, et al. Patient-reported outcomes with durvalumab after chemoradiotherapy in stage III, unresectable non-small-cell lung cancer (PACIFIC): a randomised, controlled, phase 3 study. The Lancet Oncology. 2019;20(12):1670–1680. doi: 10.1016/S1470-2045(19)30519-4. [DOI] [PubMed] [Google Scholar]
- 22.Bordoni R, Ciardiello F, von Pawel J, Cortinovis D, Karagiannis T, Ballinger M, et al. Patient-reported outcomes in OAK: a phase III study of Atezolizumab versus docetaxel in advanced non-small-cell lung cancer. Clinical Lung Cancer. 2018;19(5):441–449. doi: 10.1016/j.cllc.2018.05.011. [DOI] [PubMed] [Google Scholar]
- 23.Bauml JM, Mick R, Ciunci C, Aggarwal C, Davis C, Evans T, et al. Pembrolizumab after completion of locally ablative therapy for oligometastatic non-small cell lung cancer: a phase 2 trial. JAMA Oncology. 2019;5:1283–1290. doi: 10.1001/jamaoncol.2019.1449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mansfield AS, Kazarnowicz A, Karaseva N, Sanchez A, De Boer R, Andric Z, et al. Safety and patient-reported outcomes of atezolizumab, carboplatin, and etoposide in extensive-stage small-cell lung cancer (IMpower133): a randomized phase I/III trial. Annals of Oncology. 2020;31(2):310–317. doi: 10.1016/j.annonc.2019.10.021. [DOI] [PubMed] [Google Scholar]
- 25.Schadendorf D, Larkin J, Wolchok J, Hodi FS, Chiarion-Sileni V, Gonzalez R, et al. Health-related quality of life results from the phase III CheckMate 067 study. European Journal of Cancer. 2017;82:80–91. doi: 10.1016/j.ejca.2017.05.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Schadendorf D, Dummer R, Hauschild A, Robert C, Hamid O, Daud A, et al. Health-related quality of life in the randomised KEYNOTE-002 study of pembrolizumab versus chemotherapy in patients with ipilimumab-refractory melanoma. European Journal of Cancer. 2016;67:46–54. doi: 10.1016/j.ejca.2016.07.018. [DOI] [PubMed] [Google Scholar]
- 27.Coens C, Suciu S, Chiarion-Sileni V, Grob JJ, Dummer R, Wolchok JD, et al. Health-related quality of life with adjuvant ipilimumab versus placebo after complete resection of high-risk stage III melanoma (EORTC 18071): secondary outcomes of a multinational, randomised, double-blind, phase 3 trial. The Lancet Oncology. 2017;18:393–403. doi: 10.1016/S1470-2045(17)30015-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Revicki DA, van den Eertwegh AJ, Lorigan P, Lebbe C, Linette G, Ottensmeier CH, et al. Health related quality of life outcomes for unresectable stage III or IV melanoma patients receiving ipilimumab treatment. Health and Quality of Life Outcomes. 2012;10:66. doi: 10.1186/1477-7525-10-66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Petrella TM, Robert C, Richtig E, Miller WH, Jr, Masucci GV, Walpole E, et al. Patient-reported outcomes in KEYNOTE-006, a randomised study of pembrolizumab versus ipilimumab in patients with advanced melanoma. European Journal of Cancer. 2017;86:115–124. doi: 10.1016/j.ejca.2017.08.032. [DOI] [PubMed] [Google Scholar]
- 30.Long GV, Atkinson V, Ascierto PA, Robert C, Hassel JC, Rutkowski P, et al. Effect of nivolumab on health-related quality of life in patients with treatment-naive advanced melanoma: results from the phase III CheckMate 066 study. Annals of Oncology. 2016;27(10):1940–1946. doi: 10.1093/annonc/mdw265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Cella D, Grunwald V, Nathan P, Doan J, Dastani H, Taylor F, et al. Quality of life in patients with advanced renal cell carcinoma given nivolumab versus everolimus in CheckMate 025: a randomised, open-label, phase 3 trial. The Lancet Oncology. 2016;17(7):994–1003. doi: 10.1016/S1470-2045(16)30125-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Cella D, Grunwald V, Escudier B, Hammers HJ, George S, Nathan P, et al. Patient-reported outcomes of patients with advanced renal cell carcinoma treated with nivolumab plus ipilimumab versus sunitinib (CheckMate 214): a randomised, phase 3 trial. The Lancet Oncology. 2019;20(2):297–310. doi: 10.1016/S1470-2045(18)30778-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.McGregor BA, McKay RR, Braun DA, Werner L, Gray K, Flaifel A, et al. Results of a multicenter phase II study of atezolizumab and bevacizumab for patients with metastatic renal cell carcinoma with variant histology and/or sarcomatoid features. Journal of Clinical Oncology. 2020;38(1):63–70. doi: 10.1200/JCO.19.01882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.O'Donnell PH, Arkenau HT, Sridhar SS, Ong M, Drakaki A, Spira AI, et al. Patient-reported outcomes and inflammatory biomarkers in patients with locally advanced/metastatic urothelial carcinoma treated with durvalumab in phase 1/2 dose-escalation study 1108. Cancer. 2020;126(2):432–443. doi: 10.1002/cncr.32532. [DOI] [PubMed] [Google Scholar]
- 35.Vaughn DJ, Bellmunt J, Fradet Y, Lee JL, Fong L, Vogelzang NJ, et al. Health-related quality-of-life analysis from KEYNOTE-045: a phase III study of pembrolizumab versus chemotherapy for previously treated advanced urothelial cancer. Journal of Clinical Oncology. 2018;36(16):1579–1587. doi: 10.1200/JCO.2017.76.9562. [DOI] [PubMed] [Google Scholar]
- 36.Chen R, Zinzani PL, Fanale MA, Armand P, Johnson NA, Brice P, et al. Phase II study of the efficacy and safety of pembrolizumab for relapsed/refractory classic Hodgkin lymphoma. Journal of Clinical Oncology. 2017;35(19):2125–2132. doi: 10.1200/JCO.2016.72.1316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.von Tresckow B, Fanale M, Ardeshna KM, Chen R, Meissner J, Morschhauser F, et al. Patient-reported outcomes in KEYNOTE-087, a phase 2 study of pembrolizumab in patients with classical Hodgkin lymphoma. Leukemia & Lymphoma. 2019;60(11):2705–2711. doi: 10.1080/10428194.2019.1602262. [DOI] [PubMed] [Google Scholar]
- 38.Harrington KJ, Ferris RL, Blumenschein G, Jr, Colevas AD, Fayette J, Licitra L, et al. Nivolumab versus standard, single-agent therapy of investigator’s choice in recurrent or metastatic squamous cell carcinoma of the head and neck (CheckMate 141): health-related quality-of-life results from a randomised, phase 3 trial. The Lancet Oncology. 2017;18:1104–1115. doi: 10.1016/S1470-2045(17)30421-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Ferris RL, Blumenschein G, Jr, Fayette J, Guigay J, Colevas AD, Licitra L, et al. Nivolumab for recurrent squamous-cell carcinoma of the head and neck. The New England Journal of Medicine. 2016;375(19):1856–1867. doi: 10.1056/NEJMoa1602252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Kaufman HL, Hunger M, Hennessy M, Schlichting M, Bharmal M. Nonprogression with avelumab treatment associated with gains in quality of life in metastatic Merkel cell carcinoma. Future Oncology. 2018;14(3):255–266. doi: 10.2217/fon-2017-0470. [DOI] [PubMed] [Google Scholar]
- 41.Naumann RW, Hollebecque A, Meyer T, Devlin MJ, Oaknin A, Kerger J, et al. Safety and efficacy of nivolumab monotherapy in recurrent or metastatic cervical, vaginal, or vulvar carcinoma: results from the phase I/II CheckMate 358 trial. Journal of Clinical Oncology. 2019;37(31):2825–2834. doi: 10.1200/JCO.19.00739. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Bharmal M, Fofana F, Barbosa CD, Williams P, Mahnke L, Marrel A, et al. Psychometric properties of the FACT-M questionnaire in patients with Merkel cell carcinoma. Health and Quality of Life Outcomes. 2017;15(1):247. doi: 10.1186/s12955-017-0815-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.King-Kallimanis BL, Howie LJ, Roydhouse JK, Singh H, Theoret MR, Blumenthal GM, et al. Patient reported outcomes in anti-PD-1/PD-L1 inhibitor immunotherapy registration trials: FDA analysis of data submitted and future directions. Clinical Trials. 2019;16(3):322–326. doi: 10.1177/1740774519836991. [DOI] [PubMed] [Google Scholar]
- 44.Hall ET, Singhal S, Dickerson J, Gabster B, Wong H-N, Aslakson RA, et al. Patient-reported outcomes for cancer patients receiving checkpoint inhibitors: opportunities for palliative care - a systematic review. Journal of Pain and Symptom Management. 2019;58(1):137–156.e131. doi: 10.1016/j.jpainsymman.2019.03.015. [DOI] [PubMed] [Google Scholar]
- 45.European Medicines Agency E.M.A . Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man. The use of patient-reported outcome (PRO) measures in oncology studies. 2016. [Google Scholar]
- 46.Brundage M, Hanna T. Adjuvant ipilimumab for stage III melanoma: the patient voice. The Lancet Oncology. 2017;18(3):282–284. doi: 10.1016/S1470-2045(17)30003-7. [DOI] [PubMed] [Google Scholar]
- 47.Lorigan P, Green AC. Immunotherapy: does adjuvant ipilimumab have little adverse effect on quality of life? Nature Reviews. Clinical Oncology. 2017;14(7):395–396. doi: 10.1038/nrclinonc.2017.60. [DOI] [PubMed] [Google Scholar]
- 48.Singer S. Quality of life after nivolumab treatment for head and neck cancer. The Lancet Oncology. 2017;18(8):993–994. doi: 10.1016/S1470-2045(17)30463-1. [DOI] [PubMed] [Google Scholar]
- 49.Das S, Horn L. Quality matters: Immunotherapy and the evolving landscape of advanced cancer care. Expert Review of Quality of Life in Cancer Care. 2017;2(5):235–244. [Google Scholar]
- 50.De Velasco G, Je Y, Bossé D, Awad MM, Ott PA, Moreira RB, et al. Comprehensive meta-analysis of key immune-related adverse events from CTLA-4 and PD-1/PD-L1 inhibitors in cancer patients. Cancer Immunology Research. 2017;5(4):312–318. doi: 10.1158/2326-6066.CIR-16-0237. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.El Osta B, Hu F, Sadek R, Chintalapally R, Tang SC. Not all immune-checkpoint inhibitors are created equal: meta-analysis and systematic review of immune-related adverse events in cancer trials. Critical Reviews in Oncology/Hematology. 2017;119:1–12. doi: 10.1016/j.critrevonc.2017.09.002. [DOI] [PubMed] [Google Scholar]
- 52.Khoja L, Day D, Wei-Wu Chen T, Siu LL, Hansen AR. Tumour- and class-specific patterns of immune-related adverse events of immune checkpoint inhibitors: a systematic review. Annals of Oncology. 2017;28(10):2377–2385. doi: 10.1093/annonc/mdx286. [DOI] [PubMed] [Google Scholar]
- 53.Kluetz PG, Slagle A, Papadopoulos EJ, Johnson LL, Donoghue M, Kwitkowski VE, et al. Focusing on core patient-reported outcomes in cancer clinical trials: symptomatic adverse events, physical function, and disease-related symptoms. Clinical Cancer Research. 2016;22(7):1553–1558. doi: 10.1158/1078-0432.CCR-15-2035. [DOI] [PubMed] [Google Scholar]
- 54.Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology. 2010;63(11):1179–1194. doi: 10.1016/j.jclinepi.2010.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Kulis D, Bottomley A, Whittaker C, van de Poll-Franse LV, Darlington A, Holzner B, et al. The use of the Eortc item library to supplement Eortc quality of life instruments. Value in Health. 2017;20(9):A775. [Google Scholar]
- 56.Petersen MA, Groenvold M, Aaronson NK, Chie WC, Conroy T, Costantini A, et al. Development of computerized adaptive testing (CAT) for the EORTC QLQ-C30 physical functioning dimension. Quality of Life Research. 2011;20(4):479–490. doi: 10.1007/s11136-010-9770-x. [DOI] [PubMed] [Google Scholar]
- 57.Hansen AR, Ala-Leppilampi K, McKillop C, Siu LL, Bedard PL, Abdul Razak AR, et al. Development of the functional assessment of cancer therapy-immune checkpoint modulator (FACT-ICM): a toxicity subscale to measure quality of life in patients with cancer who are treated with ICMs. Cancer. 2020;126(7):1550–1558. doi: 10.1002/cncr.32692. [DOI] [PubMed] [Google Scholar]
- 58.Kyte D, Retzer A, Ahmed K, Keeley T, Armes J, Brown JM, et al. Systematic evaluation of patient-reported outcome protocol content and reporting in cancer trials. Journal of the National Cancer Institute. 2019;111:1170–1178. doi: 10.1093/jnci/djz038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Cherny NI, Sullivan R, Dafni U, Kerst JM, Sobrero A, Zielinski C, et al. A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: The European Society for Medical Oncology magnitude of clinical benefit scale (ESMO-MCBS) Annals of Oncology. 2015;26(8):1547–1573. doi: 10.1093/annonc/mdv249. [DOI] [PubMed] [Google Scholar]
- 60.Schnipper LE, Davidson NE, Wollins DS, Blayney DW, Dicker AP, Ganz PA, et al. Updating the American Society of Clinical Oncology value framework: revisions and reflections in response to comments received. Journal of Clinical Oncology. 2016;34(24):2925–2934. doi: 10.1200/JCO.2016.68.2518. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Protocols from the clinical trial identified and/or links to the clinical trial registration as well as individual clinical trial information are provided in Supplementary Information.