Highlights
-
•
Value assessment frameworks help guide decisions in a standardized and transparent fashion.
-
•
Particularly in early-stage cancers, payers balance early access with maturity of data.
-
•
We propose principles for defining and assessing the value of cancer therapies.
-
•
The principles can facilitate discussion and decision-making on treatment development and evaluation.
-
•
Next steps could include evolving existing value frameworks, to improve cancer outcomes.
Abstract
The move toward early detection and treatment of cancer presents challenges for value assessment using traditional endpoints. Current cancer management rarely considers the full economic and societal benefits of therapies. Our study used a modified Delphi process to develop principles for defining and assessing value of cancer therapies that aligns with the current trajectory of oncology research and reflects broader notions of value. 24 experts participated in consensus-building activities across 5 months (16 took part in structured interactions, including a survey, plenary sessions, interviews, and off-line discussions, while 8 participated in interviews). Discussion focused on: 1) which oncology-relevant endpoints should be used for assessing treatments for early-stage cancer and access decisions for early-stage treatments, and 2) the importance of additional value components and how these can be integrated in value assessments. The expert group reached consensus on 4 principles in relation to the first area (consider oncology-relevant endpoints other than overall survival; build evidence for endpoints that provide earlier indication of efficacy; develop evidence for the next generation of predictive measures; use managed entry agreements supported by ongoing evidence collection to address decision-maker evidence needs) and 3 principles in relation to the second (routinely use patient reported outcomes in value assessments; assess broad economic impact of new medicines; consider other value aspects of relevance to patients and society).
1. Introduction
Value assessments play a key role in determining access to cancer treatments. To optimize outcomes and enable the most effective allocation of limited payer resources, clinical benefits must be balanced against the costs and potential risks of a therapy. Concepts of value are not static, however, and frameworks for assessing value need to evolve in parallel with scientific advances if they are to remain fit for purpose.
Rapid developments in cancer research, combined with a fundamental shift toward earlier diagnoses and earlier, more personalized, treatments, have improved outcomes for people with cancer around the world [1], [2], [3], [4], [5], [6]. Oncology science continues to deliver advancements that can lead to more targeted and effective treatments. However, if patients are to benefit fully from these developments, a shift in approach to value assessment is required to improve access to innovative therapies.
Innovative treatments are particularly important for maximizing the potential benefits of early detection. The current cancer treatment paradigm generally aims for remission, followed by administering the next round of treatments on relapse (see Fig. 1). In a future paradigm based on early detection, by contrast, optimal treatment would often begin with monitoring and assessment to inform personalized treatments that are more localized and targeted, with curative intent [7]. To this end, the identification and utilization of additional oncology-relevant measures should be considered in terms of their role in accelerating the detection of even nascent cancers, speeding up drug development, and better informing treatment pathways and value assessments.
Fig. 1.
Illustrative paradigm shift in cancer treatment with curative intent.
Funding decisions can be extremely complex because the cost of a new therapy does not always offset other healthcare expenses. Payers and health technology assessment bodies (HTA) account for the impact of medicines on health systems on aspects beyond the immediate cost to varying extents; some (e.g., the U.S.’s Institute for Clinical and Economic Review (ICER)) may include quantitative assessment of societal impacts [8], [9]. Further complexities arise when assessing the value of new treatments that show positive therapeutic effects without fully mature clinical data, as the potential value of earlier access must be weighed against safety or efficacy uncertainties. Regulators would have already made such deliberations before payers use the same clinical data but accompanied with cost data to make reimbursement decisions.
Overall Survival (OS) remains the standard endpoint in many contexts for payer decision-making regarding the clinical value of new oncology medicines. While OS is undeniably important, its usage can limit access to new medicines that could improve treatment results, especially when assessing new therapies for early-stage disease. OS data may be difficult to collect, could take many years to mature, and/or could be confounded by subsequent therapies [10], [11], [12]. Waiting sufficiently long to have mature OS data to make access decisions can mean that people with cancer today will not have the option of a treatment that could make them eligible for additional future treatments. Other oncology-relevant endpoints may thus be more appropriate for assessing treatments for early-stage cancers (see Supplemental Table 1).
Ultimately, it is important that people with cancer receive medicines as early as possible where there is sufficient evidence of efficacy and understanding of the treatment’s safety profile/tolerability. To achieve this goal, sustained collaboration among manufacturers, regulators, and payers is needed to define the value of oncology medicines in terms of clinical and other value components, including economic benefit, broader benefits for society at large, and value from the perspective of people with cancer (see Supplemental Table 2).
Value assessment in oncology has been recently reviewed [13], and in this study we build on that body of work by convening experts from a varied stakeholder-group to develop consensus across countries and stakeholder-groups to key outstanding questions. We also believe that our study is broader in scope, with considerations beyond endpoints. For this purpose, we employed a modified Delphi process, in which multidisciplinary experts were iteratively polled and convened for discussion to achieve consensus, on principles for defining and assessing the value of cancer therapies in a manner that both aligns with the current trajectory of oncology research and reflects broader notions of value. In particular, we sought to answer 2 questions:
-
1)
Which oncology-relevant endpoints should be used to assess the benefit of treatments for early-stage cancer in clinical trials, and access decisions for early-stage cancer treatments?
-
2)
Which additional value components are important in oncology and how can they be integrated in value assessments within healthcare systems and processes?
2. Materials and methods
For this study we organised a modified Delphi process, which is a method for developing expert consensus on challenging topics through iterated rounds of polling and discussion (see Fig. 2), widely used in areas of healthcare where scientific evidence is insufficient or contradictory [14]. The goal of this process was to stimulate dialogue around appropriate value assessment, with a focus on early-stage disease, and ultimately reach consensus around a set of easily understandable, broadly applicable, and actionable principles for defining and assessing the value of cancer therapies.
Fig. 2.
Flow diagram of modified Delphi process.
2.1. Expert recruitment
The study team compiled a list of experts from the global cancer care ecosystem using purposive sampling. 16 expert panelists and 8 expert interviewees completed the exercise (see supplemental methods), including patient advocates, oncologists, health economists, regulators, members of payer and HTA bodies, and representatives from professional societies. The group included experts in a diverse range of cancer types as well as perspectives from 14 countries (Australia, Canada, China, Germany, India, Ireland, Italy, Japan, Singapore, South Korea, Spain, Sweden, the U.K., and the U.S.). Only experts who did not currently work at regulatory agencies, payers, or HTA bodies were invited to participate to protect against potential conflicts of interest. Some experts were provided compensation for their time in participating, and some experts chose to forego compensation (note, none of the experts were employed by a pharmaceutical company at the time of this project). All participants were briefed ahead of time on what to expect and consented to the process and the use that would be made of their contributions.
2.2. Consensus-Building process
Over a period of 5 months, 16 members of the expert group participated in 2 rounds of structured interactions. The first round began with members completing quantitative and qualitative items on a survey (see supplemental methods) to determine their current views on 4 dimensions of value (Clinical benefit; Benefit to patients and/or caregivers; Benefit to the healthcare system; Social / macro benefit). Expert panelists were also asked by the study team of independent consultants for their views on the suitability of 12 possible clinical endpoints for use in cancer trials (see Supplemental Table 1); the study team then summarised these views ahead of the first discussion.
Each round of interactions comprised a pre-read that included the results from the survey that preceded each plenary and agenda and objectives for the discussion. These were circulated 7 days before the meeting and a virtual plenary meeting (panel) followed by online discussions. Plenary sessions took the form of a 4-hour workshop-style meeting, with breakout sessions in which groups of experts discussed specific cancers. Expert panelists were encouraged to find common ground and to explore the reasons for differing views. Structured discussions then continued online on the secure social platform Within3.
In parallel with the plenary sessions and online discussions, the study team conducted structured interviews via videoconference with each expert panelist, and with 8 additional expert interviewees, using an interview guide developed with reference to initial survey results. These interviews provided additional qualitative information to assist in understanding the experts’ views and allowed the study team to clarify points of uncertainty. Interviews were also used to gather contributions from expert panelists who were unable to join one of the plenary sessions.
The study team conducted multiple rounds of polling during the second set of online discussions to determine where consensus was building and iteratively refined the principles to reduce or eliminate disagreements until expert panelists reached agreement. Final consensus on the wording of principles was established by co-authoring a consensus report. The study team prepared an initial draft presenting their understanding of the consensus position. The expert panelists and interviewees then offered revisions.
3. Results
3.1. Principles on oncology-relevant endpoints
The group identified four consensus principles pertaining to oncology-relevant endpoints for consideration in value assessments, particularly for early-stage cancers.
3.1.1. Principle 1 Consider oncology-relevant endpoints other than OS which have intrinsic value for decision making
In early-stage cancer, OS data takes time to mature or may not be possible to collect in the longer term in early-stage disease. Indication, intent of treatment, and feasibility of measuring patient-relevant outcomes (e.g., event-free survival (EFS), disease-free survival (DFS), relapse-free survival (RFS)) within a reasonable timeframe should be evaluated when considering oncology-relevant endpoints as alternative to OS in value assessments. See Supplemental Table 1 for a decision of these and other oncology-relevant endpoints.
Access and funding decisions for cancer treatments currently focus primarily on OS data to determine treatment efficacy [15]. However, it can take years to collect the data, especially for early-stage disease [10], [16], and participants in clinical trials often start other treatments during follow up, confounding OS data for the initial therapy [11], [12]. People with cancer also may not survive long enough, or may have disease that is too advanced, to benefit from access to new treatments while data matures.
The group agreed that other oncology-relevant endpoints should be considered when making decisions about access to therapies, with medical oncologists and patient advocates emphasizing the importance of not delaying access to treatment options. Health economists and HTA experts in the group acknowledged the challenges of demonstrating statistically significant OS benefit in early-stage cancers, noting that additional endpoints [17] are increasingly recognized either in their own right or as proxies for OS [18], [19]. Health economists were more likely to accept endpoints for initial value assessment that showed strong correlations with long-term outcomes, although there is currently insufficient evidence for and consensus regarding which alternatives meet these criteria and in which settings (see Fig. 3: results from polling 9 experts on which endpoint(s) are most likely to provide meaningful data on their own in early-stage breast and lung cancers, either as measures of efficacy or predictors of clinical outcomes, depending on the type and stage of cancer).
Fig. 3.
Expert indication of endpoints potentially acceptable for value assessment in oncology.
3.2. Principle 2 Continue to build evidence for endpoints that provide earlier indication of treatment efficacy
Emerging additional oncology-relevant endpoints that can detect treatment impact earlier, such as pCR (pathologic complete response, defined as the absence of residual invasive cancer upon evaluation of resected tissue), generally currently require confirmatory longitudinal outcome data. As evidence builds that pCR in specific disease settings and therapeutic classes correlates with other outcomes data (e.g., EFS, DFS and RFS), and/or people with cancer and oncologists confirm it reflects meaningful benefit, pCR may become established as a predictor and/or measure of clinical benefit.
While health economists and regulators in the group preferred OS in the adjuvant setting, they recognized inherent challenges with relying on mature OS data. Patient advocates and oncologists were more amenable to accepting oncology-relevant endpoints such as pCR as measures on their own, without correlating OS, PFS, DFS, or RFS data. The group agreed that PFS, pCR, DoR (duration of response: the length of time a tumour will respond to treatment without growing or metastasizing), DFS, RFS and EFS could provide meaningful efficacy data in early-stage cancers, either as endpoints on their own or in combination, and that the perspectives of people with cancer regarding quality of life (QoL) and tolerability also add value.
pCR is increasingly used as an endpoint in clinical trials and acceptance is growing among regulators [20], [21]. The group explored the role of pCR in early-stage cancers in the neoadjuvant setting as a potential interim oncology-relevant endpoint to support conditional reimbursement approval pending longer-term data. The group indicated that while pCR can provide early data on treatment response, this currently needs to be complemented with longitudinal data to inform regulatory and payer decisions. However, as more trials use pCR as a primary endpoint, stronger evidence will emerge to inform its utility in decision-making and as a predictor of longer-term outcomes.
3.2.1. Principle 3 Develop evidence for the next generation of predictive measures that detect and monitor disease
Advances in disease monitoring, such as through circulating tumour DNA (ctDNA), may provide important early information about treatment response and tumour recurrence. Trials should collect ctDNA data to assess their value as predictors of clinical outcomes.
Precision medicine and research into cancer biomarkers is already yielding results that could transform the management of cancer care in the future. Research into ctDNA shows particular promise. Assessed with a simple blood test (a “liquid biopsy”), ctDNA uses a tumour’s genetic signature to detect disease at a very early stage, allowing for potential early intervention [22].
Research is ongoing across oncology therapy areas into the use of ctDNA to monitor disease and/or predict clinical outcomes, with especially promising studies focusing on metastatic breast cancer [7], [23], [24] and lung cancer [25], [26], [27] as well as early-stage colorectal cancer. The group agreed that further studies are warranted. The group also agreed more broadly that ctDNA has potential as an oncology-relevant measure for value assessment decisions and recommended that ctDNA data collection in clinical trials continue toward that goal. Patient advocates and oncologists noted that uptake of ctDNA monitoring in routine clinical practice would require wider use of liquid biopsies and that monitoring tools would need to be funded adequately and made available to physicians for benefits to be realized in clinical practice.
3.2.2. Principle 4 Use managed entry agreements (MEAs) supported by ongoing evidence collection to help address decision-maker evidence needs
Carefully designed MEAs with planned confirmatory evidence collection can support timely patient access to new therapeutics and help to address evidence uncertainties associated with earlier access for decision makers.
The group highlighted that medicines with a positive value assessment based on predictor endpoints may need additional data to confirm long-term outcomes. As Pauwels et al., wrote “Coverage with evidence agreements can provide answers about uncertainties in real world effectiveness by using patient-relevant outcomes” [28].
The group agreed that, in some countries, carefully designed MEAs with planned confirmatory evidence collection can support timely patient access to new therapeutics and help to address evidence uncertainties. This approach can enable proactive management around uncertainty on the part of the payer related to long-term outcomes and support fast action in clinical practice by working in partnership with the pharmaceutical company to mitigate emerging adverse events not detected during clinical trials. Examples of this approach include the “anwendungsbegleitende Datenerhebung” in Germany [29], “coverage with evidence development” in the US [30] and UK [31], the Italian Medicines Agency (AIFA) registry in Italy [32].
There may also be product- or indication-specific agreements between the manufacturer and payer in which reimbursement is contingent upon pre-specified real-world outcomes [33]. Adjustments to the type of agreement may be needed in countries where citizens pay the majority of medical costs out of pocket.
3.3. Principles on value components in oncology
The group agreed that it is useful to consider broader elements of value that early-stage cancer treatments bring to people with cancer, society, and the healthcare system overall. 3 value-related principles were identified.
3.3.1. Principle 5 Routinely use patient reported outcomes (PROs) in value assessments
Data collected from patients via PROs, including QoL, should routinely and consistently be incorporated into value assessments, along with the value components that are already used relating to safety and efficacy.
The group agreed that, in appropriate trials, standard measures of clinical benefit need to be complemented with PROs that assess impact on QoL. The group identified 2 actions that would contribute to this goal:
-
1.
Improved and more consistent use of QoL data in value assessments. QoL data are routinely considered in regulators’ assessments as well as in many HTA and payer assessments, but use of these data is not yet universal. Simpler tools are also needed; patient advocate groups often report that existing QoL tools are too complicated or not relevant.
-
2.
In appropriate trials, utilization of PROs to collect QoL data and support cumulative reporting over time of lower-grade adverse events. Recalibrating value frameworks to include information on lower grade adverse events that could impact QoL tolerability measures would further support informed decision-making. Patient advocates also encouraged the collection of tolerability data directly via PROs and other mechanisms to get a true understanding of a treatment’s tolerability from an individual’s perspective.
3.3.2. Principle 6 Assess broad economic impact of new medicines
The economic impact of medicines is an essential component of the value assessment and should consider the downstream effect a medicine can have on the amount and associated cost of healthcare resources a patient eventually needs, as well as the socio-economic impact (paid and voluntary work) for patients and those in a caregiving capacity.
Formalized analyses of economic benefit are often limited to costs within the healthcare system [34]. The group discussed additional economic value components suggested by an ISPOR value framework [35], focusing on 2 important factors: a treatment’s socio-economic impact and its impact on healthcare resource utilization overall. The group agreed that the assessment of economic benefit should be widened to include broader societal costs such as the socio-economic impact for people with cancer and those in a caregiving capacity, as well as healthcare expenses that are avoided due to effective earlier treatments. The group agreed that implementing such measurements seemed feasible. Some experts questioned whether this was the role of payers, but there is currently no other established process through which these factors could be assessed.
3.3.3. Principle 7 Consider other value aspects of relevance to patients and society
Insurance value, the value of choice, scientific spillovers, equity of access, and real option value should be considered in value assessments, although they may not all be readily quantifiable and may instead require a more qualitative assessment.
The group reflected on 12 value components considered by an ISPOR special task force [36], highlighting 5 as particularly important.
-
1)
Insurance value, as Goring et al. wrote [37], “captures the value to healthy individuals of being protected from the physical and financial burden of a particular illness due to the availability of a new therapy/technology.” Patient advocates valued this component because it provided assurance to people that, should they get sick, treatment options will be available for them.
-
2)
The value of choice from having multiple treatment options was vital for patient advocates, with an emphasis on reflecting individual concerns and preferences of people with cancer directly to regulators and payers in order to inform their assessments. (When treatment options have different risk profiles, this additionally brings the value of hope into play, as patients will have different risk preferences.).
-
3)
Technological breakthroughs can potentially have scientific spillover benefits that enable advances beyond the current product or indication. This should be rewarded to recognize the uncertainties involved in innovation and to provide incentives.
-
4)
Equity of access was an important topic as the benefits of therapies are only seen if people with cancer are aware of options, able to access them, and able to stay on treatment [24]. Health inequities are challenging components to measure [38], so the group proposed that innovators should be rewarded for addressing inequities in both drug development and post-approval access designs. Innovators should ensure that their clinical trials recruit participants that reflect the populations impacted by the specific cancer under study, accounting for variation in both genetics and in access to quality care. Increasing the volume of research in this area would give oncologists essential information on dosing and point to ethnic differences in patient response to a given treatment.
-
5)
Real option value was identified as important, particularly by patient advocates and oncologists. Real option value is generated when treatments extend the lives and wellbeing of people with cancer so they can benefit from future treatment options and subsequent lines of treatment after their current treatment [39].
4. Discussion
Using a modified Delphi process, an expert group reached consensus on 7 principles for defining and assessing the value of cancer therapies. These principles offer a resource to facilitate cross-stakeholder discussion and decision-making, and to support the evolution of existing value frameworks with the goal of improving outcomes for people with cancer.
4.1. Oncology Relevant Endpoints
The 4 principles addressing oncology relevant endpoints focus on accelerating the generation of early evidence of treatment effect, while taking appropriate account of considerations regarding long-term effectiveness and safety. The expert group’s consensus on the usefulness of endpoints other than OS reflects and amplifies views that are already being put into practice in some parts of the broader cancer community [17], [18].
A core part of the work that needs to be done to support this trend is the resolution of evidence uncertainties around these alternative endpoints, as this will accelerate access to new medicines that meet the necessary safety, quality, and efficacy thresholds [16]. The group’s view that alternative endpoints could provide meaningful efficacy data in early-stage cancers is consistent with the results of other consensus-building exercises [40]. It is also reflected in practice: clinical trials increasingly use pCR as an oncology-relevant endpoint with promising results [41], [42] and acceptance is growing among regulators [41], [20], [21]. The group also agreed on the importance of developing new predictive measures. The recommendation that ctDNA analysis be explored further is grounded in promising ongoing research into breast and lung cancer [25], [7], [26], [23], [24], [27] and aligns with the emerging consensus around the need to assess this measure’s potential value for people with early-stage solid tumours [43], [44], [40].
Collecting this additional data will address the current shortage of evidence regarding alternative endpoints, which was identified by participating experts as a major barrier to their use. In particular, they highlighted the need for robust evidence that alternative endpoints correlate with longer-term outcomes such as OS or QoL, for specific cancers at specific stages. Likewise, more evidence and deliberation regarding value components will help develop priorities, since not all values can be weighed equally, and some are more challenging to measure than others, from both innovators’ perspective in clinical trials and HTAs’ in terms of value to society and health systems.
While not relevant in all national contexts, carefully designed MEAs have significant potential in some countries for addressing the uncertainty around efficacy endpoints other than OS. In France, for example, the “accès précoce” program enables early access to innovative therapies with the requirement to collect confirmatory real-world evidence on treatments. [45] In the UK, the Cancer Drugs Fund (CDF) has the same intent. The CDF provides funding for early access to new treatments. All patients are registered, allowing the possibility of collection of real-world routine data from electronic patient records and national treatment databases to enable further evaluation [46]. Where benefit is not confirmed by NICE, the CDF stops funding the medicine. This approach is complemented by the Medicines and Healthcare products Regulatory Agency’s increased surveillance and managed access at specialist centers as part of its Early Access to Medicines Scheme (EAMS) [47]. This enables proactive management around uncertainty and fast action within clinical practice working in partnership with the pharmaceutical company to mitigate any emerging adverse events not detected during clinical trials. These programs may serve as useful models for other countries.
4.2. Limitations
The principles articulated in this report reflect the perspectives of experts from the cancer communities in 14 countries. While the number of experts who contributed to the consensus meets Delphi process guidelines [48], a larger sample or a sample weighted differently with regard to areas of expertise may not have reached the same consensus. Similarly, the expert perspectives gathered here predominantly represent views from advanced economies. As such, the consensus reached may not be generalizable to the health systems of all countries. Perspectives from beyond the countries represented here are needed in future studies, as care resources, experiences, and outcomes vary widely across the globe.
5. Conclusions
5.1. Policy recommendations
Many countries use value assessment frameworks to inform both clinical and economic decisions about treatment availability and reimbursement. These frameworks assess the essential value components of clinical benefit, economic value, and patient health outcomes alongside a variety of other important measures (see Supplemental Table 2). Examples include the ISPOR value flower [49], value frameworks from the American Society of Clinical Oncology [50], and the National Comprehensive Cancer Network, and the magnitude of clinical benefit scale guideline from the European Society for Medical Oncology [51]. Current value assessments do not always consider the full personal, economic, or societal benefits of early-stage cancer therapies. The principles outlined above can contribute to the evolution of such frameworks by broadening conceptions of value (see Fig. 4).
Fig. 4.
Next steps for evolving value assessment in cancer therapy.
A key point of agreement among the expert group was that PROs, including QoL, should routinely form part of value assessments to properly reflect the experience of the patient alongside considerations around efficacy and safety. While QoL data are routinely included in many value assessments, such as those of Germany’s Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG), the US Centers for Medicare & Medicaid Services (CMS) [52] and the UK’s National Institute for Health and Care Excellence (NICE), others, such as private insurers in the U.S., give them less prominence. Consistency on this front is vital. A recent systematic review of the literature determined that incorporating PROs leads to a broad range of care improvements for people with cancer [53]. Efforts are already underway to identify challenges to the collection, analysis, and application of PRO data to inform regulatory and treatment decision making [54], but further attention to this important area is needed.
Assessing the broader economic impact of therapies on society is also an essential step, as narrow analyses that focus solely on their impact within health systems will inevitably obscure the full value of a treatment. Recent research has shown that the return on investment from the societal benefits of new technologies, therapies, and services that extend the prognosis and QoL of people with non-curative cancers can be substantial [55]. A range of metrics for measuring broader socio-economic value components are available in the literature and are feasible to implement [56], [57]. Taking this broader view may provide direct and indirect long-term healthcare savings by reducing the amount of healthcare spending per patient [58], limiting the time they are less able to contribute to the workforce and their communities [5], [59], and easing the emotional stress and financial strain of employment-related issues for their caregivers.
In addition to socio-economic impact, the experts recommended that the cancer community consider 5 additional value components with particular relevance to patients and society: insurance value, value of choice, scientific spillovers, equity of access, and real option value. While no consensus was reached on how to fully capture these components quantitatively, a qualitative assessment could be undertaken for a given cancer indication with input from patient advocates or people with cancer.
5.2. Next Steps
Collaboration across the cancer community is essential to make further progress on how value is assessed for early-stage cancer treatments. There are many different roles, perspectives, and areas of expertise across the healthcare ecosystem, but the cancer community shares key common goals: to increase health equity and access, improve the experience for people with cancer from diagnosis through treatment, increase survival rates, and ultimately deliver cures. The value principles outlined in this paper provide a resource for assessing and evaluating innovation toward these goals, with the interests of people with cancer at the core.
The principles offer both a) stimulus and reference points for the evolution of value frameworks used to inform regulatory and reimbursement decision-making, and b) key considerations for the development of medicines. Using these principles as starting points, the cancer community can take specific actions together toward the goal of improving access to new medicines for early-stage cancer.
AI statement: The authors made no use of AI for any part of this work.
Conflict of interest statement: H.L., M.L., M.G., J.W., and J.G. were funded by AstraZeneca for this research. A.F., Y.K.G, D-C.S. have no conflicts to report, S.B., R.C., P.S, B.S. received funding by AstraZeneca for this research, J.B., R. K., L.G, received honoraria from multiple pharmaceutical companies, T.S. has undertaken consulting/advisory work for multiple pharmaceutical companies, A-M.B. has received honoraria from Roche and AstraZeneca, and participates in patient councils and advisory boards with proceeds from those going to Lung Cancer Europe (LuCE); J.C. has (1) undertaken consulting/advisory work for: Roche, AstraZeneca, Seattle Genetics, Daiichi Sankyo,Lilly, Merck Sharp&Dohme, Leuko, Bioasis, Clovis Oncology, Boehringer Ingelheim, Ellipses, Hibercell, BioInvent, Gemoab, Gilead, Menarini, Zymeworks, Reveal Genomics, Scorpion Therapeutics, Expres2ion Biotechnologies, Jazz Pharmaceuticals, Abbvie, (2) received honoraria from Roche, Novartis, Eisai, Pfizer, Lilly, Merck Sharp&Dohme, Daiichi Sankyo, Astrazeneca, Gilead, Steamline Therapeutics, (3) received esearch funding to the Institution from Roche, Ariad pharmaceuticals, AstraZeneca, Baxalta GMBH/Servier Affaires, Bayer healthcare, Eisai, F. Hoffman-La Roche, Guardanth health, Merck Sharp&Dohme, Pfizer, Piqur Therapeutics,Iqvia, Queen Mary University of London, and (4) holds stock in MAJ3 and Capital; G.C. has (1) undertaken consulting advisory work for BMS, Roche, Pfizer, Novartis, Lilly, Astra Zeneca, Daichii Sankyo, Merck, Seagen, Ellipsis, Gilead, and (2) received honoraria from Lilly, Pfizer, Relay; G.L. has undertaken consulting advisory work for Sandoz; G1 Therapeutics; Partners Healthcare; BeyondSpring; ER Squibb; MSD; Jazz Pharm; TEVA; Seattle Genetics; Fresenius Kabi; and Samsung (all outside the submitted work); L.P. has received consultancies funding by pharmaceutical companies and owns stocks / options in two of them; G.V. has (1) undertaken consulting/advisory work for AstraZeneca, Roche, Novartis, Pfizer, Seagen, Eisai, Sanofi and (2) received honoraria from Pfizer, Novartis, Eisai; Z.P-W has received grant funding from and/or participated in an advisory board in the last 24 months from the following pharmaceutical companies: AbbVie, Adaptive, Amgen, Autolus, Astellas, AstraZeneca, Bristol-Myers Squibb, CanCell Therapeutics, Daiichi-Sankyo, Gilead, Glycostem, Incyte, INO Therapeutics, Janssen, Jazz, Kura Oncology, Kyowa Kirin, Novartis, Otsuka, Pleco Therapeutics, Pfizer, Roche, Seagen, Servier, Sobi, Takeda and Zambon.
Funding information
This research was funded by AstraZeneca.
CRediT authorship contribution statement
Myrto Lee: Writing – review & editing, Supervision, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization. Hugo Larose: Writing – review & editing, Writing – original draft, Project administration, Methodology, Investigation, Formal analysis, Data curation, Conceptualization, Methodology. Martin Gräbeldinger: Writing – review & editing, Writing – original draft, Data curation. Jon Williams: Supervision, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization, Methodology. Anne-Marie Baird: Writing – review & editing, Validation, Investigation. Susan Brown: Writing – review & editing, Validation, Investigation. Johannes Bruns: Writing – review & editing, Validation, Investigation. Russell Clark: Writing – review & editing, Validation, Investigation. Javier Cortes: Writing – review & editing, Validation, Investigation. Giuseppe Curigliano: Writing – review & editing, Validation, Investigation. Andrea Ferris: Writing – review & editing, Validation, Investigation. Louis P. Garrison: Writing – review & editing, Validation, Investigation. Y.K. Gupta: Writing – review & editing, Validation, Investigation. Ravindran Kanesvaran: Writing – review & editing, Validation, Investigation. Gary Lyman: Writing – review & editing, Validation, Investigation. Luca Pani: Writing – review & editing, Validation, Investigation. Zack Pemberton-Whiteley: Writing – review & editing, Validation, Investigation. Tomas Salmonson: Writing – review & editing, Validation, Investigation. Peter Sawicki: Writing – review & editing, Validation, Investigation. Barry Stein: Writing – review & editing, Validation, Investigation. Dong-Churl Suh: Writing – review & editing, Validation, Investigation. Galina Velikova: Writing – review & editing, Validation, Investigation. Jens Grueger: Methodology, Writing – review & editing, Supervision, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization.
Declaration of competing interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
The authors would like to acknowledge and thank Anni Ding, Aparna Shekar, Annabelle Sherwood, and Ashley Veselik for their support and guidance, and medical writers Cheryl de Jong-Lambert and Paul Scade for their assistance in preparing the manuscript. This research was funded by Astrazeneca.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.hpopen.2024.100116.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
References
- 1.Siegel R.L., Miller K.D., Fuchs H.E., Jemal A. Cancer statistics, 2021. Ca Cancer J Clin. 2021;71(1):7–33. doi: 10.3322/caac.21654. [DOI] [PubMed] [Google Scholar]
- 2.Bosetti C., Bertuccio P., Malvezzi M., Levi F., Chatenoud L., Negri E., et al. Cancer mortality in Europe, 2005–2009, and an overview of trends since 1980. Ann Oncol. 2013;24(10):2657–2671. doi: 10.1093/annonc/mdt301. [DOI] [PubMed] [Google Scholar]
- 3.Canadian Cancer Society. Canadian Cancer Statistics. [Available from: <https://cancer.ca/en/research/cancer-statistics/canadian-cancer-statistics>. Accessed 21 November 2022.
- 4.Loud J.T., Murphy J. Cancer screening and early detection in the 21st century. Semin Oncol Nurs. 2017;33(2):121–128. doi: 10.1016/j.soncn.2017.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.World Health Organization. Early cancer diagnosis saves lives, cuts treatment costs. 2017 [Available from: <https://www.who.int/news/item/03-02-2017-early-cancer-diagnosis-saves-lives-cuts-treatment-costs>. Accessed 22 August 2023.
- 6.US National Cancer Institute. Cancer trends progress report [Available from: <https://progressreport.cancer.gov/diagnosis/stage>. Accessed 22 August 2023.
- 7.Vasan N., Baselga J., Hyman D.M. A view on drug resistance in cancer. Nature. 2019;575(7782):299–309. doi: 10.1038/s41586-019-1730-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.National Institute for Health and Care Excellence (NICE). Annex 7: health technology assessment process [Available from: <https://www.nice.org.uk/Media/Default/About/what-we-do/Life-sciences/evaluation-framework.pdf>. Accessed 22 August 2023.
- 9.ICER. 2020-2023 value assessment framework 2020 [Available from: <https://icer.org/wp-content/uploads/2020/10/ICER_2020_2023_VAF_102220.pdf>. Accessed 22 August 2023.
- 10.Lux M.P., Ciani O., Dunlop W.C., Ferris A., Friedlander M. The impasse on overall survival in oncology reimbursement decision-making: how can we resolve this? Cancer Manag Res. 2021:8457–8471. doi: 10.2147/CMAR.S328058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Zietemann V.D., Schuster T., Duell T.H. Post-study therapy as a source of confounding in survival analysis of first-line studies in patients with advanced non-small-cell lung cancer. J Thorac Dis. 2011;3(2):88. doi: 10.3978/j.issn.2072-1439.2010.12.07. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Saad E., Buyse M. Statistical controversies in clinical research: end points other than overall survival are vital for regulatory approval of anticancer agents. Ann Oncol. 2016;27(3):373–378. doi: 10.1093/annonc/mdv562. [DOI] [PubMed] [Google Scholar]
- 13.Fameli A., Paulsson T., Altimari S., Gutierrez B., Cimen A., Nelsen L., et al. Looking beyond survival data: how should we assess innovation in oncology reimbursement decision making. Values & Outcomes Spotlight. 2023;9.5 S1,:S5–S12. [Google Scholar]
- 14.Bourrée F., Michel P., Salmi L.R. Méthodes de consensus: revue des méthodes originales et de leurs grandes variantes utilisées en santé publique. Rev Epidemiol Sante Publique. 2008;56(6):415–423. doi: 10.1016/j.respe.2008.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kleijnen S., Lipska I., Alves T.L., Meijboom K., Elsada A., Vervölgyi V., et al. Relative effectiveness assessments of oncology medicines for pricing and reimbursement decisions in european countries. Ann Oncol. 2016;27(9):1768–1775. doi: 10.1093/annonc/mdw233. [DOI] [PubMed] [Google Scholar]
- 16.Solà-Morales O., Volmer T., Mantovani L. Perspectives to mitigate payer uncertainty in health technology assessment of novel oncology drugs. J Mark Access Health Policy. 2019;7(1):1562861. doi: 10.1080/20016689.2018.1562861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Brooks N., Campone M., Paddock S., Shortenhaus S., Grainger D., Zummo J., et al. Approving cancer treatments based on endpoints other than overall survival: an analysis of historical data using the PACE continuous innovation INDICATORS™(CII) Drugs in Context. 2017;6 doi: 10.7573/dic.212507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Smith N., Fu A.-C., Fisher T., Meletiche D., Pawar V. Oncology drugs and added benefit: insights from 3 european health technology assessment agencies on the role of efficacy endpoints. J Med Econ. 2022;25(1):1–6. doi: 10.1080/13696998.2021.2009711. [DOI] [PubMed] [Google Scholar]
- 19.Kilickap S., Demirci U., Karadurmus N., Dogan M., Akinci B., Sendur M.A.N. Endpoints in oncology clinical trials. J buon. 2018;23(7):1–6. [PubMed] [Google Scholar]
- 20.European Medicines Agency. The role of the pathological complete response as an endpoint in neoadjuvant breast cancer studies 2014 [Available from: <https://www.ema.europa.eu/en/documents/scientific-guideline/draft-guideline-role-pathological-complete-response-endpoint-neoadjuvant-breast-cancer-studies_en.pdf>. Accessed 22 August 2023.
- 21.Food and Drug Administration. Pathological Complete Response in Neoadjuvant Treatment of High-Risk Early-Stage Breast Cancer: Use as an Endpoint to Support Accelerated Approval Guidance for Industry 2020 [Available from: <https://www.fda.gov/media/83507/download>. Accessed 22 August 2023.
- 22.Said R., Guibert N., Oxnard G.R., Tsimberidou A.M. Circulating tumor DNA analysis in the era of precision oncology. Oncotarget. 2020;11(2):188. doi: 10.18632/oncotarget.27418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Liu B., Hu Z., Ran J., Xie N., Tian C., Tang Y., et al. The circulating tumor DNA (ctDNA) alteration level predicts therapeutic response in metastatic breast cancer: novel prognostic indexes based on ctDNA. Breast. 2022;65:116–123. doi: 10.1016/j.breast.2022.07.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hrebien S., Citi V., Garcia-Murillas I., Cutts R., Fenwick K., Kozarewa I., et al. Early ctDNA dynamics as a surrogate for progression-free survival in advanced breast cancer in the BEECH trial. Ann Oncol. 2019;30(6):945–952. doi: 10.1093/annonc/mdz085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ryu W.K., Oh S., Lim J.H., Lee S.J., Shin H.-T., Ryu J.-S. Monitoring circulating tumor DNA in untreated non-small-cell lung cancer patients. Int J Mol Sci. 2022;23(17):9527. doi: 10.3390/ijms23179527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zografos E., Dimitrakopoulos F.-I., Koutras A. Prognostic value of circulating tumor DNA (ctDNA) in oncogene-driven NSCLC: current knowledge and future perspectives. Cancers. 2022;14(19):4954. doi: 10.3390/cancers14194954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Frank M.S., Andersen C.S., Ahlborn L.B., Pallisgaard N., Bodtger U., Gehl J. Circulating tumor DNA monitoring reveals molecular progression before radiologic progression in a real-life cohort of patients with advanced non–small cell lung cancer. Cancer research communications. 2022;2(10):1174–1187. doi: 10.1158/2767-9764.CRC-22-0258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pauwels K., Huys I., Vogler S., Casteels M., Simoens S. Managed entry agreements for oncology drugs: lessons from the european experience to inform the future. Front Pharmacol. 2017;8:171. doi: 10.3389/fphar.2017.00171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gemeinsamer Bundesausschuss. Anwendungsbegleitende Datenerhebung bei neuen Arzneimitteln [Available from: https://www.g-ba.de/themen/arzneimittel/arzneimittel-richtlinie-anlagen/anwendungsbegleitende-datenerhebung/. Accessed 7 February 2024.
- 30.Services CfMM. Coverage with Evidence Development [Available from: https://www.cms.gov/medicare/coverage/evidence. Accessed 7 February 2024.
- 31.Walker S., Sculpher M., Claxton K., Palmer S. Coverage with evidence development, only in research, risk sharing, or patient access scheme? a framework for coverage decisions. Value Health. 2012;15(3):570–579. doi: 10.1016/j.jval.2011.12.013. [DOI] [PubMed] [Google Scholar]
- 32.Xoxi E., Facey K.M., Cicchetti A. The evolution of AIFA registries to support managed entry agreements for orphan medicinal products in Italy. Front Pharmacol. 2021;12 doi: 10.3389/fphar.2021.699466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Garrison L.P., Jr, Towse A., Briggs A., de Pouvourville G., Grueger J., Mohr P.E., et al. Performance-based risk-sharing arrangements—good practices for design, implementation, and evaluation: report of the ISPOR good practices for performance-based risk-sharing arrangements task force. Value Health. 2013;16(5):703–719. doi: 10.1016/j.jval.2013.04.011. [DOI] [PubMed] [Google Scholar]
- 34.Yuasa A., Yonemoto N., Demiya S., Foellscher C., Ikeda S. Investigation of factors considered by health technology assessment agencies in eight countries. PharmacoEconomics-Open. 2021;5:57–69. doi: 10.1007/s41669-020-00235-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.ISPOR. Value Assessment Frameworks [Available from: <https://www.ispor.org/strategic-initiatives/value-assessment-frameworks>. Accessed 22 August 2023.
- 36.Neumann P.J., Willke R.J., Garrison L.P., Jr A health economics approach to US value assessment frameworks—introduction: an ISPOR special task force report [1] Value Health. 2018;21(2):119–123. doi: 10.1016/j.jval.2017.12.012. [DOI] [PubMed] [Google Scholar]
- 37.Garrison L. Novel elements of the value flower: fake or truly novel? Signal. 2021;01 [Google Scholar]
- 38.National Institutes of Health. Transformative Research to Address Health Disparities and Advance Health Equity [Available from: <https://commonfund.nih.gov/healthdisparitiestransformation>. Accessed 22 August 2023.
- 39.Li M., Basu A., Bennette C.S., Veenstra D.L., Garrison L.P. Do cancer treatments have option value? real-world evidence from metastatic melanoma. Health Econ. 2019;28(7):855–867. doi: 10.1002/hec.3899. [DOI] [PubMed] [Google Scholar]
- 40.European Medicines Agency. Committee for Medicinal Products for Human Use (CHMP) Guideline on the Clinical Evaluation of Anticancer Medicinal Products 2019 [Available from: <https://www.ema.europa.eu/en/documents/scientific-guideline/draft-guideline-evaluation-anticancer-medicinal-products-man-revision-6_en.pdf>. Accessed 22 August 2023.
- 41.Gion M., Pérez-García J.M., Llombart-Cussac A., Sampayo-Cordero M., Cortés J., Malfettone A. Surrogate endpoints for early-stage breast cancer: a review of the state of the art, controversies, and future prospects. Therapeutic advances in medical oncology. 2021;13 doi: 10.1177/17588359211059587. 17588359211059587. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Houssami N., Macaskill P., von Minckwitz G., Marinovich M.L., Mamounas E. Meta-analysis of the association of breast cancer subtype and pathologic complete response to neoadjuvant chemotherapy. Eur J Cancer. 2012;48(18):3342–3354. doi: 10.1016/j.ejca.2012.05.023. [DOI] [PubMed] [Google Scholar]
- 43.Friends of Cancer Research. Assessing the Use of ctDNA as an Early Endpoint in Early-Stage Disease. Friends of Cancer Research Annual Meeting 2021 2021 [Available from: <https://friendsofcancerresearch.org/wp-content/uploads/Assessing_Use_of_ctDNA_Early_Endpoint_Early-Stage_Disease.pdf>. Accessed 22 August 2023.
- 44.Food and Drug Administration. Use of Circulating Tumor DNA for Early-Stage Solid Tumor Drug Development Guidance for Industry (Draft Guidance) 2022 [Available from: <https://www.fda.gov/media/158072/download>. Accessed 22 August 2023.
- 45.Haute autorité de santé. Autorisation d’accès Précoce Aux Médicaments : Doctrine d’évaluation de La HAS 2021 [Available from: <https://www.has-sante.fr/upload/docs/application/pdf/2021-06/acces_precoces_-_doctrine.pdf >. Accessed 22 August 2023.
- 46.NHS. Cancer Drugs Fund [Available from: <https://www.england.nhs.uk/cancer/cdf/> Accessed 22 August 2023.
- 47.NHS. Apply for the early access to medicines scheme (EAMS) 2014 [Available from: <https://www.gov.uk/guidance/apply-for-the-early-access-to-medicines-scheme-eams>. Accessed 22 August 2023.
- 48.Hasson F., Keeney S. Enhancing rigour in the Delphi technique research. Technol Forecast Soc Chang. 2011;78(9):1695–1704. [Google Scholar]
- 49.Lakdawalla D.N., Doshi J.A., Garrison L.P., Jr, Phelps C.E., Basu A., Danzon P.M. Defining elements of value in health care—a health economics approach: an ISPOR special task force report [3] Value Health. 2018;21(2):131–139. doi: 10.1016/j.jval.2017.12.007. [DOI] [PubMed] [Google Scholar]
- 50.Schnipper L.E., Davidson N.E., Wollins D.S., Blayney D.W., Dicker A.P., Ganz P.A., et al. Updating the American Society of Clinical Oncology value framework: revisions and reflections in response to comments received. J Clin Oncol. 2016;34(24):2925–2934. doi: 10.1200/JCO.2016.68.2518. [DOI] [PubMed] [Google Scholar]
- 51.ESMO. ESMO: Magnitude of clinical benefit scale [Available from: <https://www.esmo.org/guidelines/esmo-mcbs>. Accessed 22 August 2023.
- 52.The Council on Quality and Leadership. CMS Includes CQL’s Personal Outcome Measures® In HCBS Quality Measure Set 2022 [Available from: <https://www.c-q-l.org/resources/articles/cms-includes-cqls-personal-outcome-measures-in-hcbs-quality-measure-set/>. Accessed 22 August 2023.
- 53.Silveira A., Sequeira T., Gonçalves J., Lopes F.P. Patient reported outcomes in oncology: changing perspectives—a systematic review. Health Qual Life Outcomes. 2022;20(1):82. doi: 10.1186/s12955-022-01987-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Coens C., Pe M., Dueck A.C., Sloan J., Basch E., Calvert M., et al. International standards for the analysis of quality-of-life and patient-reported outcome endpoints in cancer randomised controlled trials: recommendations of the SISAQOL consortium. Lancet Oncol. 2020;21(2):e83–e96. doi: 10.1016/S1470-2045(19)30790-9. [DOI] [PubMed] [Google Scholar]
- 55.Rare Cancers Australia and CanTeen. Counting the Cost 2022 [Available from: <https://www.canteen.org.au/sites/default/files/2022-09/RCA4279_Counting_the_Cost_Report_FINAL.pdf>. Accessed 22 August 2023.
- 56.EuroQol Group. EQ-5D-5L [Available from: <https://euroqol.org/eq-5d-instruments/eq-5d-5l-about/>. Accessed 22 August 2023.
- 57.Angelis A., Linch M., Montibeller G., Molina-Lopez T., Zawada A., Orzel K., et al. Multiple criteria decision analysis for HTA across four EU member states: piloting the advance value framework. Soc Sci Med. 2020;246 doi: 10.1016/j.socscimed.2019.112595. [DOI] [PubMed] [Google Scholar]
- 58.Kakushadze Z., Raghubanshi R., Yu W. Estimating cost savings from early cancer diagnosis. Data. 2017;2(3):30. [Google Scholar]
- 59.Hofmarcher T., Lindgren P., Wilking N., Jönsson B. The cost of cancer in Europe 2018. Eur J Cancer. 2020;129:41–49. doi: 10.1016/j.ejca.2020.01.011. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.




