Skip to main content
JCO Clinical Cancer Informatics logoLink to JCO Clinical Cancer Informatics
. 2020 Aug 27;4:CCI.19.00103. doi: 10.1200/CCI.19.00103

Patient-Centered Approach to Benefit–Risk Characterization Using Number Needed to Benefit and Number Needed to Harm: Advanced Non–Small-Cell Lung Cancer

Gokaraju K Raju 1,2,✉, Sean Khozin 3, Karthik Gurumurthi 1, Reuben Domike 1,4, Janet Woodcock 3
PMCID: PMC7469613  PMID: 32853030

Abstract

This work summarizes the benefit and risk of the results of clinical trials submitted to the US Food and Drug Administration of therapies for the treatment of non–small cell lung cancer (NSCLC) using number needed to benefit (NNB) and number needed to harm (NNH) metrics. NNB and NNH metrics have been reported as potentially being more patient centric and more intuitive to medical practitioners than more common metrics, such as the hazard ratio, and valuable to medical practitioners in complementing other metrics, such as the median time to event. This approach involved the characterization of efficacy and safety results in terms of NNB and NNH of 30 clinical trials in advanced NSCLC supporting US Food and Drug Administration approval decisions from 2003 to 2017. We assessed trends of NNB over time of treatment (eg, for programmed death 1 inhibitors) and variation of NNB across subpopulations (eg, characterized by epidermal growth factor receptor mutation, programmed death ligand 1 expression, Eastern Cooperative Oncology Group performance status, age, and extent of disease progression). Furthermore, the evolution of NNB of treatments for advanced NSCLC was charted from 2003 to 2017. Across subpopulations, NNB, on average, was 4 patients for approved targeted therapies in molecularly enriched populations, 11 patients for approved therapies in nonmolecularly enriched populations, and 23 patients for withdrawn or unapproved therapies. Furthermore, the NNB analysis showed variation for attributes of epidermal growth factor receptor mutations, level of programmed death 1 expression, Eastern Cooperative Oncology Group performance status, etc. When considering the best-case subpopulations and available drugs, the NNB frontier reduced from an estimated value of 7.7 in 2003 to an estimated value of 2.5 in 2017 at the estimated median overall survival—equal to 6 months—of an untreated patient.

INTRODUCTION

There were an estimated 538,243 people living with lung and bronchus cancer in the United States in 2016.1 An estimated 228,150 new cases and 142,690 deaths related to lung and bronchus cancer are likely to occur in the United States in 2019.1 Approximately 80% to 85% of lung cancers are non–small-cell lung cancers (NSCLCs).2

CONTEXT

  • Key Objective

  • To quantify the benefit and risk of non–small-cell lung cancer (NSCLC) therapies in a manner that has the potential to be patient centric and intuitive to clinicians while complementing previously reported metrics, such as overall survival, progression-free survival, and objective response rate. The quantification was demonstrated using estimates of the number needed to benefit (NNB) and the number needed to harm (NNH) on the basis of recent clinical trial results for NSCLC therapies.

  • Knowledge Generated

  • The results of this work suggest differences in estimated NNB according to therapy type. Notable improvements in NNB over the temporal history of NSCLC therapies were observed, particularly in the more recent clinical trial results of targeted therapies.

  • Relevance

  • The NNB and NNH metrics used to assess the clinical trial data have the potential to enhance patient-centric understanding of the benefit and risk of treatments and to further inform treatment decisions.

The prognosis for patients with NSCLC varies by the stage of disease at diagnosis. The 5-year relative survival rates of patients with stage IVA and IVB NSCLC are 10% and 1%, respectively.2 Since the beginning of the 21st century, several treatment options have become available for NSCLC, for multiple types of patients (eg, nonsquamous, squamous, with genetic driver mutations, etc), with various mechanisms of action (eg, epidermal growth factor receptor [EGFR] inhibitors, ALK inhibitors, VEGF inhibitors, programmed death 1 [PD-1] inhibitors, etc), and over various lines of therapy. With the advent of targeted therapies, the prognosis for patients with advanced NSCLC has improved significantly from 2003 to 2014. In 2003, estimated median overall survival (OS) of patients—no subpopulations segregated—with NSCLC who were treated with chemotherapy was 10 months (vinorelbine plus cisplatin, control in cetuximab FLEX study).3 In 2014, median OS of previously untreated EGFR mutation +ve patients who were treated with erlotinib was estimated to be 23 months.4

There are advantages to shared decision making about treatments by patients and doctors and taking a patient-centered approach—that is, taking into account the patient’s history, genotype, prior treatments, preexisting conditions, state of disease, etc.5 This complex decision making can be facilitated by presenting knowledge in an intuitive manner to patients about the benefit and risk of various drugs learned from clinical trials.

US Food and Drug Administration (FDA) regulatory approval decisions are intended to be based on the evaluation of the benefit and risk of therapies.6,7 As part of the Prescription Drug User Fee Act and the US Food and Drug Administration Safety and Innovation Act,6 the FDA committed to implement a structured benefit–risk approach in assessments of new drug applications and biologic license applications.8,9

Assessment of the approvability of oncologic drugs typically relies on the following: clinical trial end points, such as objective response rate (ORR), progression-free survival (PFS), and OS (the benefits); and rates and types of adverse events, such as fatalities, nonfatal serious, and common adverse events potentially attributable to the drug product (the risks). Time-to-event metrics, such as PFS and OS, are characterized in terms of hazard ratio (HR) and median time-to-event metrics—for example, median PFS and median OS. Metrics that are closely related to HR are relative risk reduction and absolute risk reduction (ARR). The limitations of ARR are discussed in Cook et al,10 with similar limitations for relative risk reduction. These limitations include the potential nonintuitiveness to patients and health care practitioners, given the probabilistic nature of these metrics. This work analyzes the benefit and risk of drug clinical trials using metrics11,12 that have been reported to be potentially more patient centric and more intuitive to medical practitioners than metrics, such as HR, and potentially valuable to medical practitioners in complementing other metrics, such as ORR, median PFS, and median OS. We used number needed to benefit (NNB) and number needed to harm (NNH) metrics and applied them to the clinical trial results of new drug applications recently submitted to the FDA for the treatment advanced NSCLC. Additional information on the context and calculations of the number needed to treat (NNT), NNB, and NNH is provided in the Data Supplement. Health technology assessments of drug products typically involve the estimation of quality-adjusted life years gained as a result of the drug product compared with a standard of care or control of a randomized clinical trial. Limitations of the quality-adjusted life years–based approach, from ethical, methodologic, and context-specific perspectives, are well documented (eg, Pettitt et al13).

In prior work, a quantitative benefit–risk analysis approach, building on the FDA’s qualitative approach, was described14 and used for analysis of regulatory decision making in new drug applications and biologic license applications for the treatment of patients with NSCLC,15 multiple myeloma,16 and melanoma.17 This approach mapped the FDA’s characterization of the efficacy in terms of clinical end points, such as ORR, PFS, and OS, and characterization of safety in terms of fatal, nonfatal, and common adverse events to area under the quality-of-life curve. Benefit was expressed in terms of median OS and PFS, and risk as a summation of the product of seriousness and probability of a patient dying or undergoing nonfatal serious adverse events or only common adverse events. The seriousness of each of the above categories—fatal, nonfatal serious, and common adverse events—of risk was an estimate of the area under the quality-of-life curve lost by the corresponding patient.14

This work quantifies benefit and risk of drug products in terms of the NNT metric, specifically NNB and NNH. Furthermore, it uses the NNT metric to capture the evolution of benefit and risk of drug products for NSCLC since the beginning of the 21st century.

METHODS

Candidate Treatments and Regulatory Decisions

A major focus of this work was to develop an understanding of the extent to which NNB and NNH analyses align with recent decisions made by the FDA regarding new drugs to treat NSCLC. This analysis was based on publicly available details of selected clinical trials, the results of which were published between 2003 and 2017 and which formed a basis for the assessment of the approval of drug products for NSCLC by the FDA. Thirty trials were identified as detailed and shown in the Data Supplement. These trials were selected to include drug products belonging to a variety of therapeutic classes (eg, chemotherapy and targeted therapies, including EGFR inhibitors, ALK inhibitors, PD-1 inhibitors, VEGF inhibitors, etc); populations who were molecularly enriched or otherwise; various lines of therapies; various primary end points (eg, ORR, PFS, and/or OS); and regulatory statuses (eg, accelerated approval, regular approval, withdrawn submissions, etc). Clinical trial information was available either within the FDA Medical Reviews18-27 or in journal publications.3,4,28-51

NNT, NNB, and NNH

NNT is the expected number of patients who have to be treated to prevent one additional event—for example, death, serious adverse event, etc.10-12 NNT is the reciprocal of ARR. ARR, in the context of a randomized clinical trial, is the difference between the probabilities of the occurrence of the event of interest—for example, death, serious adverse event, etc—in the experimental drug arm and control arm.

When the event of interest is considered to be a benefit to the patient—for example, a patient surviving in a clinical trial arm beyond a given time point—the NNT is the NNB, which is the reciprocal of the difference between the probabilities of the patient surviving beyond the given time point in the experimental drug arm and control arm. When the event of interest is considered to be a harm to the patient—for example, a patient undergoing a serious adverse event during the clinical trial—the NNT is the NNH, which is the reciprocal of the difference between the probabilities of the patient undergoing a serious adverse event in the experimental drug arm and control arm.12 Additional information on the context and calculations of NNT, NNB, and NNH is provided in the Data Supplement.

Assessing the Impact of the Evolution of NSCLC Treatments on Clinical Outcomes for Patients With NSCLC

The period from 2003 onward has seen the approval of a number of therapies targeted to various types of NSCLC—for example, EGFR+ve, ALK+ve, BRAF+ve, PD ligand 1+ve, etc. Clinical trial results (summarized in the Data Supplement) show that these therapies have demonstrated substantial improvements in efficacy over chemotherapy. In this work, we try to assess the impact of the above developments in the treatment of NSCLC on clinical outcomes for patients with NSCLC. Specifically, we try to capture the impact on clinical outcomes for patients who are newly diagnosed with NSCLC and expected to experience progression through multiple lines of therapy. We do this using two approaches for patients newly diagnosed with some form of NSCLC: by estimating the growth in median OS over time, and by estimating the reduction in NNB—compared with an untreated patient—over time. The approach to estimating the growth in median OS over time for a newly diagnosed patient has been described in prior work,16,17 and its application to NSCLC is discussed below in Evolution of Estimated Median OS and Corresponding NNB of NSCLC Therapies. The approach to estimate the reduction in NNB—compared with an untreated patient—over time is discussed below.

An NNB frontier, with respect to a given treatment alternative—for example, targeted therapy, chemotherapy, or placebo—for a set of treatments is the lowest estimated NNB from among the treatments within the set. The set of treatments for which the frontier NNB is calculated can be selected in many ways—for example, on the basis of subpopulation of patients (eg, EGFR+ve NSCLC), line of therapy (eg, first, second, third line of therapy, etc), or available treatments at a given point in time (eg, available first-line treatments for NSCLC in the year 2005, etc). In this work, we estimate the frontier NNB for patients with newly diagnosed NSCLC at various time points. The frontier NNB, with respect to an untreated patient, for a patient with newly diagnosed NSCLC at a given point in time can be estimated in the following ways: on the basis of an estimated median OS of various treatments at various lines of therapy, as discussed and illustrated below in Evolution of Estimated Median OS and Corresponding NNB of NSCLC Therapies, or on the basis of HRs of various treatments in various lines of therapy, as discussed and illustrated in the Data Supplement. Thus, we define the NNB frontier for a given year as the best possible NNB over an untreated patient—possibly of a targeted subpopulation—aggregated over all lines of therapy in the given year. We chart the evolution of NNB over multiple years (2003 to 2017) as the reduction in the NNB frontier over the given years. The NNB frontier for the baseline year (2003) is the NNB of chemotherapy over an untreated patient in the baseline year. Aggregation of NNB over lines of therapy is based on compounding of HRs of event-free survival—PFS or OS—at the median OS of the untreated patient (50% surviving untreated patients). The NNB frontier would shift lower if it is calculated at a lower percentile—lower than the 50th percentile—of event-free survival of an untreated patient. The NNB frontier is calculated at 2 levels: stratified by types of patients (eg, EGFR+ve, ALK+ve, BRAF+ve, squamous cell, etc), and regardless of patient type. The latter is calculated as the lower bound of all patient types for each year in the horizon of analysis (2003 to 2017). Formulas for estimating the NNB frontier over time are given in the Data Supplement.

RESULTS

NNB and NNH for Selected Trials

The estimated NNB and NNH as described in the approach, associated with each of the NSCLC drugs along with their CIs, are listed in Table 1. A graphical representation of the NNB and NNH associated with NSCLC drugs is shown in Figure 1. For each clinical trial, the NNB computed based on the ORR reported could be different from that computed based on the PFS reported, which, in turn, could be different from the NNB computed based on the OS reported. Any such difference could be a result of various factors, including patients discontinuing clinical trial, deaths from disease progression or toxicity, crossover, and subsequent treatments. Figure 2 shows the NNB and NNH of selected clinical trials grouped by therapeutic class of the drug product and molecular enrichment of the patient population. It can be seen that NNB is:

TABLE 1.

Summary of NNB and NNH for Selected Clinical Trials (see the Data Supplement for the number of patients taken into account for NNB and NNH estimation)

graphic file with name CCI.19.00103t1.jpg

FIG 1.

FIG 1.

(A) Number needed to benefit (NNB) of selected clinical trials (first line). (B) NNB of selected clinical trials (non–first line). (C) Number needed to harm (NNH) of nonfatal serious adverse events of selected clinical trials (first line). (D) NNH of nonfatal serious adverse events of selected clinical trials (non–first line). ORR, objective response rate; OS, overall survival; PFS, progression-free survival.

FIG 2.

FIG 2.

(A) Number needed to benefit (NNB) of selected clinical trials grouped by therapeutic class of the experimental drug and molecular enrichment (Mol. Enr.) of patient populations (and within each group ordered chronologically by the date of publication; first line). (B) NNB of selected clinical trials grouped by therapeutic class of the experimental drug and molecular enrichment of patient populations (and within each group ordered chronologically by the date of publication; non–first line). (C) Number needed to harm (NNH) of nonfatal serious adverse events of selected clinical trials grouped by therapeutic class of the experimental drug and molecular enrichment of patient populations (first line). (D) NNH of nonfatal serious adverse events of selected clinical trials grouped by therapeutic class of the experimental drug and molecular enrichment of patient populations (non–first line). ALK, anaplastic lymphoma kinase; EGFR, epidermal growth factor receptor; ORR, objective response rate; OS, overall survival; PD-1, programmed death 1; PFS, progression-free survival.

  • Relatively low for approved targeted therapies in molecularly enriched patient populations (eg, dabrafenib plus trametinib in BRAF mutation+ve patients; crizotinib, ceritinib, and alectinib in ALK+ve patients; erlotinib and afatinib in EGFR+ve patients; and pembrolizumab in PD ligand 1+ve patients), and higher for approved therapies in nonmolecularly enriched populations (eg, erlotinib, atezolizumab, nivolumab, necitumumab, bevacizumab, and pemetrexed)

  • Highest for therapies for which the submissions were withdrawn or not approved (eg, cetuximab and gefitinib for non–first line use)

Also, it can be seen that NNH is relatively small with a negative sign—better than control—for approved targeted therapies in molecularly enriched populations.

NNB Analysis Over Time and Subpopulations

NNB analyses over time for selected trials are shown in Figure 3. It can be seen that:

FIG 3.

FIG 3.

(A) Number needed to benefit (NNB) over time and epidermal growth factor receptor (EGFR) mutations subpopulations stratified by the presence of EGFR mutations in the gefitinib IPASS trial.30 (B) NNB over time and subpopulations in the nivolumab CheckMate 057 trial41 stratified by programmed death ligand 1 (PD-L1) expression. (C) NNB over time and subpopulations in the crizotinib 1007 trial36 stratified by the presence of brain metastasis. (D) NNB over time and subpopulations in the crizotinib 1007 trial36 stratified by the Eastern Cooperative Oncology Group performance status (ECOG PS). OS, overall survival; PFS, progression-free survival.

  • The overall NNB over time for gefitinib in the IPASS trial30 (Fig 3A) is a superposition of the negative NNB over time for EGFR−ve patients and positive NNB over time for EGFR+ve patients.

  • Patients with PD-1 expression of 10% or greater in the Checkmate 057 trial41 of nivolumab (Fig 3B) benefit early from treatment compared with patients with PD-1 expression of less than 10%.

  • Patients with brain metastasis have a lower NNB compared with patients with no brain metastasis in the crizotinib 1007 trial36 (Fig 3C).

  • Patients with ECOG performance status of 2 have a lower NNB compared with patients with ECOG performance status of less than 2 in the crizotnib 1007 trial36 (Fig 3D).

In Figures 3A and 3B, the points at which the NNB curve crosses the time axis correspond to the time points when the corresponding Kaplan-Meier curves are estimated to cross each other. NNB analysis for subpopulations in the nivolumab Checkmate 057 trial41 (Fig 4A), the alectinib ALEX trial49 (Fig 4B), and the afatinib LUX-Lung 8 trial42 (Fig 4C) indicate that, generally, the point estimate of NNB is lower for patients with lower ECOG performance status. An exception to this general observation is seen in crizotinib 1007 trial36 (Fig 3D)—that is, the apparent lower NNB of crizotinib over chemotherapy for patients with higher ECOG performance status could be a result of their lower tolerance to the toxicity of chemotherapy. This possibility is supported by the higher NNB for higher ECOG performance status in trials in which the experimental drug and control were both considered to be relatively toxic, as in the nivolumab trial Checkmate 05741 (Fig 4A), or relatively less toxic, as in the alectinib ALEX trial49 (Fig 4B) and the afatinib LUX-Lung 8 trial42 (Fig 4C).

FIG 4.

FIG 4.

(A) Number needed to benefit (NNB) over subpopulations in the nivolumab CheckMate 057 trial41 stratified by Eastern Cooperative Oncology Group performance status (ECOG PS). (B) NNB over subpopulations in the alectinib ALEX trial49 stratified by ECOG PS. (C) NNB over subpopulations in the afatinib LUX LUNG 8 trial42 stratified by ECOG PS. OS, overall survival; PFS, progression-free survival.

Evolution of Estimated Median OS and Corresponding NNB of NSCLC Therapies

Figure 5A shows the evolution of the estimated median OS of NSCLC treatments from 2003 to 2017 for various patient types. The thick dark blue line in Figure 5A—labeled Overall—shows the evolution of the highest estimated median OS of NSCLC treatments among all types of patients considered. Figure 5B shows the evolution of the NNB frontier for NSCLC treatments from 2003 to 2017 for various patient types. The thick dark blue line in Figure 5B shows the evolution of the overall NNB frontier—that is, the best NNB across all types of patients considered—for NSCLC treatments.

FIG 5.

FIG 5.

(A) Evolution of estimated median overall survival (OS) of non–small-cell lung cancer (NSCLC) drug products. (B) Evolution of number needed to benefit (NNB; estimated on the basis of median OS) of NSCLC drug products. FL, first line.

To estimate median OS, the approach and ORR–OS and PFS–OS correlations used are the same as in previous work.15 In Figure 5A, the evolution of the estimated median OS of NSCLC treatments for each patient type is calculated as in previous work.16,17

The frontier median OS—highest estimated median OS—among all types of patients considered (shown by the thick dark blue line in Fig 5A) is the maximum of the estimated frontier median OS of all patient types considered in each year. For example, the estimated frontier median OS in 2017 is 39.7 months, corresponding to the EGFR+ve patient type, which is higher than that of the other patient types considered (37.9 months in ALK+ve patients, and 23.2 months in BRAF+ve, nonsquamous, nondriver mutation, and patients with squamous NSCLC).

Figure 5B shows the evolution of the NNB frontier for each patient type derived from the corresponding median OS frontier shown in Figure 5A. The NNB frontier for each year is derived from the median OS frontier for the same year by comparing the frontier median OS with the median OS of an untreated patient—estimated as 6 months.52 The HR corresponding to the frontier median OS in each year to that of an untreated patient is estimated as the median OS of untreated patient/frontier median OS. The corresponding NNB—termed the frontier NNB for the given year—is then derived from the HR of the frontier treatment with respect to an untreated patient using the formula NNB = 1/(0.5HR − 0.5), as previously discussed in Methods. For example, in 2017, the estimated HR corresponding to the frontier median OS of 39.7 months = 6/39.7 = 0.15. The corresponding frontier NNB is estimated as = 1(0.50.15 − 0.5) = 2.5 patients. Similarly, the frontier NNB for each year in Figure 5B is calculated from the frontier median OS shown in Figure 5A for the corresponding year.

The evolution of the NNB frontier has also been estimated using an approach of compounding HRs over lines of therapy and time, as discussed and illustrated for EGFR+ve patients in the Data Supplement. The Data Supplement discusses the evolution of the NNB frontier estimated using the approach of compounding HRs for the types of patients considered in Figure 4A. The Data Supplement also shows the evolution of NNB frontiers estimated using the approach of compounding HRs over all types of patients considered. The Data Supplement shows the potential treatment sequences for various types of patients—for example, as in Doroshow et al53—over time. The Data Supplement shows the year-by-year NNB frontier for EGFR+ve patients estimated using the approach of compounding HRs.

It can be seen in Figure 5A that the frontier median OS has increased from 9 months in 2003 to 39.7 months in 2017, and Figure 5B that the frontier NNB has reduced from 7.7 patients in 2003 to approximately 2.5 patients in 2017 for patients with NSCLC for the most advanced frontier of any patient type. This improvement is partially correlated with the advent of targeted therapies administered to molecularly enriched populations.

DISCUSSION

Whereas HR is extensively used to assess the approvability of oncologic therapies, it might not be intuitive to patients and health care professionals trying to make decisions in a clinical setting.10 NNB and NNH are metrics that may be intuitive complements to HR. Moreover, the NNT metric, as it is a function of the absolute reduction of risk, is reflective of the clinical importance of a probability of a specific event—for example, death or nonfatal serious adverse event.10 As the NNB metric on the basis of time-to-event metrics draws on the same common source of data—Kaplan-Meier curves of OS or PFS—as such metrics as HR or median OS or PFS, NNB can be expected to be largely consistent with HR or median OS or median PFS in assessing the benefit of the experimental drug product over the control.

The analysis in this work shows that NNB and NNH for the selected trials are consistent with the regulatory decisions that are based on these trials. Thus, the communication of clinical trial results and drug product approvability decisions in terms of NNB and NNH, in addition to currently used metrics, such as HR, might enable better communication of the results of clinical trials in practice.

In this work, NNT has been computed for trials with various scenarios: primary end points, therapeutic classes of drug products, lines of therapy, and regulatory statuses of drug products. Whereas in those scenarios—for example, primary end point, line of therapy, etc—NNT provides a quantitative metric of how much better the experimental drug is compared with the control, NNTs might not be comparable across the scenarios. For example, the NNT for OS for a product could be different from the NNT for PFS and the NNT for ORR for a product in the same clinical trial. Therefore, the purpose of NNT estimation—for example, selection of a therapy in a clinical setting—has to be taken into account while assessing the comparability of NNT estimates from various scenarios.

As baseline risk—for example, the proportion of patients who die as a result of the disease at a given point in time since the start of treatment—reduces, the maximum potential ARR also reduces—as the maximum value of ARR is no more than the baseline risk—and, therefore, minimum potential NNT tends to increase. Thus, for relatively small baseline risk, minimum potential NNT tends to be relatively large. For example, if the baseline risk of fatality is 1%, then the maximum potential ARR is 1% and the minimum potential NNT is 100. This property of NNT makes the NNT metric less sensitive to improvements in relative risk—for example, if the risk in the experimental drug arm is 0.5%, then the improvement in relative risk is 50%, whereas ARR is only 0.5%; however, this same property of NNT is also considered to be advantageous when trading the benefit of treatment against the risk of toxicity for small values of baseline risk.10

As ARR tends to zero, NNT becomes high—tends to infinity—and CI for NNT tends to become wide. This could be interpreted in terms of NNT as the less effective a drug product is compared with its control, the less the certainty that the product is more effective compared with the control.

With regard to the use of NNT for statistical inference, for the case in which NNT is calculated on the basis of the difference in ORR (as described in the Data Supplement), if the difference in ORR is statistically significant—that is, the lower CI of the difference in ORRs is not opposite in sign to the upper CI—then the corresponding NNT is also statistically significant. Similarly, for the case in which NNT is calculated on the basis of HR for time-to-event metrics, such as PFS or OS (as described in the Data Supplement), if the ARR for a given point in time—for example, median PFS or OS in the control arm—estimated on the basis of HR is statistically significant, then the corresponding NNT is also statistically significant.

Despite the limitations discussed above, reporting of clinical trial results including NNT could further enable patient-centric, shared decision making by doctors and patients about treatment options, taking into account the performance of drug products in clinical trials, subpopulation effects on drug product performance, variation of drug product performance over time of treatment administration, and the specific attributes of the patient being treated.

SUPPORT

Funded in part by the US Food and Drug Administration.

AUTHOR CONTRIBUTIONS

Conception and design: All authors

Administrative support: Janet Woodcock

Financial support: Janet Woodcock

Collection and assembly of data: Gokaraju K. Raju, Sean Khozin, Karthik Gurumurthi, Reuben Domike

Data analysis and interpretation: All authors

Manuscript writing: All authors

Final approval of manuscript: All authors

Accountable for all aspects of the work: All authors

AUTHORS' DISCLOSURES OF POTENTIAL CONFLICTS OF INTEREST

The following represents disclosure information provided by authors of this manuscript. All relationships are considered compensated unless otherwise noted. Relationships are self-held unless noted. I = Immediate Family Member, Inst = My Institution. Relationships may not relate to the subject matter of this manuscript. For more information about ASCO's conflict of interest policy, please refer to www.asco.org/rwcorascopubs.org/cci/author-center.

Open Payments is a public database containing information reported by companies about payments made to US-licensed physicians (Open Payments).

Gokaraju K. Raju

Consulting or Advisory Role: Pfizer (Inst), Sun Pharma (Inst)

Sean Khozin

Employment: Johnson & Johnson

Leadership: Johnson & Johnson

Stock and Other Ownership Interests: Johnson & Johnson

Travel, Accommodations, Expenses: Johnson & Johnson

No other potential conflicts of interest were reported.

REFERENCES

  • 1.National Cancer Institute Cancer stat facts: Lung and bronchus cancer. https://seer.cancer.gov/statfacts/html/lungb.html
  • 2.American Cancer Society Non-small cell lung cancer. https://www.cancer.org/cancer/non-small-cell-lung-cancer.html
  • 3.Pirker R, Pereira JR, Szczesna A, et al. Cetuximab plus chemotherapy in patients with advanced non-small-cell lung cancer (FLEX): An open-label randomised phase III trial. Lancet. 2009;373:1525–1531. doi: 10.1016/S0140-6736(09)60569-9. [DOI] [PubMed] [Google Scholar]
  • 4.Leon LF, Golsorkhi A, Liu S, et al. Overall survival analyses of first-line erlotinib versus chemotherapy in the EURTAC study population controlling for the use of post-study therapy. Ann Oncol. 2014;25(suppl 4; abstr 1273P):iv447. [Google Scholar]
  • 5.US Congress 21st Century Cures Act. 114th Congress (2015–2016) www.congress.gov/bill/114th-congress/house-bill/6/text
  • 6.Frey P. Benefit-Risk Framework. Silver Spring, MD: US Food and Drug Administration; 2012. [Google Scholar]
  • 7.US Food and Drug Administration Structured approach to benefit-risk assessment in drug regulatory decision-making. https://www.fda.gov/media/84831/download
  • 8.Morris SA, Rosenblatt M, Orloff JJ, et al. The PCAST report: Impact and implications for the pharmaceutical industry. Clin Pharmacol Ther. 2013;94:300–302. doi: 10.1038/clpt.2013.93. [DOI] [PubMed] [Google Scholar]
  • 9.Woodcock J. The PCAST report on pharmaceutical innovation: Implications for the FDA. Clin Pharmacol Ther. 2013;94:297–300. doi: 10.1038/clpt.2013.88. [DOI] [PubMed] [Google Scholar]
  • 10.Cook RJ, Sackett DL. The number needed to treat: A clinically useful measure of treatment effect. BMJ. 1995;310:452–454. doi: 10.1136/bmj.310.6977.452. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Laupacis A, Sackett DL, Roberts RS. An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988;318:1728–1733. doi: 10.1056/NEJM198806303182605. [DOI] [PubMed] [Google Scholar]
  • 12.Altman DG, Andersen PK. Calculating the number needed to treat for trials where the outcome is time to an event. BMJ. 1999;319:1492–1495. doi: 10.1136/bmj.319.7223.1492. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pettitt D. A., Raza S., Naughton B., et al. The limitations of QALY: A literature review. J Stem Cell Res Ther. 2016;6:1000334. [Google Scholar]
  • 14.Raju GK, Gurumurthi K, Domike R. Benefit-risk analysis for decision-making: An approach. Clin Pharmacol Ther. 2016;100:654–671. doi: 10.1002/cpt.507. [DOI] [PubMed] [Google Scholar]
  • 15.Raju GK, Gurumurthi K, Domike R, et al. A benefit-risk analysis approach to capture regulatory decision-making: Non-small cell lung cancer. Clin Pharmacol Ther. 2016;100:672–684. doi: 10.1002/cpt.501. [DOI] [PubMed] [Google Scholar]
  • 16.Raju GK, Gurumurthi K, Domike R, et al. A benefit-risk analysis approach to capture regulatory decision-making: Multiple myeloma. Clin Pharmacol Ther. 2018;103:67–76. doi: 10.1002/cpt.871. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Raju G. K., Gurumurthi K, Domike R, et al. Using a benefit-risk analysis approach to capture regulatory decision making: Melanoma. Clin Pharmacol Ther. 2019;106:123–135. doi: 10.1002/cpt.1461. [DOI] [PubMed] [Google Scholar]
  • 18.US Food and Drug Administration Drug approval package: Iressa (gefitinib) tablets. http://www.accessdata.fda.gov/drugsatfda_docs/nda/2003/021399_iressa.cfm
  • 19.US Food and Drug Administration Drug approval package: Tarceva (erlotinib hydrochloride) http://www.accessdata.fda.gov/drugsatfda_docs/nda/2004/21-743_Tarceva.cfm
  • 20.US Food and Drug Administration Drug approval package: Avastin (bevacizumab) http://www.accessdata.fda.gov/scripts/cder/drugsatfda/index.cfm?fuseaction=Search.Label_ApprovalHistory#apphist
  • 21.US Food and Drug Administration Drug approval package: Xalkori (crizotinib) capsules. http://www.accessdata.fda.gov/drugsatfda_ docs/nda/2011/202570Orig1s000TOC.cfm#top
  • 22.US Food and Drug Administration Drug approval package: Gilotrif (afatinib) tablets. http://www.accessdata.fda.gov/drugsatfda_docs/nda/2013/201292Orig1s000TOC.cfm
  • 23.US Food and Drug Administration Drug approval package: Cyramza (ramucirumab) http://www.accessdata.fda.gov/scripts/cder/drugsatfda/index.cfm?fuseaction=Search.Label_ApprovalHistory#apphist
  • 24.US Food and Drug Administration Drug approval package: Zykadia (ceritinib) capsules. http://www.accessdata. fda.gov/drugsatfda_docs/nda/2014/205755Orig1s000TOC.cfm
  • 25.US Food and Drug Administration Drug approval package; Opdivo (nivolumab) http://www.accessdata.fda.gov/scripts/cder/drugsatfda/index.cfm?fuseaction5Search.Overview&DrugName=OPDIVO
  • 26.U.S. Food and Drug Administration Drug approval package: Tagrisso (osimertinib) tablets. http://www.accessdata.fda.gov/drugsatfda_docs/nda/2015/208065Orig1s000TOC.cfm
  • 27.U.S. Food and Drug Administration Drug approval package: Alecensa (alectinib) capsule. https://www.accessdata.fda.gov/drugsatfda_docs/nda/2015/208434Orig1s000TOC.cfm
  • 28.Thatcher N, Chang A, Parikh P, et al. Gefitinib plus best supportive care in previously treated patients with refractory advanced non-small-cell lung cancer: Results from a randomised, placebo-controlled, multicentre study (Iressa Survival Evaluation in Lung Cancer) Lancet. 2005;366:1527–1537. doi: 10.1016/S0140-6736(05)67625-8. [DOI] [PubMed] [Google Scholar]
  • 29.Kim ES, Hirsh V, Mok T, et al. Gefitinib versus docetaxel in previously treated non-small-cell lung cancer (INTEREST): A randomised phase III trial. Lancet. 2008;372:1809–1818. doi: 10.1016/S0140-6736(08)61758-4. [DOI] [PubMed] [Google Scholar]
  • 30.Mok TS, Wu YL, Thongprasert S, et al. Gefitinib or carboplatin-paclitaxel in pulmonary adenocarcinoma. N Engl J Med. 2009;361:947–957. doi: 10.1056/NEJMoa0810699. [DOI] [PubMed] [Google Scholar]
  • 31.Douillard JY, Ostoros G, Cobo M, et al. First-line gefitinib in Caucasian EGFR mutation-positive NSCLC patients: A phase-IV, open-label, single-arm study. Br J Cancer. 2014;110:55–62. doi: 10.1038/bjc.2013.721. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Kazandjian D, Blumenthal GM, Yuan W, et al. FDA approval of gefitinib for the treatment of patients with metastatic EGFR mutation-positive non-small cell lung cancer. Clin Cancer Res. 2016;22:1307–1312. doi: 10.1158/1078-0432.CCR-15-2266. [DOI] [PubMed] [Google Scholar]
  • 33.ClinicalTrails.gov Study of cisplatin/vinorelbine +/− cetuximab as first-line treatment of advanced non small cell lung cancer (FLEX) https://clinicaltrials.gov/ct2/show/NCT00148798
  • 34.Ciuleanu T, Brodowicz T, Zielinski C, et al. Maintenance pemetrexed plus best supportive care versus placebo plus best supportive care for non-small-cell lung cancer: A randomised, double-blind, phase 3 study. Lancet. 2009;374:1432–1440. doi: 10.1016/S0140-6736(09)61497-5. [DOI] [PubMed] [Google Scholar]
  • 35.Rosell R, Carcereny E, Gervais R, et al. Erlotinib versus standard chemotherapy as first-line treatment for European patients with advanced EGFR mutation-positive non-small-cell lung cancer (EURTAC): A multicentre, open-label, randomised phase 3 trial. Lancet Oncol. 2012;13:239–246. doi: 10.1016/S1470-2045(11)70393-X. [DOI] [PubMed] [Google Scholar]
  • 36.Shaw AT, Kim D-W, Nakagawa K, et al. Crizotinib versus chemotherapy in advanced ALK-positive lung cancer. N Engl J Med. 2013;368:2385–2394. doi: 10.1056/NEJMoa1214886. [Erratum: N Engl J Med 373:1582, 2015] [DOI] [PubMed] [Google Scholar]
  • 37.Shaw AT, Ou SH, Bang YJ, et al. Crizotinib in ROS1-rearranged non-small-cell lung cancer. N Engl J Med. 2014;371:1963–1971. doi: 10.1056/NEJMoa1406766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kazandjian D, Blumenthal GM, Luo L, et al. Benefit–risk summary of crizotinib for the treatment of patients with ROS1 alteration-positive, metastatic non-small cell lung cancer. Oncologist. 2016;21:974–980. doi: 10.1634/theoncologist.2016-0101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Eli Lilly Advisory committee briefing materials for necitumumab. http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/Drugs/OncologicDrugsAdvisoryCommittee/UCM453753.pdf
  • 40.Brahmer J, Reckamp KL, Baas P, et al. Nivolumab versus docetaxel in advanced squamous-cell non-small-cell lung cancer. N Engl J Med. 2015;373:123–135. doi: 10.1056/NEJMoa1504627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Borghaei H, Paz-Ares L, Horn L, et al. Nivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer. N Engl J Med. 2015;373:1627–1639. doi: 10.1056/NEJMoa1507643. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Soria JC, Felip E, Cobo M, et al. Afatinib versus erlotinib as second-line treatment of patients with advanced squamous cell carcinoma of the lung (LUX-Lung 8): An open-label randomised controlled phase 3 trial. Lancet Oncol. 2015;16:897–907. doi: 10.1016/S1470-2045(15)00006-6. [DOI] [PubMed] [Google Scholar]
  • 43.Garon EB, Rizvi NA, Hui R, et al. Pembrolizumab for the treatment of non-small-cell lung cancer. N Engl J Med. 2015;372:2018–2028. doi: 10.1056/NEJMoa1501824. [DOI] [PubMed] [Google Scholar]
  • 44.Sul J, Blumenthal GM, Jiang X, et al. FDA approval summary: Pembrolizumab for the treatment of patients with metastatic non-small cell lung cancer whose tumors express programmed death-ligand 1. Oncologist. 2016;21:643–650. doi: 10.1634/theoncologist.2015-0498. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Reck M, Rodríguez-Abreu D, Robinson AG, et al. Pembrolizumab versus chemotherapy for PD-L1-positive non-small-cell lung cancer. N Engl J Med. 2016;375:1823–1833. doi: 10.1056/NEJMoa1606774. [DOI] [PubMed] [Google Scholar]
  • 46.Rittmeyer A, Barlesi F, Waterkamp D, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): A phase 3, open-label, multicentre randomised controlled trial. Lancet. 2017;389:255–265. doi: 10.1016/S0140-6736(16)32517-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Mok TS, Wu Y-L, Ahn M-J, et al. Osimertinib or platinum-pemetrexed in EGFR T790M-positive lung cancer. N Engl J Med. 2017;376:629–640. doi: 10.1056/NEJMoa1612674. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Soria JC, Tan DSW, Chiari R, et al. First-line ceritinib versus platinum-based chemotherapy in advanced ALK-rearranged non-small-cell lung cancer (ASCEND-4): A randomised, open-label, phase 3 study. Lancet. 2017;389:917–929. doi: 10.1016/S0140-6736(17)30123-X. [DOI] [PubMed] [Google Scholar]
  • 49.Peters S, Camidge DR, Shaw AT, et al. Alectinib versus crizotinib in untreated ALK-positive non-small-cell lung cancer. N Engl J Med. 2017;377:829–838. doi: 10.1056/NEJMoa1704795. [DOI] [PubMed] [Google Scholar]
  • 50.Planchard D, Besse B, Groen HJM, et al. Dabrafenib plus trametinib in patients with previously treated BRAFV600E-mutant metastatic non-small cell lung cancer: An open-label, multicentre phase 2 trial. Lancet Oncol. 2016;17:984–993. doi: 10.1016/S1470-2045(16)30146-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Odogwu L, Mathieu L, Blumenthal G, et al. FDA approval summary: Dabrafenib and trametinib for the treatment of metastatic non-small cell lung cancers harboring BRAF V600E mutations. Oncologist. 2018;23:740–745. doi: 10.1634/theoncologist.2017-0642. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Van Damme V, Govaerts E, Nackaerts K, et al. Clinical factors predictive of long-term survival in advanced non-small cell lung cancer. Lung Cancer. 2013;79:73–76. doi: 10.1016/j.lungcan.2012.09.015. [DOI] [PubMed] [Google Scholar]
  • 53.Doroshow DB, Herbst RS. Treatment of advanced non-small cell lung cancer in 2018. JAMA Oncol. 2018;4:569–570. doi: 10.1001/jamaoncol.2017.5190. [DOI] [PubMed] [Google Scholar]
  • 54.Karweit J, Kotapati S, Wagner S, et al. An expanded portfolio of survival metrics for assessing anticancer agents. Am J Manag Care. 2017;23:54–61. [PubMed] [Google Scholar]
  • 55.Macaulay R, Ahuja A, Ademisoye E, et al. Relative value assessment: Characterizing the benefit of oncology therapies through diverse survival metrics from a US perspective. Clinicoecon Outcomes Res. 2019;11:199–219. doi: 10.2147/CEOR.S177343. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Baggstrom MQ, Stinchcombe TE, Fried DB, et al. Third-generation chemotherapy agents in the treatment of advanced non-small cell lung cancer: A meta-analysis. J Thorac Oncol. 2007;2:845–853. doi: 10.1097/JTO.0b013e31814617a2. [DOI] [PubMed] [Google Scholar]
  • 57.Bria E, Milella M, Cuppone F, et al. Outcome of advanced NSCLC patients harboring sensitizing EGFR mutations randomized to EGFR tyrosine kinase inhibitors or chemotherapy as first-line treatment: a meta-analysis. Ann Oncol. 2011;22:2277–2285. doi: 10.1093/annonc/mdq742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Socinski MA, Evans T, Gettinger S, et al. Treatment of stage IV non-small cell lung cancer: Diagnosis and management of lung cancer, 3rd ed—American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013;143(suppl 5):e341S–e368S. doi: 10.1378/chest.12-2361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Miller RG., Jr . Survival Analysis. ed 2. Hoboken, NJ: John Wiley and Sons; 1998. [Google Scholar]
  • 60.Ku HH. Notes on the use of propagation of error formulas. J Res. 1966;70C:263–273. https://nvlpubs.nist.gov/nistpubs/jres/70C/jresv70Cn4p263_A1b.pdf [Google Scholar]
  • 61.Altman DG. Confidence intervals for the number needed to treat. BMJ. 1998;317:1309–1312. doi: 10.1136/bmj.317.7168.1309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Box GEP, Hunter JS, Hunter WG. Statistics for Experimenters. Hoboken, NJ: John Wiley and Sons; 1978. [Google Scholar]
  • 63.Schiller JH, Gandara DR, Goss GD, et al. Non–small-cell lung cancer: Then and now. J Clin Oncol. 2013;31:981–983. doi: 10.1200/JCO.2012.47.5772. [DOI] [PubMed] [Google Scholar]

Articles from JCO Clinical Cancer Informatics are provided here courtesy of American Society of Clinical Oncology

RESOURCES