Abstract
Background
Debate over the viability of the current commercial research and development (R&D) model is ongoing. A controversial theme is the cost of bringing a new molecular entity (NME) to market.
Objective
Our aim was to evaluate the range and suitability of published R&D cost estimates as to the degree to which they represent the actual costs of industry.
Methods
We provided a systematic literature review based on articles found in the Pubmed, Embase and EconLit electronic databases, and in a previously published review. Articles published before March 2020 that estimated the total R&D costs were included (22 articles with 45 unique cost estimates). We included only literature in which the methods used to collect the information and to estimate the R&D costs were clearly described; therefore, three reports were excluded. We extracted average pre-launch R&D costs per NME and converted the values to 2019 US dollars (US$) using the gross domestic product (GDP) price deflator. We appraised the suitability of the R&D estimated costs by using a scoring system that captures three domains: (1) how success rates and development time used for cost estimation were obtained; (2) whether the study considered potential sources contributing to the variation in R&D costs; and (3) what the components of the cost estimation were.
Results
Estimates of total average capitalized pre-launch R&D costs varied widely, ranging from $161 million to $4.54 billion (2019 US$). Therapeutic area-specific estimates were highest for anticancer drugs (between $944 million and $4.54 billion). Our analysis identified a trend of increasing R&D costs per NME over time but did not reveal a relation between cost estimates and study ranking when the suitability scores were assessed. We found no evidence of an increase in suitability scores over time.
Conclusion
There is no universally correct answer regarding how much it costs, on average, to research and develop an NME. Future studies should explicitly address previously neglected variables, which likely explain some variability in estimates, and consider the trade-off between the transparency and public accessibility of data and their specificity. Use of our proposed suitability scoring system may assist in addressing such issues.
Supplementary Information
The online version contains supplementary material available at 10.1007/s40273-021-01065-y.
Key Points for Decision Makers
The suitability of the published research and development (R&D) cost estimates used to represent the actual R&D costs of the pharmaceutical industry varies. We found a trade-off between transparency and replicability of the analysis and between specificity and reliability of the source data. |
Average costs may obscure important differences, such as by therapeutic area, small/large molecules, orphan/non-orphan, original/licensed-in, and firm size; in particular, estimations suggest higher mean costs for oncological drugs. |
Moreover, most R&D cost studies do not address current trends in pharmaceutical R&D (e.g., the complexities of drug discovery and clinical trials), nor do they consider regulatory changes over time for a new medicine’s approval. |
Introduction
The escalation of research and development (R&D) expenditures, along with a corresponding decline in new molecular entities (NMEs) reaching the world markets, have created concerns around the sustainability of the biopharmaceutical industry’s business model [1]. Part of the discussion has been based on the increase in the R&D costs of an NME in the 1990s and early 2000s, triggered mainly by increasing attrition rates and duration of clinical trials [1]. Analysts at that time suggested that the model for developing new medicines was becoming unaffordable [2]. A report prepared for the European Commission in 2000 [3] stressed the crucial role of research productivity in the competitiveness of the pharmaceutical industry.
More recent studies suggest that the decline in productivity has not persisted [4, 5]. Given the dissatisfaction of researchers, patient groups, and policy makers with the pharmaceutical industry’s pricing policies [6–8], the focus of the debate has now shifted on to the importance of R&D costs for drug pricing. For instance, several researchers and organizations have raised concerns about the substantial increase of cancer drugs’ acquisition costs and its effects on affordability and accessibility [8–10], concerns that we share and that have motivated us to conduct this study. Some researchers are skeptical of using R&D costs as a justification for higher cancer drug prices, for instance considering the significant differences in prices among various countries [11, 12]. Even in the case of orphan drugs, researchers have expressed doubt that small patient numbers justify higher prices of NME-based products [13, 14]. From a health economics perspective, and one that endorses fair access to innovative value-added products, we believe that high R&D costs alone should not justify high medicine prices. Indeed, there is a trend towards a ‘value-based pricing’ model [15] where R&D costs alone do not necessarily play a crucial role. However, the inherent risks of pharmaceutical R&D cannot be ignored, and the value-based pricing model must contend with the ‘if’ and ‘how’ successful medicines compensate drug failures.
At the core of the discussion is whether the average R&D cost estimates of bringing an NME to market are valid. For instance, some methods used in these estimates are controversial. Of particular criticism are the studies based on the database created by the Tufts Center for the Study of Drug Development (hereafter termed ‘Tufts data’) [16–18]. The controversy stems over the magnitude of the estimates (often used to justify higher drug prices) [19] and the alleged close relationship the Tufts Center has with the pharmaceutical industry [20–23]. The debates around the Tufts’ studies, which also apply to other studies, mainly center on four issues. First, the transparency and the breadth of coverage of data used are called into question given the data are shielded from external scrutiny [20, 24–30]. Second, results might be overestimated [24–30] because the focus is on self-originated NMEs, which account for a minor proportion of all NMEs approved and tend to cost more [27, 28]. Third, some critics argue that the opportunity costs should not be considered and that the discount rates (cost of capital [COC]) applied were too high [20, 24, 26, 27, 31]. Fourth, the estimates ignored that drug R&D activities receive a considerable amount of public funding [20, 21, 23, 24, 26–30]. The authors from the Tufts group [32–36] have countered these criticisms, defending the representativeness of their samples, the use of opportunity costs, the reasons for focusing on self-originated NMEs, and for their exclusion of public funding. However, they have not offered sufficient justification for the inaccessibility of their data. Ultimately, their results cannot be substantiated.
The much lower estimates provided by Prasad and Mailankody [37] have also been criticized but for potential downward biases [38]. First, the authors used a sample of successful drugs from small companies. Second, 90% of the products were orphan medicines, which studies suggest can have 50% lower R&D costs than non-orphan medicines [39–41]. Third, 50% of the products were approved after phase II trials, thus excluding the costly phase III trials. Fourth, the COC for start-up technology companies appeared to be underestimated [42].
The estimation of R&D costs is a highly contentious research topic that needs an unbiased examination. The present review provides a systematic compilation and a critical assessment of all published estimates of the (pre-launch) average R&D costs per NME. Our assessment uses criteria addressing three key domains: (1) how the drugs’ success rates and development time used for cost estimation were obtained; (2) if the study considered potential sources attributing to the variation in R&D costs; and (3) what the components of the cost estimation were. Based on these domains, our main objective was to create a framework for assessing the comprehensiveness of cost estimates (e.g., what factors are to be considered and to what extent these factors are incorporated). This will help stakeholders understand what a particular R&D estimation is (and is not) capturing.
Methods
Systematic Literature Review
As a starting point for collecting studies pertaining to the R&D costs of bringing a new medicine to the market (pre-launch), we included all articles from a previous systematic review by Morgan et al. [43] that included literature until 19 January 2010. We then conducted a full systematic literature review with search dates from 1 January 2010 to 5 March 2020. Inclusion criteria as outlined by Morgan et al. included original research providing an estimation of the total R&D costs, studies describing the source of data and research methods in detail, and articles written in English.
Three academic search engines were used: Pubmed, Embase (OvidSP) and EconLit (EBSCO). Additionally, we searched Google Scholar to ensure the inclusion of grey literature. The search terms used were the combination of the concepts of “drug research and development” and “costs” or “drug research and development” and “expenditure”. Finally, we conducted a ‘snowballing’ of references (i.e., used the reference lists of selected articles to identify additional relevant articles).
Eleven articles from our search fulfilled all criteria. Combining these articles with the 11 articles previously identified by Morgan et al. [43], the analysis included a total of 22 articles (for additional information regarding the search criteria, selection process and data extraction, including the PRISMA flow diagram, see electronic supplementary information 1).
We extracted the average R&D cash and capitalized values estimated per successful drug from the selected articles. We also collected the total R&D costs and, when available, the R&D costs per phase (i.e., discovery, preclinical, clinical, and submission for market approval). When only R&D costs per phase were reported, we calculated the total R&D costs by summing the R&D costs of all reported phases. We extracted the currency and year for which the authors stated the R&D costs were reported. Based on this information, we adjusted the R&D costs to 2019 prices by using the gross domestic product (GDP) price deflator obtained from the US Bureau of Economic Analysis (BEA) [44]. Additionally, two articles reported results in non-US dollar (US$) currency. For the first article, Chit et al. [45], in which results were shown in Canadian dollars (CAN$) at 2011 prices, we used the 5 July 2011 exchange rate reported by the International Monetary Fund [46] to convert their estimates into US$. For the second article, Årdal et al. [47], in which the results were reported in Euros at 2015 prices, we converted their values by using the 1 July 2015 exchange rate [46]. All R&D costs are shown in 2019 US$ prices. Details on the total and per phase R&D costs, and details on all other extracted variables, can be found in electronic supplementary information 2.
Suitability Score
The methods used to estimate the (average) cost of drug R&D in the literature are heterogeneous and simply comparing the cost estimates from each study without examining how the estimates are calculated can be misleading. Instead of straight comparisons, an assessment is needed of the methods for calculating costs in order to determine their suitability (i.e., how well the estimates represent actual R&D costs of the drug industry). To this end, we designed a ‘suitability score’ framework to assess how comprehensively a study identifies the appropriate factors required for the estimation of R&D costs and to what extent these factors are incorporated into the analysis.
We identified 16 relevant factors (see electronic supplementary information 3) from the literature [20, 25, 28, 30, 43, 48] to form the framework. For each factor, six categories ranked on a scale from one to six were created. These categories denote the extent to which the studies have considered each of these factors. Total scores range from 16 to 96. Higher scores indicate that studies considered a wider range of factors and addressed them more comprehensively, and thus the final cost estimates may be considered a more suitable estimation of the actual R&D costs in the pharmaceutical industry.
The 16 factors are classified into three domains (details are reported in electronic supplementary information 3): (1) how drugs’ success rates and development time used for cost estimation were obtained; (2) if the study considered potential sources attributing to the variation in R&D costs; and (3) what the components of the cost estimation were. Considering the previously cited criticisms of studies lacking in breadth of coverage (meaning only a fraction of pharmaceutical industry pipeline being represented by the R&D cost estimate) as well as in transparency of the drug and cost data [20, 25, 28, 30], we emphasized the importance of replicability of the data in the categories. Specifically, we created categories to assess the replicability of sampling of the drugs used for estimating costs, success rates and development time, and for the replicability of cost data collection at the project, firm, or industry level.
For most factors, the consequence of a factor to be rated category 1 or 2 are similar; both signify that the factor was not considered in the R&D cost estimation (the framework’s terminology is summarized in electronic supplementary information 4). However, we assigned a category 2 to those articles where the authors mentioned the significance of the factor for the R&D costs, but the authors did not consider the factor in the R&D costs estimation (e.g., authors stated that the factor is important but the information available does not allow its consideration in the estimation). On the other hand, category 1 was assigned to articles where the factor was completely ignored. This distinction aims to capture the authors’ views when deciding whether to include these factors. Although it does not impact the suitability, we believe it is crucial to include the authors’ rationale for dismissing certain factors affecting the cost estimation. A complete description of factors and categories is provided in electronic supplementary information 3.
Additionally, we assessed how the studies considered four variables identified in the literature as impacting future trends in R&D costs and processes, including the role of public funding [20, 21, 23, 27]. To explore this aspect, for each variable we developed additional categories similar to those used to assess the 16 factors in the suitability score. However, the scores from these additional categories are not considered part of our evaluation of the suitability of cost estimates; they are used to illustrate the perspective of the authors. Details can be found in electronic supplementary information 5.
Drug Inclusion Period and Research and Development (R&D) Costs
In order to explore if the drug inclusion period was related to the magnitude of these estimates, a series of ordinary least squares (OLS) models were estimated, using as the dependent variable four measures of average costs: (1) total capitalized R&D costs; (2) total non-capitalized R&D costs; (3) capitalized clinical costs (phases I–III); and (4) non-capitalized clinical costs. These costs were regressed against the middle year of the drug sample inclusion period, controlling for three categorical variables: (1) phases included (preclinical, clinical, and period of submission for market approval); (2) therapeutic area (mixed vs. unique); and (3) method used (Tufts method, i.e., methodology used by DiMasi and colleagues [16–18] vs. other). Additionally, we considered the possibility of a nonlinear relationship between the drug sample inclusion period and the R&D costs.
Results
Table 1 shows the main information extracted from the 22 selected articles. Some of the articles reported more than one cost estimation, yielding a total of 45 different estimates (without considering estimates from the sensitivity analysis). Estimates of the total average capitalized (pre-launch) R&D costs needed to bring a new compound to the market varied widely, from $161 million to $4.5 billion, depending on which research phases were included in the analysis (e.g. discovery and preclinical phases were not included in 13 estimations), the therapeutic class, the drug sample inclusion period, the actual annual COC, and the methodology, among other factors (details on the methods, databases, data sources, and results of the selected studies are reported in electronic supplementary information 2).
Table 1.
Articlea | Publication year | Therapeutic class considered | Drug inclusion period | No. of drugs | No. of drugs considered to extract the sample | No. of companies | Clinical approval success rates | Average cash estimated per success drugb | Clinical development time, years (PI+PII+PIII) | Real annual COC (rate) | Average capitalized costs estimated per successful drugb | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Clinical phases | Totalc | Clinical phases (PI, PII and PIII) | Totalc | ||||||||||
Wouters et al. [19]—All | 2020 | Mixed | FDA approval between 2009 and 2018 | 63 NCEs and NBEs | 355 NCEs and NBEs | 47 | 0.14 | A.Included | A.Includede | 8.30f | 0.105 | A.Included | 1359.18 |
Wouters et al. [19]—High qualityd | Mixed | 23 NCEs and NBEs | 355 NCEs and NBEs | 0.14 | 9.35f | 1163.22 | |||||||
Wouters et al. [19]—Oncology | Antineoplastic and immunomodulating agents | 20 NCEs and NBEs | 116 NCEs and NBEs | 0.03 | 6.99f | 4538.93 | |||||||
Wouters et al. [19]—At and Me | Alimentary tract and metabolism | 15 NCEs and NBEs | 44 NCEs and NBEs | 0.20 | 9.15f | 1455.22 | |||||||
Wouters et al. [19]—CNS | Nervous system | 8 NCEs and NBEs | 33 NCEs and NBEs | 0.15 | 8.59f | 1095.66 | |||||||
Wouters et al. [19]—Abx | Anti-infectives for systemic use | 5 NCEs and NBEs | 40 NCEs and NBEs | 0.25 | 8.02f | 1319.80 | |||||||
Jayasundara et al. [40]—Orphan | 2019 | Mixed | FDA approval between 2000 and 2015 | 100 orphan approved for a new indication | 1163 trails with 602 orphan drugs | Not relevant | 0.33 | 183.70 | 183.70 | 11.42 | 0.105 | 321.61 | 321.61 |
Jayasundara et al. [40]—non-orphan | 100 non-orphan approved for a new indication | 1163 trails with 561 non-orphan drugs | 0.10 | 321.84 | 321.84 | 6.15 | 455.32 | 455.32 | |||||
Jayasundara et al. [40]—Orphan (NME) | 74 NME | As a scenario analysis, they identified, from the original selected sample, those that were NMEs | 0.33 | A.Included | 267.18 | 267.18 | |||||||
Jayasundara et al. [40]—non-orphan (NME) | 54 NME | 0.10 | 539.89 | 539.89 | |||||||||
Årdal et al. [47]—Min | 2018 | Antibiotics | Not relevant | A hypothetical antibacterial project | Costs of finishing all of the expected clinical trials per phase for the antibacterial project | 19 SMEs | Not considered | A.Includede | A.Includede | 1.50g | COC not considered | A.Not estimated | |
Årdal et al. [47]—Max | 6.00g | ||||||||||||
Prasad and Mailankody [37] | 2017 | Oncological drugs | FDA approval between 2006 and 2015 | 10 NCEs and NBEs | 13 NCEs and NBEs | 10 | Not considered | A.Included | 750.18 | 7.30f | 0.070 | A.Included | 943.83 |
DiMasi et al. [17] | 2016 | Mixed | 1995–2007 | 106 (86 NCEs, 19 NBEs) | 1442 NCEs and NBEs | 10 | 0.12 | 1065.50 | 1540.25 | 6.73 | 0.105 | 1611.32 | 2823.58 |
Chit et al. [45] | 2014 | Seasonal influenza vaccines | 2000–2011 | 39 vaccines | Influenza vaccines that meet the inclusion criteria | 24 | 0.20 | 70.16 | 70.16 | 7.33 | 0.090 | 243.81 | 522.42 |
Falconi et al. [50] | 2014 | Oncological drugs | Phase I–III trial took place between 1998 and 2012 | 199 NCEs and NBEs | 199 NCEs and NBEs | Not relevant | 0.11 | A.Included | 11.50 | 0.090 | 2086.68 | 2086.68 | |
Sertkaya et al. [49]—Abx (Min—ABSSSI) | 2014 | Antibacterial drugs | Not relevant | A hypothetical new antibacterial drug for six indications | A hypothetical new antibacterial drug | Not relevant | 0.09 | 58.58h | 84.47h | 2.75 | 0.110 | A.Not estimated | |
Sertkaya et al. [49]—Abx (Max—HABP/VABP) | 0.09 | 142.30h | 168.19h | 5.63 | 0.110 | ||||||||
Sertkaya et al. [49]—Vaccines | Vaccines | A model based on a theoretical new vaccine in preventing ABOM | A hypothetical vaccine | 0.39 | 230.24h | 315.47h | 6.70 | 0.110 | |||||
Mestre-Ferrandiz et al. [48] | 2012 | Mixed |
If one of the intervals was completed between 1998 and 2002: Intervals: (1) Pre-first toxicity dose; (2) first toxicity dose to first human dose; (3) first human dose to first patient dose; (4) first patient dose to first pivotal dose; (5) first pivotal dose to first core submission; (6) first core submission to first core launch |
97 NMEs | 209 NMEs | 16 | 0.11 | 804.13 | 1029.34 | 5.90 | 0.110 | 1235.90 | 1724.12 |
Adams and Brantner [51] | 2010 | Mixed | 1989–2001 | All NCEs that fulfil the selection criteria | 2245 observations (firm/year) | 183 | 0.24 | 702.08 | 702.08 | 6.20 | 0.110 | 1,785.85 | 1,785.85 |
Paul et al. [52] | 2010 | Mixed | 2000–2007 | No clear number of NCEs and NBEs | No info | 13 | 0.12 | 652.96 | 1,040.21 | 6.50 | 0.110 | 1,079.53 | 2,118.55 |
DiMasi and Grabowski [53] | 2007 | Therapeutic recombinant proteins and mAbs | 1990–2003 | 17 NBEs (4 from DiMasi et al. [18], 13 from a Biotech firm) | 522 NBEs | 4 (3 companies from DiMasi et al. [18] and 1 Biotech firm) | 0.30 | 463.39 | 717.75 | 6.81 | 0.115 | 803.18 | 1591.65 |
Adams and Brantner [54] | 2006 | Mixed | 1989–2002 | Same selected sample as DiMasi et al. [18]: 68 NCEs | 3181 NCEs | Cash expense costs from DiMasi et al. [18] (10 companies). Developing times and success rates sample based on Pharmaprojects | 0.24 | 446.05 | 637.42 | 6.58 | 0.110 | 700.73 | 1248.94 |
DiMasi et al. [55]—All | 2004 | Mixed | 1983–1994 | 68 NCEs | All compounds in the Tufts CSDD database that met the inclusion criteria | 10 | 0.22 | 405.48 | 405.48 | 6.01 | 0.110 | 670.51 | 670.51 |
DiMasi et al. [55]—Anes | Analgesic/anesthetic | 10 of the 68 NCEs and NBEs | 0.25 | 359.36 | 359.36 | 3.87 | 539.58 | 539.58 | |||||
DiMasi et al. [55]—Abx | Anti-infective | 9 of the 68 NCEs and NBEs | 0.25 | 517.77 | 517.77 | 4.21 | 707.92 | 707.92 | |||||
DiMasi et al. [55]—CV | Cardiovascular | 12 of the 68 NCEs and NBEs | 0.18 | 401.75 | 401.75 | 5.08 | 661.88 | 661.88 | |||||
DiMasi et al. [55]—CNS | CNS | 13 of the 68 NCEs and NBEs | 0.18 | 394.10 | 394.10 | 7.71 | 758.28 | 758.28 | |||||
DiMasi et al. [18] | 2003 | Mixed | 1983–1994 | 68 (61 NCEs, 7 NBEs) | 583 NCEs and NBEs | 10 | 0.22 | 405.50 | 579.60 | 6.01 | 0.110 | 671.64 | 1153.66 |
Global Alliance for TB Drug Development [56]—Min | 2001 | Tuberculosis | Not relevant | One hypothetical project to develop a new TB drug | One hypothetical project to develop a new TB drug | Not relevant | 0.10 | A. Included | 6.58 | 0.100 | 109.35 | 166.91 | |
Global Alliance for TB Drug Development [56]—Max | 0.10 | 9.30 | 0.120 | 165.47 | 345.33 | ||||||||
Young and Surrusco [24]—Min | 2001 | Mixed | FDA approval between 1990 and 1996 | Base results based on 207 NCEs. R&D costs based on all approved drugs were also estimated | 563 new drugs | Not relevant | Not considered | A.Included | 247.97 | Estimations were based on the average (per year) R&D spending over a 7-year period divided by the average (per year) number of drugs approved during the previous 7 years | COC not considered | A.Not estimated | |
Young and Surrusco [24]—Max | FDA approval between 1994 and 2000 | 234 NCEs. R&D costs based on all approved drugs were also estimated | 667 new drugs | 326.65 | |||||||||
DiMasi et al. [57]—Small firms | 1995 | Mixed | 1970–1982 | 23 of the 93 NCEs | The selected data correspond to 19% of all NCEs in the database | 5 of 12 | 0.24 | 78.52 | 291.89 | 4.66 | 0.090 | 132.68 | 674.68 |
DiMasi et al. [57]—Medium firms | 33 of the 93 NCEs | 4 of 12 | 0.17 | 139.26 | 277.16 | 6.13 | 221.36 | 545.58 | |||||
DiMasi et al. [57]—Large firms | 37 of the 93 NCEs | 3 of 12 | 0.28 | 97.16 | 235.23 | 5.72 | 143.59 | 451.18 | |||||
DiMasi et al. [58]—All | 1995 | Mixed | 1970–1982 | 93 NCEs | All drugs in the CSDD database that meet the inclusion criteria | 12 | 0.23 | 97.10 | 230.11 | No information for clinical phases only. 8.24 years reported for the clinical and submission period | 0.090 | 152.38 | 472.77 |
DiMasi et al. [58]—NSAID | Non-steroidal anti-inflammatory | 8 of the 93 NCEs | 0.22 | 162.27 | 162.27 | 8.29 | 265.07 | 265.07 | |||||
DiMasi et al. [58]—CV | Cardiovascular | 21 of the 93 NCEs | 0.26 | 101.41 | 101.41 | 7.63 | 160.52 | 160.52 | |||||
DiMasi et al. [58]—Abx | Anti-infective | 15 of the 93 NCEs (one outlier was excluded) | 0.30 | 79.88 | 246.15 | 5.03 | 114.43 | 393.17 | |||||
DiMasi et al. [58]—Neuro | Neuropharmacological | 18 of the 93 NCEs | 0.20 | 97.16 | 97.16 | 6.53 | 167.82 | 167.82 | |||||
DiMasi et al. [16] | 1991 | Mixed | 1970–1982 | 93 NCEs | The selected data correspond to 19% of all NCEs in the database | 12 | 0.23 | 94.57 | 223.56 | 5.72 | 0.090 | 148.10 | 454.53 |
Wiggins [59] | 1987 | Mixed | FDA approval between 1970 and 1985 | 223 NCEs | 324 NCEs | No information | Not considered | A.Not estimated | 131.17 | Not considered | 0.080 | 252.25 | 252.25 |
Hansen [60] | 1979 | Mixed | 1963–1975 | Around 100 NCEs | Sample corresponds to around 15% of the NCEs taken into human testing by the 25 firms surveyed during the study conducted by Hansen [61] | 14 | 0.13 | 48.79 | 105.93 | 4.58 | 0.080 | 68.74 | 176.15 |
Additional information can be found in electronic supplementary information 2.
Source: Authors’ elaboration
A.Not estimated assumed to be NOT estimated (the analysis of the article suggests that this particular calculation of R&D costs was NOT estimated), A.Included assumed to be included (the value is not reported; however, our analysis suggests that the R&D costs for that particular phase are reflected in the TOTAL R&D reported), All estimation includes all the observations in the sample, ABOM acute bacterial otitis media, ABSSSI acute bacterial skin and skin structure infections, Abx anti-infectives, Anes analgesics/anesthetic, CNS central nervous system, COC cost of capital, CSDD Center for the Study of Drug Development, CV cardiovascular, HABP/VABP hospital-acquired/ventilator-associated bacterial pneumonia, mAbs monoclonal antibodies, Max maximum reported value, Min minimum reported value, NBE new biological entity, NCE new chemical entity, Neuro neuropharmacological, NME new molecular entity, NPV net present value, NSAID nonsteroidal anti-inflammatory drug, R&D research and development, SMEs small and medium enterprises, TB tuberculosis
aEach row corresponds to the information related to one main R&D estimate. When more than one R&D cost estimate is reported, we refer to each by including the reference of the corresponding article and a keyword that describes the main characteristic of the R&D cost estimate
bMillion US dollars—2019 prices
cConsiders failures and includes all estimated phases (when animal testing has been estimated separately, it is also included here)
dConsistency and completeness of company reporting in the US Securities and Exchange Commission (SEC) filings vary. Therefore, Wouters et al. [19] categorized each selected data point as high, medium, or low quality, depending on the availability and consistency of reported data
eThe authors reported only the average cash estimated per investigational compound (cash spent in R&D, not considering failures). Values are presented in electronic supplementary information 2
fAuthors collected information by drug candidate, starting from the year in which the company began reporting costs for that particular drug in their financial statements until approval. This period could include 1 or more years of preclinical costs. The development time reported by the authors is based on the average time of all drugs included in the analysis. This means that, for some of these drugs, time also includes a few years of preclinical trials
gÅrdal et al. [47] considered only phase I and phase II
hWe assumed that Sertkaya et al. [49] considered the risk of failure. They used a decision tree model to estimate the costs. There is a decision node in each trial phase with the success rate to transit to the next phase, and the terminal nodes represent the NPV of each outcome (failure or success at each phase). The final figure, the expected NPV of a successful antibiotic, was obtained by working backward from each terminal node to the beginning of the R&D process
Two articles did not consider the COC [24, 47], which implies that these papers did not provide a capitalized estimate. One study did not include phase III within clinical development (Table 1) [49]. Prasad and Mailankody [37] deviated from the other studies by using a lower COC assumption. Additionally, the Jayasundara et al. [40] key estimate was for both ‘true’ NMEs (i.e. approved by the US FDA for its first indication) and drugs that received an additional FDA-approved indication. Table 1 presents both R&D cost estimates of Jayasundara et al. [40], which include the full sample (NMEs and non-NMEs), as well as the data for ‘true’ NMEs only (which are of primary interest in our context).
Suitability Assessment
The suitability scores for the R&D cost estimations are presented in Table 2 and Fig. 1, while the rankings of the articles according to the total scores, from highest to lowest, are presented in Fig. 1, Chart A. The highest score of 81 [19], 96 being the maximum, suggests that even the cost estimate with the highest suitability still omitted some factors.
Table 2.
Article | Drug sample characteristics | Possible sources of variation in R&D costs | Monetary values | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Breadth of coverage | Replicability | Transition or success prob.—estimation | Risk of failure | Development time—estimation | Therapeutic class | NCE or NBE | Orphan drug | Self-originated or licensed-in | Firm size | Discovery/preclinical | Clinical phases | Opportunity costs | Tax-deductible costs | |||
Considered | Source reliability | Specificity | Replicability | |||||||||||||
Wouters et al. [19] (2020) | 5 | 6 | 4 | 6 | 6 | 6 | 3 | 3 | 5a | 4 | 6 | 6 | 5 | 6 | 6 | 4 |
Jayasundara et al. [40] (2019) | 2 | 5 | 4 | 6 | 6 | 1 | 1 | 6 | 1 | 1 | 4 | 1 | 5 | 6 | 6 | 4 |
Årdal et al. [47] (2018) | 2 | 2 | 1 | 1 | 6 | 4 | 4 | 1 | 3 | 3 | 6 | 3 | 2 | 3 | 2 | 1 |
Prasad and Mailankody [37] (2017) | 2 | 6 | 1 | 1 | 6 | 4 | 6 | 6 | 6 | 3 | 6b | 5 | 4 | 6 | 6 | 3 |
DiMasi et al. [17] (2016) |
4 | 3 | 5 | 6 | 5 | 5 | 5 | 3 | 4 | 3 | 6 | 6 | 5 | 3 | 6 | 2 |
Chit et al. [45] (2014) |
5 | 4 | 6 | 6 | 6 | 4 | 4 | 1 | 1 | 3 | 6 | 6 | 3 | 4 | 6 | 5 |
Falconi et al. [50] (2014) |
5 | 6 | 6 | 5 | 5 | 4 | 3 | 1 | 1 | 1 | 1 | 1 | 3 | 2 | 5 | 1 |
Sertkaya et al. [49] (2014) |
3 | 2 | 4 | 6 | 4 | 4 | 4 | 3 | 1 | 3 | 6 | 6 | 3 | 2 | 6 | 3 |
Mestre-Ferrandiz et al. [48] (2012) | 4 | 4 | 6 | 6 | 6 | 3 | 3 | 3 | 3 | 3 | 6 | 6 | 6 | 3 | 6 | 3 |
Adams and Brantner [51] (2010) | 6 | 4 | 6 | 5 | 6 | 5 | 5 | 1 | 3 | 5 | 4 | 1 | 5 | 4 | 6 | 1 |
Paul et al. [52] (2010) |
4 | 3 | 5 | 6 | 6 | 3 | 3 | 1 | 3 | 3 | 6 | 6 | 6 | 3 | 5 | 1 |
DiMasi and Grabowski [53] (2007) | 5 | 3 | 5 | 6 | 5 | 3 | 6 | 1 | 1 | 4 | 6 | 6 | 5 | 3 | 6 | 1 |
Adams and Brantner [54] (2006) | 6 | 4 | 6 | 5 | 6 | 5 | 1 | 1 | 3 | 5 | 6 | 6 | 5 | 4 | 6 | 3 |
DiMasi et al. [55] (2004) |
5 | 3 | 5 | 6 | 5 | 6 | 3 | 1 | 4 | 1 | 1 | 1 | 5 | 3 | 6 | 1 |
DiMasi et al. [18] (2003) |
4 | 3 | 5 | 6 | 5 | 3 | 3 | 1 | 4 | 3 | 6 | 6 | 5 | 3 | 6 | 2 |
Global Alliance for TB Drug Development [56] (2001) |
3 | 2 | 4 | 5 | 6 | 4 | 1 | 3 | 3 | 1 | 6 | 5 | 5 | 2 | 6 | 1 |
Young and Surrusco [24] (2001) | 6 | 5 | 1 | 4 | 2 | 1 | 1 | 1 | 3 | 1 | 1 | 1 | 4 | 5 | 2 | 6 |
DiMasi et al. [57] (1995) |
4 | 3 | 5 | 6 | 5 | 6 | 1 | 1 | 4 | 6 | 6 | 6 | 5 | 3 | 5 | 1 |
DiMasi et al. [58] (1995) |
4 | 3 | 5 | 6 | 5 | 6 | 1 | 1 | 4 | 1 | 4c | 1 | 5 | 3 | 6 | 1 |
DiMasi et al. [16] (1991) |
4 | 3 | 5 | 6 | 5 | 3 | 1 | 1 | 4 | 3 | 6 | 6 | 5 | 3 | 6 | 2 |
Wiggins [59] (1987) |
6 | 5 | 1 | 1 | 4 | 3 | 1 | 1 | 1 | 1 | 1 | 1 | 4 | 5 | 6 | 1 |
Hansen [60] (1979) |
2 | 3 | 4 | 5 | 5 | 1 | 1 | 1 | 4 | 1 | 6 | 6 | 5 | 3 | 6 | 1 |
A detailed explanation of the categories used are provided in electronic supplementary information 3.
Source: Authors’ elaboration
NBE new biological entity, NCE new chemical entity, prob. probabilities, R&D research and development
The score assesses how comprehensively the studies considered factors contributing to the R&D cost estimation and to what extent they addressed them. Higher numbers indicate that the estimations reflect the factor to a higher degree
aConsidered in the sensitivity analysis by changing the assumptions for preclinical costs
bGiven that the authors included the entire R&D investment of the company, we assumed that estimation should cover R&D costs from the time of discovery or initial acquisition of the compound to approval
cOnly for two of the estimations reported: (1) all drugs, and (2) anti-infectives (Abx)
Five articles provided scores higher than 70 [17, 19, 37, 48, 54]. The most recent study by Wouters et al. [19] stands out with the highest number of factors scoring over five, with the highest score in the domain ‘monetary values’. Prasad and Mailankody [37] did not include success probabilities or any method to consider the risk of failure, which led to its low rating on the ‘drug sample characteristics’ domain (Table 2). Nevertheless, higher ratings for the factors in the domain ‘possible sources of variation in R&D costs’ led to a high overall score. This domain was largely neglected in many of the included articles.
The article by Wiggins [59] had the lowest score, followed by Young and Surrusco [24] and Årdal et al. [47] (Fig. 1). None of the R&D costs estimated by these authors reflected success probabilities: two did not consider the risk of failure and two did not include costs in the discovery and preclinical phases (Table 2). Årdal et al. [47] estimated the R&D costs for only one therapeutic class—antibiotics—and thereby scored lower on the factors of breadth of coverage and replicability. Moreover, Årdal et al. [47] did not include the costs of phase III trials, nor did they consider risk failures or costs of capital adjustments (see electronic supplementary information 2) (Fig. 2).
‘Possible sources of variation in R&D costs’ is the domain in which the selected articles showed the lowest scores (Table 2). This domain aims to capture whether the estimated R&D cost represents only an average of the R&D costs per new compound, or if it reflects the heterogeneity that exists in the drug discovery and development process. Most of the studies did not address the impact of orphan drug status and consideration of tax-deductible costs.
It is important to stress the difference between the two ‘Replicability’ factors. First, the factor in the domain ‘Drug Sample Characteristics’ refers to the access to the database used to select the drug sample. For instance, the articles based on the ‘Tufts data’ [16, 18, 53, 55, 57, 58] were assigned a category ‘3’ (the database used to select the drug sample is not publicly available, but are collected by a third party with strict confidentiality arrangements where only individual companies could access their own data submitted). Even if there is the possibility of working with the Tufts group and replicating part of the methodology, there is no option to access the whole database directly. Regarding the factor ‘Replicability’ in the domain ‘Monetary Values’, we refer to the source of the monetary values (e.g., the cash expended in R&D, by phase), rather than sample selection. In this domain, we considered that suitability exists when (1) it is possible to calculate the final R&D cost estimation based on the original monetary data (i.e., data by company and/or selected drugs); or (2) it is possible to replicate the data collection fully (e.g., by interviewing the same set of companies using the same form and considering the same drugs). For instance, articles based on confidential surveys to multinational pharma companies [16–18, 47, 48, 53, 55, 57, 58, 60] are assigned a ‘3’ (the information used to estimate the cash expended in R&D during the clinical phases is not publicly available, but is collected by a third party with strict confidentiality arrangements where only individual companies could access their own data submitted).
Considering previous critiques of the methodology used to estimate R&D costs [20, 25, 27], we identified four factors that dominated the debate on the appropriateness of their inclusion: (1) risk of failure; (2) orphan drug status; (3) opportunity costs; and (4) tax-deductible costs. In Fig. 1, Chart B, a separate ranking of articles excluding these factors is presented. A comparison of Charts A and B reflects that the suitability scores of the articles by Jayasundara et al. [40] (a 37% decrease), Sertkaya et al. [49] (a 30% decrease) and Young and Surrusco [24] (a 30% decrease) had the most significant change. Additionally, seven articles had no change in their comparative ranking and five changed their position by one place only. The comparative rankings of two [45, 48] of the remaining 10 studies are two places lower in Chart B than in Chart A. An additional article, Jayasundara et al. [40], which focuses on the differences on the R&D costs between orphan and non-orphan drugs, decreased by three places. The latter three articles [40, 45, 48] are among the few that mentioned tax-deductible costs. Other comparative rankings improved by three to four places [47, 55, 58, 60], attributed to the fact that both orphan drug status and tax-deductible costs were considered in these studies’ analyses.
In addition to our analysis presented in Fig. 1, we conducted a sensitivity analysis by excluding different combinations of factors to observe the effect on the suitability score and on the rankings (additional details are provided in electronic supplementary information 6). While for some articles (e.g. Årdal et al. [47], Falconi et al. [50], Wiggins [59], and Wouters et al. [19]) the ranking is highly consistent regardless of the excluded factors, rankings of other articles (e.g., Adams and Brantner [51], Prasad et al. [22], and Jayasundara et al. [40]) vary noticeably.
R&D Cost Estimates
We extracted both capitalized and non-capitalized R&D costs per successful medicine. The estimates of the average capitalized R&D are displayed in Fig. 2. A thicker line represents higher suitability scores. Blue lines are estimations that considered only the clinical phases, red lines incorporated, additionally, an approximation of the discovery and preclinical phases, and green lines considered, additionally, the R&D costs invested during the period of submission for marketing authorization. Capitalized values were reported for all but three of the selected articles [24, 47, 49], giving a total of 38 capitalized estimations of the average R&D costs. Only the R&D cost estimates that could be linked to a specified drug inclusion period are represented in Fig. 2 (36 of 38). The estimates from the Global Alliance for TB Drug Development [56] did not require the definition of a drug inclusion period, therefore it is not presented in Fig. 2. Sixty-one percent (22 of 36) of the remaining estimated R&D capitalized costs were under $1 billion. Particularly remarkable was the capitalized R&D cost estimated by Wouters et al. [19] for oncological drugs ($4.5 billion ), not only because of its magnitude (by far the highest) but also because it doubled the earlier estimate by Falconi et al. [50] for oncological drugs ($2.1 billion). The estimates presented by Adams and Brantner [51] and Falconi et al. [50] included only the clinical phases, although they are among the highest in the sample and are at a similar level to those in studies that also considered the discovery, preclinical, and submission to approval phases.
Figure 2 shows the average reported values of Wouters et al. [19], although they also reported median R&D costs, which, in the case of oncology, is equal to $2.8 billion. This suggests a positive skew in the oncological drugs sample selected by Wouters et al. [19], which highlights the importance of relying on either mean or median estimates. Notably, among the included articles, only Wouters et al. [19] and Prasad et al. [22] reported median costs as the main results. The average capitalized costs with 7% COC reported by Prasad et al. [22] were $944 million, while the median costs were $788 million. The difference between the mean and median is at a magnitude of more than $150 million, although the difference is not as drastic as that reported by Wouters et al. [19], who found a difference of around $1.7 billion. Three of the main papers from DiMasi et al.[16–18] also reported median costs, but only for cash expenses for each phase (in addition to mean costs). Given that they used the mean phase length to calculate capitalized costs, only mean capitalized costs were reported. Adams and Brantner [54] reported in a similar way, whereas the other articles reported only average costs.
In general, publications with the most recent drug inclusion periods tended to report higher estimates (Fig. 2). Nevertheless, there were exceptions. While Adams and Brantner [54] and DiMasi and Grabowski [53] considered similar inclusion periods and similar R&D phases, estimates differed by around $330 million. Similarly, the articles by Jayasundara et al. [40] and Chit et al. [45] (the latter presenting estimates for an influenza vaccine), which had the most recent drug inclusion periods, reported R&D values that were lower than what is expected from a consistent increase trend of R&D costs across time.
The non-capitalized average R&D costs per successful drug are shown in Fig. 3. Thirty-two reported R&D cost estimations were adjusted by the risk of failure but not by the opportunity costs. Wouters et al. [19], Falconi et al. [50], and the Global Alliance for TB Drug Development [56] reported only capitalized values and values without adjusting by risk of failure or opportunity costs, while Årdal et al. [47] calculated R&D costs without adjusting by risk of failure or opportunity costs. Of the 32 estimates, the three estimates from Sertkaya et al. [49] could not be linked to a drug inclusion period, therefore only 29 observations are shown in Fig. 3. The highest estimate (DiMasi et al. [17]), which considered both preclinical and clinical phases, was around $500 million higher than the Paul et al. [52] and Mestre-Ferrandiz et al. [48] estimates, which also included the submission phase. The lowest reported R&D costs corresponded to the approximation for particular therapeutic classes—two from DiMasi et al. [58] (drugs for the cardiovascular and nervous systems) and one from Chit et al. [45] (seasonal influenza vaccine).
The OLS models suggest a positive and significant relationship between the period and the R&D costs regardless of the estimated equation. However, the R-squared is low (around 0.5), as well as the number of degrees of freedom (DF; regressions with the R&D capitalized value between 30 and 34 DF, and non-capitalized values between 19 and 27 DF). For detailed results, see electronic supplementary information 7.
The OLS results indicate no significant differences in R&D costs between an estimation that corresponds to one therapeutic area and an estimation that represents multiple therapeutic areas. However, the limited number of observations hinders the possibility of comparing R&D costs between different therapeutic areas. In this regard, it is interesting to observe that the data used in the articles regarding development times vary considerably by therapeutic area: Wouters et al. [19], from 7 years in oncology to 9.2 years in metabolism and endocrinology; DiMasi et al. [55], from 5.2 years in analgesics and anesthetic to 9.6 years in the central nervous system; DiMasi et al. [58], from 6.4 years in anti-infectives to 9.7 years in neuropharmacologicals.
Given the possibility of outliers (e.g., Wouters et al. [19] for the highest estimate for oncology, and Jayasundara et al. [40] and Chit et al. [45] in terms of their lower values), regression analysis was repeated omitting such extreme values. Then there was an increase in the R-squared (to around 0.8 and 0.6 for equations including non-capitalized and capitalized costs, respectively), but a reduction in the number of DFs (results reported in electronic supplementary information 6). Results including the three control variables suggested that when the Tufts method was applied, the capitalized R&D costs for the clinical phases was significantly lower and the estimated total average cash spent in R&D was significantly higher. Moreover, there was no significant effect when considering a mix of therapeutic areas versus considering only one. Dashed lines in Figs. 2 and 3 correspond to the OLS models without outliers, with R&D costs as the dependent variable and the drug inclusion period as the only independent variable. Slopes of both equations were positive and significant. While the regression results with or without the outliers should be treated with caution, they show a (positive) relationship between the drug inclusion period and the magnitude of the R&D estimates. This implies that R&D costs have increased over time.
Additionally, Figs. 2 and 3 show that there was no link between the magnitudes of the estimated R&D costs with the score assigned (additional figures showing the results for preclinical and clinical phases are presented in electronic supplementary information 8). Nevertheless, a comparison between Charts A and B in Figs. 2 and 3 suggests a lower score for those estimations linked to one particular therapeutic area. Note that the scores proposed here focused mainly on the validity of the R&D cost estimates for representing the actual overall R&D costs.
We are aware that therapeutic area-specific R&D estimates usually rely on the best evidence possible for that particular area, and some of the methods used to generate that data might not be replicable across the entire industry. Naturally, these papers will have lower ratings in some of the dimensions.
Twenty-seven of the 45 estimates presented data with and without capitalization. Figure 4 shows the percentage of the opportunity costs of the total capitalized R&D costs. For instance, for DiMasi et al. [16] and Paul et al. [52], the capitalized R&D costs were around 50% higher than the non-capitalized R&D costs, implying ‘time’ represented 50% of the total capitalized costs in these papers. The study by Chit et al. [45] was excluded from the estimates since the non-capitalized value excluded the preclinical and discovery phases, while the capitalized estimation included both. In addition, the capitalized cost estimation was in 2022 CAN$, for which we do not have a proper method to deflate to 2019 US$ to compare it with other studies. In most of the cases, opportunity costs represent a percentage that ranged between 35% and 51% (17 of 24 estimations). In general, the estimations that excluded preclinical and discovery (blue lines) show lower percentages than those that included them (red lines), with two clear exceptions—Prasad and Mailankody [37] and Adams and Brantner [51]. The former shows the smallest percentage value (21%) among the sample. This can be explained by the fact that the authors applied the lowest annual COC and one of the shortest clinical development times.
Impact on Future Estimates
Some experts have challenged the estimations presented in the articles used in our analysis, in respect of how four variables impact the validity of existing and future estimates [20, 25, 27]:
The role of public investment: How much of the R&D costs come from public resources and not from private investments?
Post-authorization R&D costs: After the drug is approved by the corresponding regulator (e.g., FDA or European Medicines Agency [EMA]), how much R&D is still required to assure reimbursement and market success?
Disparities in regulations and length of time for approval across time.
Variations in the complexity of clinical trials (e.g., protocol design) across time.
Although these variables do not have a main role in estimating the R&D costs of bringing a new NME to the market, they still warrant consideration. The first (the role in public investment) is not related to the R&D cost level but with the funding sources. The second (post-authorization R&D costs) captures the authors’ consideration of potential R&D costs occurring after market approval, which are particularly relevant for drugs approved in the earlier stages of development. The latter two are crucial if the aim is to analyze possible future trends in R&D costs. Table 3 illustrates that our selected articles mostly ignored these four variables.
Table 3.
Article | Role of public investment | Post-authorization R&D costs | Variations in regulation or approval times | Variations in the complexity of clinical trials or drug discovery |
---|---|---|---|---|
Wouters et al. [19] (2020) | 1 | 1 | 1 | 1 |
Jayasundara et al. [40] (2019) | 1 | 1 | 1 | 1 |
Årdal et al. [47] (2018) | 3 | 1 | 4 | 1 |
Prasad and Mailankody [37] (2017) | 1 | 1 | 6 | 1 |
DiMasi et al. [17] (2016) | 5 | 5 | 5 | 5 |
Chit et al. [45] (2014) | 4 | 4 | 1 | 1 |
Falconi et al. [50] (2014) | 1 | 1 | 1 | 1 |
Sertkaya et al. [49] (2014) | 4 | 6 | 4 | 4 |
Mestre-Ferrandiz et al. [48] (2012) | 4 | 4 | 4 | 4 |
Adams and Brantner [51] (2010) | 1 | 1 | 1 | 1 |
Paul et al. [52] (2010) | 1 | 4 | 3 | 1 |
DiMasi and Grabowski [53] (2007) | 1 | 1 | 1 | 1 |
Adams and Brantner [54] (2006) | 1 | 1 | 4 | 1 |
DiMasi et al. [55] (2004) | 1 | 1 | 1 | 1 |
DiMasi et al. [18] (2003) | 4 | 5 | 5 | 4 |
Global Alliance for TB Drug Development [56] (2001) | 4 | 5 | 1 | 1 |
Young and Surrusco [24] (2001) | 4 | 1 | 4 | 1 |
DiMasi et al. [57] (1995) | 4 | 1 | 1 | 1 |
DiMasi et al. [58] (1995) | 1 | 1 | 4 | 1 |
DiMasi et al. [16] (1991) | 1 | 1 | 5 | 4 |
Wiggins [59] (1987) | 1 | 1 | 6 | 6a |
Hansen [60] (1979) | 1 | 2 | 5 | 1 |
Source: Authors’ elaboration
R&D research and development
6 indicates the main estimation of the R&D costs were adjusted by the variable; 5 indicates additional estimations (sensitivity analysis) were reported where R&D costs were adjusted by the variable; 4 indicates the authors state that the variable was relevant in the estimation of the R&D costs, but they were not able to adjust the R&D estimations (e.g., lack of information); 3 indicates the authors mentioned the variable, but without any link to the estimation of the R&D costs; 2 indicates the authors stated that the variable should not be considered in the estimation of the R&D costs; 1 indicates there was no mention of the variable in any part of the document. A detailed explanation of these categories is provided in electronic supplementary information 5
aNo increase in complexity was discussed; however, the authors included a parameter to capture the regulatory stringency in the previous years.
Discussion
We systematically reviewed studies that estimated the (pre-launch) R&D cost per NME and examined how the studies addressed key factors that might influence the estimate. The main components of the R&D cost per NME are: (1) direct cash expenses; (2) the future value at the time of launch (and thus return on investment), which is to be adjusted to the high risk of development failure (i.e., success or attrition rates); and (3) the long development times resulting in substantial opportunity costs (i.e., COC). Results showed a wide range of R&D cost estimates, from $161 million [58] to $4.54 billion [19]. There was evidence that more recent drug samples resulted in higher cost estimates; however, this should be interpreted with caution due to the (1) exceptions, (2) limited number of observations, and (3) heterogeneity in the methods and data used. Additionally, our assessment showed neither a relationship between the suitability scores and magnitude of cost estimates nor between the scores and the recency of investigated drug samples.
To our knowledge, this study is the first attempt to evaluate and systematically quantify the suitability of the R&D estimates to represent the actual R&D costs of the pharmaceutical industry. Our intention is to disentangle the complexity behind the average R&D cost estimations, rather than how any particular estimation should be used to set prices. Our proposed scoring system does not assess the quality of an article; rather, it is intended to address three critical issues for evaluating R&D cost estimates: the breadth of coverage, replicability, and reliability. We also do not intend to score the credibility of the R&D cost estimates since our suitability score depends on many factors, some of which are not related to the ‘credibility’ of the study. For instance, a paper might score low overall but high in some specific dimensions because it is therapy-specific (e.g., oncology drugs); this would not imply that the estimation is ‘less credible’ only because it covers less breadth of the industry pipeline.
We evaluated 16 factors covering three domains related to (1) how the selection of drugs was made and how the related success rates and development times used for cost estimation were obtained; (2) consideration of drivers of R&D costs variations; and (3) elements of the estimation, as shown in Table 2. The domains (1) and (3) evaluate the database(s) used to extract the different cost drivers, including monetary values (cash investments), success rates, and development times. Given the fundamental differences among the databases, scoring the monetary data’s suitability is not straightforward. For example, the Tufts group’s monetary values are differentiated by project and firm [16, 18, 53, 55, 57, 58] (i.e., high specificity) but were collected via confidential surveys under strict confidentiality arrangements. Moreover, despite the authors’ efforts to validate their estimates with publicly available aggregate data [17], to the best of our knowledge the data have not been audited by any external parties. In contrast, Young and Surrusco [24] used the publicly available data reported by each company to the Pharmaceutical, Research and Manufacturers of America (PhRMA), allowing higher transparency, but to link it to individual new chemical entities (NCEs) approved annually, the authors assumed a time lag between the R&D spending reported and the number of compounds approved. However, the R&D process is complex and assuming an equal time lag for all compounds does not account for the enormous variability in project duration [62, 63]. This variability is reflected in the wide range of development times depending on the therapeutic area.
Ultimately there is a trade-off between transparency and specificity. Therefore, we included two factors to assess the monetary values used to estimate clinical R&D costs: (1) replicability, and (2) specificity. For the replicability factor, a higher value was assigned to the use of publicly available data, while a higher specificity score was given to articles that included information by project and firm. With few exceptions [24, 37, 47, 59], the scores for specificity were higher than for replicability, suggesting a trend to sacrifice transparency in favor of more accurate estimates.
The most overlooked domain was the ‘possible source of variation in the R&D costs’, which reflects the heterogeneity of the pharmaceutical sector and the potential implications of this heterogeneity on the estimated value. Several factors affect the investment in R&D, and we selected the five factors most often mentioned in the literature: therapeutic class; orphan or non-orphan drugs; firm size; NCE or new biological entity (NBE); and self-originated or licensed-in (acknowledging it is not meant to be an exhaustive list).
Only seven papers considered differences by therapeutic area. One article [19] reported an estimate for oncology (total R&D capitalized costs) of over $4 billion higher than the R&D costs for any other estimated therapeutic category. In addition to the seven mentioned articles, seven other articles focused on one therapeutic area only, thereby not considering possible differences among disease categories. Moreover, there were differences regarding therapy-specific estimates. For example, in oncology, Falconi et al. [50] estimated R&D costs of $2.1 billion, one of the highest in the sample, while the Prasad and Mailankody [37] estimate was considerably lower at $944 million.
Only a few articles considered differences by therapeutic area. However, R&D cost differences among therapeutic areas are highly plausible given the differences in project success rates between disease areas and types of molecules [1, 4, 63]. For example, empirical evidence suggests that monoclonal antibodies for cancer have the highest probability of success [1]. Additionally, technological advancements have led to considerable growth in research opportunities in some disease areas, increasing the number of possible compounds that can be tested. This is reflected in the differences of the number of compounds in the pipeline among therapeutic areas [64, 65], where the largest proportion corresponds to oncological products [65]. Moreover, improvements in preclinical testing in some therapeutic areas have facilitated early discontinuation when warranted, avoiding unnecessary clinical trial costs [5].
Despite the increase in the number of new orphan drugs approved and launched into the market [66, 67], the methodologies used to estimate R&D costs mostly ignored possible differences between orphan and non-orphan drugs. Some studies suggest that R&D costs for orphan drugs might be about half of those for non-orphan medicines [39–41]. This is partly explained by the fact that trials related to rare diseases include fewer participants, are less likely to be randomized or double-blinded, and are more likely to assess disease response instead of overall survival [66]. Additionally, regulatory innovations incentivizing research on rare diseases—partly by reducing companies’ out-of-pocket R&D costs, reducing the time from submission to approval, and shifting risk to the post-authorization period—have led to the authorization of many treatments based on fewer data and surrogate measures only [66]. This might explain a negative effect on the pre-approval R&D spending while potentially impacting post-launch R&D costs. However, some factors suggest potentially higher average R&D costs of bringing an orphan drug into the market. For instance, the R&D process for orphan drugs is marked by difficulties in recruiting patients for clinical trials, thus increasing costs per patient. Furthermore, relatively less medical research is conducted on rare diseases, resulting in a limited clinical understanding of such disease processes. Moreover, for ultra-rare diseases, the generation of robust clinical evidence is hindered by the limited availability of validated instruments to measure disease severity and progression [43, 68].
An additional source of heterogeneity in the R&D process is the size of the pharmaceutical company. The evidence is inconclusive on whether smaller firms are more efficient than larger firms in bringing new drugs into the market. Backfisch [69] suggests that this disagreement is due to disparities among selected samples and periods, emphasizing that new projects from small firms have been growing strongly. Despite the increase in R&D efforts of small and medium firms, only three studies considered the firm size in their estimations [51, 54, 57]. Additionally, some of the included articles used samples solely or mainly from large firms. Moreover, medium and small firms tend to produce NBEs rather than NCEs [4], with the former having lower attrition than the latter. Thus, excluding small and medium companies would also exclude NBEs, potentially biasing the results.
There is a lack of data measuring the R&D costs of licensed-in products; accordingly, only one article included this component [37]. Ignoring these products might bias the results, since evidence suggests licensed-in products have higher success rates than self-originated molecules [4, 70]. Because small firms produce a higher proportion of licensed-in products, omitting them might also bias the results.
It is debatable whether the trend in current R&D cost estimates can predict future development. During the last decade, regulatory authorities have implemented new mechanisms allowing earlier access to new medicines [71, 72]. For instance, the FDA implemented the Fast-Track Program in 1987 and the Accelerated Approval Program in 1992 [66], while the EMA has been issuing conditional marketing authorizations since 2006 [73, 74]. These changes imply a shift in R&D costs from pre- to post-marketing authorization. The studies that are undertaken post-launch research should count as R&D costs, especially if required by regulatory authorities. However, no data are available on how this shift impacts total R&D costs when R&D includes pre- and post-authorization activities.
Additionally, most R&D cost estimates do not adequately capture the complexities of drug discovery and clinical trials. For instance, although changes in cancer classification and treatment strategies have resulted in clinical trial design improvements [75], none of the oncological drug studies mentioned the potential effects of the increasing complexity of clinical trials.
Another indicator that current estimates may not predict future expenditures per NME is the evolution of the industry’s pipeline. Given the increasing impact of personalized or precision medicines [76], there is a transition towards targeted treatments that are more effective or better tolerated in smaller groups of patients. This generates a need to co-develop diagnostic tools to identify individuals most likely to benefit. The total effect on R&D costs is unclear but it also merits further investigation.
High list prices of many recently launched anticancer drugs, orphan products, and immune and gene therapies [6, 7, 77] have prompted calls for ‘cost-plus’ pricing approaches. One such proposal began with a call for transparency on the actual R&D costs for a cancer drug and resulted in an algorithm for a ‘cost price of new [cancer] treatment’ [78]. Similarly, a proposal for reasonable prices of orphan drugs suggested increased thresholds for cost effectiveness by considering R&D costs and treatment populations [79]. They argued that society might be willing to sacrifice some efficiency as long as the profitability of the manufacturers does not exceed that of non-orphan drugs [79]. In this context, calls for transparency of the cost to develop an NME have gained popularity [80], for instance the 2019 publication of the resolution on price transparency of the World Health Assembly (WHA) [81, 82]. Interestingly, while the resolution focused on transparency of net prices, no consensus was achieved on a proposed requirement for pharmaceutical companies to disclose internal R&D and other cost data [81]. However, proposals for increased transparency of R&D costs face practical difficulties. For instance, accounting for the actual cost may remove incentives for manufacturers to accelerate and efficiently manage development. Furthermore, it may be challenging to obtain the desired transparency (e.g., the actual cost of failures).
By definition, average R&D cost estimates, even when adjusted by potential differences (e.g., by therapeutic area), do not account for the added value offered by a new treatment modality. From an economic perspective, we believe that social value should be the primary determinant of reasonable drug prices [83–85]. If there are important elements of social value not captured by the logic of cost effectiveness, as implemented in many health technology assessment (HTA) processes, the completeness of the value component of the cost-benefit equation needs to be examined. In fact, there is increasing evidence that social norms and preferences are not adequately included in conventional health economic evaluation models [41, 86].
Study Limitations
First, personal experience and knowledge could have influenced our scoring. We addressed potential biases by basing our scoring criteria on previous literature and incorporating the experts’ concerns reflected in the literature in the ranking and descriptions given to the categories in the 1 to 6 scales. However, the heterogeneity in experts’ opinions (i.e., points of view and priorities) made this a difficult task that leads to an unavoidable degree of subjectivity. We addressed this subjectivity by basing the categories’ descriptions on extensive deliberation among our team members. A key touchstone was establishing well-defined, commonly understood definitions of each category to reduce personal interpretation of the data. Additionally, we distributed the scoring among four persons, first independently and subsequently by consensus. Finally, we conducted a sensitivity analysis to test the robustness of the suitability scores when between one and four factors were excluded from the analysis. However, the only way to eliminate subjectivity is through broader discussions on a common ground where there is an agreement on at least what needs to be discussed; our framework aims to be this common ground.
Second, we applied equal weighting to each factor. For a study to include a meaningful set of weights, it should use a focus group of experts and relevant stakeholders to incorporate systematically different points of view (e.g., the Delphi method). Such an undertaking is part of the next steps of a research plan that will follow this study. Our framework is the first step to initiate and encourage discussion of the future development of such a set of weights.
Third, a quantitative analysis is hindered by the differences in the models and the low number of observations. Therefore, it is impossible to verify which factor(s) had the strongest influence on the R&D cost estimates, or determine causality between the factors and the final R&D costs. Accordingly, despite statistical significance, the positive relationship identified between the drug inclusion period and the magnitude of the estimates should be treated with caution. Similarly, the lack of transparency due to the confidentiality of the data hindered us from determining to what degree the sample data affected the level of R&D costs estimated.
Fourth, we included articles that report the methodology used to collect information and the estimates of R&D costs. Articles that lacked this information were excluded [87–89], however they may provide further insight into this research topic.
Lastly, the complexity of the topic prevented the inclusion of an exhaustive list of factors. Nevertheless, we feel that our careful analysis of the literature has captured the main concerns expressed by experts and other shareholders interested in this topic.
Conclusions and Future Perspectives
There is no simple answer to our original question of how much it costs (on average) to research and develop a new medicine, specifically an NME. Average R&D costs mask essential sources of heterogeneity. For example, there are differences by therapeutic area, with new cancer showing the highest R&D costs. Other sources of heterogeneity among estimates are less well-documented, for example the impact of firm size, orphan versus non-orphan, chemical versus biological compounds (i.e., small versus large molecules), the origin of a new drug candidate (in-house versus licensed-in), and the potential role of public versus private funding. Future studies should include previously neglected variables and carefully consider the trade-off between the transparency and public accessibility of data and their specificity. Our scoring system may provide valuable guidance in that respect.
We detected a trend indicating that capitalized costs per NME are increasing. If the trend continues, it might have implications for the viability of the research-based biopharmaceutical industry’s business model. However, even this interpretation relies on the assumption that current or past trends are indicators of future trends, which is debatable. Future increases in R&D costs might reflect the growing complexity of target diseases, but ultimately these increases will be a function of the evolution of direct costs, attrition rates, and development times. These factors might be influenced by technological advances, the emergence of precision medicine, the resulting ‘orphanization’ of indications, and the development of companion diagnostics allowing effective stratification of patient subpopulations.
Regarding our included studies, we do not intend to deny any of their merits. Instead, we assessed how comprehensively the studies reported factors that play a role in the R&D cost estimation. We created a multifactorial framework because we believe that the validity of R&D cost estimates rests on multiple conditions. Estimations are difficult or almost impossible to compare because too many researchers tend to favor some factors to the detriment of others. Moreover, R&D cost estimates are used without considering the assumptions underlying the estimation. In this regard, our framework can serve as a guideline of the minimum set of factors that should be considered in future R&D cost estimations. If some proposed factors are not taken into account, they should at least be discussed in terms of the potential effects on the estimation. There remains a long way to the establishment of a commonly agreed framework to evaluate R&D cost estimations, particularly when considering that the R&D of new molecular entities is far from static. We believe our framework can play an important role in providing clarity of what a particular R&D cost estimation captures.
Supplementary Information
Below is the link to the electronic supplementary material.
Acknowledgements
The authors would like to thank Ms. Rachel Eckford, a native speaker of American English, for her constructive criticism of the manuscript. The authors also thank Ms. Erica Niebauer for her support in the article selection process.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Declarations
Conflicts of interest
Michael Schlander, Karla Hernandez-Villafuerte, Chih-Yuan Cheng, Jorge Mestre-Ferrandiz, and Michael Baumann have no conflicts of interest to report.
Availability of data and material
Not applicable.
Code availability
Available from the authors upon reasonable request.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Author contributions
M.S.: Conceptualization, formal analysis, methodology, project administration, supervision, validation, visualization, writing—original draft, writing—review and editing, data analysis. K.H.-V.: Conceptualization, data curation, formal analysis, methodology, project administration, validation, visualization, writing—original draft, writing—review and editing, literature search, data analysis. C.-Y.C.: Conceptualization, data curation, formal analysis, methodology, validation, visualization, writing—original draft, writing—review and editing, literature search, data analysis. J.M.-F.: Conceptualization, formal analysis, methodology, validation, visualization, writing—original draft, writing—review and editing, data analysis. M.B.: Supervision, validation, writing—review and editing.
Footnotes
The original Online version of this article was revised: The Funding note was not included, however it was misplaced in Declarations section in the original version.
Michael Schlander and Karla Hernandez-Villafuerte contributed equally as first authors.
Change history
11/17/2021
The Funding note is included and deleted from the Declarations section.
References
- 1.Pammolli F, Magazzini L, Riccaboni M. The productivity crisis in pharmaceutical R&D. Nat Rev Drug Discov. 2011;10(6):428. doi: 10.1038/nrd3405. [DOI] [PubMed] [Google Scholar]
- 2.Barker R. A flexible blueprint for the future of drug development. Lancet. 2010;375(9712):357–359. doi: 10.1016/S0140-6736(10)60141-9. [DOI] [PubMed] [Google Scholar]
- 3.Gambardella A, Orsenigo L, Pammolli F, Lacetera N, Magazzini L, Mariani M, et al. Global competitiveness in pharmaceuticals: a European perspective. Brussels: European Commission; 2000. [Google Scholar]
- 4.Backfisch M. Have pharmaceutical R&D project success rates decreased? A critical review and new empirical results. In Joint discussion paper series in economics. 2017.
- 5.Pammolli F, Righetto L, Abrignani S, Pani L, Pelicci PG, Rabosio E. The endless frontier? The recent upsurge of R&D productivity in pharmaceuticals. BioRxiv:2019:670471. [DOI] [PMC free article] [PubMed]
- 6.Howard DH, Bach PB, Berndt ER, Conti RM. Pricing in the market for anticancer drugs. J Econ Perspect. 2015;29(1):139–162. doi: 10.1257/jep.29.1.139. [DOI] [PubMed] [Google Scholar]
- 7.Luzzatto L, Hyry HI, Schieppati A, Costa E, Simoens S, Schaefer F, et al. Outrageous prices of orphan drugs: a call for collaboration. Lancet. 2018;392(10149):791–794. doi: 10.1016/S0140-6736(18)31069-9. [DOI] [PubMed] [Google Scholar]
- 8.Workman P, Draetta GF, Schellens JH, Bernards R. How much longer will we put up with $100,000 cancer drugs? Cell. 2017;168(4):579–583. doi: 10.1016/j.cell.2017.01.034. [DOI] [PubMed] [Google Scholar]
- 9.Hyman DA, Silver C. Pricing and paying for cancer drugs: policy options for fixing a broken system. Cancer J. 2020;26(4):298–303. doi: 10.1097/PPO.0000000000000457. [DOI] [PubMed] [Google Scholar]
- 10.Salas-Vega S, Shearer E, Mossialos E. Relationship between costs and clinical benefits of new cancer medicines in Australia, France, the UK, and the US. Soc Sci Med. 2020;258:113042. [DOI] [PubMed]
- 11.Vogler S, Vitry A. Cancer drugs in 16 European countries, Australia, and New Zealand: a cross-country price comparison study. Lancet Oncol. 2016;17(1):39–47. doi: 10.1016/S1470-2045(15)00449-0. [DOI] [PubMed] [Google Scholar]
- 12.van Harten WH, Wind A, de Paoli P, Saghatchian M, Oberst S. Actual costs of cancer drugs in 15 European countries. Lancet Oncology. 2016;17(1):18–20. doi: 10.1016/S1470-2045(15)00486-6. [DOI] [PubMed] [Google Scholar]
- 13.Simoens S, Picavet E, Dooms M, Cassiman D, Morel T. Cost-effectiveness assessment of orphan drugs. Springer; 2013. [DOI] [PubMed]
- 14.Hollis A. Orphan drug pricing and costs: a case study of Kalydeco and Orkambi. Healthc Policy. 2019;15(1):70. doi: 10.12927/hcpol.2019.25937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Office of Fair Trading. The pharmaceutical price regulation scheme: an OFT market study. United Kingdom. Office of Fair Trading; 2007.
- 16.DiMasi JA, Hansen RW, Grabowski HG, Lasagna L. Cost of innovation in the pharmaceutical industry. J Health Econ. 1991;10(2):107–142. doi: 10.1016/0167-6296(91)90001-4. [DOI] [PubMed] [Google Scholar]
- 17.DiMasi JA, Grabowski HG, Hansen RW. Innovation in the pharmaceutical industry: new estimates of R&D costs. J Health Econ. 2016;47(1):20–33. doi: 10.1016/j.jhealeco.2016.01.012. [DOI] [PubMed] [Google Scholar]
- 18.DiMasi JA, Hansen RW, Grabowski HG. The price of innovation: new estimates of drug development costs. J Health Econ. 2003;22(2):151–185. doi: 10.1016/S0167-6296(02)00126-1. [DOI] [PubMed] [Google Scholar]
- 19.Wouters OJ, McKee M, Luyten J. Estimated research and development investment needed to bring a new medicine to market, 2009–2018. JAMA. 2020;323(9):844–853. doi: 10.1001/jama.2020.1166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Avorn J. The $2.6 billion pill: methodologic and policy considerations. N Engl J Med. 2015;372(20):1877–9. [DOI] [PubMed]
- 21.Kesselheim AS, Avorn J, Sarpatwari A. The high cost of prescription drugs in the United States: Origins and prospects for reform. JAMA. 2016;316(8):858–871. doi: 10.1001/jama.2016.11237. [DOI] [PubMed] [Google Scholar]
- 22.Prasad V, De Jesus K, Mailankody S. The high price of anticancer drugs: origins, implications, barriers, solutions. Nat Rev Clin Oncol. 2017;14(6):381–390. doi: 10.1038/nrclinonc.2017.31. [DOI] [PubMed] [Google Scholar]
- 23.Goozner M. A much-needed corrective on drug development costs. JAMA Intern Med. 2017;177(11):1575–1576. doi: 10.1001/jamainternmed.2017.4997. [DOI] [PubMed] [Google Scholar]
- 24.Young B, Surrusco M. RX R&D myths: the case against the drug industry’s ‘R&D scare card’. Washington, DC: Public Citizen; 2001. [Google Scholar]
- 25.Love J. Evidence regarding research and development investments in innovative and non-innovative medicines. Consumer Project on Technology; 2003.
- 26.Angell M. The truth about the drug companies: how they deceive us and what to do about it. New York: Random House; 2005. [Google Scholar]
- 27.Light DW, Warburton R. Demythologizing the high costs of pharmaceutical research. BioSocieties. 2011;6(1):34–50. [Google Scholar]
- 28.Light D, Warburton R. Extraordinary claims require extraordinary evidence: comment. J Health Econ. 2005;24(5):1030–1033. doi: 10.1016/j.jhealeco.2005.07.001. [DOI] [PubMed] [Google Scholar]
- 29.Light DW. Misleading congress about drug development. J Health Polit Policy Law. 2007;32(5):895–913. doi: 10.1215/03616878-2007-063. [DOI] [PubMed] [Google Scholar]
- 30.Light DW, Warburton RN. Setting the record straight in the reply by DiMasi, Hansen and Grabowski. J Health Econ. 2005;24(5):1045–1048. doi: 10.1016/j.jhealeco.2005.07.001. [DOI] [PubMed] [Google Scholar]
- 31.Goozner M. The 800 million dollar pill: the truth behind the cost of new drugs. Berkeley: University of California Press; 2004. [Google Scholar]
- 32.DiMasi JA, Hansen RW, Grabowski HG. Reply: Extraordinary claims require extraordinary evidence. J Health Econ. 2005;24:1034–1044. doi: 10.1016/j.jhealeco.2005.07.001. [DOI] [PubMed] [Google Scholar]
- 33.DiMasi JA, Hansen RW, Grabowski HG. Setting the record straight on setting the record straight: response to the light and Warburton rejoinder. J Health Econ. 2005;24(5):1049–1053. [Google Scholar]
- 34.Dimasi JA, Hansen RW, Grabowski HG. Assessing claims about the cost of new drug development: a critique of the Public Citizen and TB Alliance reports. Tufts Center for the Study of Drug Development; 2006.
- 35.Dimasi JA, Hansen RW, Grabowski HG. Misleading congress about drug development: reply. J Health Polit Policy Law. 2008;33(2):319–324 (discussion 25–27). [DOI] [PubMed]
- 36.DiMasi JA, Grabowski HG, Hansen RW. The cost of drug development. N Engl J Med. 2015;372(20):1972. doi: 10.1056/NEJMc1504317. [DOI] [PubMed] [Google Scholar]
- 37.Prasad V, Mailankody S. Research and development spending to bring a single cancer drug to market and revenues after approval. JAMA Intern Med. 2017;177(11):1569–1575. doi: 10.1001/jamainternmed.2017.3601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.DiMasi JA. Assessing pharmaceutical research and development costs. JAMA Intern Med. 2018;178(4):587. [DOI] [PubMed]
- 39.EvaluatePharma. Orphan drug 20142014.
- 40.Jayasundara K, Hollis A, Krahn M, Mamdani M, Hoch JS, Grootendorst P. Estimating the clinical cost of drug development for orphan versus non-orphan drugs. Orphanet J Rare Dis. 2019;14(1):12. doi: 10.1186/s13023-018-0990-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Schlander M, Garattini S, Holm S, Kolominsky-Rabas P, Nord E, Persson U, et al. Incremental cost per quality-adjusted life year gained? The need for alternative methods to evaluate medical interventions for ultra-rare disorders. J Comp Effective Res. 2014;3(4):399–422. doi: 10.2217/cer.14.34. [DOI] [PubMed] [Google Scholar]
- 42.Metrick A, Yasuda A. Venture capital and the finance of innovation. Wiley; 2010.
- 43.Morgan S, Grootendorst P, Lexchin J, Cunningham C, Greyson D. The cost of drug development: a systematic review. Health Policy. 2011;100:4–17. doi: 10.1016/j.healthpol.2010.12.002. [DOI] [PubMed] [Google Scholar]
- 44.US Bureau of Economic Analysis. Implicit price deflators for gross domestic product [index numbers, 2012 = 100]. Revised 27 Feb 2020. US Bureau of Economic Analysis.
- 45.Chit A, Parker J, Halperin SA, Papadimitropoulos M, Krahn M, Grootendorst P. Toward more specific and transparent research and development costs: the case of seasonal influenza vaccines. Vaccine. 2014;32(26):3336–3340. doi: 10.1016/j.vaccine.2013.06.055. [DOI] [PubMed] [Google Scholar]
- 46.International Monetary Fund. Exchange rate archives: representative exchange rates for selected currencies. 2020. https://www.imf.org/external/np/fin/data/param_rms_mth.aspx. Accessed Mar 2020.
- 47.Årdal C, Baraldi E, Theuretzbacher U, Outterson K, Plahte J, Ciabuschi F, et al. Insights into early stage of antibiotic development in small-and medium-sized enterprises: a survey of targets, costs, and durations. J Pharmaceut Policy Pract. 2018;11(1):8. doi: 10.1186/s40545-018-0135-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Mestre-Ferrandiz J, Sussex J, Towse A. The R&D cost of a new medicine. London: Office of Health Economics; 2012. [Google Scholar]
- 49.Sertkaya A, Eyraud JT, Birkenbach A, Franz C, Ackerley N, Overton V, et al. Analytical framework for examining the value of antibacterial products. US Department of Health and Human Services; 2014.
- 50.Falconi A, Lopes G, Parker JL. Biomarkers and receptor targeted therapies reduce clinical trial risk in non–small-cell lung cancer. J Thorac Oncol. 2014;9(2):163–169. doi: 10.1097/JTO.0000000000000075. [DOI] [PubMed] [Google Scholar]
- 51.Adams CP, Brantner VV. Spending on new drug development. Health Econ. 2010;19(2):130–141. doi: 10.1002/hec.1454. [DOI] [PubMed] [Google Scholar]
- 52.Paul SM, Mytelka DS, Dunwiddie CT, Persinger CC, Munos BH, Lindborg SR, et al. How to improve R&D productivity: the pharmaceutical industry’s grand challenge. Nat Rev Drug Discov. 2010;9(3):203. doi: 10.1038/nrd3078. [DOI] [PubMed] [Google Scholar]
- 53.DiMasi JA, Grabowski HG. The cost of biopharmaceutical R&D: is biotech different? Manag Decis Econ. 2007;28(4–5):469–479. [Google Scholar]
- 54.Adams CP, Brantner VV. Estimating the cost of new drug development: is it really $802 million? Health Aff. 2006;25(2):420–428. doi: 10.1377/hlthaff.25.2.420. [DOI] [PubMed] [Google Scholar]
- 55.DiMasi JA, Grabowski HG, Vernon J. R&D costs and returns by therapeutic category. Drug Inf J. 2004;38(3):211–223. [Google Scholar]
- 56.Global Alliance for TB Drug Development. The economics of TB drug development: New data for new research. New York: Global Alliance for TB Drug Development; 2001.
- 57.DiMasi JA, Grabowski HG, Vernon J. R&D costs, innovative output and firm size in the pharmaceutical industry. Int J Econ Bus. 1995;2(2):201–219. [Google Scholar]
- 58.DiMasi JA, Hansen RW, Grabowski HC, Lasagna L. Research and development costs for new drugs by therapeutic category. Pharmacoeconomics. 1995;7(2):152–169. doi: 10.2165/00019053-199507020-00007. [DOI] [PubMed] [Google Scholar]
- 59.Wiggins SN. The cost of developing a new drug. Pharmaceutical Manufacturers Association; 1987.
- 60.Hansen RW. The pharmaceutical development process: estimates of development costs and times and the effects of proposed regulatory changes. In Chien RI editor. Issues in pharmaceutical economics. Lexiton: D.C. Heath and Company; 1979.
- 61.Hansen RW. Regulation and pharmaceutical innovation: a review of the literature on monetary measures of costs and benefits. Washington, DC: Center for Research in Government Policy and Business, University of Rochester; 1976. [Google Scholar]
- 62.Abrantes-Metz RM, Adams C, Metz AD. Pharmaceutical development phases: a duration analysis. In Working paper 274. Federal Trade Commission, Bureau of Economics working paper; 2004.
- 63.Barrenho E, Smith P, Miraldo M. The determinants of attrition in drug development: a duration analysis. In Report No. 1744-6783. Imperial College London; 2013.
- 64.Smietana K, Ekstrom L, Jeffery B, Møller M. Improving R&D productivity. Nat Rev Drug Discov. 2015;14(7):455–456. doi: 10.1038/nrd4650. [DOI] [PubMed] [Google Scholar]
- 65.IQVIA. The changing landscape of research and development: innovation, drivers of change, and evolution of clinical trial productivity. IQVIA Institute for Human Data Science; 2019.
- 66.Darrow JJ, Avorn J, Kesselheim AS. FDA approval and regulation of pharmaceuticals, 1983–2018. JAMA. 2020;323(2):164–176. doi: 10.1001/jama.2019.20288. [DOI] [PubMed] [Google Scholar]
- 67.Mestre-Ferrandiz J, Palaska C, Kelly T, Hutchings A, Parnaby A. An analysis of orphan medicine expenditure in Europe: is it sustainable? Orphanet J Rare Dis. 2019;14(1):287. doi: 10.1186/s13023-019-1246-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Schlander M, Garattini S, Kolominsky-Rabas P, Nord E, Persson U, Postma M, et al. Determining the value of medical technologies to treat ultra-rare disorders: a consensus statement. J Market Access Health Policy. 2016;4(1):33039. doi: 10.3402/jmahp.v4.33039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Backfisch M. The development of firm size and innovativeness in the pharmaceutical industry between 1989 and 2010. In Joint discussion paper series in economics; 2018.
- 70.DiMasi JA, Feldman L, Seckler A, Wilson A. Trends in risks associated with new drug development: success rates for investigational drugs. Clin Pharmacol Therapeut. 2010;87(3):272–277. doi: 10.1038/clpt.2009.295. [DOI] [PubMed] [Google Scholar]
- 71.Baird L, Banken R, Eichler HG, Kristensen F, Lee D, Lim J, et al. Accelerated access to innovative medicines for patients in need. Clin Pharmacol Therapeut. 2014;96(5):559–571. doi: 10.1038/clpt.2014.145. [DOI] [PubMed] [Google Scholar]
- 72.Eichler HG, Oye K, Baird LG, Abadie E, Brown J, Drum C, et al. Adaptive licensing: taking the next step in the evolution of drug approval. Clin Pharmacol Therapeut. 2012;91(3):426–437. doi: 10.1038/clpt.2011.345. [DOI] [PubMed] [Google Scholar]
- 73.European Medicines Agency . Conditional marketing authorisation: report on ten years of experience at the European Medicines Agency. London: European Medicines Agency; 2017. [Google Scholar]
- 74.Martinalbo J, Bowen D, Camarero J, Chapelin M, Démolis P, Foggi P, et al. Early market access of cancer drugs in the EU. Ann Oncol. 2016;27(1):96–105. doi: 10.1093/annonc/mdv506. [DOI] [PubMed] [Google Scholar]
- 75.Renfro LA, An M-W, Mandrekar SJ. Precision oncology: a new era of cancer clinical trials. Cancer Lett. 2017;387:121–126. doi: 10.1016/j.canlet.2016.03.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Dugger SA, Platt A, Goldstein DB. Drug development in the era of precision medicine. Nat Rev Drug Discov. 2018;17(3):183. doi: 10.1038/nrd.2017.226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.World Health Organization. Access to medicines, vaccines and pharmaceuticals. World Health Organization; 2018.
- 78.Uyl-de Groot CA, Löwenberg B. Sustainability and affordability of cancer drugs: a novel pricing model. Nat Rev Clin Oncol. 2018;15(7):405. doi: 10.1038/s41571-018-0027-x. [DOI] [PubMed] [Google Scholar]
- 79.Berdud M, Drummond M, Towse A. Establishing a reasonable price for an orphan drug. London: Office of Health Economics; 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Simoens S. Pricing and reimbursement of orphan drugs: the need for more transparency. Orphanet J Rare Dis. 2011;6(1):42. doi: 10.1186/1750-1172-6-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Shaw B, Mestre-Ferrandiz J. Talkin’ about a resolution: issues in the push for greater transparency of medicine prices. Pharmacoeconomics. 2020;38(2):125–134. doi: 10.1007/s40273-019-00877-3. [DOI] [PubMed] [Google Scholar]
- 82.Silverman ED. World Health Assembly adopts resolution over transparent drug pricing to mixed reviews. Pharmalot 2019. https://www.statnews.com/pharmalot/2019/05/28/drug-prices-transparency-world-health-assembly/. Accessed 2 Mar 2020.
- 83.Miners A, Cairns J, Wailoo A. Department of health proposals for including wider societal benefits into value based pricing: a description and critique. Sheffield: University of Sheffield, NICE Decision Support Unit; 2013. [Google Scholar]
- 84.Richardson J, McKie J. Economic evaluation of services for a National Health Scheme: the case for a fairness-based framework. J Health Econ. 2007;26(4):785–799. doi: 10.1016/j.jhealeco.2006.11.004. [DOI] [PubMed] [Google Scholar]
- 85.Richardson J, Iezzi A, Sinha K, Khan MA, Mckie J. An instrument for measuring the social willingness to pay for health state improvement. Health Econ. 2014;23(7):792–805. doi: 10.1002/hec.2950. [DOI] [PubMed] [Google Scholar]
- 86.Richardson J, Schlander M. Health technology assessment (HTA) and economic evaluation: efficiency or fairness first. J Market Access Health Policy. 2019;7(1):1557981. doi: 10.1080/20016689.2018.1557981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Deloitte & Global Data. Unlocking R&D productivity: measuring the return from pharmaceutical innovation 2019. The Deloitte Centre for Health Solutions & Global Data; 2018.
- 88.Deloitte & Thomson Reuters. Measuring the return from pharmaceutical innovation 2012: is R&D earning its investment? The Deloitte Centre for Health Solutions & The Thomson Reuters Life Sciences Professional Services Team; 2012.
- 89.Gilbert J, Henske P, Singh A. rebuilding big pharma’s business model. In Vivo Bus Med Rep. 2003;21(10).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.