Abstract
Outcomes based payments contracting is in its infancy. The increased attention being given to rare disease place a premium on the ability to engage with payers to ensure that there is an analytical framework relevant to value claims contracting. Rare disease is not, of course, alone; many other chronic disease states may be suitable candidates and have been over the past 10 years or more. Rare disease, however stands apart: (i) the evidence base at product launch is limited; (ii) the therapy costs are often considered prohibitive; and (iii) the target patient population is small. At the same time, those seeking to implement an evidence-based engagement with health systems to support innovative rare disease interventions face a substantive technology assessment barrier. The focus in health technology assessment on assumption driven modeled cost-effectiveness simulations that support imaginary recommendations for cost-effective pricing and access is, however, an avoidable barrier. In the US, this barrier is the business model of the Institute for Clinical and Economic Review (ICER) and one endorsed by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Rare disease can be better served with other tools at our disposal with a proposed new start analytical framework in health technology assessment. The purpose of this brief note is to make the case that this proposed new start focused on single attribute value claims that meet the standards of normal science and fundamental evidence can not only dispense with the ICER imaginary modeling but, with a new start formulary submission package, integrate value claims with assessment protocols to set the stage for effective outcome-based contracting as the default standard for future payer negotiations.
Keywords: Value claims, rare disease, new standards, abandoning ICER, imaginary claims
INTRODUCTION
Value claims for pharmaceutical products and devices to support outcomes contracting, in particular in rare disease, can only be understood if we are clear about the standards that must be applied in the development, application and evaluation of instruments to capture response to therapy within the many rare disease and therapy areas 1. If a value claim, whether it is for clinical outcomes, patient reported outcomes (to include quality of life), drug utilization or resource utilization, is to support formulary submissions and, in the longer run, outcomes contracting to support pricing and access recommendations, then it must meet the standards for normal science, including fundamental measurement. These requirements are critical in rare disease where the focus is on closely targeted therapies and not high prevalence chronic conditions where we have, in the past, focused on ‘blockbuster’ therapies; where outcomes contracting has been essentially ignored. The unique status of targeted rare disease products represents a game changer 1. Close attention needs to be given to the structure and content of formulary submissions, the standards of value claims and, in the longer term, protocols to accompany those claims; protocols that detail the process of claims tracking and reporting for health systems and contracting with partners who understandably seek to attempt to minimize risk and defaults in outcomes contracting for rare disease.
The purpose of this brief commentary is to detail the required standards for value claims in rare disease, the importance of a formulary submission that promotes evaluable value claims and the place of protocols to support those claims, and prospective outcomes contracting 1. To date, there has been limited efforts to introduce outcomes contracting in rare disease. Perhaps this is not for want of trying, but the reason may be more basic: the absence of an agreed set of rules to support formulary submissions where a balance has to be sought, favorable to all parties, between the obvious need to recoup development costs by the manufacturer and the equally obvious concern of the health system that the needs of patients and caregivers are met. Needs, it might be added, that are broader than the those articulated by clinicians. This commentary considers: (i) a statement of the required analytical standards for value claims; and (ii) the required structure and content of formulary submissions to support value claims in rare disease and potential outcomes contracting.
STANDARDS FOR VALUE CLAMS
If we accept the standards of normal science for credible, evaluable and replicable value claims, together with recognition of the limitations of fundamental measurement, then we must recognize two essential premises for any disease specific value claim and formulary submission:
All value claims for a product or therapeutic intervention must each refer to a single attribute that meets the demarcation standards for normal science: all value claims must be credible, evaluable and replicable
All value claims must be consistent with the limitations imposed by the axioms of fundamental measurement: they must be unidimensional and meet interval or ratio measurement standards
These premises apply to value claims that are disease or target patient population specific, where every claim is supported by a reporting and assessment protocol. It should be emphasized that value claims are not one-off statements of anticipated impact; rather they must be seen as provisional, subject to review and the outcomes of tracking and contracting, to set the stage for the further discovery of ‘new facts’ as they apply to that rare disease. Ideally, the engagement between a manufacturer in a rare disease must be for the life of the product or as long as the health system sees a benefit from its place on formulary.
Measurement is critical. As detailed in previous commentaries in Innovations in Pharmacy value claims for specific attributes should have interval or ratio measurement properties; if not then we have no basis, as with failed ordinal measures, for evaluating response to therapy 2 3. As outcomes contracting is focused on response, and agreement on the validity of the proposed response measure, then we need agreement on the appropriate standards. The corollary here is that if we insist on these standards for measurable single attributes then we must reject multiattribute preference scores such as those for the EQ-5D-5L (and the preference base QALY) as well, as the majority of disease specific instruments that have only ordinal scores 4. Claims that the EQ-5D-3L instrument, for example, has ratio properties to support QALYs is patently false when, with the UK value set, the preference equation results in 34.6% of the 243 health states having a negative score or categorized as states worse than death 5. There is no true zero or any evidence for an interval score; the time trade off (TTO) tariffs are ordinal. The ordinal nature of preference scores points to a fundamental issue in rare disease: if the needs of patients and caregivers are to be evaluated and response captured, then new instruments are required and the application of Rasch measurement theory (RMT) for both dichotomous and polytomous patient reported (PRO) instruments 6. There are a number of examples of dichotomous response instruments that meet the required Rasch measurement standards; in the case of patients’ needs, an example is the, Psoriatic Arthritis Quality of Life Questionnaire (PSORIQoL) 7 and, for caregivers’ needs, the Alzheimer’s Patient Partners Life Impact Questionnaire (APPLIQue) 8 9 .
A NEW HEALTH TECHNOLOGY ASSESSMENT FRAMEWORK
Rare disease presents issues that are not found in more prevalent disease states: the question of defining a target disease population, issues of heterogeneity in population characteristics and prospective defining therapy response, the absence of data at product launch, limited comparator options and ill-defined standards of care, anticipated compliance with therapy, the time frame for tracking therapy response and limited tools to capture quality of life defined in terms of patient and caregiver needs. These are not unattainable objectives but require a commitment to the standards proposed for value claims and a willingness to invest in tracking those claims; if necessary, as part of an outcomes contract 1.
If value claims are to support effective contracting, then the choice of value claim must begin as early as Phase 2 in product development; protocols for phase 3 pivotal trials must reflect the choice of value claims and their congruence with the needs of patients and caregivers, together with those of the health system. The first step must be to decide on the categorization of value claims: clinical, PRO, drug and resource utilization. While it is easy to maintain that clinical claims, measured in interval or ratio terms, are a first call, it is important to agree these and ensure that they have the required measurement properties. There is, of course, a grey area between exclusively non-PRO clinical endpoints and PRO endpoints used by physicians to judge therapy response, yet all proposed measures must meet the required standards. This is critical because the overwhelming majority of PRO instruments used to assess therapy response may fail to meet the required Rasch measurement standards 10 11 12 13. Indeed, if there is a proposed core of instruments proposed for assessing response in a rare disease these must all be subject to the same scrutiny against RMT measurement standards (e.g., for polytomous response PRO instruments the concordance with the Rasch Rating Scale Model or Partial Credit Model to support the application of scores as approximations to interval scales for therapy response claims) 6 14.
Value claims for quality of life, either for the patient or, more usually in pediatric rare disease therapy targets, the caregiver, present a number of issues, First, it is absurd to consider any of the generic multiattribute instruments; none have the required measurement properties as they product composite ordinal preference scores. This means value claims in terms of QALYs are also to be rejected; together with any thought of attempting to emulate the ICER approximate information models with its imaginary lifetime claims 15. Instead, consideration should be given to the concept of needs fulfilment: to what extent are the subjectively assessed needs of patients and/or caregivers met in the absence of a new therapy and to what extent are these needs resolved through application of the therapy. Taking this path introduces the application of RMT or modern measurement theory 6. Widely applied for the past 60 years in education and psychology, and to a limited extent for PRO instruments in health technology assessment (with many misapplications), the appropriate application involves creating an instrument that considers the likelihood of a positive response in terms of the difficulty of a need and the ability of the patient or caregiver to resolve that need with a new intervention. The Rasch dichotomous model yields interval scores; it is now possible with a recently developed algorithm to translate these to a bounded ratio score 16. For the first time we have a true quality of life score that can yield, if required, the equivalent to a QALY measure. There are now some 25 plus dichotomous disease specific need fulfillment instruments available; few in rare diseases. This demonstrates the ability to create a disease specific instrument; but one that needs to be considered at phase 2 to allow time for development. If the measure is successful for the selected need fulfilment attribute in a rare disease, then this could be a key factor in product acceptance subject to instrument application and replication.
Value claims for drug and other resource utilization are more straightforward. Claims should be for specific attributes, I.e., for units defined by drug and procedure codes. Given access to the appropriate data bases, with target populations defined in terms of ICD-!0-CM or ICD-11 codes, it should not be difficult to propose value claims for product uptake, switching from comparator products and estimates of compliance with therapy. These would all be ratio measures.
QUESTIONS TO BE ASKED
Preparing and presenting value claims to lay the groundwork for possible outcome-based contracting is not one sided. It is important that formulary committees or their equivalent should be prepared with a list of questions to be submitted to the manufacturer to ensure that the required standards for credible, evaluable and replicable claims that meet interval or ratio standards should be met. In the case of PROs, notably needs fulfillment claims, the health system needs to be assured that the instruments are consistent with the Rasch models application of conjoint simultaneous measurement. This is not only an insurance protection for the formulary committee but it will hopefully ensure that the manufacturer meets the required standards. After all, given the potential cost to the manufacturer of implementing and reporting outcomes, a lack of appreciation of the importance of utilizing appropriate measurement standards could be evidence of prospective contractual failure.
CONCLUSIONS
It must be emphasized that the concern is not with the ability to claim a new therapy is cost-effective; this is an outcome claim that is not only mathematically impossible but one that fails to yield valid and empirically evaluable value claims 1. Rather, in rare disease, we look to a selective choice of value claims, a portfolio, each element of which must be the subject of a protocol based evaluation to support contracted pricing and access. A key element in the creation of value claims is to focus on evidence gaps; covering clinical, quality of life and resource utilization; if data are not available at product launch to enable rapid assessment and reporting of value claims, then outcomes contracting must look to data assembly to support claims over the longer term. Falling back on ICER modelled imaginary approximate information claims is no substitute; after all, there are any number of competing modelled claims that could be created, none of which could have a preferred non-evaluable claim for future realism over any other as they are all assumption driven subject to possible bias1 17. From the manufacturer’s perspective ICER and its claim for invented evidence is a major barrier; this must be faced down in the interests not only of the manufacturer but the patient and caregiver in rare disease. We have the required framework for rare disease submissions and the contractual framework to support and evaluate value claims.
Conflicts of Interest: PCL is an Advisory Board Member and Consultant to the Institute for Patient Access and Affordability, a program of Patients Rising
Note: The opinions contained in this paper are those of the author (PCL)
REFERENCES
- 1.Langley P. Nothing to Cheer About: Endorsing Imaginary Economic Evaluations and Value Claims with CHEERS 22 [version 1; peer review: 2 approved]. F1000Research 2022, 11:248 ( 10.12688/f1000research.109389.1) [DOI] [PMC free article] [PubMed]
- 2.Langley P. Value Assessment, Real World Evidence and Fundamental Measurement: Version 3.0 of the Minnesota Formulary Submission Guidelines. InovPharm. 2020;11(4): No. 12 https://pubs.lib.umn.edu/index.php/innovations/article/view/3542/2613 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Langley P. Medicaid Formulary Decisions and the Institute for Clinical and Economic Review: Abandoning Pseudoscience in Imaginary Pharmaceutical Pricing Claims. InovPharm. 2021;12(1): No. 11 https://pubs.lib.umn.edu/index.php/innovations/article/view/3702/2676 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Langley P. Concerns with Patient Reported Outcome Measurement and Value Claims for Therapy Response: The Case of Mavacamten and Symptomatic Hypertrophic Cardiomyopathy (SHCM). InovPharm. 2022;13(2): No. 16 https://pubs.lib.umn.edu/index.php/innovations/article/view/4861/3198 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Mulhern B, Feng Y, Shah Ket al. Comparing the UK EQ-5D-3L and English EQ-5D-5L value sets. PharmacoEconomics. 2018;36:699-713 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bond T, Yan Z, Heene M, Applying the Rasch Model: Fundamental measurement in the human sciences. 4th Ed. New York: Routledge, 2021 [Google Scholar]
- 7.McKenna S, Doward L, Whalley Det al. Development of the PSORIQoL; A quality of life instrument specific to psoriatic arthritis. Ann Rheum Dis. 2004;63(2):162-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hagell P, Rouse M, McKenna S.. Measuring the impact of caring for a spouse with Alzheimer’s disease: Validation of the Alzheimer’s Patient Partners Life Impact Questionnaire (APPLIQue). J App Measure. 2018: 19(3):271-82 [PubMed] [Google Scholar]
- 9.McKenna S, Rouse M, Heaney A, Hagell P.. International development of the Alzheimer’s Patient Partners Life Impact Questionnaire (APPLIQue). Am J Alzheimer’s Disease & Other Dementias. 2020;35:1-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.McKenna S, Heaney A, Langley P.. Fundamental Outcome Measurement: Selecting Patient Reported Outcome Instruments and Interpreting the Data they Produce. InovPharm. 2021; 12(2): No. 17 https://pubs.lib.umn.edu/index.php/innovations/article/view/3911/2764 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.McKenna S, Heaney A.. Setting and maintaining standards for patient-reported outcome measures: can we rely on the COSMIN checklists? J Med Econ. 2021;24(1):502-511 [DOI] [PubMed] [Google Scholar]
- 12.Mokkink L, Terwee C, Bouteret al. Reply to the concerns raised by McKenna and Heaney about COSMIN. .J Med Econ. 2021;24(1):857-859 [DOI] [PubMed] [Google Scholar]
- 13.McKenna SP, Heaney A.. COSMIN reviews: the need to consider measurement theory, modern measurement and a prospective rather than retrospective approach to evaluating patient-based measures. J Med Econ. 2021;24(1):860-861 [DOI] [PubMed] [Google Scholar]
- 14.Combrinck C. Is this a useful instrument? An introduction to Rasch measurement models. In Kramer S, Lahey AFlynn Het al. Eds. Online Readings in Research Methods. Psychological Society of South Africa. Johannesburg: 2020. https://www.psyssa.com/wp-content/uploads/2020/08/Chapter-6_Is-this-a-useful-instrument_An-Introduction-to-Rasch-measurement-models.pdf [Google Scholar]
- 15.Langley P. The Great I-QALY Disaster. InovPharm. 2020; 11(3): No 7 https://pubs.lib.umn.edu/index.php/innovations/article/view/3359/2517 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Langley P., McKenna S. Fundamental Measurement: The Need Fulfilment Quality of Life (N-QOL) Measure. InovPharm.2021;12(2):No. 6 https://pubs.lib.umn.edu/index.php/innovations/article/view/3798/2697 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Langley P. Facilitating bias in cost-effectiveness analysis: CHEERS 2022 and the creation of assumption-driven imaginary value claims in health technology assessment [version 1; peer review: 2 approved]. F1000Research 2022, 11:993 ( 10.12688/f1000research.123709.1) [DOI] [PMC free article] [PubMed] [Google Scholar]
