Skip to main content
Elsevier Sponsored Documents logoLink to Elsevier Sponsored Documents
. 2021 Jan;24(1):118–120. doi: 10.1016/j.jval.2020.10.001

Distributional Cost-Effectiveness Analysis Comes of Age

Richard Cookson 1,, Susan Griffin 1, Ole F Norheim 2, Anthony J Culyer 1, Kalipso Chalkidou 3
PMCID: PMC7813213  PMID: 33431145

Introduction

Distributional cost-effectiveness analysis (DCEA) provides information about the equity impacts of health technologies and programs and the trade-offs that sometimes arise between equity and efficiency. This field has now come of age with a growing applied literature,1 new training resources,2 and a formal professional network: a special interest group on equity-informative economic evaluation within the International Health Economics Association.3

A systematic review published in this issue of Value in Health1 found 54 peer-reviewed studies published to date, mostly after 2015, relating to diverse disease categories, intervention types, and populations and using various equity criteria, with socioeconomic status and race/ethnicity being the most frequent. Most reviewed studies (78%) found a favorable equity impact of the health program under investigation, and only 6% found an unfavorable equity impact.

This may be a sign of publication bias, whereby equity analysis is more likely to be conducted in cases where a favorable impact is anticipated. It may also indicate a tendency to focus on the favorable distribution of benefits rather than the unfavorable distribution of burdens owing to opportunity costs. Both issues require attention, because decision makers need to know when equity impacts are unfavorable and they need a full picture of equity impacts including who bears the largest burdens of opportunity cost as well as who gains the largest benefits.

Background

Concern about health inequalities has been given further impetus in recent years by so-called “deaths of despair” from suicide, drug overdose, and alcoholic liver disease4 and, more recently, inequalities in coronavirus infection and mortality rates related to ethnicity and socioeconomic status.5 A new book2 now provides practical methods for analyzing the expected impacts of healthcare and public health programs on inequalities between advantaged and disadvantaged groups in health, health service use, and the financial hardship resulting from health service use (eg, owing to out-of-pocket costs).6, 7, 8, 9 These methods supplement conventional cost-effectiveness data with distributional breakdowns and equity weighting analyses based on social variables such as socioeconomic status, ethnicity, and geographical location and disease categories like disability and severity of illness.8,10

Effectiveness studies (trials, quasi-experiments, and evidence synthesis thereof) can sometimes give partial information on equity impacts, for example, through subgroup analysis or trials in disadvantaged populations.11 Nevertheless, effectiveness studies usually fail to address equity issues of interest to decision makers:

  • the distribution of the health opportunity costs of cost-increasing programs

  • distributional impacts within the general population

  • impacts on inequality in health outcomes beyond the trial follow-up period

  • sizes of health inequality impacts compared with other programs

  • trade-offs between equity and efficiency objectives.

Distributional Cost-Effectiveness Analysis

The general term we favor for this form of evaluation is distributional cost-effectiveness analysis (DCEA).2 We use DCEA as an umbrella term for any study that provides information about equity in the distribution of costs and effects as well as value for money. This approach uses additional evidence and modeling to evaluate equity impacts and trade-offs and can be useful whenever a decision is expected to have different consequences for different people:

  • costly new health technologies (eg, whether to fund new a treatment or vaccination, at what price, and for which population subgroups)

  • coverage in healthcare benefit packages (eg, whether to cover diabetes in a public health insurance plan and, if so, which treatments and with what copayments)

  • new health service delivery infrastructure (eg, whether to invest in a community health worker program, how to select target areas for new investments)

  • public health (eg, whether to implement a sugar-sweetened beverage tax, how to evaluate health effects with effects on private household consumption and expenditure)

Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs is a guide for research commissioners, users, students, and analysts.2 The introductory chapters summarize how DCEA applies in various decision-making contexts and defines the concepts needed to read and critically appraise DCEA studies.

DCEA can explore the implications of giving special priority to improving the health of program recipients compared to nonrecipients.12,13 It can also analyze the distribution of health benefits and burdens (opportunity costs) within the general population by equity-relevant social variables (eg, socioeconomic status, geographical location, indigenous status, ethnicity, sex, age) and disease categories (eg, disease classification, severity of illness, proximity to death, rarity of condition).14 It can also evaluate distributional consequences for nonhealth outcomes, such as income or financial protection from out-of-pocket healthcare costs,15 and locate potential trade-offs between equity and efficiency objectives.16 Depending on the question at hand, additional modeling ranges from simple decision trees to sophisticated microsimulation.17

The distinctive aim is to extract new information about equity out of the analysis, rather than to incorporate value judgments about equity into it. DCEA is not about finding an algorithmic approach to replace context-specific deliberation with a universal equity formula. Rather, it can be used as an input into context-specific deliberation by decision makers and stakeholders. Standard cost-effectiveness studies inescapably make value judgments about equity—but implicitly. A common one is, for example, the value judgment that all health-adjusted life-years are equally valuable.18 DCEA makes these judgments explicit. It specifies the kinds of distributional consequences to expect and proposes measures. At a minimum, it can provide simple descriptive information.

The Equity-Efficiency Impact Plane

The equity-efficiency impact plane is a way of visualizing the findings of a DCEA study.19 This enables thinking about trade-offs between efficiency and equity and can also help decision makers keep both objectives in sight and in balance.

According to the standard net health benefit framework, a program is cost-effective if its health benefit is greater than its health opportunity cost.20 Nevertheless, if it harms equity then a cost-effective program might not be worth implementing. And if a cost-ineffective program improves equity, then it might be worth implementing. The equity-efficiency impact plane in Figure 1 sets out the 4 logical possibilities.

Figure 1.

Figure 1

Equity-efficiency impact plane.

The origin of the equity-efficiency impact plane locates a comparator intervention. The vertical axis tells us whether an alternative option is better than the comparator in terms of efficiency, and the horizontal axis tells us whether it is better in terms of equity.

Equity impact can be measured in whatever units are of interest to the decision maker. In England and Ethiopia, for example, researchers have used a reduction in an index of inequality in deprivation-related inequality in health-adjusted life expectancy.21,22 Nevertheless, other measures will suit different policy contexts—including objective health measures such as infant mortality and simple equity metrics such as the gap between the best and worst off.

A policy that falls in the northeast win-win quadrant improves both total health and health equity, and one that falls in the southwest lose-lose quadrant harms both. In low- and middle-income countries, vaccination programs (eg, rotavirus immunization)23 and infectious disease control programs (eg, tuberculosis)24 often fall into the win-win quadrant, because they typically deliver large health gains per unit cost and disproportionately benefit socially disadvantaged groups. By contrast, investments in high-cost end-of-life treatments may fall into the lose-lose quadrant of being neither cost-effective nor likely to reduce social inequality in health. Coverage of interventions in the lose-lose quadrant will rely on other ethical and political arguments of value.25

Equity and efficiency impacts may also be opposed. In the northwest win-lose quadrant, the option is good for total health but bad for equity, and in the southeast lose-win quadrant, the option is bad for total health but good for equity. This can happen, for example, when socially disadvantaged groups gain less than advantaged groups from a decision to fund a medical technology, due perhaps to barriers to access, adherence, and long-term recovery, and additional investment in delivery infrastructure and follow-up care would be needed to facilitate equal access, adherence, and long-term recovery.

Quick and Dirty Approaches

Simplified aggregate approaches are also available, when there is not enough time or resource to conduct a full DCEA study. These combine aggregate outputs from standard cost-effectiveness analysis with information about distributions of a relevant disease or risk factor and utilization of a relevant category of care.22,26 This can provide useful prima facie information about equity impact, even though there is no detailed modeling.

Equity-Efficiency Trade-Offs

In the win-lose and lose-win cases, equity trade-off analysis is required to discover which policy is better overall. This analysis can be done informally by making intuitive judgments. It can also be done formally as the following examples show:

  • inequality indices that assign numerical values to equity impacts

  • dominance tests based on simple underlying principles or axioms of equity

  • indirect equity weighting (ie, quantifying an overall social value for each policy by using a social welfare function with an equity parameter, which reflects degree of concern for the worse off and indirectly implies equity weights)

  • direct equity weighting (ie, formally comparing the policy options by setting direct equity weights on health benefits for special groups)

The methods chapters of the book2 contain step-by-step instructions on how to conduct an equity-informative study, with accompanying spreadsheet training exercises27 and an online tool28 for summarizing equity impacts and trade-offs. There are also online resources for those interested more specifically in equity-informative economic evaluation in low- and middle-income countries.29,30 Updates on training materials and courses are available via the International Health Economics Association Special Interest Group on equity-informative economic evaluation.3

Conclusion

Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs and its training materials, together with the recent review, should stimulate studies that combine efficiency and equity in all countries, whatever their stage of development, where equity in health and healthcare is of concern, or where aspirations to universal health coverage are an imperative. These developments should also spur theorists and practitioners alike to develop further techniques and create better data for decisions and, of course, better decisions.

Article and Author Information

Accepted for Publication: October 6, 2020

Published Online: November 7, 2020

doi: https://doi.org/10.1016/j.jval.2020.10.001

Acknowledgments

Conflict of Interest Disclosures: Dr Cookson reported receiving grants from the Wellcome Trust during the conduct of this study. Drs Cookson, Norheim, Culyer, and Griffin are editors of the Oxford University Press handbook cited in this editorial. Dr Chalkidou is an editor for Value in Health and had no role in the peer review process of this article.

Funding/Support: Richard Cookson is funded by the Wellcome Trust (Grant No. 205427/Z/16/Z) and is a member of the National Health Service Advisory Committee on Resource Allocation. The views expressed in this publication are those of the authors and not necessarily those of the Wellcome Trust, the National Health Service, or the Department of Health.

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

References

  • 1.Systematic review of equity-informative economic evaluations [e-pub ahead of print] Value Health. 2020 [In Press] [Google Scholar]
  • 2.Cookson R., Griffin S., Norheim O.F., Culyer A.J. Oxford University Press; Oxford, UK: 2020. Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs. [Google Scholar]
  • 3.Equity Informative Economic Evaluation International Health Economics Association. https://www.healtheconomics.org/page/EEE
  • 4.Case A., Deaton A. Princeton University Press; Princeton, USA: 2020. Deaths of Despair and the Future of Capitalism. [Google Scholar]
  • 5.Galea S., Abdalla S.M. COVID-19 pandemic, unemployment, and civil unrest: underlying deep racial and socioeconomic divides. JAMA. 2020;324(3):227–228. doi: 10.1001/jama.2020.11132. [DOI] [PubMed] [Google Scholar]
  • 6.Jamison D.T., Summers L.H., Alleyne G. Global health 2035: a world converging within a generation. Lancet. 2013;382:1898–1955. doi: 10.1016/S0140-6736(13)62105-4. [DOI] [PubMed] [Google Scholar]
  • 7.Ottersen T., Norheim O., Berhane F. Making fair choices on the path to universal health coverage: final report of the WHO Consultative Group on Equity and Universal Health Coverage. World Health Organization. http://apps.who.int/iris/bitstream/10665/112671/1/9789241507158_eng.pdf
  • 8.Marmot M., Friel S., Bell R. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008;372:1661–1669. doi: 10.1016/S0140-6736(08)61690-6. [DOI] [PubMed] [Google Scholar]
  • 9.World Health Organization . World Health Organization; Geneva, Switzerland: 2015. Tracking universal health coverage: first global monitoring report. [Google Scholar]
  • 10.Boerma T., Eozenou P., Evans D. Monitoring progress towards universal health coverage at country and global levels. PLoS Med. 2014;11 doi: 10.1371/journal.pmed.1001731. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Welch V.A., Norheim O.F., Jull J. CONSORT-Equity 2017 extension and elaboration for better reporting of health equity in randomised trials. Br Med J. 2017;359 doi: 10.1136/bmj.j5085. [DOI] [PubMed] [Google Scholar]
  • 12.Ottersen T., Forde R., Kakad M. A new proposal for priority setting in Norway: open and fair. Health Policy. 2016;120(3):246–251. doi: 10.1016/j.healthpol.2016.01.012. [DOI] [PubMed] [Google Scholar]
  • 13.Van de Wetering E., Stolk E., Van Exel N. Balancing equity and efficiency in the Dutch basic benefits package using the principle of proportional shortfall. Eur J Health Econ. 2013;14(1):107–115. doi: 10.1007/s10198-011-0346-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Cookson R., Mirelman A.J., Griffin S. Using cost-effectiveness analysis to address health equity concerns. Value Health. 2017;20:206–212. doi: 10.1016/j.jval.2016.11.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Verguet S., Kim J.J., Jamison D.T. Extended cost-effectiveness analysis for health policy assessment: a tutorial. Pharmacoeconomics. 2016;34:913–923. doi: 10.1007/s40273-016-0414-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Asaria M., Griffin S., Cookson R. Distributional cost-effectiveness analysis of health care programmes—a methodological case study of the UK Bowel Cancer Screening Programme. Health Econ. 2015;24:742–754. doi: 10.1002/hec.3058. [DOI] [PubMed] [Google Scholar]
  • 17.Skarda I., Asaria M., Cookson R. Lifecourse modelling for childhood policy analysis. University of York. https://equipol.org/research/projects/lifesim
  • 18.Shah K., Cookson R.A., Culyer T. NICE’s social value judgements about equity in health and health care. Health Econ Policy Law. 2013;8:145–165. doi: 10.1017/S1744133112000096. [DOI] [PubMed] [Google Scholar]
  • 19.Kypridemos C., Allen K., Hickey G.L. Cardiovascular screening to reduce the burden from cardiovascular disease: microsimulation study to quantify policy options. BMJ. 2016;353:i2793. doi: 10.1136/bmj.i2793. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Drummond M.F., Sculpher M., Claxton K. 4th ed. Oxford University Press; Oxford, UK: 2015. Methods for the Economic Evaluation of Health Care Programmes. [Google Scholar]
  • 21.Dawkins B., Mirelman A., Asaria M. Distributional cost-effectiveness analysis in low- and middle-income countries. Health Policy Plan. 2018;33:456–463. doi: 10.1093/heapol/czx175. [DOI] [PubMed] [Google Scholar]
  • 22.Griffin S., Love-Koh J., Pennington B. Evaluation of intervention impact on health inequality for resource allocation. Med Decis Making. 2019;39(3):171–182. doi: 10.1177/0272989X19829726. [DOI] [PubMed] [Google Scholar]
  • 23.Verguet S., Murphy S., Anderson B. Public finance of rotavirus vaccination in India and Ethiopia: an extended cost-effectiveness analysis. Vaccine. 2013;31:4902–4910. doi: 10.1016/j.vaccine.2013.07.014. [DOI] [PubMed] [Google Scholar]
  • 24.Verguet S., Laxminarayan R., Jamison D.T. Universal public finance of tuberculosis treatment in India: an extended cost-effectiveness analysis. Health Econ. 2015;24:318–332. doi: 10.1002/hec.3019. [DOI] [PubMed] [Google Scholar]
  • 25.Teerawattananon Y., Dabak S.V., Khoe L.C. To include or not include: renal dialysis policy in the era of universal health coverage. BMJ. 2020;368:m82. doi: 10.1136/bmj.m82. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Love-Koh J., Cookson R., Gutacker N. Aggregate distributional cost-effectiveness analysis of health technologies. Value Health. 2019;22:518–526. doi: 10.1016/j.jval.2019.03.006. [DOI] [PubMed] [Google Scholar]
  • 27.Cookson R, Love-Koh J, Van Ourti T, et al. Handbook of Distributional Cost-Effectiveness Analysis: Supporting Materials. University of York. https://www.york.ac.uk/che/research/equity/handbook/. Accessed November 3, 2020.
  • 28.Asaria M. Distributional cost-effectiveness analysis: online tool. University of York. https://shiny.york.ac.uk/dcea/
  • 29.Verguet S. Teaching pack: extended cost-effectiveness analysis. Harvard University. https://repository.chds.hsph.harvard.edu/repository/collection/teaching-pack-extended-cost-effectiveness-analysis/
  • 30.Bergen Centre for Ethics and Priority Setting. University of Bergen. https://www.uib.no/en/bceps

RESOURCES