Version Changes
Revised. Amendments from Version 1
We have made edits that highlight this paper’s broader relevance for future pandemics. While time has moved on, we think it remains useful going forward to map out the concepts and principles around integrating economic and epidemiological evidence. The paper however remains a viewpoint on the factors that should be generally considered in economic evaluation of pandemic responses. We have however added several new references. We have also further clarified several issues, with minor additions to the text, including: aspects of social protection, the application of the rule of rescue, the interaction between health and economic policy and the application of VSL. We have also added text on the early estimates of economic impact from other diseases and mentioned that some bore our and some did not. We clarified the value of modelling unmitigated epidemics. FInally, we note that persons with high health and economic risk the resulting choice/ behaviours are challenging to predict.
Abstract
Covid-19 requires policy makers to consider evidence on both population health and economic welfare. Over the last two decades, the field of health economics has developed a range of analytical approaches and contributed to the institutionalisation of processes to employ economic evidence in health policy. We present a discussion outlining how these approaches and processes need to be applied more widely to inform Covid-19 policy; highlighting where they may need to be adapted conceptually and methodologically, and providing examples of work to date. We focus on the evidential and policy needs of low- and middle-income countries; where there is an urgent need for evidence to navigate the policy trade-offs between health and economic well-being posed by the Covid-19 pandemic.
Keywords: Covid, health economics, cost-effectiveness
Disclaimer
The views expressed in this article are those of the author(s). Publication in Wellcome Open Research does not imply endorsement by Wellcome.
Introduction
Covid-19 (C19) required a ‘whole society’ policy response to protect health, economic and social welfare globally. Policy options were multi-sectoral and include scaling-up C19 health services, physical distancing, strengthened social protection and a wide range of additional sectoral, fiscal and macro-economic interventions 1 . Given the magnitude and breadth of impact of C19, policy action required careful consideration of trade-offs between the health, economic and social dimensions of population welfare. Understanding, not just the nature, but also the extent of these trade-offs is critical, particularly for low- and middle-income countries (LMICs), to inform policies that maximise overall population welfare during pandemics.
Health policy inevitably involves trade-offs and priority setting between and within different diseases and populations, e.g. between the young vs the old; the severely sick vs the relatively healthy (or less sick); etc. Health sectors employ a range of processes to inform this priority setting 2 . However, where formal processes for health sector priority setting exist, in the majority of cases they are designed to inform health policy decisions made at the margin; typically appraising the adoption of specific health interventions or technology (referred to as health technology assessment (HTA)) 3, 4 . Periodically, wider efforts are made to assess whether the range of services included in Universal Health Care (UHC) health benefit packages being delivered across the health sector is optimal 5– 9 .
The field of health economics has a long history of bringing together epidemiological modelling and economics to quantify the trade-offs made both within the health sector and between health and other dimensions of welfare; and supporting the use of such evidence in policy. Cost-effectiveness analysis typically assesses whether population health is maximised within the existing financial constraints (such as a budget limit on healthcare spending): acknowledging that every investment in an intervention within the health sector will mean that another intervention to improve health will be forgone – the concept of ‘opportunity cost’. In priority setting, cost-effectiveness is also considered with other aspects of welfare, for example ensuring equity of health 10, 11 or avoiding catastrophic health expenditures 12, 13 . Health technologies, services or policy interventions are typically assessed from the perspective of the health sector, although sometimes also consider the lost productive time (productivity losses) of individuals who are sick or die prematurely is considered, known as taking a societal perspective 14 .
We examine here how health economic evidence and more broadly priority setting processes to support decisions around new health technologies (pharmaceutical interventions) and public health policies need to be adapted for pandemics, focussing on eLMICs. We first explore how current approaches may needd to be adapted for C19; then we examine the empirical approaches and analytical requirements of providing integrated evidence of health, economic and social impact to health policy makers. We argue for pandemic preparedness approaches that support the rapid adaption and application of evidence informed priority setting to ensure that decisions made around pandemics remain evidence informed, transparent and accountable to the population they serve.
Broadening the assessment of health sector policy under C19
Pandemics are no different from any other health issue, in that much of the C19 response will incur ‘within health sector trade-offs’ and therefore it is critical to assess both the impact of overall population health and equity in C19 policy. However, the scale, speed and scope of a pandemic generate impact of exceptional depth and breadth of impact across health systems and, critically, the wider economy, which mean that standard ‘within health sector’ approaches to priority setting need to be extended to ensure that overall allocations to the health sector are optimal, considering all dimensions of population welfare including health, economic and social welfare 15 . Challenges in doing this, include:
-
1.
The magnitude of the health impact from pandemics means that governments may wish to re-evaluate and rapidly change health sector funding levels, in order to maintain some semblance of ‘health as usual’ i.e. current levels of population health, for example, current levels of maternal mortality. Therefore, the trade-offs may move beyond opportunity costs within the health sector to opportunity costs for other sectors.
-
2.
The health impact of pandemics such as C19 can rapidly evolve, and therefore policy responses and the analytics to inform them need to be instantaneous, despite the complexity involved.
-
3.
Health, interventions and economic policy goals interact with one another and are ‘dynamic’ in the sense that ill health impacts on economic and social welfare. Ill-health can impede the ability to work or exasperate economic inequities. Likewise, improvements in economic and social welfare can substantially impact health and health equity. For example, reduction in C19 attributable mortality is in part determined by the balance between policies to increase health system capacity and physical distancing. Likewise, economic welfare is in part determined by the balance between physical distancing and social protection policy.
-
4.
Pandemic response policies such as physical distancing, are likely to have substantial short- to medium-term macro-economic and poverty impacts, so, to ensure economic welfare continues ‘as usual’, for example maintain current levels of employment, governments are likely to simultaneously alter their ratio of present and future spending and investment policies.
-
5.
Much of the cost of C19 interventions and pandemic responses will be borne at the household level with implications for both household consumption and savings behaviour, labour supply decisions and consequential broader social and health ramifications of catastrophic losses to household income. Even where public expenditures are transferred to households and provide social protection, they eventually have to be paid for from household income, through taxation. Therefore, C19 policy may require rapid changes to the balance between public sector and private expenditure across the economy, having short- and long- term implications for government budgets.
-
6.
Many mitigating behavioural responses to pandemics exhibit important externalities, which means that the actions of each individual directly impact the welfare of others. Typically, this requires a public policy response as individuals will not act in a way that necessarily benefits society as a whole. For instance, patients with mild C19 may not self-quarantine without incentives to do so.
-
7.
Pandemic response policy is also likely to have substantial distributional impacts. For, example, there may be trade-offs between costs and benefits incurred by different socioeconomic groups, genders, ethnicities, urban/rural populations, those with differing health status etc. Therefore, heterogeneity of cost and the distribution of health benefits between sub-populations need to be considered.
-
8.
Responses to pandemics are also ‘dynamic’ over time, for example the ability to exit physical distancing smoothly may depend on the credibility and understanding of government policy during the periods of stringent physical distancing. Likewise, the ability to stimulate improvements in ‘demand-side’ economic behaviour post-crisis may depend on government credibility in handling the economic consequences during the crisis.
-
9.
Finally, it is highly likely that both health and economic impacts will heterogeneous across populations, and responses to pandemics will need to reflect local health, social and economic constraints.
In short, informing policy action for C19 and other pandemics is challenging, and needs to include evidence and the analysis of trade-offs within and between health services, but also inform social and economic policies (including financial protection and different sectoral objectives), across population groups, between the public and private sectors, and over time, conducted in an uncertain and rapidly evolving global context. As such, pandemic policy making requires additional processes to conventional HTA, evidence generation and review to understanding wide-ranging trade-offs that will be required across a broad range of sectors.
However, before moving evidence to policy challenges demanded by wider inter-sectoral interaction, we examine the generation evidence on the trade-offs incurred within the health sector: between the allocation of resources specifically to C19 services and new technologies versus those for other health conditions. During a pandemic ‘business as usual’ is, or should be, disrupted, but whether it is the exceptional use of bed capacity, or financing of C19 vaccines and treatments, pandemics can impose a clear ‘health-health’ trade-offs.
Assessing trade-offs across the health sector
Typically, health trade-offs are empirically assessed by establishing whether the implementation of an intervention results in a net improvement in population health. The extent of the ‘opportunity cost’ of C19 expenditure (and hence the net impact on population health) depends on: the extent to which underutilised health service capacity exists and can be employed; the extent to which other health services can be delayed or cancelled without causing harm; the extent of health impact gained from diverting additional funding to the health sector from elsewhere. To conduct these analyses a comparable measure of population health is required, measuring both the extent of both mortality and morbidity impact combined with populations’ preferences for different health states. There is an extensive literature on different ways to measure population preferences for different health states, with many countries using standardised measures such as quality adjusted life years (QALYs) or disability adjusted life years (DALYs) as composite measures of health impact 16 . Importantly, these measures account for years of healthy life rather than deaths, weighing each year in full health equally. Estimates of DALYs averted for C19 for LMICs found that disability from C19 would increase DALYs lost by up to a third 17 .
There is a debate as to whether all health vs health trade-offs compare like with like even when generic health measures are used. In previous pandemics, it has been argued that a ‘rule of rescue’, the moral action to save lives in immediate danger whatever the consequences for other health spend, should be applied 18 , even if the impact on population is negative. Population preferences around the rule of rescue within the health sector have been investigated, to assist in spending decisions around new life saving technologies, and may be considered during ‘emergency phases’ of pandemics, although this has been less explored in LMICs. For example, NICE in the UK, found that most (of a small council of citizens) prioritise immediate life-saving interventions above routine health interventions. However, this prioritisation was only agreed with strict definition of criteria, and even in these circumstances there should some consideration of the extent of impact on population health overall 18 .
Empirical evidence on the net population health impact of C19 has suggested at least in the short term, C19 is incurring substantial opportunity costs for other health areas in LMICs, with health sectors not being able to sufficient address both underlying financial and non-financial constraints in the time required. A study on immunisation in LMICs found that every excess C19 death during routine vaccination would be traded for over 100 deaths in children if routine vaccination ceased 19 . Concerns have also been raised around the impact of C19 on TB and HIV 20, 21 . This adds to the evidence from previous pandemics of adverse impacts on health services in LMICs; it was estimated that approximately 10,000 additional malaria deaths may have resulted from the cessation of malaria treatment in Guinea, Liberia, and Sierra Leone during the Ebola epidemic 22 .
C19 stretches existing health sector capacity globally, but had C19 and other pandemics are likely stretch LMIC financial and health sector capacity is substantial. An early study estimates that if it had been unmitigated, the total health sector costs for C19 could have been extremely high, ranging from 58% to 122% of current annual health spend in five LMIC cities 23 . Barasa et al. assessed the capacity of the Kenyan health system to absorb those requiring critical care due to C19 and found that critical bed requirements of C19 surge varied from 12% to 145% of current capacity across different counties in Kenya 24 . Moreover, hospitals in LMICs typically run at high occupancy and focus on acute care, so displaced services may have a higher opportunity cost than in high income countries (HICs). Even if large temporary hospitals can be constructed, and supplies accessed, qualified health workers will be a critical resource in many LMICs; estimates range from 13 to 56 times current capacity at an unmitigated C19 peak 19 .
In summary, while the within health trade-offs in LMICs are likely to have been substantial, but during the pandemic there was limited direct evidence available to assist policy makers respond in a way that considers overall population impact of their choices. There remains a need to ensure health economic methods are employed in pandemics to address this evidence gap; especially as new technologies are employed, and determine the optimal allocation resources between different diagnostic, treatment and preventative interventions during the health sector at different stages of pandemics 25 . Providing evidence alone however, is insufficient, importantly the production of evidence should be matched with ‘evidence based deliberative processes’that build on current health technology assessment processes, but can respond with the rapidity required for pandemics.
Informing C19 policy choice considering trade-offs between health and wider economy
Economic models can inform policy makers about the extent of the economic impact of pandemics and responses to them. The ‘health economics’ and ‘macroeconomics’ professions apply different models to assess health and economic burdens. Micro-(health) economic models tend to integrate complex epidemiological models, but estimate societal costs by multiplying the time off work with rates of income loss per day off work measured by wages, or sometimes approximated using gross domestic product (GDP) per capita per day, known as the ‘human capital approach’. They can also be linked with epidemiological models to estimate numbers of households placed below the poverty line as an immediate consequence of illness and health seeking behaviour 13 .
Conversely, the macro-economic tradition focuses on estimating aggregate economic impact that includes the interactions between individuals and households, employing epidemic estimates produced by external models. Macroeconomic models account for consequential economic behaviour or adjustment, over time, including coping mechanisms such as household decisions to reduce costs and increase savings, workers’ decisions to participate in the workforce, and producers’ and traders’ decisions to maximise profits, to address shocks to the economy (see Figure 1). Importantly, macro-economic models allow for interaction and feedback between different economic sectors, and global macro-economic models are also able to capture the consequences of pandemics on global movement and trade.
There is a long tradition of trying to integrate infectious disease modelling into macro-economic modelling to explore policy trade-offs within one model framework to inform policy makers; and incorporating health to economic to health feedbacks. Work from previous epidemics have included early studies of the macro-economic impact of the HIV pandemic 26– 30 , which relied on epidemiological projections by World Bank, but no integrated epidemiological model. Recent models employ more elaborate epidemiological models and produce broad ranges of estimates of both health and economic impacts including summary measures in non-monetary units (e.g. symptomatic cases/hospitalizations/deaths averted, work time absenteeism, etc.) and costs (e.g. combined impacts of work absenteeism, health costs, and public mitigation and suppression interventions in local currency units) 31– 36 . However, there remain challenges in fully integrating the dynamic feedbacks between the progression of infectious diseases and the economy over long time periods. While most macro-economic models of pandemics incorporate the epidemic projections over time, it remains a challenge to incorporate the feedback between the resulting economic impact to the epidemic trajectory 37 .
Even where the impacts of different pandemic policies can be estimated in an integrated manner, the optimal balance between health and economic policy outcomes is difficult to ascertain as it is inherently value laden. There is some evidence on how populations balance the two outcomes from high income countries (HICs). For example, economists have explored how populations value health and economic welfare using a measure known as the value of statistical life (VSL). VSL estimates the amount individuals would be willing to pay for an improvement in survival, and can be used to convert health impact into monetary value: allowing for an estimate of net welfare 38 . VSL values are derived from surveys that aim to capture a population’s willingness to pay for a reduction in annual mortality risk, and are reported to range between 20 and 140 times GDP per capita to avoid one death 39– 41 . Studies in the US applying VSL values to C19 control suggest a net benefit which is higher for social distancing compared to suppression strategies and that social planners should be willing to pay approximately 26% of annual (US) consumption to avoid C19 deaths 39 . When VSL estimates are extrapolated to LMICs, net benefits that are considerably reduced compared to HICs, although still remain positive 42 . However, these estimates only point to a general direction as VSL estimates are not generally available for LMIC populations 42 . Moreover, VSL is controversial, as it is narrowly focussed on mortality and does not consider values around years of life lost and morbidity, and is highly sensitive to individual income. There have been other approaches taken to estimate benefits which are not covered here, but rely on measures of benefit related to the value of health to health sector payers, but in non-pandemic times 43 . The current evidence base and methods on the valuation of health versus economic welfare in LMICs therefore remains woefully inadequate, and even where models provide joint health and economic outputs, careful decision processes are required to ensure these are weighed correctly (see section on governance below).
Estimating the impact of C19 without intervention – analytical approaches
The starting point of any empirical analysis of C19 policy on both health and economic welfare is to understand the base case, or the unmitigated C19 impact on the economy or poverty or the ‘cost of illness’. Previous unmitigated pandemics have had substantial economic and poverty impacts. A challenge in estimating the impact of unmitigated pandemics is predicting how individuals judge and act when facing both perceived health and economic risks 44 . In simple terms, Figure 2 illustrates incremental impact on behaviour of public health policy in the face of C19, or other pandemic related risk. Figure 2 divides the population into four groups depending on the level of individual health and economic risk they face. Most of those with a high health risk but little economic risk may voluntarily choose to physical distance (all individuals above line 1). If individuals are altruistic that may increase their propensity to stay in (all individuals above line 2). However, for many either the economic risk will be too high, or the health risk too low, so they may not stay in and spread the disease and harm others (externalities). Likewise, those facing some of those facing either both high or low risks in both domains may chose not to distance. In this case public health policy may intervene and enforce physical distancing, or alternatively use social protection to reduce individuals’ economic risk, resulting in all individuals above line 3 distancing. The central point being that the economic cost and health impact of the public policy are the costs of moving the line from 2 to 3, and the costs of illness and health impact of C19 are those above line 2.
During the early stages of the HIV pandemic, several macro-economic studies aimed to estimate the costs of illness of HIV in LMICs. Estimates varied by setting, but ranged from approximately 1-5% of GDP 26– 28 . For example, for Cameroon it was estimated that the loss of skilled workers from HIV would reduce annual economic growth by 1.7% per annum 45 . Similarly, macroeconomic studies of an unmitigated repeat of the UK flu pandemics from 1957 and 1968 was estimated to be short-lived and, in the worst-case scenario, to constitute a loss of 9.5% of quarterly GDP or a loss of 2.5% of annual GDP in the UK, most of which is due to population coping responses (self-imposed physical distancing) 32 .
Micro-economic estimates of the cost of illness of C19 suggested that an unmitigated C19 epidemic would incur a substantial cost of illness in the first year 23 . Households affected by C19 incur costs due to time off work from sickness and incur costs from death. While many C19 deaths occur in older age groups, co-morbidities in working-age (and poor) segments in LMICs may mean that substantial proportions of households may still suffer income losses from an unmitigated C19 epidemic 23 .
While unmitigated estimates are often used in the very initial stages of pandemics to alert policy makers to the extent of any catastrophic impact if nothing is done, they are often made on the basis of highly scarce data, and under considerable uncertainty. Moreover, they cannot be validated as a policy response quickly follows and therefore in reality ‘and unmitigated epidemic cannot be observed’. Moreover, while unmitigated epidemics are argued to provide a useful comparator against which to measure the impact of interventions, even without government intervention they are unlikely to occur, as individuals within populations will act, and therefore unmitigated pandemics remain a conceptual construct, rather than a forecast of any real world consequence of pandemics.
Assessing the economic impact C19 intervention – analytical approaches
Micro-economic models of C19 46 and initial observational data suggest that the immediate direct impact on poverty of widespread physical distancing or ‘lock down’ will be substantial in LMICs 47 . Two macro-economic modelling approaches have also been used to date to explore the macro-economic impact of such policies in LMICs. First, aggregate dynamic stochastic general equilibrium (DSGE) models have been used to focus on characterising optimal social planning and explore the balance between economic and health burdens at an aggregate level 40, 41, 48– 50 . For example, the early use of DSGE models in the US suggested that the scale-up of testing could reduce the economic costs of current lockdown by 2% of GDP 41 , and that the optimal levels of US teleworking could approach 40% at peak levels 40 .
Second, multi-sector computable general equilibrium (CGE) models have explored the economic impact of C19 considering interactions between different sectors (e.g. social distancing-related sector-specific business and school closures, and private mitigation behaviours including reduced demand for entertainment, recreational activities, etc.) CGE model applications to infectious diseases are numerous and stretch back to the early stages of the HIV epidemic. The first global CGE applications to respiratory pandemic diseases appeared in the early-2000s, including analyses of SARS 51 and pandemic influenza 52 . Early studies of macro-economic impact in the UK estimated that the period of lockdown would reduce deaths by 95%, but increase the total cost to the UK economy, in 2020, to 29.2% of GDP unless additional mitigating economic policies were put in place to reduce economic co-harms of the suppression strategy 31 . In comparison, mitigation strategies imposed for 12 weeks would reduce deaths by 29%, but with a total cost of 13.5% of GDP.
Globally a 2.5% drop in GDP is estimated for LMICs, and if C19 continues, in the longer-term LMICs (excl. China) could suffer a 4.8% in GDP 53 . There is, however, still a dearth of work examining the integrated health and macro-economic impact of different public health policies in LMICs. None of the macro-economic studies for LMICs to date explicitly consider disaggregated impact for different population groups and specifically estimate the numbers of households falling into poverty. Yet, there is substantial evidence from other infectious diseases that suggests this impact may be high. For example, between 27-83% of households affected by tuberculosis in LMICs experience costs that are catastrophic (defined as exceeding 20% of household income) 54 . Households encountering catastrophic costs due to poor health often respond by adopting coping strategies, which can potentially cause further long term harm, including drawing high-interest loans, selling productive assets (such as livestock), or taking children out of school 55 .
The need for context specific evidence from LMICs
Any health economic evidence generated to inform C19 policy needs to reflect the specific structural features of different LMIC economies and health sectors, including the values of specific populations. However, during a pandemic this presents a sizeable challenge given the large numbers of countries involved and limited capacity both to generate and conduct health economic analyses. We therefore identify below the critical and urgent context specific data needs required to inform the applications of modelling efforts outlined above to LMICs.
Population characteristics
Fundamentally, any modelling outcomes estimating economic and health trade-offs around the C19 response will be driven by the overlap between populations that are most at risk of infection, at risk of dying, at risk of transmitting C19 or provide most risk to the economy (or vulnerable to income-related shocks). Figure 3 extends Figure 2 to include not just the health risks faced by the individuals, but the risk that they cause harm to others. The yellow shaded area is the population who complies with physical distancing, but do not consider their harm to others. In this example a whole segment of the population who is at high risk of transmission, but has high economic risk and low individual health risk do not comply.
The three dimensions of risk factors are in turn are determined by a combination of biology and social and economic behaviour, that may be correlated (e.g. socioeconomically disadvantaged groups may be more likely to be in poor health and therefore susceptible to severe disease). The challenge for LMIC policy makers, and the scientists/economists who support them, is to better identify these interactions, and develop an understanding that these relationships are dynamic. In other infectious diseases, the relationship between economic risk and these two dimensions of health risk, and the mixing between these populations has been pivotal in how pandemics progress over time, with diseases becoming endemic in populations with high economic risk 56 .
Estimates of C19 transmission are best made estimated dynamically and predictions of the epidemic curve made by country. C10 transmission models currently rely on population specific demographic data 57 and often on non- context specific social contact patterns, using synthetic contact matrices that extrapolate survey data from other settings based on household and societal characteristics 58 . To estimate and understand both health and economic impact, setting specific data on how social contacts vary by population groups and socio-economic status is urgently required. For example, the probability of being infected by a particular person is likely to be higher for those in close and regular contact (e.g. household contacts) or those in overcrowded working and living conditions; but we know little about how those in these conditions interact with different population groups.
Household capacity and resilience
There is also an urgent need to understand the many context specific barriers that prevent individuals, households and firms from complying with C19 policies optimally and may make trade-offs between health and economic welfare more severe, particularly for poor populations. Epidemiological models can also be used to explore and identify between economic risk and disease, but still require primary data to identify explicit links between the specific constraint and disease related behaviour and progression 59 . Stigma and mental health issues may constrain the ability of individuals to protect themselves. The extent of trust in institutions and social values may influence the extent of adherence to physical distancing. Even when willingness is there, there may be demand side constraints related to economic status, including the affordability and allocation of goods that protect against C19 infection to those most in need, such as basic commodities for hand washing and facemasks. Housing conditions may also be a critical constraint; for example, in many urban informal settlements in LMICs, houses are crowded and one-roomed and have shared and/or outdoor toilets and water sources, making stringent physical distancing impossible.
There are also a wide range of factors that influence the resilience (and reduce the economic risk) of employed households to mitigate economic impacts, including access to loans at affordable interest rates, employment conditions, and the ability to sell assets 60 . However, for households relying on daily subsistence income, or on foreign remittances, the poverty impact of being unable to work may be severe. While many HIC countries have strong social protection mechanisms in place, many LMICs have weaker mechanisms for providing emergency transfers to populations 61 . There is a substantial body of economic evidence on the extent to which cash transfers and social protection in LMICs both impact health outcomes and reduce economic risk, which can support governments to design appropriate mechanisms 59, 62– 66 , and methods such as benefit incidence than can capture the way in which costs and benefits of different public policies impact different population groups 67, 68 .
Health sector burden and capacity
Case fatality risks for C19 are also dependent on local health services and the existing disease burden/co-morbidities, which vary substantially by setting and may also be correlated with economic status 69, 70 . Yes, there is a dearth of information on how different socio-economic groups are accessing both C19 and non-C19 services. In some settings the limiting health system constraint may, however, not be bed capacity, but staff, oxygen, medicines, or protective equipment 24 . Other elements of capacity such as the strength of the surveillance and testing systems may allow governments to exit physical distancing at an earlier point in the epidemic and reduce economic losses. However, depending on both physical and financial access these may also be less accessible to poorer populations. Previous studies on TB provide an example of how to characterise these constraints 25, 71 and explore their impact on infectious disease trajectories and the eventual cost-effectiveness of different interventions 72 .
Improving the governance for assessing C19 policies
LMIC governments will need to continuously refine their policies to align with how their populations value health, economic welfare and different dimensions of health. C19 has brought difficult trade-offs, commonly faced by the health sector, to the forefront of public scrutiny. There are several standard frameworks that are typically used to ensure that health policy processes operate in an evidence-based, accountable, and fair manner considering both economic and epidemiological evidence. The analytical frameworks for designing such processes have been developed in the context of HTA in HICs, but also applied in LMICs such as China, South Africa, India 31 , Thailand and Indonesia 73 .
Table 1 illustrates the types of health and economic trade-offs facing LMICs when making policy choices on social distancing, school closure and expanding health sector capacity to address C19. In their choices, policy makers would ideally maximize public goals such as health, economic welfare and social welfare - yet, in reality, choices impact differently on these goals. Formalised structured decision-making tools such as multi criteria decision analysis (MCDA) can support policy makers in making their choices, and Table 1 provides the starting point of this approach based on the public goals as mentioned in this paper. A complete MCDA would provide a comprehensive overview of the performance of policy choices on all public goals (possibly involving scoring of the performance and weighing of public goals), as input for the policy making process. Yet, given the urgency of C19 response, policy makers may not be able to conduct a complete MCDA and will make the trade-offs in a more deliberative manner 74 .
Table 1. Framework for policy trade-offs in the Covid-19 response (with examples).
Policy choices/
public goals |
Health | Economic welfare | Social welfare | |
---|---|---|---|---|
Impact on Covid-19
related health |
Impact on other
diseases |
|||
Physical
distancing # |
Reduced infections
in overall population |
Increased mental
health problems because of isolation; improved health through improved air pollution |
Reduced household income
and consumption through reduced tourism, export, foreign direct investment and inflationary pressure |
Compromised civil liberties; unrest; food
insecurity |
School closure | Reduced infections
in children; reduced infections in overall population |
Increased mental
health problems because of isolation Increased morbidity and mortality from delayed presentation and treatment delays |
Reduced income if parents
have to take time off work without compensation; loss of income for education sector workers if they are not compensated; increased demand for substitutes like online education |
Increased exposure of children to
violence and exploitation; poor nutrition if children rely on meals provided at schools; stress for teachers for creating and maintaining online learning; challenges measuring and validating learning. |
Expanded
health sector response |
Reduced mortality
and morbidity |
Treatment delays | Increased health insurance
premiums |
Displacement of other public
expenditure, such as on culture. |
# Various physical distancing policies are possible, depending on duration and restrictions. Such policies have different impacts on public goals and could be listed as different policy choices here.
At the core of deliberative approaches is the recognition that policy makers are accountable to the populations they serve and thus need to ensure a legitimate decision-making process. Legitimacy here refers to the reasonableness, or fairness, of policy choices as perceived by stakeholders, which is an important prerequisite for broad societal support for these policies 74, 75 . For example, the decision whether or not to enforce social distancing should include a consideration of the (potentially competing) interests of people and sectors with varying levels of health and economic vulnerability. Stakeholders are likely to have a wide range of social values and interests that result in different perceptions of what makes particular C19 policy choices valuable, for example limiting the spread of the epidemic, reducing impact on business, and limiting social expenditure. In such processes, stakeholders may reasonably disagree on what values can be used to guide decisions, often explicitly identifying a diverse range of criteria by which to assess policy 9 .
The combination of the complex mesh of trade-offs, described in previous sections, and the wide range of social values, discussed above, indicates that there is a need for careful deliberative processes in which all stakeholders can meaningfully participate and their values be considered, informed as much as possible by evidence. Such processes should be transparent in the sense that there is clarity between which stakeholders and values are involved, what the available evidence is (and its quality), and how decisions are being taken. The decisions themselves should be made available to the public, including the evidence presented and its argumentation, to ensure public engagement, debate and support for the resulting C19 response. However, given the urgency of the decision-making, such broad consultative processes may not always be feasible and may depend on the stage of the epidemic. At the minimum, policy makers should include key stakeholders representing the health, economic and social dimensions of welfare in its advisory committee to adequately consider all related trade-offs, alongside scientific and economic evidence.
Conclusion
LMIC policy makers face major challenges in defining their optimal policy response to C19. We call for increased in investment in health economics evidence and evidence informed deliberative policy decisions that consider both health and economic impact. The need is acute in LMICs given the dearth of information and lack of access to both data and joint epidemiological and economic decision support models. There is a risk that countries are forced to rely on qualitative debate, or simple analytical approaches to make decisions, often with severe consequences.
We have highlighted the large body of previous work that can form the basis of that evidence generation to support C19 policy in LMICs, which demonstrates emerging collaboration between economists and epidemiologists, both within the scientific community and the policy arena. Critical priorities include: creating greater capacity (specifically in LMICs) to conduct combined economic and epidemiological modelling and support government decisions; parameterising models with enhanced mapping of social contact data that includes economic status; tracking of the opportunity costs incurred in the health sector, including an improved understanding of the effectiveness of lower cost health sector intervention; economic evaluation to estimate the value of new C19 technologies that fully considers future risk; and communications to support decision makers and the general public understand the uncertainty and evidence quality of current models. However, ultimately, while scientists and academics can generate evidence, and enquire and explore the values of populations, trade-offs between health, populations and the economy require transparent and consultative processes if population welfare is to be protected during the C19 crisis.
Data availability
No data are associated with this article.
Funding Statement
This work was supported by the Wellcome Trust [221303].
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
[version 2; peer review: 2 approved]
References
- 1. World Health Organisation: Country and Technical Guidance - Coronavirus disease (COVID-19). 2020. Reference Source [Google Scholar]
- 2. Kaur G, Prinja S, Lakshmi PVM, et al. : Criteria Used for Priority-Setting for Public Health Resource Allocation in Low- and Middle-Income Countries: A Systematic Review. Int J Technol Assess Health Care. 2019;35(6):474–483. 10.1017/S0266462319000473 [DOI] [PubMed] [Google Scholar]
- 3. Li R, Hernandez-Villafuerte K, Towse A, et al. : Mapping Priority Setting in Health in 17 Countries Across Asia, Latin America, and sub-Saharan Africa. Health Syst Reform. 2016;2(1):71–83. 10.1080/23288604.2015.1123338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Tantivess S, Chalkidou K, Tritasavit N, et al. : Health Technology Assessment capacity development in low- and middle-income countries: Experiences from the international units of HITAP and NICE [version 1; peer review: 2 approved]. F1000Res. 2017;6:2119. 10.12688/f1000research.13180.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Isaranuwatchai W, Li R, Glassman A, et al. : Disease Control Priorities Third Edition: Time to Put a Theory of Change Into Practice Comment on "Disease Control Priorities Third Edition Is Published: A Theory of Change Is Needed for Translating Evidence to Health Policy". Int J Health Policy Manag. 2019;8(2):132–135. 10.15171/ijhpm.2018.115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Watkins DA, Nugent R, Saxenian H, et al. : Intersectoral Policy Priorities for Health. In: Disease Control Priorities: Improving Health and Reducing Poverty. 3rd edition. Washington (DC): The International Bank for Reconstruction and Development / The World Bank; 2017 Nov 27. Chapter 2. 2017. 10.1596/978-1-4648-0527-1_ch2 [DOI] [PubMed] [Google Scholar]
- 7. Glassman A, Giedion U, Smith P: What's In, What's Out: Designing Benefits for Universal Health Coverage. (Center for Global Development).2018. Reference Source [Google Scholar]
- 8. Terwind F, Rajan D, Soucat A: Priority-setting for national health policies, strategies and plans.In: Strategizing national health in the 21st century: a handbook. (eds G Schmets, D Rajan, & S Kadandale) (Geneva: World Health Organization).2016. Reference Source [Google Scholar]
- 9. Oortwijn W, Jansen M, Baltussen R: Use of Evidence-Informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe. Int J Health Policy Manag. 2020;9(1):27–33. 10.15171/ijhpm.2019.72 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Asaria M, Griffin S, Cookson R: Distributional Cost-Effectiveness Analysis: A Tutorial. Med Decis Making. 2016;36(1):8–19. 10.1177/0272989X15583266 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Cookson R, Mirelman AJ, Griffin S, et al. : Using Cost-Effectiveness Analysis to Address Health Equity Concerns. Value Health. 2017;20(2):206–212. 10.1016/j.jval.2016.11.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Verguet S, Kim JJ, Jamison DT: Extended Cost-Effectiveness Analysis for Health Policy Assessment: A Tutorial. Pharmacoeconomics. 2016;34(9):913–923. 10.1007/s40273-016-0414-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Verguet S, Riumallo-Herl C, Gomez GB, et al. : Catastrophic costs potentially averted by tuberculosis control in India and South Africa: a modelling study. Lancet Glob Health. 2017;5(11):e1123–e1132. 10.1016/S2214-109X(17)30341-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Sanders GD, Neumann PJ, Basu A, et al. : Recommendations for Conduct, Methodological Practices, and Reporting of Cost-effectiveness Analyses: Second Panel on Cost-Effectiveness in Health and Medicine. JAMA. 2016;316(10):1093–1103. 10.1001/jama.2016.12195 [DOI] [PubMed] [Google Scholar]
- 15. Beutels P, Edmunds WJ, Smith RD: Partially wrong? Partial equilibrium and the economic analysis of public health emergencies of international concern. Health Econ. 2008;17(11):1317–1322. 10.1002/hec.1339 [DOI] [PubMed] [Google Scholar]
- 16. Drummond MFS, Claxton MJ, Stoddart K, et al. : Methods for the Economic Evalutation of Health Care Programmes.Fourth Edition. 4th edn, (Oxford University Press).2015. Reference Source [Google Scholar]
- 17. Briggs A, Vassall A: Count the cost of disability caused by COVID-19. Nature. 2021;593(7860):502–505. 10.1038/d41586-021-01392-2 [DOI] [PubMed] [Google Scholar]
- 18. Collier P, Sterck O: The moral and fiscal implications of antiretroviral therapies for HIV in Africa. Oxford Economic Papers. 2018;70(2):353–374. Reference Source [Google Scholar]
- 19. Abbas KM, Procter S, van Zandvoort K, et al. : Benefit-risk analysis of health benefits of routine childhood immunisation against the excess risk of SARS-CoV-2 infections during the Covid-19 pandemic in Africa.(LSHTM CMMID).2020. 10.1101/2020.05.19.20106278 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. McQuaid FMN, Read JM, Sumner T: Contacts or care? Impact of COVID-19-related disruption on tuberculosis burden. In: submission 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Jewell BL, Smith JA, Hallett TB: The Potential Impact of Interruptions to HIV Services: A Modelling Case Study for South Africa. medRxiv. 2020. 10.1101/2020.04.22.20075861 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Walker PG, White MT, Griffin JT, et al. : Malaria morbidity and mortality in Ebola-affected countries caused by decreased health-care capacity, and the potential effect of mitigation strategies: a modelling analysis. Lancet Infect Dis. 2015;15(7):825–832. 10.1016/S1473-3099(15)70124-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Davies NG, Sweeney S, Torres-Rueda S, et al. : The impact of Coronavirus disease 2019 (COVID-19) on health systems and household resources in Africa and South Asia. In: submission 2020. 10.1101/2020.05.06.20092734 [DOI] [Google Scholar]
- 24. Barasa EW, Ouma PO, Okiro EA: Assessing the Hospital Surge Capacity of the Kenyan Health System in the Face of the COVID-19 Pandemic. Medxriv. 2020. 10.1101/2020.04.08.20057984 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Neumann P, Cohen JT, Kim DD, et al. : Consideration Of Value-Based Pricing For Treatments And Vaccines Is Important, Even In The COVID-19 Pandemic. Health Aff (Millwood). 2021;40(1):53–61. 10.1377/hlthaff.2020.01548 [DOI] [PubMed] [Google Scholar]
- 26. Cuddington JT: Modeling the macroeconomic effects of AIDS, with an application to Tanzania. World Bank Econ Rev. 1993;7(2):173–189. 10.1093/wber/7.2.173 [DOI] [PubMed] [Google Scholar]
- 27. Cuddington JT: Further results on the macroeconomic effects of AIDS: the dualistic, labor-surplus economy. World Bank Econ Rev. 1993;7(3):403–417. 10.1093/wber/7.3.403 [DOI] [PubMed] [Google Scholar]
- 28. Cuddington JT, Hancock JD: Assessing the impact of AIDS on the growth path of the Malawian economy. J Dev Econ. 1994;43(2):363–368. 10.1016/0304-3878(94)90013-2 [DOI] [PubMed] [Google Scholar]
- 29. Cuddington JT, Hancock JD: The macroeconomic impact of AIDS in Malawi: a dualistic, labour surplus economy. J Afr Econ. 1995;4(1):1–28. 10.1093/oxfordjournals.jae.a036821 [DOI] [PubMed] [Google Scholar]
- 30. Cuddington JT, Hancock JD, Rogers CA: A Dynamic Aggregative Model of the AIDS epidemic with Possible Policy Interventions. J Policy Model. 1994;16(5):473–496. 10.1016/0161-8938(94)90024-8 [DOI] [Google Scholar]
- 31. MacQuilkan K, Baker P, Downey L, et al. : Strengthening health technology assessment systems in the global south: a comparative analysis of the HTA journeys of China, India and South Africa. Glob Health Action. 2018;11(1):1527556. 10.1080/16549716.2018.1527556 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Keogh-Brown MR, Smith RD, Edmunds JW, et al. : The macroeconomic impact of pandemic influenza: estimates from models of the United Kingdom, France, Belgium and The Netherlands. Eur J Health Econ. 2010;11(6):543–554. 10.1007/s10198-009-0210-1 [DOI] [PubMed] [Google Scholar]
- 33. Keogh-Brown MR, Wren-Lewis S, Edmunds WJ, et al. : The possible macroeconomic impact on the UK of an influenza pandemic. Health Econ. 2010;19(11):1345–1360. 10.1002/hec.1554 [DOI] [PubMed] [Google Scholar]
- 34. Smith RD, Keogh-Brown MR: Macroeconomic impact of pandemic influenza and associated policies in Thailand, South Africa and Uganda. Influenza Other Respir Viruses. 2013;7Suppl 2(Suppl 2):64–71. 10.1111/irv.12083 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Smith RD, Keogh-Brown MR, Barnett T: Estimating the economic impact of pandemic influenza: An application of the computable general equilibrium model to the U.K. Soc Sci Med. 2011;73(2):235–244. 10.1016/j.socscimed.2011.05.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Smith RD, Keogh-Brown MR, Barnett T, et al. : The economy-wide impact of pandemic influenza on the UK: a computable general equilibrium modelling experiment. BMJ. 2009;339:b4571. 10.1136/bmj.b4571 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Smith RD, Keogh-Brown MR, Chico RM, et al. : Will more of the same achieve malaria elimination? Results from an integrated macroeconomic-epidemiological demographic model. Am J Trop Med Hyg. 2020;103(5):1871–1882. 10.4269/ajtmh.19-0472 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Hammitt JK: Premature deaths, statistical lives, and the economic value of mortality risk.Harvard Center for Risk Analysis.2020. Reference Source [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Hall RE, Jones CI, Klenlow PJ: Trading Off Consumption and COVID-19 Deaths.Stanford University and NBER,2020. 10.3386/w27340 [DOI] [Google Scholar]
- 40. Jones C, Philippon T, Venkateswaran V: Optimal Mitigation Policies in a Pandemic: Social Distancing and Working From Home.National Bureau of Economic Research, Cambridge, MA,2020. 10.3386/w26984 [DOI] [Google Scholar]
- 41. Alvarez FE, Argente D, Lippi F: A Simple Planning Problem for COVID-19 Lockdown.NBER Working Paper No. 26981. National Bureau of Economic Research, Cambridge MA, U.S.A,2020. Reference Source [Google Scholar]
- 42. Barnett-Howell ZM, Mobarak AM: Should Low-Income Countries Impose the Same Social Distancing Guidelines as Europe and North America to Halt the Spread of COVID-19?Yale University and Y-RISE,2020. Reference Source [Google Scholar]
- 43. Dutta M, Husain Z: What cost decisiveness? A cost benefit analysis of the lockdown to contain COVID-19 in India. medRxiv. 2020. 10.1101/2020.07.07.20148338 [DOI] [Google Scholar]
- 44. Brug J, Aro AR, Richardus JH: Risk perceptions and behaviour: towards pandemic control of emerging infectious diseases: international research on risk perception in the control of emerging infectious diseases. Int J Behav Med. 2009;16(1):3–6. 10.1007/s12529-008-9000-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Kambou G, Devarajan S, Over M: The Economic Impact of AIDS in an African country: Simulations with a Computable General Equilibrium model of Cameroon. J Afr Econ. 1992;1(1):109–130. 10.1093/oxfordjournals.jae.a036738 [DOI] [Google Scholar]
- 46. Wang Q, Shi N, Huang J: Effectiveness and cost-effectiveness of public health measures to control COVID-19: a modelling study. medRxiv. 2020. 10.1101/2020.03.20.20039644 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Shlomai A, Leshno A, Sklan EH, et al. : Global versus focused isolation during the SARS-CoV-2 pandemic-A cost-effectiveness analysis. medRxiv. 2020. 10.1101/2020.03.30.20047860 [DOI] [Google Scholar]
- 48. Eichenbaum MS, Rebelo S, Trabandt M: The Macroeconomics of Epidemics.National Bureau of Economic Research,2020. Reference Source [Google Scholar]
- 49. Jones C, Philippon T, Venkateswaran V: A note on efficient mitigation policies.2020. [Google Scholar]
- 50. Atkeson A: What Will be the Economic Impact of COVID-19 in the US? Rough Estimates of Disease Scenarios.National Bureau of Economic Research, Cambridge MA.,2020. Reference Source [Google Scholar]
- 51. Lee J, McKibbin W: Globalization and Disease: The Case of SARS. Asian Economic Papers. 2004;3(1):113–131. 10.1162/1535351041747932 [DOI] [Google Scholar]
- 52. Sidorenko AA, McKibben WJ: Global Macroeconomic Consequences of Pandemic Influenza.Lowy Institute For International Policy,2006. Reference Source [Google Scholar]
- 53. Maliszewska M, Mattoo A, van der Mensbrugghe D: The Potential Impact of COVID-19 on GDP and Trade.World Bank Policy Research Working Paper No. 9211. World Bank, Washington DC,2020. 10.1596/1813-9450-9211 [DOI] [Google Scholar]
- 54. World Health Organisation: Global Tuberculosis Report.World Health Organisation Geneva, Switzerland,2019. Reference Source [Google Scholar]
- 55. Sweeney S, Mukora R, Candfield S, et al. : Measuring income for catastrophic cost estimates: Limitations and policy implications of current approaches. Soc Sci Med. 2018;215:7–15. 10.1016/j.socscimed.2018.08.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Medley GF, Vassall A: When an emerging disease becomes endemic. Science. 2017;357(6347):156–158. 10.1126/science.aam8333 [DOI] [PubMed] [Google Scholar]
- 57. Imperial College: Nowcasts of C19 accross LMICs.2020. Reference Source [Google Scholar]
- 58. Prem K, Cook A, Jit M: Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLoS Comput Biol. 2017;13(9):e1005697. 10.1371/journal.pcbi.1005697 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. Boccia D, Rudgard W, Shrestha S, et al. : Modelling the impact of social protection on tuberculosis: the S-PROTECT project. BMC Public Health. 2018;18(1):786. 10.1186/s12889-018-5539-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60. Government U.K: Measuring resiliance.2016. Reference Source [Google Scholar]
- 61. Loayza NV, Pennings SM: Macroeconomic Policy in the Time of COVID-19: A Primer for Developing Countries.World Bank Malaysia hub.2020. Reference Source [Google Scholar]
- 62. Baird SJ, Garfein RS, McIntosh CT, et al. : Effect of a cash transfer programme for schooling on prevalence of HIV and herpes simplex type 2 in Malawi: a cluster randomised trial. Lancet. 2012;379(9823):1320–1329. 10.1016/S0140-6736(11)61709-1 [DOI] [PubMed] [Google Scholar]
- 63. Boccia D, Hargreaves J, Lönnroth K, et al. : Cash transfer and microfinance interventions for tuberculosis control: review of the impact evidence and policy implications. Int J Tuberc Lung Dis. 2011;15 Suppl 2(Suppl 2):37–49. 10.5588/ijtld.10.0438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64. Boccia D, Pedrazzoli D, Wingfield T, et al. : Towards cash transfer interventions for tuberculosis prevention, care and control: key operational challenges and research priorities. BMC Infect Dis. 2016;16:307. 10.1186/s12879-016-1529-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. Carter DJ, Glaziou P, Lönnroth K, et al. : The impact of social protection and poverty elimination on global tuberculosis incidence: a statistical modelling analysis of Sustainable Development Goal 1. Lancet Glob Health. 2018;6(5):e514–e522. 10.1016/S2214-109X(18)30195-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66. Carter DJ, Daniel R, Torrens AW, et al. : The impact of a cash transfer programme on tuberculosis treatment success rate: a quasi-experimental study in Brazil. BMJ Glob Health. 2019;4(1):e001029. 10.1136/bmjgh-2018-001029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67. Asante A, Price J, Hayen A, et al. : Equity in Health Care Financing in Low- and Middle-Income Countries: A Systematic Review of Evidence from Studies Using Benefit and Financing Incidence Analyses. PLoS One. 2016;11(4):e0152866. 10.1371/journal.pone.0152866 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68. Wiseman V, Asante A, Price J, et al. : Ten best resources for conducting financing and benefit incidence analysis in resource-poor settings. Health Policy Plan. 2015;30(8):1053–1058. 10.1093/heapol/czu108 [DOI] [PubMed] [Google Scholar]
- 69. The OpenSAFELY Collaborative, . Williamson E, Walker AJ, et al. : OpenSAFELY: factors associated with COVID-19-related hospital death in the linked electronic health records of 17 million adult NHS patients. medRxiv. 2020;2020.2005.2006.20092999. 10.1101/2020.05.06.20092999 [DOI] [Google Scholar]
- 70. Clark A, Jit M, Warren-Gash C, et al. : How many are at increased risk of severe COVID-19 disease? Rapid global, regional and national estimates for 2020. In: submission.2020. 10.1101/2020.04.18.20064774 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71. Bozzani FM, Mudzengi D, Sumner T, et al. : Empirical estimation of resource constraints for use in model-based economic evaluation: an example of TB services in South Africa. Cost Eff Resour Alloc. 2018;16:27. 10.1186/s12962-018-0113-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72. Sumner T, Bozzani F, Mudzengi D, et al. : Estimating the Impact of Tuberculosis Case Detection in Constrained Health Systems: An Example of Case-Finding in South Africa. Am J Epidemiol. 2019;188(6):1155–1164. 10.1093/aje/kwz038 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73. Tromp N, Prawiranegara R, Siregar A, et al. : Translating international HIV treatment guidelines into local priorities in Indonesia. Trop Med Int Health. 2018;23(3):279–294. 10.1111/tmi.13031 [DOI] [PubMed] [Google Scholar]
- 74. Baltussen R, Jansen MPM, Bijlmakers L, et al. : Value Assessment Frameworks for HTA Agencies: The Organization of Evidence-Informed Deliberative Processes. Value Health. 2017;20(2):256–260. 10.1016/j.jval.2016.11.019 [DOI] [PubMed] [Google Scholar]
- 75. Daniels N, Sabin J: Limits to health care: fair procedures, democratic deliberation, and the legitimacy problem for insurers. Philos Public Aff. 1997;26(4):303–350. 10.1111/j.1088-4963.1997.tb00082 [DOI] [PubMed] [Google Scholar]