Skip to main content
PLOS One logoLink to PLOS One
. 2020 Apr 17;15(4):e0231768. doi: 10.1371/journal.pone.0231768

Distinguishing moral hazard from access for high-cost healthcare under insurance

Christopher T Robertson 1,*, Andy Yuan 2, Wendan Zhang 2, Keith Joiner 2
Editor: Jason Anthony Aimone3
PMCID: PMC7164657  PMID: 32302322

Abstract

Context

Health policy has long been preoccupied with the problem that health insurance stimulates spending (“moral hazard”). However, much health spending is costly healthcare that uninsured individuals could not otherwise access. Field studies comparing those with more or less insurance cannot disaggregate moral hazard versus access. Moreover, studies of patients consuming routine low-dollar healthcare are not informative for the high-dollar healthcare that drives most of aggregate healthcare spending in the United States.

Methods

We test indemnities as an alternative theory-driven counterfactual. Such conditional cash transfers would maintain an opportunity cost for patients, unlike standard insurance, but also guarantee access to the care. Since indemnities do not exist in U.S. healthcare, we fielded two blinded vignette-based survey experiments with 3,000 respondents, randomized to eight clinical vignettes and three insurance types. Our replication uses a population that is weighted to national demographics on three dimensions.

Findings

Most or all of the spending due to insurance would occur even under an indemnity. The waste attributable to moral hazard is undetectable.

Conclusions

For high-cost care, policymakers should be more concerned about the foregone efficient spending for those lacking full insurance, rather than the wasteful spending that occurs with full insurance.

Introduction

Although insurance enhances welfare by laying off risk [1] some have estimated that insurance may do more harm than good. [2,3,4,5] Standard health economics theory stipulates that insurance stimulates wasteful spending by insulating patients from the marginal cost of the healthcare they consume. This wasteful spending may take the form of consumption of low-value healthcare, or the failure to pursue lower-cost providers of healthcare, or perhaps even the pursuit of riskier lifestyles that create more need for healthcare in the first place (not the focus of the present paper). On this theory of “moral hazard” insurance creates a collective action problem: individual decisions drive up insurance premiums by consuming care that people would not rationally want if they bore its marginal costs. [6,7] Indeed, a landmark field experiment showed that patients receiving more fulsome insurance spent more on healthcare, with no detectable health b50enefits for median patients. [8] This theory and data have influenced a generation of scholarship in favor of substantial cost exposures in health insurance. For example, leading economists have proposed that patients pay a 50% coinsurance rate with no cap on out-of-pocket exposure. [9]

This work has been deeply influential on U.S. policy, which has eschewed universal and fulsome coverage. [10] When President Bill Clinton proposed an expansion of health insurance, he worried that, “many of us who have had fully paid health care plans have used the system whether we needed it or not without thinking what the costs were.” [11] In a contemporaneous survey, economists resoundingly endorsed the moral hazard theory, and many opposed the creation of national health insurance coverage. [12] When President George W. Bush expanded health savings accounts (rather than insurance), he complained that insured patients “really don't know the true costs of medical services they receive.” [11] Even President Obama’s effort to expand health insurance left families exposed to over $16,300 per year in out-of-pocket expenses (for 2020), which can bankrupt even middle-class families. [13,14]

More recent economic work suggests a more nuanced account of insurance. In a range of clinical situations, Baicker, Mullainnathan, and Schwartzstein note that patients seem to forgo highly efficient healthcare. [15] Even when healthcare is deeply subsidized or free, some diabetics do not adhere to their insulin regimens and some patients with heart disease do not take their beta blockers, for examples. The authors suggest that in these special situations where individuals may be biased against consumption, optimal copays should sometimes be zero, or perhaps negative. They coin a term, ‘negative behavioral hazard,’ to describe the tendency of individuals to under-consume valuable health care interventions, in contrast to ‘positive behavioral hazard,’ which is the tendency of individuals to over-consume interventions lacking value.

In this same vein, Brot-Goldberg and associates recently studied a change to greater cost-sharing exposure among a group of highly-paid employees, and found that, while it reduced spending, the intervention did not cause greater price-shopping. [16] In other work, high-deductible healthcare plans have been shown to reduce health spending, but also reduce appropriate preventative care and medication adherence. [17] Recent research suggests that providers may drive spending choices to a much greater degree than patients. [18,19]

Our study adds to the literature in the following two ways. First, we use indemnities as an alternative theory-driven counterfactual in two vignette-based survey experiments with a high-dollar healthcare setting. Second, our analysis of the experimental outcome provides evidence that most of the healthcare spending from insured consumers would occur even under an indemnity. There is no detectable waste attributable to moral hazard triggered by insurance in the high-dollar healthcare context.

High-cost care and the indemnity counterfactual

To understand the effects of any intervention, such as health insurance, the analyst must compare it to the alternative, or counterfactual. Economists have traditionally focused on uninsurance as the counterfactual for health insurance. Summarizing this “general theory that health economists apply to insurance,” leading economist and governmental advisor Mark Pauly explains that “‘[m]oral hazard’ … is generally… inefficient, because some of the use of medical care that insurance stimulates (compared with having no insurance, when a person pays the full market price) must by definition be care that is worth less to the person than its market price.” [20]

While the uninsurance counterfactual is arguably appropriate for low-price consumption (e.g., a generic drug) that is available to both insured and uninsured people alike, it may not be appropriate for high-cost care or poor consumers. In 2015, half of all health expenditures fell on just 5% of the population, and that group spent $50,572 on average, which is also roughly the income for an entire year for a median Americans. [21] In such cases where the care is unaffordable, an uninsured or underinsured patient’s “choice” not to consume arguably does not reveal anything about their valuation of the non-consumed goods and services. [22]

John Nyman argues that people buy health insurance not just to spread the risk of large expenses; they seek access to healthcare they otherwise could not afford to consume. [23,24] In addition to insufficient wealth, illness often causes income loss, which thus reduces how much healthcare sick persons could buy out of pocket. [25,26] Nyman’s theory has been largely ignored by health economists, [27] perhaps because the theory has not seemed conducive to empirical testing and because it makes it more difficult to make policy-relevant inferences from the fact that health insurance stimulates health spending. The additional spending could be beneficial to welfare, since it provides individuals with the necessary purchasing power to access valuable care.

Yet, increased spending due to insurance may still reflect welfare losses, as consumers do not bear marginal costs. They could, for example, spend $100,000 of the insurer’s money to access care worth only $5,000. To distentangle access from moral hazard–a necessity to set optimal insurance policy–a more appropriate counterfactual for insurance is necessary.

In the contemporary U.S. since the 1950s, health insurance benefits are largely paid in-kind to reimburse healthcare providers for the goods and services they provide, rather than paid as cash to the beneficiaries. [28] In contrast, indemnities are a form of insurance, which pays benefits in cash-equivalents to the beneficiary, rather than paying them in-kind to healthcare providers. Scholars have proposed such an indemnity system for healthcare. [29,30,31] Cutler and Zeckhauser have argued that indemnities would be “optimal … and the simplest health insurance policy.” [32]

Indeed, U.S. automobile insurers sometimes pay cash benefits. [33] Worldwide, there are established markets for indemnities keyed to medical occurrences [34,35] often sold as riders to life insurance policies. [36] These are sometimes known as “dreaded disease” plans, and are largely supplementary to traditional health insurance coverage of medical expenses. Similarly, in the U.S., there is a growing market for “critical illness” insurance plans, which have “are often pitched as an insurance policy for your health insurance policy.” [37]

Aside from laying off risk and providing access to otherwise unaffordable care, insurance has other functions, such as bundling insureds into groups, which have greater market power to negotiate prices (with the threat of excluding a provider from a network), compared to individuals who nominally face undiscounted “list” prices. [38] On the other hand, uninsured individuals often receive discounted prices based on lower administrative costs and their ability to pay, which can actually then be less than prices offered to insurers. [39] Although it would be more complicated, an insurer could provide this provider-bargaining function, like a discount card, even if it paid benefits to insureds under an indemnity. (In our experimental framework below, we hold constant the price between indemnities, traditional insurance, and uninsured conditions.)

Although they are not used for primary health insurance coverage in the United States today, indemnities are interesting as a potential real-world mechanism for financing healthcare and protecting patients from risk. [40] But even if indemnities were completely impractical (perhaps because of fraud or other problems), they are theoretically interesting as a counterfactual for decomposing the effects of health insurance, as shown in Fig 1. Indemnity maintains an opportunity cost for patients, unlike standard insurance. Indemnity also guarantees access to care, unlike uninsurance. The consumption rate under an indemnity thus explains away some of the marginal consumption under traditional insurance, since these individuals would consume even if the insurance were fungible (creating opportunity costs), but do not consume when uninsured (lacking access).

Fig 1. Theoretical model for decomposing effects of health insurance from two counterfactual conditions.

Fig 1

Values are hypothesized for illustration. Reproduced with permission [40].

Thus, the analyst needs estimates of consumption for identically-situated patients under uninsurance, indemnity, and traditional insurance. Those with insurance who would consume even if they did not have insurance (as shown in the uninsured counterfactual), are merely using insurance to spread the risks of being exposed to costly care, as in classic economic theory. To estimate the access function of insurance, the analyst measures the difference in proportions on intent to consume between those who are uninsured versus those insured by indemnity, holding all else constant. To measure truly wasteful marginal spending under traditional in-kind insurance, the analyst looks to the difference in rates of treatment consumption between those with indemnities versus traditional insurance. This measure allows an estimate of the moral hazard effect of insurance, since access is controlled in both conditions, but the consumer’s price signal is eliminated in traditional insurance.

Nyman and colleagues have recently empirically estimated the size of the access effects of insurance, by examining other income shocks and their effects on healthcare consumption, as an analogy to true indemnities keyed to illness. [41] This population-survey approach is not keyed to the sorts of expensive healthcare consumption decisions that drive most health spending. In contrast, a simulated indemnity insurance policy would provide a more direct conceptual test. We are aware of no direct empirical studies of the effects of indemnities on medical care consumption, which allow such direct comparisons of the appropriate counterfactuals.

Materials and methods

We seek to simulate identically-situated patients with no insurance, traditional insurance, or indemnity insurance, in contexts of high-value and low-value healthcare. Lacking archival data on indemnities for primary health coverage and unable to randomize patients to true uninsurance in the field, we constructed a randomized vignette-based survey experiment. Vignette-based research has become a staple of social science generally and useful for simulating discrete choices in healthcare research in particular. [14,4244] Online populations are an increasingly powerful way to collect large amounts of data from attentive respondents, with high levels of attention and demographic representativeness. [4547]

Vignettes

In two experiments, we sought to simulate realistic clinical situations culminating with patients deciding, “…would you take [the treatment]?” We asked respondents to explain that decision in writing as well.

Vignettes were constructed around common medical conditions in the US, for which some costly intervention is presented to and being considered by the patient. The intervention can be carried out on an elective or semi-elective basis: patient decisions are made in a non-emergent setting. For example, Experiment 1 focused on a single clinical situation, with vignettes depicting a hypothetical drug (“Bucarin”) as a chemotherapy for the respondent’s colon cancer, costing $80,000, on top of the standard regimen the patient will otherwise receive.

Experiment 2 replicated the Bucarin case, and also introduced seven other scenarios as shown in Table 1 (one per respondent). This heterogeneity in case presentations is important because the fraction of moral hazard may depend on whether the treatment directly influences survival from a potentially fatal disease, or whether the treatment choices impacts mobility/lifestyle, or whether the treatment merely affects personal appearance (to describe three of our cases). Thus across a range of conditions, we tested cases involving a drug for lung cancer, a stent device used for stable coronary artery disease, surgery for gastrointestinal disease, a drug for macular degeneration, a biologic for psoriasis, a knee replacement surgery for degenerative arthritis, and spinal surgery for lower back pain. The vignettes cover a wide range of commonly encountered and expensive medical situations, varying in severity, rate of progression, extent of disability, treatment options, physician preferences, and costs.

Table 1. Summary of experimental vignettes.

Disease or Condition Proposed Treatment / Baseline Proposed Treatment
High Value Manipulation Low Value Manipulation
Cancer: Adenocarcinoma of the colon $80k novel drug / standard therapy Drug has been approved by the FDA for colon cancer and studies show it improves chances of survival Drug has not been approved for use in colon cancers. Oncologist has had good experiences using the drug off-label
Cancer: Non-small-cell lung cancer $125k novel drug / home hospice Drug increased average survival by 8 months Drug stopped tumors growth for 4 months but did not show any survival benefit
Cardiovascular: Coronary Artery Disease $55k drug-eluting stent / medical therapy The FDA has approved the stent to prevent heart attacks because it improves survival Stent is not approved for prophylactic use (prior to heart attack), but is recommended off-label, with no survival benefit
Gastrointestinal Disease: GERD $45k gastric reflux surgery / medical and lifestyle therapy Three-quarters of patients experience relief of their symptoms Half of patients experience relief of symptoms, but side effects can be substantial and patient is not optimal surgical candidate
Age-Related Macular Degeneration (AMD) $15k novel drug / established drug Novel drug improves vision in 2/3 of cases compared to 1/3 of cases with established drug There is less data on the very new novel drug and doctor recommends sticking with the established drug
Skin/Autoimmune disease: Psoriasis $20k biologic drug / standard medical therapy Two-thirds of patients who take the drug report clear skin, and low dose minimizes potential severe risks One-third of patients who take drug report clear skin; side effects can be severe, including cancer
Orthopedic Disease: Degenerative Arthritis $70k total knee replacement surgery / medical management Orthopedic surgeon finds instability in right knee which requires surgery, which should occur now Orthopedic surgeon finds no instability but predicts surgery will eventually be needed; but arthritis is still mild to moderate
Neurologic Disease: Degenerative Lower Spine Disease $85k spinal surgery / medical management New surgery removes pain and disability in two-thirds of patients and most patients struggle to comply with alternative medical treatments New surgery removes pain and disability in one-third of patients, which is equivalent to the results of intense medical treatment including physical therapy

Every respondent was offered the stipulated baseline treatment, which they would receive if they declined the proposed treatment. Respondents were randomly assigned to consider one high value or low value treatment against that baseline.

The vignettes (available from the authors) were fairly extensive and detailed, ranging from 409 to 576 words (494 on average), with an additional 551 words presented for informed consent, writing prompts, etc. All vignettes contained the following components, corresponding to the information used in clinical decision making by patients and providers: history of present illness including medical management of the condition to date, past medical history relevant to the condition, diagnostic testing data where appropriate, and costs of the procedure. All patients are seen by specialists for the respective condition. These specialists provide informed consent, covering potential benefits, side effects and risks of the intervention. Total costs for interventions are typical for such interventions in the US, ranging from $15,000 to $125,000, as shown in Table 1.

Manipulations

We varied both the type of insurance and the value of care (high or low, with each subject receiving a recommendation for one case). High and low value scenarios are broadly consistent with the range of outcomes described in the medical literature. High value scenarios reflect the more certain and/or more effective outcomes, while low value scenarios reflect the less certain and/or less effective outcomes. As an example of a value manipulation, in Experiment 1, the high-value condition is for an FDA-approved drug, with proof of safety and efficacy for the patient’s condition, while the low-value condition offers an off-label use for a condition not specifically considered by the FDA, with no proof of safety and efficacy for the patient’s specific condition. In the low-value condition, the drug is nonetheless recommended by the oncologist, as is quite common in the real world [48].

In manipulating the respondent’s insurance status, we asked them to imagine that they are either (a) uninsured, (b) with traditional insurance, or (c) insured in a cash indemnity program. For the uninsured conditions, the text provided:

“Please imagine that you currently do not have health insurance, however you do have the same amount of wealth and credit that you actually have in the real world (the amount you provided in your answer above). So, only if you have enough money available, you can pay for the Bucarin yourself. Think back to your answer to the purchasing power above. If you do have that much purchasing power, please consider however, other things you may prefer to do with the money. Please be realistic.“

For the traditional insurance conditions, the text provided:

“Please imagine you have full health insurance, and you have already met your annual deductible, so there is no additional cost to you out of pocket, if you choose to take [the treatment]. In deciding, please be realistic.”

The indemnity was described as:

Please imagine you have full health insurance, and you have already met your annual deductible. Your insurance company has a unique program, in which they cover special drugs with a cash payment, called an indemnity (similar to car insurance). Because your physician has indicated that you are a candidate for [the treatment] you receive a $125,000 cash payment from your insurance company. You receive the money regardless of whether you decide to take [the treatment]. You decide whether you spend the cash on the [the treatment] or instead keep the money for whatever other purposes you may choose. In deciding, please be realistic.

Notably, the indeminity script uses the word “cash” three times. In the vignettes, the insurance manipulations were highlighted in boldface text, as shown here. In both of the insurance conditions, there is no cost-sharing required, on the theory that the patient has already reached her annual maximum through the cascade of healthcare that culminates in this pivotal decision, a not-uncommon phenomenon. [22]

Based on the design described above, Experiment 1 had six conditions (3 insurance types x 2 treatment values), in between-subjects design with equal allocation across all variables and levels thereof. Experiment 2 yielded 48 conditions (3 insurance types x 2 treatment values x 8 clinical scenarios), in between-subjects design with equal allocation across all variables and levels thereof. Manipulations were fully crossed in factorial design to maximize statistical power. [49,50]

Respondent engagement

On the informed consent page, we warned all respondents that they may be quizzed on the material, and that they should be careful. To increase engagement and internal validity, we also included several mandatory writing prompts that interrupted the vignette. Halfway through the scenario, we asked, “Please refer to the story specifically, and share a sentence describing how you would feel in this medical situation, and your thoughts about your treatment options described so far.” At the end of the scenario in Experiment 2, we also asked, “On the next page you will share your decision. First, now please write two sentences putting in your own words, (1) your understanding of the treatment options, and (2) your insurance situation, as described above.”

A research assistant (RA) manually reviewed whether respondents provided minimally meaningful responses to the writing prompts. The RA was blinded to respondents’ experimental conditions. Those providing junk data were removed.

To further ensure engagement, in both experiments, after the survey on a separate page, we asked all respondents to identify their insurance type in the vignette. Those answering this manipulation-check incorrectly were screened. In Experiment 2 we similarly required a correct answer to a disease-type query, and screened those failing.

Research populations and data quality

In Experiment 1, we recruited human subjects from a platform (Mechanical Turk (“Mturk”)) provided by Amazon.com to collect 613 valid observations. To ensure engagement in the materials and reduce the risk of the work being completed by non-human “bots”, we pre-qualified respondents who were successful in at least 90% of prior tasks they had attempted. [47] We also used TurkPrime to block duplicate IP addresses and verify worker country location (United States), and we paid $1.25 to each worker, who (on the median) spent 8.0 minutes to complete the task. The research population was reasonably diverse and randomization successfully distributed observable covariates across experimental conditions (S1 Table). After applying our manipulation checks, RA review of the qualitative responses found no junk data for exclusion.

In Experiment 2 we expand generalizability by including a range of seven other clinical scenarios; quadruple the sample size; replicate with a different respondent population (Survey Sampling International (SSI)); and recruit a demographically representative pool, tracking U.S. Census distributions of age, gender, and household income, with successful randomization across conditions (S2 Table). SSI uses multiple recruitment and incentivization methods, described in the Supplemental materials. In Experiment 2, we began with 2400 valid observations, defined as those who passed the insurance-type and disease-type manipulations. A blinded RA reviewed qualitative responses, and we eliminated 44 respondents who did not engage meaningfully in the task, yielding 2,356 responses for analysis.

With the above pre-qualification screening and a blinded manual review of qualitative responses, fraudulent responses, including bots are unlikely to be contaminating the final data in our analysis. Due to the randomized controlled trial design, any such noise would bias the analysis towards finding null result. This turns out to be not the case as we see a sharp contrast among responses under two of three different insurance types and both levels of treatment value. Additionally, the estimations are consistant across two experiments, conducted with different populations.

Covariates and analysis

We collected standard demographics and respondents’ actual insurance status (as distinct from the manipulated insurance type descried above) for use as controls. Prior to the vignettes we also asked each person for their maximum purchasing power (i.e., cash, formal and informal credit, sellable assets) that could be used “for a very important purchase … if absolutely necessary to make such a purchase, if you absolutely had to do so.” To ensure some level of introspection on this point, we asked respondents qualitatively “explain briefly how you would come up with that amount of money. From what sources would you draw to reach that amount? What might you have to give up?” In some of our models, we used the quantiative amount as an “impossibility screen” to evaluate subsequent respondent choices to consume healthcare in the uninsured condition. The vignettes do not ask respondents to imagine different purchasing powers than they have in the real world; we exploit this natural variation which may be salient to respondents. (As it happens, this screen does not substantially change our results.)

In our regression models, we created subsets of the data to test the theory-driven contrasts (uninsurance versus indemnity to test the access function of insurance, and indemnity versus traditional insurance to test for moral hazard). To produce regression-adjusted percent of patients consuming the healthcare across condition (Fig 2), the main specification employs a linear probability model, for ease of interpreting coefficients (S3 & S4 Tables). The Supplemental Information also presents logit and probit models, which generally lead to similar results. For robustness, we there present analyses with and without controls, and with and without data screens.

Fig 2.

Fig 2

Percent consuming treatment by insurance type and value of treatment with bootstrapped 95% confidence intervals across two study populations (Panels A & B). Panel A is N = 613 respondents provided by Amazon.com, adjusted for demographics, in a cancer vignette, either on-label (high value) or off-label (low value). Panel B is N = 2,356 respondents from Survey Sampling International, representative to U.S. Census, by age, gender, and income; randomized across eight vignettes and adjusted for demographics and vignette. Both samples exclude those failing insurance-type manipulation check and purchasing-power impossibility check. As shown in Table 2, using a Mann-Whitney U Test and T-test, the differences between uninsurance and either type of insurance are highly significant; the differences between insurance types are not significant.

As shown in Fig 3, to identify a likely counterfactual for each individual respondent, we also deployed Bayesian simulation analogue to the Peters-Belson method. [51,52,53] This approach provides greater precision, of particular importance for interpreting potential null effects.

Fig 3. Marginal effects of insurance (moral hazard and access) on intent to consume healthcare under Bayesian Monte Carlo estimation method, using uninsurance and indemnity counterfactuals (with 95% Confidence Intervals).

Fig 3

Amazon.com convenience sample is N = 613 respondents from Mturk, in a cancer vignette, randomized to either on-label (high value) or off-label (low value) proposed treatment. SSI Demographics-Weighted Sample is from Survey Sampling International, N = 2,356, representative to U.S. Census, by age, gender, and income; randomized across eight vignettes in high or low value. Controls adjust for demographics, value of proposed healthcare, and vignette. Both samples exclude those failing insurance-type manipulation check and purchasing-power impossibility check. When controls are applied, moral hazard is not statistically significant under either sample. Access is significant under both samples.

Results and discussion

Participants’ intent to consume the proposed treatment was very responsive to some variations on insurance type and treatment value (Fig 2 and Table 2). We find virtually no spending when respondents lack health insurance, but very substantial spending in the traditional insurance condition. With insurance, respondents were about five times more likely to consume the proferred healthcare. On the other hand, although the sign for moral hazard is in the theorized direction, there were no significant differences in consumption between those in the indemnity and traditional insurance conditions. This null result persisted in the replication, and pooling across seven additional vignettes, and regardless of whether we applied regression controls (Table 3) and manipulation checks and alternative logit and probit models (S3 and S4 Tables). The main results are as follows.

Table 2. Bivariate tests of statistical significance for differences in treatment consumption between insurance types, with subsets for treatment value (Low, High, Both).

Panel A: Online Convenience Sample Experiment (Amazon.com)
Uninsured minus Indemnity Indemnity minus Traditional
Value of Healthcare Low High Both Low High Both
Mann-Whitney U test (CLESa) 0.389*** 0.303*** 0.345*** 0.482 0.451 0.468
T-test (Mean Differenceb) -0.222*** -0.394*** -0.309*** -0.037 -0.098 -0.065
Obs N1,N2 101,100 103,102 204,202 100,105 102,102 202,207
Panel B: Online Census-Weighted Experiment (SSI Sample)
  Uninsured minus Indemnity Indemnity minus Traditional
Value of Healthcare Low High Both Low High Both
Mann-Whitney U test (CLESa) 0.400*** 0.331*** 0.366*** 0.468 0.487 0.480
T-test (Mean Differenceb) -0.201*** -0.339*** -0.268*** -0.064 -0.027 -0.040
Obs N1,N2 366,351 425,356 791,707 351,452 356,406 707,858

a CLES stands for the Common Language Effect Size, which is the probability that variable for the first group is larger than variable for the second group.

b Mean Difference for each T-test is the mean of the second group subtracted from the mean of the first group.

“***” significant at 0.1% level

“**” significant at 1% level

“*” significant at 5% level.

Table 3. Linear probability models on intent to consume treatment.

Panel A: Online Convenience Sample Experiment (Amazon.com)
Uninsured vs Indemnity Insurance (Access) Traditional Insurance vs Indemnity (Moral Hazard)
Indemnity Insurance 0.222*** 0.225***
(0.064) (0.067)
Traditional Insurance 0.037 0.055
(0.068) (0.070)
Value of Healthcare 0.015 0.012 0.188** 0.180*
(0.064) (0.066) (0.068) (0.071)
Indemnity X Value 0.172 0.165
(0.090) (0.094)
Traditional X Value 0.061 0.034
(0.096) (0.099)
Constant 0.208*** 0.146 0.430*** 0.248
(0.045) (0.202) (0.049) (0.223)
Controls NO YES NO YES
R-squared 0.121 0.128 0.054 0.073
N 406 390 409 396
Panel B: Online Census-Weighted Experiment (SSI Sample)
  Uninsured vs Indemnity Insurance (Access) Traditional Insurance vs Indemnity Insurance (Moral Hazard)
Indemnity Insurance 0.201*** 0.218***
(0.035) (0.036)
Traditional Insurance 0.064 0.032
(0.035) (0.036)
Value of Healthcare 0.058 0.076* 0.196*** 0.194***
(0.033) (0.034) (0.037) (0.038)
Indemnity X Value 0.138** 0.121*
(0.048) (0.050)
Traditional X Value -0.037 -0.016
(0.050) (0.051)
Constant 0.227*** 0.338*** 0.427*** 0.676***
(0.024) (0.095) (0.026) (0.105)
Controls NO YES NO YES
R-squared 0.097 0.167 0.033 0.107
N 1,498 1,377 1,565 1,427

Standard errors shown in parentheses.

“***” significant at 0.1% level

“**” significant at 1% level

“*” significant at 5% level. Controls include demographics and vignette-type.

We did not power our study to explore specific hypotheses related to individual clinical conditions; instead we included these manipulations to improve generalizability. Nonetheless, the Supplemental Information displays regression results for individual scenarios (S5S12 Tables). We found that respondents tended to be sensitive to the value of the healthcare proposed–just as the factor was highly significant in our pooled models, treatment value made a detectable difference (at the 0.05 level) to respondent decisions in 5 out of 9 of the individual disease experiments (including Experiment 1, its replication in Experiment 2, and seven others). Access was the key function of insurance: in 8 out of 9 of the scenario cases (all but the psoriasis scenario), those with health insurance consumed more, even with fungible insurance that had an opportunity cost. In contrast, we found no moral hazard detectable (at the 0.05 level) in any of our scenarios (0 out of 9) when controls are included. Just as in our highly-powered pooled results, we found no moral hazard that could be distinguished from the null (at the 0.05 level). Considering the interaction effect, we found that the fungibility of insurance in the indemnity also did not make respondents detectably more sensitive to the value of the proposed treatment in any of the scenarios (0 out of 9), the same result as in our overall model.

Strengths and limitations

Our randomized design blinds respondents and avoids certain forms of response bias, while solving for endogeneity and internal validity, thus allowing causal inferences, unlike typical surveys. Our vignette-based approach allows study of indemnity insurance plans, which do not presently exist as a form of primary health insurance. The realistic vignettes drafted by a physician, represented a wide range of cases of high-cost care, which drive most health spending, but where it is infeasible to field experiment due to the ethical and practical difficultly of deny insurance for such life-saving care. This is precisely the domain where the access function of insurance may be most important [24] but precisely where we cannot extrapolate from studies of routine, inexpensive healthcare. [54] In this domain, discrete choice experiments, like the one we fielded, provide a useful approach. [46,47]

We replicated our findings in two independent and diverse research populations. One provided incentives for respondents to pay close attention, and another provided a more demographically-representative sample.

One interesting feature of our vignette approach could be counted as a strength (for theoretical clarity) and a weakness (for realism): we excluded implicit forms of insurance that exist in the United States. [55] Specifically, for the respondents in the uninsured conditions, we did not make salient the fact that they could get some healthcare in hospital emergency rooms, without showing proof of payment, due to a Federal law called EMTALA. Further, although we did ask them to consider their access to credit when estimating their maximum purchasing power, we did not make especially salient the fact that they could rack up medical bills and ultimately fail to pay them, perhaps even discharging them in bankruptcy. These implicit forms of insurance have many disadvantages and inefficiencies, but they are one reason that prior studies of explicit insurance have not found major benefits for health. Thus, the uptake rates shown in our uninsured conditions are likely unrealistically low, since in the United States access would often in fact be provided through these implicit insurance mechanisms (making nobody truly uninsured in this sense). Nonetheless, as the analytic baseline for standard economic theory [20], the truly uninsured patient is the relevant construct to simulate, since only such a person is fully incentivized to make cost-benefit tradeoffs.

Our methodology has other limitations. Most importantly, respondents may not have fully grasped the importance of the insurance type manipulation. Since indemnities are not commonly used in health insurance, notwithstanding the bold type used in our case presentations, respondents may have failed to appreciate that they would receive a cash payment, which they could spend on anything else they preferred. Nonetheless, respondents noticed and reacted to the relatively subtle and complicated manipulations concerning the value of the proposed treatment, with statistical significance at the .01 level. Moreover, we tested respondents ex post to determine whether they remembered which type of insurance plan they were in and we excluded those who failed. In particular, respondents in the indemnity condition had to correctly respond that they were in the condition where the insurer would pay them “cash”, which they could choose to spend on the treatment, or not.

Notwithstanding general findings that vignette research can be valid if done appropriately [14,4247], a variety of biases may infect vignette decisions compared to real world decisions. For example, in the real world, perhaps respondents would be more likely to feel the pressure of alternative needs to spend money, especially when sick and unable to work. Or respondents may be more likely accept their physicians’ recommendations, in the heat of a clinical encounter. Across our 16 vignettes, with eight diseases and two levels of quality, driving much different base rates of consumption, we see consistent dynamics for our experimental manipulations.

We also simplified the healthcare system in various ways. We did not simulate the various sorts of cost-sharing profiles that could be applied to traditional insurance or indemnities. In fact, large-dollar spending often happens after cost-sharing maxima have been exhausted by prior spending. [22] We also used individuals’ real-world incomes and maximum purchasing powers, but randomly assigned them to experimental insurance statuses, without regard for their capacity to afford insurance premiums (a remarkably complicated question, given the explicit and implicit premium subsidies that exist in the employer and individual healthcare markets). The distinction between high value and low value care in some vignettes was more stark than would typically be the case in actual medical practice. Nonetheless, our vignettes provided a clean test of consumption decisions in the idealized-but-complex clinical situations presented.

Conclusions

Fig 3 summarizes our primary findings. We were consistently unable to find a significant effect of moral hazard waste, and the upper ranges of our confidence intervals help rule out the hypothesis that the problem is substantial in the experimental sample. In contrast, we consistently found a substantial effect of insurance to provide access to expensive healthcare. These suggest that moral hazard in the healthcare sector may not be large, but the benefit of insurance providing access to expensive healthcare could be substantial.

This research project sheds light on moral hazard, which has preoccupied health economics and U.S. health policy for half a century. By testing a novel counterfactual of indemnity insurance, we distinguished the access function of health insurance from waste, and thus informed longstanding debates about how fulsome health insurance coverage should be.

Importantly, we focus on expensive interventions, associated with serious illness, which drives aggregate health spending. [21] Our data suggest that in these circumstances, moral hazard waste is not substantial, since the vast majority of spending stimulated by insurance would happen with fungible insurance, which preserves a price signal for consumers. We make no claim that these findings can or should be extrapolated directly to more routine care decisions.

Healthcare is far from an ideal market: it is rife with wasteful spending and infected by all sorts of market failures, including the misaligned incentives of healthcare providers. Our data show what we know obtains in the real world: healthcare consumers are often willing to consume low-value care, when their physicians recommend it. Yet, our data show that the problem exists regardless of whether patients have a traditional insurance policy that occludes the price of care or an indemnity policy that makes the price salient along with the opportunity costs of consumption. Thus, our data helps to pinpoint the problem, and helps us understand where future policymaking should focus. For example, our study suggests that it will be more effective to align incentives of providers with health and thrift, rather than placing more risk on patients.

Our data is consistent with macro-economic data, showing that the U.S. has some of the highest healthcare spending along with very high levels of out of pocket patient cost-exposure. Countries with insubstantial patient cost exposure have some of the most efficient healthcare systems, delivering impressive health outcomes at lower overall costs than in the United States [56]. Our data is also consistent with research findings that providers drive consumptions much more than patients [18,19] and that patients exposed to cost decline both high-value and low-value are alike. [15,16,17] These studies have been unable to distinguish the access function of insurance in particular.

The lack of healthcare consumption associated with uninsurance and underinsurance appear to be a much more substantial problem than moral hazard associated with fulsome insurance. Health policy should accordingly reconsider patient-cost exposure and pursue other measures to reduce the prevalence of low-value healthcare.

Supporting information

S1 Table. Demographics split by insurance type manipulation.

(DOCX)

S2 Table. Demographics split by insurance type manipulation.

(DOCX)

S3 Table. Online convenience sample experiment (amazon.com)–linear probability models on intent to consume treatment.

(DOCX)

S4 Table. Online census-weighted experiment (SSI Sample)–regressions on intent to consume treatment.

(DOCX)

S5 Table. Cancer: Adenocarcinoma of the colon.

(DOCX)

S6 Table. Cancer: Non-small-cell lung cancer.

(DOCX)

S7 Table. Cardiovascular: Coronary artery disease.

(DOCX)

S8 Table. Gastrointestinal disease: GERD.

(DOCX)

S9 Table. Age-Related Macular Degeneration (AMD).

(DOCX)

S10 Table. Skin/Autoimmune disease: Psoriasis.

(DOCX)

S11 Table. Orthopedic disease: Degenerative arthritis.

(DOCX)

S12 Table. Neurologic disease: Degenerative lower spine disease.

(DOCX)

S1 Data

(DOCX)

S2 Data

(ZIP)

Acknowledgments

The authors appreciate the research assistance of Ellen Stark. The project benefitted from review of preliminary drafts of the protocol and/or manuscript by John Nyman, Gautam Gowrisankaran, William Sage, Victor Laurion, Jamie Robertson, Jim Greiner, Tara Sklar, Simone Sepe, Anna Rita Bennato, Govind Persad, and anonymous peer reviewers. The project benefitted from feedback at University of Arizona’s QuantLaw and University of Arizona’s Interdisciplinary Experimental Readings Group, University of Minnesota’s Symposium on Drug Prices, the American Association of Law Schools Insurance Law Section, the Philosophy, Politics, and Economics Program at University of Pennsylvania, and the Conference on Empirical Legal Studies. Fig 1 is also forthcoming as part of a book published by Harvard University Press.

Data Availability

All data is available at https://figshare.com/articles/fulldata_stata_dta/9923132.

Funding Statement

The authors gratefully acknowledge the funding support from the Center for Management Innovations in Healthcare at the Eller College of Management, from the Rogers College of Law, and from the College of Medicine, all at the University of Arizona.

References

  • 1.Arrow K. Uncertainty and the welfare economics of medical care. Am Econ Rev. 1963;53(5):941–973. [Google Scholar]
  • 2.Zeckhauser R. Medical insurance: A case study of the tradeoff between risk spreading and appropriate incentives. J Econ. Theory. 1970;2(1):10–26. [Google Scholar]
  • 3.Feldstein MS. The welfare loss of excess health insurance. J Polit Econ. 1973;81(2):276–277. [Google Scholar]
  • 4.Feldman R, Dowd B. A new estimate of the welfare loss of excess health insurance. Am Econ Rev. 1991;81(1):297–301. [PubMed] [Google Scholar]
  • 5.Pauly MV. The economics of moral hazard: comment. Am Econ Rev. 1968;58(3):531–537. [Google Scholar]
  • 6.Baker T. On the genealogy of moral hazard. Tex Law Rev . 1996;75(2):237–292. [Google Scholar]
  • 7.Stone D. Behind the jargon: Moral hazard. J Health Polit Policy Law. 2011;36(5):887–896. 10.1215/03616878-1407676 [DOI] [PubMed] [Google Scholar]
  • 8.Newhouse J. Free for All: Lessons from the RAND Health Insurance Experiment. Cambridge, MA: Harvard University Press; 1993. [Google Scholar]
  • 9.Manning W, Marquis MS. Health insurance: The tradeoff between risk pooling and moral hazard. J Health Econ. 1996;15(5):609–639. 10.1016/s0167-6296(96)00497-3 [DOI] [PubMed] [Google Scholar]
  • 10.Kwak J. Economism: Bad Economics and the Rise of Inequality. New York City, NY: Pantheon; 2017. [Google Scholar]
  • 11.Centers for Medicare & Medicaid Services. CMS History Project President’s Speeches, Sept 2017. https://www.cms.gov/About-CMS/Agency-Information/History/downloads/CMSPresidentsSpeeches.pdf.
  • 12.Fuchs VR. Economics, values, and health care reform. Am Econ Rev. 1996;86(1):1–24. [PubMed] [Google Scholar]
  • 13.Dickman SL, Himmelstein DU, Woolhandler S. Inequality and the health-care system in the USA. Lancet. 2017;389(10077):1431–1441. 10.1016/S0140-6736(17)30398-7 [DOI] [PubMed] [Google Scholar]
  • 14.Shrime MG, Weinstein MC, Hammitt JK, Cohen JL, Salomon JA. Trading bankruptcy for health: a discrete-choice experiment. Value Health. 2018;21(1):95–104. 10.1016/j.jval.2017.07.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Baicker K, Mullainathan S, Schwartzstein J. Behavioral hazard in health insurance. Q J Econ. 2015;130(4):1623–1667. 10.1093/qje/qjv029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Brot-Goldberg ZC, Chandra A, Handel BR, Kolstad JT. What does a deductible do? The impact of cost-sharing on health care prices, quantities, and spending dynamics. Q J Econ. 2017;132(3):1261–1318. [Google Scholar]
  • 17.Agarwal R., Mazurenko O., & Menachemi N. (2017). High-deductible health plans reduce health care cost and utilization, including use of needed preventive services. Health Aff., 36(10), 1762–1768. [DOI] [PubMed] [Google Scholar]
  • 18.Chandra A, Skinner J. Technology growth and expenditure growth in health care. J Econ Lit. 2012;50(3):645–680. 10.1257/jel.50.3.645. [DOI] [Google Scholar]
  • 19.Chernew M, Cooper Z, Larsen-Hallock E, and Morton FS. Are health care services shoppable? Evidence from the consumption of lower-limb MRI scans, NBER Working Paper No. 24869 (July 2018). [Google Scholar]
  • 20.Pauly MV. Medicare drug coverage and moral hazard. Health Aff. 2004;23(1):113–122. 10.1377/hlthaff.23.1.113. [DOI] [PubMed] [Google Scholar]
  • 21.Mitchell EM, Machlin SR. Statistical Brief #506: Concentration of health expenditures and selected characteristics of high spenders, U.S. civilian noninstitutionalized population, 2015. Agency for Healthcare Research and Quality website. https://meps.ahrq.gov/data_files/publications/st506/stat506.pdf Published December 2017. [PubMed]
  • 22.Chernew M. E., Encinosa W. E., & Hirth R. A. (2000). Optimal health insurance: the case of observable, severe illness. Journal of Health Economics, 19(5), 585–609. 10.1016/s0167-6296(00)00061-8 [DOI] [PubMed] [Google Scholar]
  • 23.Nyman JA. The value of health insurance: the access motive. J Health Econ. 1999;18(2): 141–152. 10.1016/s0167-6296(98)00049-6 [DOI] [PubMed] [Google Scholar]
  • 24.Nyman JA. The value of health insurance: the access motive. J Health Econ. 1999;18(2): 141–152. 10.1016/s0167-6296(98)00049-6 [DOI] [PubMed] [Google Scholar]
  • 25.Gertler P, Gruber J. Insuring consumption against illness. Am Econ Rev. 2002;92(1):51–70. 10.1257/000282802760015603 [DOI] [PubMed] [Google Scholar]
  • 26.Dobkin C, Finkelstein A, Kluender R, Notowidigdo MJ. The economic consequences of hospital admissions. Am Econ Rev. 2018;108(2):308–352. 10.1257/aer.20161038 [DOI] [PubMed] [Google Scholar]
  • 27.Kelman S, Woodward A. John Nyman and the economics of health care moral hazard. ISRN Econ 2013;2013(603973). 10.1155/2013/603973 [DOI] [Google Scholar]
  • 28.Robertson C. The split benefit: The painless way to put skin back in the health care game. Cornell Law Rev. 2013;98(4):921–963. [Google Scholar]
  • 29.Gianfrancesco FD. A proposal for improving the efficiency of medical insurance. J Health Econ. 1983; 2(2):176–184. 10.1016/0167-6296(83)90007-3 [DOI] [PubMed] [Google Scholar]
  • 30.Graboyes RF. Our money or your life: Indemnities vs. deductibles in health insurance. https://www.richmondfed.org/~/media/richmondfedorg/publications/research/working_papers/2000/pdf/wp00-4.pdf. Fed. Reserve Bank of Richmond, Working Paper No. 00–04. Published August 2000.
  • 31.Pauly M. V. (1971). Indemnity insurance for health care efficiency. Economic and Business Bulletin, 24(1), 53–59. [Google Scholar]
  • 32.Cutler DM, Zeckhauser RJ. The anatomy of health insurance In: Culyer AJ, Newhouse JP, eds. Handbook of Health Economics Vol. 1, Part A, Amsterdam:The Netherlands; 2000:563–643. [Google Scholar]
  • 33.Feigenbaum S. “Body shop” Economics: What’s Good for Our Cars May Be Good for Our Health. Regulation: Cato Rev. Bus. & Gov’t 1992;15(4):25–27. [Google Scholar]
  • 34.Gutiérrez C, Macdonald AS. Adult polycystic kidney disease and critical illness insurance. N Am Actuar Journal. 2003;7(2): 93–115. 10.1080/10920277.2003.10596092. [DOI] [Google Scholar]
  • 35.You CH, Kang S, Ha HS, Kwon YD. Factors Influencing the Purchase of Indemnity Private Health Insurance among the Elderly People Aged 65–75. Korea Journal of Hospital Management. 2019;24(1):48–56. [Google Scholar]
  • 36.Gui EH, Macdonald AS. Early-onset Alzheimer’s disease, critical illness insurance and life insurance Genetics and Insurance Research Centre Research Report, Heriot-Watt University; 2002; 2.02:1–31. [Google Scholar]
  • 37.Bernard TS. Debating secondary insurance for illness. New York Times. March 19, 2016:B1. [Google Scholar]
  • 38.Melnick GA, Zwanziger J, Bamezai A, Pattison R. The effects of market structure and bargaining position on hospital prices. Journal of health economics. 1992. October 1;11(3):217–33. 10.1016/0167-6296(92)90001-h [DOI] [PubMed] [Google Scholar]
  • 39.Rosato D, How Paying Your Doctor in Cash Could Save You Money: Even if you have health insurance, sometimes you are better off not using it. Consumer Reports. May 04, 2018 https://www.consumerreports.org/healthcare-costs/how-paying-your-doctor-in-cash-could-save-you-money/ [Google Scholar]
  • 40.Robertson CT. Exposed: Why Our Health Insurance Is Incomplete and What Can Be Done about It. Harvard University Press; 2019. December 17. [Google Scholar]
  • 41.Nyman JA, Koc C, Dowd BE, McCreedy E, Trenz HM. Decomposition of moral hazard. Journal of health economics. 2018. January 1;57:168–78. 10.1016/j.jhealeco.2017.12.003 [DOI] [PubMed] [Google Scholar]
  • 42.Evans SC, Roberts MC, Keeley JW, et al. Vignette methodologies for studying clinicians’ decision-making: Validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15(2):160–170. 10.1016/j.ijchp.2014.12.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hainmueller J, Hangartner D, Yamamoto T. Validating vignette and conjoint survey experiments against real-world behavior. Proc Natl Acad Sci U S A. 2015;112(8):2395–2400. 10.1073/pnas.1416587112 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wallander L. 25 years of factorial surveys in sociology: A review. Soc Sci Res. 2009;38(3):505–520. 10.1016/j.ssresearch.2009.03.004. [DOI] [Google Scholar]
  • 45.Thomas KA, Clifford S. Validity and mechanical turk: An assessment of exclusion methods and interactive experiments. Comput Human Behav. 2017;77(December):184–197. 10.1016/j.chb.2017.08.038. [DOI] [Google Scholar]
  • 46.Hauser DJ, Schwarz N. Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behav Res Methods. 2016;48(1):400–407. 10.3758/s13428-015-0578-z [DOI] [PubMed] [Google Scholar]
  • 47.Peer E, Vosgerau J, Acquisti A. Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behav Res Methods. 2014;46(4):1023–1031. 10.3758/s13428-013-0434-y [DOI] [PubMed] [Google Scholar]
  • 48.Robertson C, Kesselheim AS. Regulating off-label promotion—a critical test. N Engl J Med. 2016; 375(24):2313–2315. 10.1056/NEJMp1611755 [DOI] [PubMed] [Google Scholar]
  • 49.Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychological methods. 2009. September;14(3):202 10.1037/a0015826 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. American journal of preventive medicine. 2014. October 1;47(4):498–504. 10.1016/j.amepre.2014.06.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Greiner J, Pattanayak CW, Randomized evaluation in legal assistance: What difference does representation (offer and actual use) make. Yale Law J. 2011;121(8):2118–2214. [Google Scholar]
  • 52.Belson WA. A technique for studying the effects of a television broadcast. J R Stat Soc Ser C Appl Stat. 1956;5(3):195–202. [Google Scholar]
  • 53.Peters CC. A method of matching groups for experiment with no loss of population. J Educ Res. 1941;34(8):606–612. [Google Scholar]
  • 54.Pauly M. More on moral hazard. J Health Econ. 1983;2(1):81–85. 10.1016/0167-6296(83)90014-0 [DOI] [PubMed] [Google Scholar]
  • 55.Finkelstein A., Mahoney N., & Notowidigdo M. J. (2018). What Does (Formal) Health Insurance Do, and For Whom?. Annual Review of Economics, (0). 10.1146/annurev-economics-080217-053237 [DOI] [Google Scholar]
  • 56.Laurion V, Robertson C. Ideology meets reality: What works and what doesn’t in patient exposure to health care costs. Indiana Health Law Rev. 2018;15(43):43–65. 10.18060/3911.0043 [DOI] [Google Scholar]

Decision Letter 0

Jason Anthony Aimone

12 Dec 2019

PONE-D-19-27471

Distinguishing moral hazard from the access function of health insurance: A vignette experiment

PLOS ONE

Dear Dr. Robertson,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I am sorry for the long duration of the review process. Obtaining referees for the study, perhaps due to the methodology differences to others researching in similar areas, was more difficult than normal. In the end I had 1 outside reviewer and I reviewed the paper in detail myself as well.  Both the reviewer and I am favorable to your paper.  If you decide to submit a minor revision of the paper please include with your resubmission a detailed response to the concerns and points of the reviewers.  Find here my own comments:

Major:

  • The paper could be improved by adding some discussion of what you are doing into the introduction. It reads as a lit review or state of healthcare but does not give any indication of what the paper will be about.

  • There are some downsides that need to be addressed in greater detail in the paper. For instance, in the introduction the paper neglects to discuss the idea of negotiated prices. Traditionally insured individuals and uninsured individuals do not only differ in “access” and “moral hazard” components of spending (as in Fig 1) but also differ in what the expected cost of a given healthcare good costs. Insured individuals gain not only the funding for a procedure but also gain the pooled bargaining power of the insurance company. Uninsured individuals in some (most?) cases would face not only the out-of-pocket costs that the insurance company would alternatively pay for but also a second premium for not having bargaining power. The same procedure would likely cost them more to purchase.  How would/do indemnities work on this margin? Do the companies that back the indemnities negotiate healthcare prices as traditional insurers do? Citations here are needed as well.

  • Please provide your vignettes in an appendix.

  • P11: I like that you provide in-text the wording for the indemnity program. I would also like to see how the uninsured and traditional insurance differs in-text or as a footnote.

  • P12: Clarify for experiment 2 whether this is a between-subject or within-subject design.  If a between subject design, please indicate how the 2400 observations are divided between the 3x2x7 treatments.  Likewise, for Experiment 1 how were the 613 observations divided between thr 3x2 treatments?

  • P12: can you also tell us how participants were paid in MTurk & your other sample?  Flat rate? How much?  How did you address the concern of bots on MTurk?

  • Figure 2 Note: In the last sentence where you indicate the significant differences or lack of significant differences, please provide the test you are using.

  • Please move the table of your main regression analysis to the main text.

  • I would like to see some non-parametric analysis of raw data as seen in figure 2.  Mann-Whitney is probably ideal.  You are making claims of differences and no differences but are not utilizing the most direct method of analyzing your experimental data and instead base everything off of regressions.

  • You attach your stata dta file but not your do file to run your analysis. Please include that in your revision.

Minor:

  • Need citation and numbers for claim that high-$ healthcare drives most aggregate healthcare spending in the US

  • Some typos remaining in paper (for instance, no brackets around citation #10, #30, or #46)

  • You refer to the difference in indemnity and traditional insurance as moral hazard throughout paper but in your tables you call it “waste”. This is somewhat of a disconnect.  Why not just call it “M.Hzd” in the parentheses “Insurance (M.Hzd)” to make things more clear?

  • P 15: you say “In contrast, we found no moral hazard detectable (at the 0.05 level) in any of

  • our scenarios (0 out of 9). ” this is not exactly true. In table S12 b you have a 5% level significance when controls are excluded. If you want to make this claim in the paper you need to add the qualifier that you are meaning “when controls are included”.

  • P19 “rule out the hypothesis that the problem is substantial.” You may want to add a qualifier that this is “in the experimental sample”. You cannot “rule out” that there is a moral hazard in the healthcare sector at large, you can only say that your data suggests that it is not large.

We would appreciate receiving your revised manuscript by Jan 26 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Jason Anthony Aimone

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that Figure(s) 1 in your submission contain copyrighted images. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a)    You may seek permission from the original copyright holder of Figure(s) [#] to publish the content specifically under the CC BY 4.0 license.

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.  

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b)    If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

3. Please ensure that you include a title page within your main document. You should list all authors and all affiliations as per our author instructions and clearly indicate the corresponding author.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is an innovative paper addressing an important question. The authors present very well the background underpinning their research which helps motivate a very critical question in the literature. They apply a proven-sound methodology. The authors explain their results eloquently and in manner that is accessible to a wide reading audience. The policy implications of this paper can be extremely important and/or start a fruitful string of research in this area.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Jason Anthony Aimone

10 Mar 2020

PONE-D-19-27471R1

Distinguishing moral hazard from access for high-cost healthcare under insurance

PLOS ONE

Dear Dr. Robertson,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I am ready to accept this paper but there are just a few small edits, that are very minor, but I  need to mark the paper as minor revision in order to provide an easy way for you to upload those edits.  The direction of these things is not relevant to the scientific rigor of the study but the clarity is needed for the paper.

First, Figure 2 and Table 2 are a bit confusing. It appears Indemnity has the highest uptake (consumption) of all three categories in each situation.  This would imply a negative moral hazard rather than a positive moral hazard directionally (even if not significant).  The labels of the bars and orders of the bars seem to have changed since the first version of the figure, maybe something got mixed up?  Table 2 then is hard to interpret the signs of the values in the table (first group minus second group)? Clarifying better what the values in the table are and what is being subtracted from what would be very helpful.    

Second, Table 3 is a bit confusing. The variable "insurance" is self explanatory for the uninsured vs indemnity regression but it is not self explanatory for the indemnity vs the traditional insurance regression. For all of these regression tables, If the variable is indemnity, use that label rather than insurance. If it is "Traditional Insurance" please use that label (and make a separate row to distinguish from indemnity in the other regression model).  Added to the confusion from Figure 2/Table 2 these regressions become hard to understand.

Finally, you say in your response document “Such details about payment and recruitment are not available from the SSI pool; those functions are outsourced to the provider.”  This is not necessarily a problem but should just be mentioned. Readers need to know whether they were incentivized in their responses or did it without compensation. I’d recommend contacting your provider and asking them about the incentive

We would appreciate receiving your revised manuscript by Apr 24 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.  

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Jason Anthony Aimone

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 2

Jason Anthony Aimone

1 Apr 2020

Distinguishing moral hazard from access for high-cost healthcare under insurance

PONE-D-19-27471R2

Dear Dr. Robertson,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Jason Anthony Aimone

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Jason Anthony Aimone

3 Apr 2020

PONE-D-19-27471R2

Distinguishing moral hazard from access for high-cost healthcare under insurance

Dear Dr. Robertson:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Jason Anthony Aimone

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Demographics split by insurance type manipulation.

    (DOCX)

    S2 Table. Demographics split by insurance type manipulation.

    (DOCX)

    S3 Table. Online convenience sample experiment (amazon.com)–linear probability models on intent to consume treatment.

    (DOCX)

    S4 Table. Online census-weighted experiment (SSI Sample)–regressions on intent to consume treatment.

    (DOCX)

    S5 Table. Cancer: Adenocarcinoma of the colon.

    (DOCX)

    S6 Table. Cancer: Non-small-cell lung cancer.

    (DOCX)

    S7 Table. Cardiovascular: Coronary artery disease.

    (DOCX)

    S8 Table. Gastrointestinal disease: GERD.

    (DOCX)

    S9 Table. Age-Related Macular Degeneration (AMD).

    (DOCX)

    S10 Table. Skin/Autoimmune disease: Psoriasis.

    (DOCX)

    S11 Table. Orthopedic disease: Degenerative arthritis.

    (DOCX)

    S12 Table. Neurologic disease: Degenerative lower spine disease.

    (DOCX)

    S1 Data

    (DOCX)

    S2 Data

    (ZIP)

    Attachment

    Submitted filename: Rebuttal Letter w Letterhead w ctr.docx

    Attachment

    Submitted filename: Response_to_Reviewers.docx

    Data Availability Statement

    All data is available at https://figshare.com/articles/fulldata_stata_dta/9923132.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES