Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Jul 27;17(7):e0271063. doi: 10.1371/journal.pone.0271063

Can additional funding improve mental health outcomes? Evidence from a synthetic control analysis of California’s millionaire tax

Michael Thom 1,*
Editor: Mohamed F Jalloh2
PMCID: PMC9328510  PMID: 35895624

Abstract

California is the only one of its peers with a state-wide tax earmarked for mental health programs. The voter-approved levy applies to personal income above $1 million and has generated over $20 billion since 2005. But whether the additional funding improved population mental health remains unknown. This study applies the synthetic control method to the CDC’s National Vital Statistics System data to determine how the tax affected suicide deaths in California. Findings show that the state’s suicide mortality rate increased more gradually after the tax’s implementation than it would have otherwise. By 2019, the cumulative impact was approximately 5,500 avoided deaths. Multiple robustness and sensitivity checks confirm that result. However, the effect did not appear immediately, nor was it present within all demographic groups. Nevertheless, additional revenue was associated with improved mental health in California. Other governments may likewise yield beneficial outcomes.

Introduction

Population mental health deteriorated over recent decades. Depression prevalence rose in the 1990s and 2000s, especially among adolescents and young adults [1,2]. From 1999 through 2019, the suicide mortality rate in the United States increased by over 30 percent [3]. Suicides now outnumber homicides by more than 2:1, and it is the second leading cause of death among individuals under 34 [4].

The trend does not have a single catalyst. Culprits include rising social isolation, economic instability, and technology use [57]. Mental health treatment is expensive for many, some doubt its effectiveness, and stigma makes others reluctant to seek help [8,9]. Public policy also bears responsibility. Deinstitutionalization, which encouraged the closure of state psychiatric hospitals starting in the 1960s, left many who needed inpatient care without viable options, and mental health funding was a common target of state budget-balancing in the 1980s and 1990s [10].

Although declining mental health is a national dilemma, public funding obligations largely remain with state governments. All 50 draw on general tax revenue to underwrite costs, and five use earmarked taxes to raise additional resources. Colorado, Illinois, Missouri, and Washington permit municipalities, typically counties, to levy a sales or property tax surcharge to subsidize mental health programs. But since not all municipalities exercise the option, none of those taxes is state-wide.

California’s strategy differs. The state’s Mental Health Services Act imposes a one percent “millionaire tax”—i.e., a personal state income tax on earnings above $1 million. Voters approved the levy in November 2004 amid growing alarm over homelessness and diminishing mental health funding. Notably, the law includes a provision that bars California from shifting the state’s pre-existing funding responsibilities to municipalities. In other words, the state cannot use earmarked tax revenue to subsidize previous commitments. The stipulation is consistent with the law’s objective to increase mental health funding, not merely develop a new revenue source. From 2005 through 2019, the tax raised approximately $21.6 billion. In 2019 alone, it generated an all-time high of $2.4 billion, or about $60 per capita (Fig 1).

Fig 1. California mental health services tax revenue per capita.

Fig 1

Author’s calculations based on data reported in “Promises Still to Keep: A Decade of the Mental Health Services Act” from California’s Little Hoover Commission, annual expenditure reports from the California Health and Human Service Agency, and current population estimates from the United States Census Bureau. Amounts adjusted using the Consumer Price Index.

California distributes the revenue to each county based on a formula that incorporates population and cost of living adjustments. Each one develops a stakeholder-informed plan to spend its allocation within three program areas. Community Services and Support (approximately 72 percent of funding in 2019) finances direct services for adults and minors with serious mental health conditions. It can include psychiatric treatment and therapy, substance abuse treatment, and outreach for at-risk populations. Prevention and Early Intervention (approximately 18 percent of funding in 2019) finances services that prevent mental health conditions from instigating severe outcomes, such as hospitalization, homelessness, and suicide. It may include traditional treatment or support for crisis intervention facilities and programs. Innovation (approximately five percent of funding in 2019) subsidizes new, sometimes experimental treatment approaches, such as web-based chat and triage services. Administrative costs and reimbursements consume the remaining funds.

Whether earmarked mental health tax revenue yields population-level improvement remains an open question. Available studies are few and narrow in scope [11]. For example, patients at five tax-supported clinics in Los Angeles County, California, accessed more mental health services, but providers reported higher stress and lower morale [12]. According to other Los Angeles-based assessments, tax-supported programs improved vulnerable groups’ mental health [13] and lowered emergency room visits [14], but the progress may have been transitory [15].

This study is the first to examine whether revenue from California’s earmarked mental health tax affected a vital public health indicator: suicide mortality. Self-inflicted deaths are perhaps the most heartrending consequence of mental anguish, but they are exceedingly preventable. Indeed, cognitive behavioral therapy and other interventions reduce suicidal ideation and death [16]. To determine the revenue’s impact, this study utilizes the synthetic control method to compare outcomes before and after California voters approved the tax. The results show that the state’s suicide mortality rate was lower than it would have been without the tax. However, the effect did not emerge immediately, nor did it materialize within all demographic groups. Nevertheless, the results indicate that additional funding can stem the tide of declining mental health and quite literally save lives.

Methods

Empirical strategy: The synthetic control method

This study applies the synthetic control method (“SCM”) to California to determine whether revenue from the state’s earmarked mental health tax improved population mental health as indicated by the state’s suicide mortality rate. California is an exemplary case study. It is the only state with a tax that generates funding for all its counties. Unlike staggered local tax implementation in other states, California imposed its tax at a single point with no significant ex-post changes, creating well-defined before and after periods.

SCM facilitates causal inference in settings where one unit (here, California) experiences an intervention (here, implementing an earmarked mental health tax) that many other units do not. To synthesize a control, SCM draws on pre-intervention outcomes in California and certain other states, collectively referred to as the donor pool. That synthetic control is a weighted linear combination of pre-intervention donor state outcomes. The method assigns a weight to each donor through a “best fit” optimization procedure that minimizes the pre-intervention discrepancy between California and the control. SCM uses donor state outcomes to estimate the synthetic control’s post-intervention trajectory. Differences between California and the synthetic control are construed as an intervention-driven treatment effect. Abadie and Gardeazabal [17] developed the method and applied it to terrorism’s economic impact, while others have used it to evaluate a variety of public health policies, including expanded contraceptive availability [18] and soda and tobacco taxes [19,20].

SCM’s causal inference capacity rests on constructing a valid counterfactual: the synthetic control. That, in turn, depends on addressing the four empirical issues considered in the following sections.

Outcome measure and data

Longitudinal, state-level mental health data in the United States is remarkably lacking. The National Survey on Drug Use and Health did not include multiple items on mental health annually until 2009, long after California implemented its tax [21]. The CDC’s Behavioral Risk Factor Surveillance System includes mental health items, but not consistently and not necessarily questions of evaluative use [22]. For instance, the survey’s 2019 questionnaire included a cumulative question absent in some prior years that asked the respondent if they had ever been told they had depression. Another question in 2019 and in preceding years instructed the respondent to estimate the number of days in the prior month that their mental health, “which includes stress, depression, and problems with emotions,” was “not good.” These items mix professionally diagnosed conditions—which may indicate waning outcomes, easier treatment access, or both—with self-diagnosed conditions.

Suicide mortality data is more reliable and available. The CDC’s National Vital Statistics System reports each state’s annual suicide mortality rate, defined as the number of intentional, self-inflicted deaths per 100,000 persons, from 1999 through 2019 for the general population and demographic groups [23]. The data align with the International Classification of Diseases, 10th Revision, and comprise all tracked methods of intentional self-harm. They exclude accidental self-harm, including opioid and other drug overdoses. The CDC culls the information from death certificates and combines it with Census Bureau estimates to calculate each state’s annual age-adjusted mortality rate. Pre-1999 data, while available, are not equivalent. It relies on a somewhat different methodology, does not include racial groups beyond “white,” “black,” and “other,” and comes from a pre-internet social and economic environment.

Data on a less tragic outcome may be preferable but do not exist in adequate quantities. Still, suicide mortality may be the ultimate test of an earmarked mental health tax’s effectiveness. Many public health experts regard suicide deaths as preventable. If tax-supported programs in California successfully alter the mental health treatment landscape by expanding access and focusing on early intervention, fewer individuals should choose to take their own life. Moreover, suicide mortality is an impartial indicator unaffected by individuals’ perceptions of their psychological status or changing levels of acceptance of having a mental health condition. Those factors threaten survey data validity.

Pre- and post-intervention periods

California voters approved the state’s tax in 2004, but revenue collection did not commence until 2005. Therefore, 2005 is California’s intervention year, its pre-intervention period is 1999–2004, and its post-intervention period is 2005–2019. The six-year pre-intervention period is comparable to other synthetic control studies [2426]. Outcome measure limitations preclude a longer timeframe, but modified assumptions about intervention timing that lengthen the pre-intervention period to seven and eight years do not affect the results (see the Robustness checks section below).

Predictor variables

The models include the suicide mortality rate lagged by one year and averaged over the entire pre-intervention period. There is no consensus on whether synthetic control models should incorporate predictors other than the lagged outcome variable; some studies have none, while others have over 40 [27]. In analyses like this study that draws on several pre-intervention periods, predictors beyond the lagged outcome are of little benefit and may bias the results [28,29] partly because the lagged outcome “absorbs” their effect and unobserved factors [19]. Diagnostic testing confirmed that estimation with other predictor sets, including the unemployment rate, per capita income, and ideology, substantially worsened model fit. Accordingly, the models exclude additional predictors.

The donor pool

At a minimum, the donor pool used to create the synthetic control cannot include the states with a policy like California’s: Colorado, Illinois, Missouri, and Washington. There are no other exclusions on policy grounds because no other state implemented an earmarked mental health tax or an alternative policy with an ostensibly similar effect (e.g., a significant and sustained funding increase). However, the donor pool should not include all remaining states, which could “overfit” the synthetic control and lead to interpolation bias [30].

Instead, it is prudent to restrict the donor pool to states like California—i.e., that have comparable outcomes, some slightly above and others slightly below [31]. Because California’s general population suicide mortality rate is consistently among the lowest in the United States, relatively few states fare worse. The donor pool includes all nine states that most often had rates close to but less than California during each pre-intervention year: Connecticut, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, and Rhode Island. In the interest of symmetry, the donor pool includes nine states that most often had rates close to but higher than California during each pre-intervention year: Delaware, Georgia, Iowa, Michigan, New Hampshire, Ohio, Pennsylvania, Texas, and Virginia. S1 Table lists each donor state’s weight. Note: “most often” refers to the frequency with which the donor states’ mortality rates were close to California’s. Each donor state had a similar mortality rate in at least four out of six pre-intervention years. This ensures that the donor pool excludes outliers with only occasional similarity to California.

Results

General population findings

Fig 2 shows the age-adjusted suicide mortality rate, measured as self-inflicted deaths per 100,000 persons, for California’s general population and the synthetic control. The root mean squared prediction error (“RMSPE”) is 0.5904, a goodness-of-fit statistic that indicates the control generally tracks California during the pre-intervention period. The sole anomaly in 2001 results from temporarily lower mortality within specific age groups (see Fig 4). The trendlines remain adjacent shortly following tax implementation but begin to deviate around 2010. California’s actual mortality rate increased after that point, but more gradually than the synthetic control. The divergence suggests that additional mental health funding reduced suicide mortality in the general population below the rate that would have occurred in its absence.

Fig 2. Age-adjusted suicide mortality rate for California’s general population, 1999–2019.

Fig 2

Fig 4. Suicide mortality rate by age group in California, 1999–2019.

Fig 4

Visual comparison alone cannot establish whether the difference—i.e., the treatment effect—was statistically significant. Placebo tests aid that determination by applying SCM to each donor state and comparing donor-control differences, which are random, to the California-control difference. A California-control difference larger than most donor-control differences implies a nonrandom treatment effect; otherwise, what appears as a treatment effect is most likely due to chance [32]. Analysts can visually assess the differences to infer significance, but a probability test that calculates pseudo p-values facilitates a more objective appraisal [26,33].

To that end, Table 1 lists the annual treatment effect, measured as the reduction in suicide deaths per 100,000 persons, and its significance from 2005–2019. Because the effect was significant from 2012 forward, although only weakly in 2013 and 2016, reduced mortality in those years was unlikely due to chance and was likely driven instead by additional revenue for mental health programs.

Table 1. Earmarked mental health tax effect on suicide mortality among California’s general population, 2005–2019.

Year Effect
2005 -0.39
2006 -0.16
2007 0.22
2008 -0.08
2009 -0.16
2010 -0.79
2011 -0.73
2012 -1.30 ***
2013 -1.10 *
2014 -1.50 ***
2015 -1.80 **
2016 -1.71 *
2017 -2.48 ***
2018 -2.09 ***
2019 -2.20 **

The effect is the reduction in mortality rate (deaths per 100,000 persons)

* p ≤ 0.10

** p ≤ 0.05

*** p ≤ 0.01.

A back-of-the-envelope calculation translates the tax’s effect into real-world impact. In 2019, the effect was a reduction of 2.20 deaths per 100,000 persons. That is the equivalent of approximately 869 suicide deaths avoided that year (the treatment effect multiplied by the state’s population of 39.5 million). Using the same method, the cumulative effect since 2012 is about 5,536 deaths avoided. S2 Table reports annual estimates.

Demographic group findings

Analysis of demographic group-specific data sheds light on whether and how the treatment effect varied among them. The synthetic control approach is identical to that described above, but the donor pools differ. That modification is necessary because the states with suicide mortality similar to California’s general population are not the same as those with similar group-specific mortality. Each analysis thus requires a unique donor pool, although there are common donors. S3 and S4 Tables list each analyses’ donor states and their respective weights.

Fig 3 shows the age-adjusted suicide mortality rate for California and its synthetic control for six groups: males and females in the top row; whites and blacks in the middle row; and Hispanics and Asians in the bottom row. Table 2 lists the annual treatment effect, statistical significance based on placebo tests, and RMSPE for each analysis.

Fig 3. Age-adjusted suicide mortality rate by sex and race in California, 1999–2019.

Fig 3

Table 2. Earmarked mental health tax effect on suicide mortality in California by sex and race, 2005–2019.

Year Males Females Whites Blacks Hispanics Asians
2005 -0.86 -0.48 -0.54 -0.59 0.05 0.09
2006 -0.68 -0.23 -0.44 -0.63 -0.17 -0.28
2007 0.13 -0.11 -0.16 0.97 -0.83 0.39
2008 -0.51 0.33 -0.37 0.84 0.35 0.82
2009 -0.66 0.41 -0.14 -0.18 0.07 0.87
2010 -1.46 -0.17 -0.74 0.61 -0.45 0.56
2011 -1.58 -0.30 -0.77 -0.17 0.32 1.14
2012 -2.19 *** -1.02 -1.58 ** 0.16 -0.13 -0.19
2013 -1.80 ** -0.71 -1.55 * 0.31 -0.12 0.11
2014 -2.30 ** -1.10 -1.65 ** -0.78 0.05 0.16
2015 -2.44 ** -1.12 ** -2.00 -0.09 0.45 -0.06
2016 -2.72 *** -1.17 -1.92 -0.17 0.49 -0.15
2017 -3.94 *** -1.81 *** -2.81 -0.42 0.27 -0.37
2018 -3.19 * -1.25 * -2.17 -0.34 0.31 -0.26
2019 -3.52 *** -1.81 *** -2.18 -0.39 0.65 -0.93
RMSPE 0.7566 0.4147 0.7012 0.6186 0.3036 0.5959

The effect is the reduction in mortality rate (deaths per 100,000 persons)

* p ≤ 0.10

** p ≤ 0.05

*** p ≤ 0.01.

The impact by sex was more prominent than by race. While it was significant more often for males (eight consecutive years starting in 2012) than females (only four years, but four of the five most recent), the effect on females was proportionally greater. To wit: the reduction in female suicide mortality in California in 2019 was 29 percent (the difference between the actual rate, 4.53, and the synthetic control rate, 6.34). For males, the reduction was only 17 percent (the difference between the actual rate, 17.10, and the synthetic control rate, 20.62). If that continues, it will amplify the already substantial male-female suicide mortality gap.

Effects by race were relatively scarce. There was no reduction in suicide mortality among blacks or Hispanics. The effect on Asians was likewise non-significant but trended in that direction; it rose from -0.06 in 2015 (p = 0.86) to -0.93 in 2019 (p = 0.42). While the effect on whites appears larger in Fig 2, it was significant only three times in 15 years and never after 2014.

The tax’s impact by age was more pronounced than by sex and race. Fig 4 displays the mortality rate for six age groups, and Table 3 lists the annual treatment effect, statistical significance based on placebo tests, and RMSPE for each analysis. The categories stem from the CDC’s data, and because they are age-specific, the rates are “crude” rather than age-adjusted. A noticeable effect occurred among those 55–64, a group for whom mortality increased after the tax’s implementation but later fell. The most consistent effect happened among those over 65, for whom the reduction increased over time. The tax had less consistent effects on those 45–54 and no effect among those 35–44. With a few exceptions, there is no evidence that the tax affected mortality among those 15–24 and 25–34, the groups for whom suicide became the second-leading cause of death over the same period.

Table 3. Earmarked mental health tax effect on suicide mortality in California by age group, 2005–2019.

Year 15–24 25–34 35–44 45–54 55–64 65+
2005 0.13 -1.14 -0.98 -0.27 -1.13 -0.02
2006 1.48 -0.49 -0.57 -0.09 -0.98 -0.53
2007 -0.47 -0.04 -0.26 0.92 1.29 -1.55
2008 0.93 -0.25 -0.31 0.12 2.04 0.60
2009 0.18 -0.78 -0.74 0.20 2.31 -0.81
2010 -0.13 -1.55 * -1.53 -1.42 1.63 0.40
2011 -0.36 -0.37 -0.97 -2.03 0.63 -0.38
2012 -1.10 -1.14 *** -2.18 -3.56 -1.05 -1.76 ***
2013 0.35 -1.04 * -1.00 -3.58 -1.57 -2.03 ***
2014 -0.63 -0.69 -1.45 -2.95 -2.18 -1.57 *
2015 0.38 -0.73 -1.78 -4.77 ** -4.53 *** -2.13 ***
2016 0.87 -0.49 -1.63 -3.61 -3.77 *** -2.76 ***
2017 0.21 -1.54 * -2.73 -5.63 *** -5.00 *** -2.95 ***
2018 0.67 -0.61 -1.40 -4.25 -4.88 ** -2.73 ***
2019 0.91 -0.70 -2.00 -4.31 *** -3.71 ** -3.14 ***
RMSPE 0.7606 0.4733 1.1666 1.1059 0.6539 0.6581

The treatment effect is the reduction in mortality rate, measured as deaths per 100,000 persons

* p ≤ 0.10

** p ≤ 0.05

*** p ≤ 0.01.

A dearth of more granular data precludes a more in-depth demographic assessment. Simply put, increasingly less information is available on more narrowly-defined groups. The CDC’s most available state-level mortality data is for the general population. Missing and unreliable data are more common in more states and years for the black, Hispanic, and especially the Asian population, but sufficient data exists on enough states to compose a donor pool and synthesize a control for California. That becomes near impossible with more specific groups (e.g., black males, Hispanic females, or persons under 14 years old). The consolation is this: it is often because there are so few suicides in those groups in many states during some years that the CDC considers the data unreliable.

Robustness checks

Five robustness checks support the above findings’ veracity. Full results for most, which collectively entail over 200 additional synthetic control analyses, are omitted to conserve space. Most of the following discussion centers on general population results, but the robustness checks confirm findings for each demographic group.

First, advancing the intervention date does not substantively alter the treatment effects. S5 Table reports the results for two revised scenarios: an intervention date of 2006, the first full year of substantial tax revenue, and 2007, which allows for a one-year lag between that revenue and a quantifiable effect. Those revisions increase the pre-intervention period to seven and eight years, respectively, but with little empirical consequence. They correspond to cumulative estimated avoided suicide deaths of 5,376 (assuming an intervention date of 2006) and 5,423 (assuming an intervention date of 2007). Both estimates are within three percent of the number reported above, which derived from a six-year intervention period.

Second, the results are robust to using a broader definition of mortality that combines deaths from intentional self-harm with accidental deaths resulting from substance abuse (e.g., alcohol and drug overdoses, including opioids, cocaine, and sedatives). The mortality rates are necessarily higher, but the pattern repeats: post-intervention, California’s rate falls slightly and then rises to a lesser degree than the synthetic control. That finding suggests that additional funding for mental health programs, some of which subsidized substance abuse treatment initiatives, reduced the number of deaths relative to what would have occurred in the funding’s absence.

Third, no single donor state biases the findings. Ruling out the prospect of an influential donor(s) entails an iterative “leave one out” tactic suggested by Abadie [34] that systematically repeats each analysis without one of the donor pool states to ensure that no single state biased the synthetic control or treatment effects. Omitted donor bias is also not an issue. Re-estimating each analysis to include the next most comparable donors—i.e., adding one extra state with a higher mortality rate and one with a lower rate, where possible—does not yield treatment effects that vary significantly from those reported above.

Fourth, there is no meaningful bias due to imprecise predictor variable matching between California and donor states during the pre-treatment period. Various regression-based techniques exist to estimate and correct such bias, a known issue in SCM [35]. Fig 5 illustrates the original and bias-corrected treatment effects for California’s general population using the OLS-based method devised by Wiltshire [36]. The OLS-based method is preferable to those that use ridge, lasso, or elastic net regression because the study’s data is straightforward: there is only one predictor variable. The nearly-collinear lines suggest that bias due to imprecise matching does not alter the abovementioned findings. For example, the bias-corrected treatment effect in 2019 was -2.18, which compares favorably to the non-corrected treatment effect reported in Table 1, -2.20.

Fig 5. Original and bias-corrected treatment effects.

Fig 5

Fifth, the findings are robust to estimation with an interrupted time-series analysis (“ITSA”). Like SCM, ITSA breaks data into pre- and post-intervention periods and uses the former to estimate an intervention’s effect. ITSA is suited for contexts with sequentially observed, variable outcome data measured before and after an intervention, making it especially useful for public health evaluations [37,38]. While multiple ITSA iterations exist, this study utilizes Linden’s generalized least squares model [39]. It allows a comparison between suicide mortality in California and similar control states. As a robustness check, ITSA is superior to a difference-in-difference model because pre-intervention outcomes in California and control states did not have parallel trends, a violation of the latter method’s assumptions that would bias its results. California’s pre-intervention period, intervention date, and post-intervention period are unchanged from the SCM approach. The 18 donor states serve as a collective control, and the lagged suicide mortality rate is the sole predictor.

Fig 6 displays the actual and predicted age-adjusted suicide mortality rate for California and the donor state average. Pre-intervention outcomes in California and the control are not significantly different. The post-intervention trendline slope for California is less than the control’s, although a gap does not appear visually until around 2010, mirroring the synthetic control findings. The difference, which increases over time, is significant (p = 0.002). While the mortality rate in control states continued to rise in the early 2000s—following the nationwide trend that began around the same time—California’s increase was comparatively flat. That suggests that, while mortality in California rose, it did so to a lesser extent than it would have in the absence of funding from the state’s earmarked mental health tax. Like the SCM results, the ITSA finding is robust to assuming an intervention date of 2006 or 2007. The finding also holds when applied to the broader mortality rate that includes substance abuse deaths.

Fig 6. Actual and predicted suicide mortality rates for California’s general population, 1999–2019.

Fig 6

Discussion and conclusion

Public policy changes, including deinstitutionalization and diminished funding, have exacerbated recent declines in population mental health. In response, a small number of states permit municipal governments to generate new resources through earmarked mental health taxes. California’s state-wide tax on incomes above $1 million is unique. This study assesses whether it affected an essential public health indicator: suicide mortality. It finds that there were fewer suicide deaths after the tax’s implementation than there would have been otherwise.

That the effect did not emerge immediately is not surprising. Voters approved the tax in 2004, but it did not take effect until 2005. California did not collect substantial revenue until one year later. Revenue collapsed after 2008 and did not return to its pre-recession level until 2013. As collections recovered and attained stability, the effect on suicide mortality gained statistical and practical significance.

This study’s findings comport with prior research linking additional economic resources with improved mental health outcomes at the local level [13,14]. However, in contrast to some others [15], the effect reported herein was durable. The methodology cannot reveal the exact causal path from new funding to reduced suicide mortality, but funding for prevention and early intervention presumably helped more individuals cope with psychological distress before it evolved into a more severe condition. The funding also increased treatment options for those already diagnosed with depression, a frequent conduit to suicide.

Yet this study finds that the effect was inconsistent across demographic groups. Although a reduction in the mortality rate was more frequent among males, the impact was proportionally larger for females. Here, again, the study’s methodology cannot reveal the precise cause(s). The etiology may be males’ lower likelihood of seeking timely mental health treatment, which arises from stigma and lower perceived need [40,41]. Males that manage to overcome those barriers can fall victim to gender bias. Evidence suggests physicians are less likely to identify male depression than female depression [42]. That is partly due to diagnostic criteria that favor female-typical symptoms [43]. It can also stem from implicit bias: studies show that adults are less likely to recognize depression in males than females [44].

There was little effect among whites and none among California’s black, Asian, and Hispanic populations. That may result from male effects canceling out female effects or vice versa. It may also be difficult for public health interventions to reduce mortality within groups with relatively low rates. But those are also groups for whom cultural expectations, along with nativity differences and language barriers, present obstacles to mental health treatment [45,46]. Implicit bias is also a likely factor. As with males, physicians are less likely to diagnose depression in blacks and Hispanics [37], and their treatment may be less tailored than whites’ [47,48].

The most visible effects occurred within specific age categories with higher suicide rates: those 55–64 and over 65. The proximate cause is likely a treatment gap. Those 18–25 in 2019 reported a higher level of serious mental illness than those over 50 (8.6 percent versus 2.9 percent) and a higher level of suicidal thoughts (11.8 percent versus 2.4 percent), but a lower level of treatment (56.4 percent versus 74.3 percent) [49]. The root cause for that disparity may be the flexibility that comes with age. Older adults, especially those over 55 or retirees, can easily accommodate inpatient and outpatient care because they are less tethered to fixed employment schedules and domestic responsibilities. That makes it simpler to initiate and sustain treatment. Individuals over 65 may also benefit from Medicare’s mental health services, although those services are not without limitation (e.g., only primary care physicians can screen for depression, and many covered treatments have co-pays or deductibles).

This study suggests several policy changes that could improve earmarked mental health taxes and associated programs. They point to a need for responsive programs that address challenges unique to racial and ethnic groups and that also address male-specific concerns. They also suggest a need for improved access for younger adults, especially 15 to 34 year-olds. That may include better integrating mental health care services into high schools and colleges, expanding the availability of paid time off from employment to receive treatment, and deploying mobile app-based diagnostic and treatment tools. Prevention and early intervention programs, which currently receive less than one-fifth of funding in California, could more effectively reduce suicide mortality if counties and the state allocated more resources to them. Moreover, while added funding can yield public health benefits, California’s instrument—a tax on personal income over $1 million—is not necessarily ideal. Tax revenue from that income level is notoriously volatile, and a rising number of high-income earners have left California and other high-tax states [50,51]. Both factors threaten funding and policy success.

Finally, additional investigation of the underlying causes of rising suicide rates would also improve policy success in California and beyond. That knowledge is essential for developing programs that reduce intentional self-harm, but the current literature is inconsistent, and the past’s conventional wisdom may not comport with the present’s reality. For example, although multiple studies suggest a correspondence between unemployment and suicide, others indicate that the link is weak to absent [52,53], is inconsistent [54], or merely coincides with other factors that are the actual cause, such as repeated exposure to bad economic news [55] and stock market volatility [56]. Research on the interaction between suicide and other diseases of despair, especially opioid and other drug overdoses, would also improve mental health program design. Most overdoses are classified as accidental, particularly those involving opioids, yet the recent increase presents no less a formidable challenge to public policymakers. Luckily, with the proper response and adequate funding, progress is attainable.

Supporting information

S1 Table. Donor states and weights for synthetic control analysis of California’s general population.

(DOCX)

S2 Table. Earmarked mental health tax effect on suicide deaths among California’s general population, 2012–2019.

(DOCX)

S3 Table. Donor pool states and weights for sex and race analyses.

(DOCX)

S4 Table. Donor pool states and weights for age group analyses.

(DOCX)

S5 Table. Earmarked mental health tax effect on suicide mortality among California’s general population using alternative intervention years.

(DOCX)

Data Availability

All the data used in this study are publicly available. The Center for Disease Control and Prevention's National Vital Statistics System mortality data is held in a public repository at https://www.cdc.gov/nchs/nvss/deaths.htm.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Twenge JM, Cooper AB, Joiner TE, Duffy ME, Binau SG. Age, period, and cohort trends in mood disorder indicators and suicide-related outcomes in a nationally representative dataset, 2005–2017. J Abnorm Psychol. 2019;128(3):185–99. doi: 10.1037/abn0000410 [DOI] [PubMed] [Google Scholar]
  • 2.Wang J, Sumner SA, Simon TR, Crosby AE, Annor FB, Gaylor E, et al. Trends in the incidence and lethality of suicidal acts in the United States, 2006 to 2015. JAMA Psychiatry. 2020;77(7):684–93. doi: 10.1001/jamapsychiatry.2020.0596 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hedegaard H, Curtin SC, Warner M. Suicide mortality in the United States, 1999–2019. Centers for Disease Control and Prevention, Available from: https://www.cdc.gov/nchs/products/databriefs/db398.htm. 33663651 [Google Scholar]
  • 4.National Institute of Mental Health [Internet]. Suicide. Available from https://www.nimh.nih.gov/health/statistics/suicide.shtml.
  • 5.Hidaka BH. Depression as a disease of modernity: explanations for increasing prevalence. J Affect Disord. 2012;140(3):205–14. doi: 10.1016/j.jad.2011.12.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kessler RC, Bromet EJ. The epidemiology of depression across cultures. Annu Rev Public Health. 2013;34:119–38. doi: 10.1146/annurev-publhealth-031912-114409 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Shensa A, Escobar-Viera CG, Sidani JE, Bowman ND, Marshal MP, Primack BA. Problematic social media use and depressive symptoms among U.S. young adults: a nationally-representative study. Soc Sci Med. 2017;182:150–7. doi: 10.1016/j.socscimed.2017.03.061 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015;45(1):11–27. doi: 10.1017/S0033291714000129 [DOI] [PubMed] [Google Scholar]
  • 9.Walker ER, Cummings JR, Hockenberry JM, Druss BG. Insurance status, use of mental health services, and unmet need for mental health care in the United States. Psychiatr Serv. 2015; 6(6):578–84. doi: 10.1176/appi.ps.201400248 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hodgkin D, Karpman HE. Economic crises and public spending on mental health care. Int J Ment Health. 2010;9(2):91–106. [Google Scholar]
  • 11.Purtle J, Stadnick NA. Earmarked taxes as a policy strategy to increase funding for behavioral health services. Psychiatr Serv. 2020;71(1):100–4. doi: 10.1176/appi.ps.201900332 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Starks SL, Arns PG, Padwa H, Friedman JR, Marrow J, Meldrum ML, et al. System transformation under the California mental health services act: implementation of full-service partnerships in L.A. County. Psychiatr Serv. 2017;68(6):587–95. doi: 10.1176/appi.ps.201500390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ashwood JS, Kataoka SH, Eberhart NK, Bromley E, Zima BT, Baseman L, et al. Evaluation of the mental health services act in Los Angeles County: implementation and outcomes for key programs. Rand Health Q. 2018;8(1)2. [PMC free article] [PubMed] [Google Scholar]
  • 14.Brown TT, Chung J, Choi SS, Scheffler R, Adams N. The impact of California’s full-service partnership program on mental health-related emergency department visits. Psychiatr Serv. 2012;63(8):802–7. doi: 10.1176/appi.ps.201100384 [DOI] [PubMed] [Google Scholar]
  • 15.Bruckner TA, Kim Y, Chakravarthy B, Brown TT. Voluntary psychiatric emergencies in Los Angeles County after funding of California’s Mental Health Services Act. Psychiatr Serv. 2012;63(8):808–14. doi: 10.1176/appi.ps.201100372 [DOI] [PubMed] [Google Scholar]
  • 16.Witt KG, Hetrick SE, Rajaram G, Hazell P, Salisbury T, Townsend E, et al. Psychosocial interventions for self-harm in adults. Cochrane Database Syst Rev. 2021;4:CD013668. doi: 10.1002/14651858.CD013668.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Abadie A, Gardeazabal J. The economic costs of conflict: a case study of the Basque Country. Am Econ Rev. 2003;93(1):113–32. [Google Scholar]
  • 18.Lindo JM, Packham A. How much can expanding access to long-acting reversible contraceptives reduce teen birth rates? Am Econ J Econ Policy. 2017; 9(3):348–76. [Google Scholar]
  • 19.Bouttell J, Craig P, Lewsey J, Robinson M, Popham F. Synthetic control methodology as a tool for evaluating population-level health interventions. J Epidemiol Community Health. 2018; 72(8):673–8. doi: 10.1136/jech-2017-210106 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Gunadi C, Benmarhnia T, White M, Pierce JP, McMenamin SB, Leas EC, et al. Tobacco price and use following California Proposition 56 tobacco tax increase. PLoS ONE. 2021;16(10):e0257553. doi: 10.1371/journal.pone.0257553 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.National Survey on Drug Use and Health [Internet]. Washington (DC): Substance Abuse and Mental Health Services Administration. c2022. - [cited 2020 May 17]. Available from: https://nsduhweb.rti.org/respweb/homepage.cfm. [Google Scholar]
  • 22.Behavioral Risk Factor Surveillance System [Internet]. Atlanta (GA): Centers for Disease Control and Prevention. c2022. - [cited 2022 May 17]. Available from: https://www.cdc.gov/brfss/index.html. [Google Scholar]
  • 23.National Vital Statistics System [Internet]. Atlanta (GA): Centers for Disease Control and Prevention. c2022. - [cited 2022 May 17]. Available from https://www.cdc.gov/nchs/nvss/index.htm. [Google Scholar]
  • 24.Baccini L, Li Q, Mirkina I. Corporate tax cuts and foreign direct investment. J Policy Anal Manage. 2014;33(4):977–1006. [Google Scholar]
  • 25.Baxter AJ, Dundas R, Popham F, Craig P. How effective was England’s teenage pregnancy strategy? A comparative analysis of high-income countries. Soc Sci Med. 2021;270:113685. doi: 10.1016/j.socscimed.2021.113685 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rieger M, Wagner N, Bedia AS. Universal health coverage at the macro level: synthetic control evidence from Thailand. Soc Sci Med. 2017;172:46–55. doi: 10.1016/j.socscimed.2016.11.022 [DOI] [PubMed] [Google Scholar]
  • 27.Ferman B, Pinto C, Possebom V. Cherry picking with synthetic controls. J Policy Anal Manage. 2020;39(2):510–32. [Google Scholar]
  • 28.Botosaru I, Ferman B. On the role of covariates in the synthetic control method. Econom J. 2019;22(2):117–30. [Google Scholar]
  • 29.Kaul A, Klößner S, Pfeifer G, Schieler M. Synthetic control methods: never use all pre-intervention outcomes together with covariates. 2015. Available from: https://mpra.ub.uni-muenchen.de/83790/1/MPRA_paper_83790.pdf. [Google Scholar]
  • 30.McClelland R, Gault S. The synthetic control method as a tool to understand state policy. 2017. Available from https://www.urban.org/sites/default/files/publication/89246/the_synthetic_control_method_as_a_tool_1.pdf. [Google Scholar]
  • 31.Abadie A, Diamond A, Hainmueller J. Comparative politics and the synthetic control method. Am J Pol Sci. 2015;59(2);495–510. [Google Scholar]
  • 32.Abadie A, Diamond A, Hainmueller J. Synthetic control methods for comparative case studies: estimating the effect of California’s tobacco control program. J Am Stat Assoc. 2010;105(490):493–505. [Google Scholar]
  • 33.Galiani S, Quistorff B. The synth_runner package: utilities to automate synthetic control estimation using synth. Stata J. 2017;17(4):834–49. [Google Scholar]
  • 34.Abadie A. Using synthetic controls: feasibility, data requirements, and methodological aspects. J Econ Lit. 2021;59(2):391–425. [Google Scholar]
  • 35.Ben-Michael E, Feller A, Rothstein J. The augmented synthetic control method. J Am Stat Assoc. 2021;116(536):1789–1803. [Google Scholar]
  • 36.Wilshire JC. allsynth: (Stacked) Synthetic Control Bias-Correction Utilities for Stata. Version: 1.0. [Preprint]. [posted 2022 May 6; cited 2022 May 17]: [40 p.]. Available from: https://justinwiltshire.com/allsynth-stacked-synthetic-control-biascorrection-utilities-for-stata. [Google Scholar]
  • 37.Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46(1):348–55. doi: 10.1093/ije/dyw098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Zhang F, Wagner AK, Ross-Degnan D. Simulation-based power calculation for designing interrupted time series analyses of health policy interventions. J Clin Epidemiol. 2011; 64(11):1252–61. doi: 10.1016/j.jclinepi.2011.02.007 [DOI] [PubMed] [Google Scholar]
  • 39.Linden A. Conducting interrupted time-series analysis for single- and multiple-group comparisons. Stata J. 2015;5(2):480–500. [Google Scholar]
  • 40.Ojeda VD, Bergstresser SM. Gender, race-ethnicity, and psychosocial barriers to mental health care: an examination of perceptions and attitudes among adults reporting unmet need. J Health Soc Behav. 2008;49(3):317–34. doi: 10.1177/002214650804900306 [DOI] [PubMed] [Google Scholar]
  • 41.Villatoro AP, Mays VM, Ponce NA, Aneshensel CS. Perceived need for mental health care: The intersection of race, ethnicity, gender, and socioeconomic status. Soc Ment Health. 2017;8(1):1–24. doi: 10.1177/2156869317718889 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Borowsky SJ, Rubenstein LV, Meredith LS, Camp P, Jackson-Triche M, Wells KB. Who is at risk of nondetection of mental health problems in primary care? J Gen Intern Med. 2000;15(6):381–88. doi: 10.1046/j.1525-1497.2000.12088.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Martin LA, Neighbors HW, Griffith DM. The experience of symptoms of depression in men vs women: analysis of the national comorbidity survey. JAMA Psychiatry. 2013;70(10):1100–6. doi: 10.1001/jamapsychiatry.2013.1985 [DOI] [PubMed] [Google Scholar]
  • 44.Swami V. Mental health literacy of depression: gender differences and attitudinal antecedents in a representative British sample. PLoS One. 2012;7(11):e49779. doi: 10.1371/journal.pone.0049779 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Abe-Kim J, Takeuchi DT, Hong S, Zane N, Sue S, Spencer MS, et al. Use of mental health-related services among immigrant and US-born Asian Americans: results from the National Latino and Asian American Study. Am J Public Health. 2007;97(1):91–8. doi: 10.2105/AJPH.2006.098541 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Kim G, Loi CX, Chiriboga DA, Jang Y, Parmelee P, Allen RS. Limited English proficiency as a barrier to mental health service use: a study of Latino and Asian immigrants with psychiatric disorders. J Psychiatr Res. 2011;45(1):104–10. doi: 10.1016/j.jpsychires.2010.04.031 [DOI] [PubMed] [Google Scholar]
  • 47.Lê Cook B, Zuvekas SH, Carson M, Wayne GF, Vesper A, McGuire TG. Assessing racial/ethnic disparities in treatment across episodes of mental health care. Health Serv Res. 2014;49(1):206–29. doi: 10.1111/1475-6773.12095 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.McGuire TG, Ayanian JZ, Ford DE, Henke RE, Rost KM, Zaslavsky AM. Testing for statistical discrimination by race/ethnicity in panel data for depression in primary care. Health Serv Res 2008;43(2):531–55. doi: 10.1111/j.1475-6773.2007.00770.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.National Institute of Mental Health. “Mental Illness.” Available from: https://www.nimh.nih.gov/health/statistics/mental-illness.
  • 50.Moretti E, Wilson DJ. The effect of state taxes on the geographical location of top earners: evidence from star scientists. Am Econ Rev. 2017;107(7):1858–1903. [Google Scholar]
  • 51.Young C, Varner C. Millionaire migration and state taxation of top incomes: evidence from a natural experiment. Natl Tax J. 2011;64(2):255–83. [Google Scholar]
  • 52.Andrés AR. Income inequality, unemployment, and suicide: a panel data analysis of 15 European countries. Appl Econ. 2005;37(4):438–51. [Google Scholar]
  • 53.Minoiu C, Andrés AR. The effect of public spending on suicide: evidence from US state data. J Socio Econ. 2008;37(1):237–61. [Google Scholar]
  • 54.Stack S. Contributing factors to suicide: political, social, cultural and economic. Prev Med. 2020;152:106498. [DOI] [PubMed] [Google Scholar]
  • 55.Vandros S, Kawachi I. Economic uncertainty and suicide in the United States. Eur J Epidemiol. 2021;36(6):641–7. doi: 10.1007/s10654-021-00770-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Wisniewski TP, Lambe BJ, Shrestha K. Do stock market fluctuations affect suicide rates? J Fin Res. 2020;43(4):737–65. [Google Scholar]

Decision Letter 0

Mohamed F Jalloh

11 Mar 2022

PONE-D-21-38742Can additional funding improve mental health outcomes? Evidence from a synthetic control analysis of California’s millionaire taxPLOS ONE

Dear Dr. Thom,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 25 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mohamed F. Jalloh

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf  and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please ensure that you include a title page within your main document. You should list all authors and all affiliations as per our author instructions and clearly indicate the corresponding author.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: 1) General comments:

This paper utilizes suicide mortality data from CDC over a period from 1999-2019 to examine the impact of CA’s mental health tax policy. Its strengths are that it applies synthetic control methods on nationally suicide mortality data to examine the impact of the CA mental health tax policy. The author further explored the policy impact in sub-populations. The disparities among different sub-population provided policy insights. Although suicide mortality is considered as the ultimate outcome of the mental health tax policy and consistently available, there are many other policy and epidemiological factors that would have impact on this outcome. Because of the reliability of the data source, the author uses 5 years pre-intervention data to predict 15 years post intervention outcome without accounting or acknowledging the influence of other noises. Overall, the data and results did not strongly support the assumption that CA’s tax policy has an positive impact on population mental health outcome.

2) Detailed comments

• Data source and outcome measure: The author discussed the availability of national available data as outcome measure of mental health and identified suicide mortality data as the ultimate outcome measure for mental health because it’s consistent, available, and good measure of population mental health. However, in all the models presented, the author only uses the pre-intervention outcome (suicide intervention) as the predictor while there are many other factors related to this outcome (e.g., opioid epidemic in 2010, the great recession in 2008, increased unemployment rate results from the recession, etc.). In fact, the opioid use disorder rates in the selected control states are all very high (majority higher than CA), which might result in greater increase in suicide mortality. And this might be easier to be explained by Fig 2 where the diverge happens around 2010.

In a different thought, is it possible to explore other mental health related outcome data? For example, since 72% of the revenue goes towards individuals with SMI, is it possible to explore the private insurance and state Medicaid data for SMI prevalence and/or inpatient/outpatient visits associated with SMI?

• Citations for NSDUH, BRFSS, and CDC mortality data are needed

• Predictors, Pre- and post- intervention periods: because the reliable suicide mortality data is only available after 1999, 1999-2004 is the pre-period, and 2005-2019 is the post period. The author uses a 5-year pre-intervention data to predict 15 years post intervention trend. The RMSPE statistic is reported and seems a good indicator for goodness-of-fit. There is no arbitrary cut-off value for RMSPE but it seems the 2001 data points for control group is at its peak while CA is at its lowest value. I’m curious about different RMSPE values for different predictor sets, e.g., by adopting the data-driven methods for variable selection described by Abadie (2021).

• Donor Pool: most of the selected states are in the east side, a few in mid-west and none of them is CA’s neighbor state. They are geographically and epidemiologically very different from CA despite the similar suicide mortality rate prior to 2008. Using the OUD rate as an example, the rise of suicide mortality rate post 2010 might just because of the severer impact of the opioid impact on those states.

• Results: the parameter estimation results for ITSA are not provided, but the author provided the p value for the post-intervention slope change. By looking at the figure provided, it looks more like some intervention was done to the control group in 2004 which results in slope change for control group and the policy does not results in any slope change for CA (treatment)? Although parallel trend assumption is not strictly required in ITSA, it is expected that slope and level change for treatment group is larger than the control group. Otherwise, the author may want to explain why there is a slope change in 2004 for control group rather than for CA.

Reviewer #2: In general, this is an interesting paper.

1. Synthetic Control Method is supposed to be a data-driven, transparent, objective evaluation method. The paper imposed several subjective constraints regarding the choice set of the donor pool with some reasoning. However, we still like to see some sensitiveness analysis due to these subjective constraints/exclusion (page 7).

2. There are no details on the modeling approach used and no equations in the paper that would enable us to judge/reduplicate what exactly is being modeled.

3. Suggest applying the permutation test to evaluate the significance and robustness of the estimations.

4. Maybe the paper can intuitively show, for example, how much tax money could deter one suicide life in different age/ethnic/gender groups in California based on your estimation of the synthetic California .

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Cheng Yuan

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Mohamed F Jalloh

16 Jun 2022

PONE-D-21-38742R1Can additional funding improve mental health outcomes? Evidence from a synthetic control analysis of California’s millionaire taxPLOS ONE

Dear Dr. Thom,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 31 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mohamed F. Jalloh, PhD, MPH

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I believe my comments are well addressed. I appreciate that the author did additional check on confounding variables such as unemployment rate.

The only suggestions I had is to actually keep the outcome of the original submission (include suicide from overdoses), and make the current revision as a sensitivity check. I see the author's intention of excluding those suicide categories and how minor the changes are. But thinking about where the mental health tax money went, it should address both mental health and SUD and not just depression related suicide. Actually a lot of SUD were treated at MH clinics.

Another thought about suicide and MH data - 911 calls will have records of suicide related cases and you can actually get data about whether referral were made. Those data might also be good national MH data but they are not publicly available as CDC mortality data, the author may need to request. Again it's just a side thought about data availability and potential outcome to investigate.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: YUAN CHENG

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 2

Mohamed F Jalloh

23 Jun 2022

Can additional funding improve mental health outcomes? Evidence from a synthetic control analysis of California’s millionaire tax

PONE-D-21-38742R2

Dear Dr. Thom,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Mohamed F. Jalloh, PhD, MPH

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Mohamed F Jalloh

6 Jul 2022

PONE-D-21-38742R2

Can additional funding improve mental health outcomes? Evidence from a synthetic control analysis of California’s millionaire tax

Dear Dr. Thom:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Mohamed F. Jalloh

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Donor states and weights for synthetic control analysis of California’s general population.

    (DOCX)

    S2 Table. Earmarked mental health tax effect on suicide deaths among California’s general population, 2012–2019.

    (DOCX)

    S3 Table. Donor pool states and weights for sex and race analyses.

    (DOCX)

    S4 Table. Donor pool states and weights for age group analyses.

    (DOCX)

    S5 Table. Earmarked mental health tax effect on suicide mortality among California’s general population using alternative intervention years.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All the data used in this study are publicly available. The Center for Disease Control and Prevention's National Vital Statistics System mortality data is held in a public repository at https://www.cdc.gov/nchs/nvss/deaths.htm.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES