Abstract
Objectives
Department of Veterans Affairs (VA) patients in depression treatment have high suicide rates after psychiatric hospitalization, antidepressant starts, and dosage changes. Policy makers have recommended closer monitoring during these periods to reduce suicide. This study assessed the frequency of high-risk periods in clinical settings, the levels of monitoring provided during these periods, and the estimated costs of providing monitoring consistent with the most stringent Food and Drug Administration recommendation for treatment periods after antidepressant change (seven visits in the first 12 weeks).
Methods
Monitoring visits were identified in the 12-week period after antidepressant starts and dosage changes and after discharge from psychiatric hospitalization for 100,000 randomly selected VA patients in depression treatment between April 1, 1999, and September 30, 2004. Incremental costs of providing intensive monitoring were estimated by using VA Health Economics Resource Center average cost data.
Results
Patients averaged less than one high-risk period each year. They completed an average of 2.4 monitoring visits during the 12-week period after antidepressant treatment events and 4.9 visits after psychiatric hospitalization. Providing intensive monitoring would cost an additional $408–$537 for each high-risk period after antidepressant treatment events and $313–$341 for each high-risk period after psychiatric hospitalization. During fiscal year 2004 providing intensive monitoring during all high-risk periods would have cost an additional $183–$270 million. Providing intensive monitoring only after psychiatric hospitalizations would have cost an additional $15–$17 million.
Conclusions
Providing intensive monitoring for VA patients in depression treatment during all high-risk periods for suicide would require substantial services reorganization and incremental expenditures. Modest expenditures would support intensive monitoring during the highest-risk period that follows psychiatric hospitalization.
Patients in treatment for depressive disorders are at much higher risk of suicide than the general population (1–4). Patients with depression have even higher rates of completed suicide after psychiatric hospitalization (3,5–7), and several studies indicate that patients with depression have higher rates of suicidality (ideation and attempts) after antidepressant starts and dosage changes (8–10). Close monitoring during these periods may reduce suicide risk.
Clinical monitoring of the population being treated for depression in the Department of Veterans Affairs (VA) health system is important to investigate because suicide rates in this system are higher than the rates in the age- and gender-matched U.S. population, the patient population is large, and systemwide reforms are feasible (1). The rate of completed suicide among VA patients receiving depression treatment between fiscal years (FYs) 1999 and 2004 was 114 per 100,000 person-years (per year of life observed) in the 60-week periods after antidepressant starts, dosage changes, or psychiatric hospitalization. Completed suicide rates in the first 12 weeks after these events were higher at 568 per 100,000 person-years after psychiatric hospitalization, 210 per 100,000 person-years after new antidepressant starts, 193 per 100,000 person-years after other antidepressant starts (in ongoing treatment), and 154 per 100,000 person-years after antidepressant dosage changes (11).
Although close clinical monitoring has not been proven to reduce suicide, it is often suggested to reduce suicide risk. The U.S. Food and Drug Administration (FDA) has recommended close monitoring in the 12 weeks after antidepressant starts or dosage changes to reduce suicide risks during these periods (12). Although the agency’s recommendations have undergone multiple iterations and have not always specified a visit frequency, the most stringent recommendation was for seven visits in the 12-week period after antidepressant starts or dosage changes for youths, with a later recommendation that adults with major depression be observed similarly (9,10).
The visit frequency suggested by the FDA to reduce suicide risk is similar to that suggested by past treatment guidelines to increase treatment efficacy during important treatment periods, such as those after depression treatment initiation (13,14). However, depression treatment patterns have changed substantially in the past ten to 15 years. The number of patients receiving depression treatment has increased while the number of visits per patient has decreased (15). In this changing context, many clinicians have viewed the FDA monitoring recommendations as being logistically difficult and prohibitively costly to implement. Several studies have reported decreased rates of new antidepressant prescriptions since the FDA warnings (16–18), although other concurrent events may have contributed to this decline.
In a world of scarce health care resources, policy makers are increasingly considering the costs and benefits of proposed health care interventions. For example, studies have examined the cost-effectiveness of screening mammography in various age groups and at different intervals, child health screenings, and other preventive services (19–24). Solid research evidence regarding the effectiveness of increased monitoring in reducing suicide is not yet available. However, given governmental and other organizational recommendations to provide close monitoring during high-risk periods, it is important to assess the potential service implications and the costs of following these recommendations.
We examined the frequency with which high-risk treatment periods occur in a nationally representative sample of VA patients in depression treatment and the intensity of monitoring provided to patients during these periods. We then examined the extent of service changes that would be required and the incremental costs of providing monitoring consistent with the most stringent FDA recommendation for monitoring. We hypothesized that monitoring rates are less intensive than the most stringent FDA recommendation and that the costs of providing monitoring consistent with FDA recommendations would be substantial.
Methods
Study data came from the VA National Registry for Depression (NARDEP), which is a unique longitudinal data resource that includes data from multiple VA administrative data sources and provides detailed services and pharmacy data for more than 1,500,000 patients diagnosed as having depressive disorders in VA facilities from FY 1997 and afterward.
Patient population and observation days
We randomly selected 100,000 of the 887,859 patients in NARDEP who received either two depression diagnoses or a depression diagnosis and an antidepressant fill between April 1, 1999, and September 30, 2004. Depression diagnoses were identified by using the following ICD-9 codes: 293.83, 296.2x, 296.3x, 296.90, 296.99, 298.0, 300.4, 301.12, 309.0, 309.1, and 311. Patients were excluded if they received diagnoses of bipolar I disorder, schizophrenia, or schizoaffective disorder during this period.
Observation began on the date of patients’ second depression diagnosis or their antidepressant fill and continued until their date of death in the National Death Index, one year after their last VA services use, or the study end date (September 30, 2004), whichever occurred first.
Treatment events
As in prior studies, we ascertained dates of discharge from psychiatric hospitalization and the dates of antidepressant fills during the observation period (11). We also ascertained new antidepressant starts, defined as fills occurring after a “clean period” of six or more months without any antidepressant fills. Other antidepressant starts were fills occurring during ongoing treatment, either without a clean period or with a short clean period of less than six months (that is, antidepressant switches, initiation of antidepressant combination treatment, or new medications after a short gap in use). A significant change in antidepressant dosage was defined as a change of ≥50% in total dosage of a specified antidepressant between two consecutive fills occurring in a six-month period (11).
Risk periods after treatment events
We classified patient observation days by whether they fell within sequential 12-week period after each type of treatment event. Days were classified as being within one to 84 days (12 weeks), 85 to 168 days (13–24 weeks), or ≥169 (>24 weeks) after the event.
Monitoring visits
We defined depression monitoring visits on the basis of criteria specified in the Healthcare Effectiveness Data and Information Set (HEDIS) optimal practitioner contact measure, as modified for VA settings (25). All visits with mental health Current Procedural Terminology (CPT) codes were counted as depression monitoring visits. Visits with non–mental health CPT codes were also counted if they had an associated ICD-9 depression diagnosis code of 290, 293–302, or 306–316. In sensitivity analyses, we explored the effect on study findings of using alternative variable definitions, counting all mental health and primary care visits as monitoring visits regardless of the accompanying ICD-9 codes.
We calculated the mean number of monitoring visits completed per 12-week high-risk period after each type of treatment event by calculating the ratio of completed monitoring visits divided by the number of high-risk observation days after each type of treatment event and then by multiplying this ratio by 84 to give us the average number of visits in 12-week high-risk periods across patients and treatment events over the entire observation period.
We also determined the frequency and mean number of HEDIS qualifying visits after patients’ first antidepressant event of interest and their first psychiatric hospitalization. Patients were excluded from this analysis if they did not have the treatment event of interest or if they had less than 84 observation days after this event.
Costs associated with increasing monitoring visits
We used VA Health Economics Resource Center (HERC) average cost data to estimate incremental costs that would be required to provide intensive monitoring during high-risk treatment periods. HERC average cost data were developed for use in health economics research and have been used in several prior studies (26–28).
We determined the treatment costs associated with increasing to seven the number of visits for patients who had fewer than seven visits during high-risk treatment periods for suicide (such visits are referred to below as incremental visits). These analyses did not assume visit reductions among patients with more than seven visits during these periods.
Because health care organizations may increase the level of monitoring by adding less expensive visits or by adding visits that reflect the current practice mix, we first estimated treatment costs for an inexpensive incremental mix. In these analyses we assumed that for every three incremental visits, two would be telephone visits (CPT codes 99371, 99372, or 99373 at a cost of $30.32 per visit) and one would be a 15-minute office visit (CPT code 99213 at a cost of $121.67 per visit). This assumption is congruent with the National Committee on Quality Assurance quality monitor for optimal practitioner contact after new antidepressant starts (25).
We then estimated the cost of increasing visits up to seven on the basis of the visit mix currently offered to VA patients in depression treatment. Eighty percent of depression monitoring visits in VA settings during FY 2004 were accounted for by the following CPT codes: 90801, 90804, 90805, 90806, 90807, 90853, 90862, 99212, 99213, and 99214. On the basis of this practice mix, the average cost of a monitoring visit during the 12-week period after an inpatient stay was $99.09 and the average cost of a monitoring visit after an antidepressant change was $115.43.
Other potential costs
Although HERC average cost data include the average overhead costs of visits (for example, hiring and training clinicians, office costs, and outreach to patients), these estimates do not include pharmacy costs. Antidepressant costs may increase if closer monitoring results in more medication adjustments and increased adherence. To estimate potential incremental pharmacy costs associated with closer monitoring, we multiplied the mean cost of antidepressants in the first 12-week high-risk periods during FY 2004 ($121.42) by the observed increases in antidepressant adherence (15%–65%) reported during collaborative care interventions for depression (29–31).
Estimating overall costs
To determine the incremental costs to the VA health system of providing close monitoring during all high-risk treatment periods in FY 2004, we determined the incremental costs of bringing cohort patients who had their most recent VA visit within one year of FY 2004 up to seven visits during all high-risk periods in FY 2004. We then extrapolated these costs to the 807,891 VA patients who had received depression treatment during the study period and remained in active treatment within one year of FY 2004.
Data analyses
We completed descriptive statistics for the patient sample, using frequencies or means as appropriate. Other data analyses are described above.
Results
Patient characteristics
The characteristics of the patient cohort are outlined in Table 1. Patients had a mean age of 58.6 years and were predominantly male (92%).
Table 1.
Characteristics of 100,000 Department of Veterans Affairs patients receiving treatment for depression
| Characteristic | N | % |
|---|---|---|
| Age (M±SD) | 58.6±14.3 | |
| Gender | ||
| Male | 91,951 | 92.0 |
| Female | 8,049 | 8.0 |
| Race | ||
| White | 76,507 | 76.5 |
| Black | 12,457 | 12.5 |
| Other (Asian, Native American, Pacific Islander, or multiracial) | 2,159 | 2.2 |
| Unknown | 8,877 | 8.9 |
| Hispanic ethnicitya | 4,649 | 4.6 |
Hispanic ethnicity is recorded separately from race.
Hospitalization, antidepressant starts, and dosage changes
Table 2 presents the percentages of cohort patients who had a psychiatric hospitalization, received antidepressant medication, had an antidepressant start, or had a dosage change during the observation period. A total of 82,677 patients (83%) had at least one antidepressant start, dosage change, or psychiatric hospitalization. On average, patients experienced .94 treatment events per patient-year of observation (95% confidence interval [CI]=.94–.95).
Table 2.
Antidepressant use, starts, and dosage changes between April 1, 1999, and September 30, 2004, among 100,000 Department of Veterans Affairs patients receiving treatment for depression
| Variable | N | % |
|---|---|---|
| Patient-level use, starts, and dosage changes | ||
| Patients with >1 treatment event of interest | 82,677 | 83.0 |
| Patients who had >1 psychiatric hospitalization | 10,299 | 10.3 |
| Patients who received antidepressants | 88,898 | 88.9 |
| Patients with >1 antidepressant treatment event of interest (new start, other start, or dosage change) | 81,244 | 81.2 |
| Received >1 new antidepressant start | 60,946 | 60.9 |
| Received >1 other antidepressant start in the context of ongoing treatment | 29,701 | 29.7 |
| Received >1 change in antidepressant dosage | 37,838 | 37.8 |
| Cohort treatment events | ||
| Number of unique treatment events (unique event-days) | 218,250 | |
| Psychiatric hospitalizations | 20,521 | |
| Antidepressant treatment events (new start, other start, or dosage change) | 197,729 | |
| New antidepressant starts | 71,541 | |
| Other antidepressant starts | 48,514 | |
| Dosage changes | 77,000 | |
| Observation days within 12 weeks after treatment eventa |
||
| Any treatment event | 14,632,570 | 17.3 |
| Psychiatric hospitalization | 1,489,435 | 1.8 |
| Any antidepressant treatment event | 13,878,905 | 16.4 |
| New antidepressant start | 5,786,125 | 6.9 |
| Other antidepressant start | 4,180,057 | 5.0 |
| Antidepressant dosage change | 5,415,514 | 6.4 |
Total observation days equates to 84,397,324 patient-days and 231,067 person-years.
Monitoring intensity
On the basis of the HEDIS definition of monitoring visits, patients averaged 4.86 visits (CI=4.82–4.89) in the 12-week period after psychiatric hospitalization and 2.40 visits (CI=2.39– 2.40) in the 12-week period after antidepressant treatment events. They completed an average of 2.18 visits (CI=2.16–2.19) after new antidepressant starts, 3.02 visits (CI=3.00–3.03) after other antidepressant starts, and 2.64 visits (CI=2.63–2.65) after significant dosage changes.
In sensitivity analyses, when all mental health and primary care visits were assumed to be monitoring visits, patients completed an average of 5.66 visits (CI=5.62–5.69) in the 12-week period after psychiatric hospitalization and 3.08 visits (CI=3.07–3.09) in the 12-week period after antidepressant treatment events.
Table 3 presents the frequency and mean number of HEDIS qualifying visits after the first treatment events of interest among 76,877 patients with at least one of the specified events and ≥84 days of follow-up after this first event. Only 6.4% of patients who had an antidepressant treatment event completed seven or more visits in the 12-week period after this first event; approximately 21.4% of those with a psychiatric hospitalization completed seven or more visits in the 12-week period after this first hospitalization.
Table 3.
Number of monitoring visits completed by 100,000 Department of Veterans Affairs patients receiving treatment for depression in the 12 weeks after the first treatment event of interest
| Number of visits |
Overall (N=76,877) |
Antidepressant (N=75,803) |
Psychiatric hospitalization (N=9,385) |
New anti- depressant start (N=56,713) |
Other anti- depressant start (N=27,650) |
Dosage change (N=35,290) |
||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| N | % | N | % | N | % | N | % | N | % | N | % | |
| 0 | 15,349 | 20.0 | 14,646 | 19.3 | 2,275 | 24.2 | 11,580 | 20.4 | 4,408 | 15.9 | 7,293 | 20.7 |
| 1 | 26,356 | 34.3 | 26,120 | 34.5 | 1,691 | 18 | 20,324 | 35.8 | 7,576 | 27.4 | 10,842 | 30.7 |
| 2 | 15,136 | 19.7 | 15,187 | 20.0 | 1,264 | 13.5 | 11,183 | 19.7 | 5,937 | 21.5 | 6,686 | 18.9 |
| 3 | 7,789 | 10.1 | 7,858 | 10.4 | 925 | 9.9 | 5,395 | 9.5 | 3,543 | 12.8 | 3,793 | 10.7 |
| 4 | 3,862 | 5.0 | 3,912 | 5.2 | 570 | 6.1 | 2,735 | 4.8 | 1,902 | 6.9 | 1,906 | 5.4 |
| 5 | 2,158 | 2.8 | 2,201 | 2.9 | 362 | 3.9 | 1,470 | 2.6 | 1,060 | 3.8 | 1,108 | 3.1 |
| 6 | 1,376 | 1.8 | 1,413 | 1.9 | 291 | 3.1 | 931 | 1.6 | 730 | 2.6 | 724 | 2.1 |
| ≥7 | 4,851 | 6.3 | 4,834 | 6.4 | 2,007 | 21.4 | 3,095 | 5.5 | 2,494 | 9.0 | 2,938 | 8.3 |
| M±SD | 2.34±3.81 | 2.37±3.85 | 4.88±7.60 | 2.21±3.66 | 2.87±4.19 | 2.59±4.20 | ||||||
Estimated incremental costs of monitoring
Depending upon whether additional visits reflected an inexpensive mix or the observed mix of monitoring visits, increasing the number of visits to seven for patients with less intensive monitoring during high-risk periods would mean an additional cost of approximately $408–$537 for each high-risk period after an antidepressant treatment event or $313–$341 for each high-risk period after a psychiatric hospitalization.
For patients who received depression treatment and remained in VA care, approximately 3.5 additional visits would have been required to reach seven visits, at a cost of $303–$394 per patient-year.
Incremental antidepressant costs
Among the 25,754 patients who had their first high-risk period in 2004, mean antidepressant costs during the 12-week high-risk period were $121.42. If closer monitoring increased antidepressant costs by 15%–65% as a result of improved adherence, this would represent incremental costs of $18–$79 per high-risk treatment period.
Estimated overall costs
For all 807,891 patients receiving depression treatment since 1999 and remaining in active VA care in FY 2004, the health system would have had to expend an additional $183–$270 million in 2004 dollars to provide intensive monitoring during all high-risk periods during the year. Increased antidepressant adherence would potentially add another $.9–$3.8 million to this figure. To provide intensive monitoring only during the treatment periods after psychiatric hospitalization would have cost $15–$17 million in 2004 dollars.
The incremental costs of providing close monitoring during all high-risk periods for patients in depression treatment would have represented .7%–1.0% of the overall FY 2004 VA health care budget of $27 billion. Providing close monitoring only during treatment periods after psychiatric hospitalization would have represented approximately .06% of the overall health care budget (32).
Discussion
Close monitoring is frequently suggested as a way to reduce suicide risk, and the FDA has specifically recommended close monitoring for this purpose after antidepressant starts and dosage changes. We present data on the potential service changes and costs of implementing intensive monitoring during high-risk periods for suicide in the nation’s largest health care organization.
We found that patients receiving VA depression treatment had less than one high-risk treatment period during each year of follow-up. They completed an average of 2.4 monitoring visits in the 12 weeks after antidepressant starts and dosage changes and 4.9 visits in the 12 weeks after psychiatric hospitalization. Given high rates of completed suicide among the VA depression treatment population (1,11), closer monitoring might be needed.
The VA would need to substantially reorganize depression services to provide monitoring consistent with the most stringent FDA recommendations. To provide seven visits during these 12-week high-risk periods, the average number of visits would need to be almost tripled in the 12 weeks after antidepressant starts and increased by 40% in the 12 weeks after psychiatric hospital discharge.
This would cost an additional $408–$537 per high-risk period after antidepressant treatment events and $313–$341 per high-risk period after psychiatric hospitalization. On average, this would result in additional expenditures of $303–$394 per patient-year of treatment. The lower range of estimated costs would result if two telephone-based visits were included in each of three incremental visits. Telephone visits are less expensive, and there is substantial research indicating the effectiveness of telephone-based care in improving outcomes for patients newly starting antidepressants (29,31–33). Thus telephone visits may also play a role in efforts to reduce suicide.
With any visit mix, the incremental aggregate costs of providing intensive monitoring are substantial. Health systems with limited resources might need to provide intensive monitoring first during the highest-risk treatment period—that is, after psychiatric hospitalization. The costs of providing intensive monitoring at this critical juncture are more modest, and suicide rates during the 12 weeks after hospitalization are very high, at 568 per 100,000 person-years.
Given the substantial aggregate costs of implementing intensive monitoring during high-risk periods for suicide, there is also an urgent need for further research regarding the effectiveness of close monitoring in reducing suicide. A recent review of suicide prevention studies concluded that only physician education and restricting access to lethal means have reasonable evidence for efficacy in preventing suicide (34). Health care organizations will likely require solid evidence for the effectiveness of intensive monitoring in reducing suicide risk before making the large shifts in depression services required for widespread implementation. Future research must also address the frequency, nature, duration, and content of monitoring visits that are most effective in reducing risks.
We conducted this study with data from VA patients in depression treatment; care must be taken in generalizing study findings. The VA population may be at higher risk of suicide than many treatment populations, although suicide rates for men receiving VA depression treatment are close to those of men receiving depression treatment in managed care settings (2). Because of high rates of comorbidity, VA patients may also receive more antidepressant changes and be hospitalized more often than other treatment populations, resulting in more high-risk periods. VA patients may also receive more or less frequent monitoring visits than patients in other settings. However, the percentage of VA patients completing seven or more mental health–focused visits in the 12 weeks after antidepressant treatment events was quite similar to the percentage of managed care patients completing seven or more such visits after new antidepressant starts (35).
Hiring new staff would likely be necessary to increase overall visit frequency during high-risk periods. Although HERC average cost data include the average overhead costs involved in hiring and training new staff, a significant and sudden expansion might result in a temporary cost increase that is not fully captured. HERC cost data also include the average costs of outreach needed to bring patients in for visits, but outreach efforts needed to bring patients in for intensive monitoring may differ from these average outreach costs (36).
In this study we focused on reducing the suicide risk of patients in depression treatment. Other populations of patients, such as those with bipolar disorder or schizophrenia, may also benefit from closer monitoring during high-risk periods.
Finally, health systems may configure incremental visits in a number of ways to meet FDA monitoring recommendations. In this study we presented the least and most expensive options that we thought health systems might consider. However, the optimal visit mix for reducing suicide risk is not known. Potentially, only visits with psychiatrists or skilled psychotherapists might prove effective in reducing suicide. The costs of providing intensive monitoring composed only of these expensive visits would fall outside of the range presented. Alternatively, new technologies such as sending text messages to patients (via phone or computer) or other automated monitoring systems may be feasible and result in costs lower than those presented here.
Conclusions
Despite the study limitations, data from this national cohort of VA patients in depression treatment provide important information regarding the frequency of hospitalization, antidepressant starts, and dosage changes in clinical settings and the intensity of clinical monitoring after these events, which allows data-driven estimates of the potential service changes and costs of providing intensive monitoring during high-risk periods for populations receiving depression treatment. These estimates can serve as benchmarks for assessing tradeoffs, as we learn more about the clinical effectiveness of intensive monitoring in reducing suicide risk.
Acknowledgments
This research was supported by grants IIR 04- 211-1 and MRP 03-320 from the VA Health Services Research and Development Service and by grant R01-MH078698-01 from the National Institute of Mental Health. The authors acknowledge substantial assistance from Ciaran Phibbs, Ph.D., and Mark Smith, Ph.D. The views expressed in this article are those of the authors and do not necessarily represent the views of the VA.
Dr. Olfson has received research support from Bristol-Myers Squibb, Eli Lilly and Company, AstraZeneca, and Ortho-McNeil Janssen Scientific Affairs. He has also worked as a consultant for Pfizer, Janssen, Bristol-Myers Squibb, and Eli Lilly and Company.
Footnotes
Disclosures
The other authors report no competing interests.
References
- 1.Zivin K, Kim HM, McCarthy JF, et al. Suicide mortality among individuals receiving treatment for depression in the Veterans Affairs health system: associations with patient and treatment setting characteristics. American Journal of Public Health. 2007;97:2193–2198. doi: 10.2105/AJPH.2007.115477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Simon GE, VonKorff M. Suicide mortality among patients treated for depression in an insured population. American Journal of Epidemiology. 1998;47:155–160. doi: 10.1093/oxfordjournals.aje.a009428. [DOI] [PubMed] [Google Scholar]
- 3.Bostwick JM, Pankratz VS. Affective disorders and suicide risk: a reexamination. American Journal of Psychiatry. 2000;157:1925–1932. doi: 10.1176/appi.ajp.157.12.1925. [DOI] [PubMed] [Google Scholar]
- 4.Harris EC, Barraclough B. Suicide as an outcome for mental disorders: a meta-analysis. British Journal of Psychiatry. 1997;170:205–228. doi: 10.1192/bjp.170.3.205. [DOI] [PubMed] [Google Scholar]
- 5.Pokorny AD. Prediction of suicide in psychiatric patients: report of a prospective study. Archives of General Psychiatry. 1983;40:249–257. doi: 10.1001/archpsyc.1983.01790030019002. [DOI] [PubMed] [Google Scholar]
- 6.Hoyer EH, Olesen AV, Mortensen PB. Suicide risk in patients hospitalised because of an affective disorder: a follow-up study, 1973–1993. Journal of Affective Disorders. 2004;78:209–217. doi: 10.1016/S0165-0327(02)00311-7. [DOI] [PubMed] [Google Scholar]
- 7.Desai RA, Dausey DJ, Rosenheck RA. Mental health service delivery and suicide risk: the role of individual patient and facility factors. American Journal of Psychiatry. 2005;162:311–318. doi: 10.1176/appi.ajp.162.2.311. [DOI] [PubMed] [Google Scholar]
- 8.Jick H, Kaye JA, Jick SS. Antidepressants and the risk of suicidal behaviors. JAMA. 2004;292:338–343. doi: 10.1001/jama.292.3.338. [DOI] [PubMed] [Google Scholar]
- 9.Silver Spring, Md. US Food and Drug Administration; [Oct 15, 2004]. FDA Public Health Advisory: Suicidality in Children and Adolescents Being Treated with Antidepressant Medications. Available at www.fda.gov. [Google Scholar]
- 10.Silver Spring, Md. US Food and Drug Administration; [June 30, 2005]. FDA Public Health Advisory: Suicidality in Adults Being Treated With Antidepressant Medication. Available at www.fda.gov. [Google Scholar]
- 11.Valenstein M, Kim HM, Ganoczy D, et al. Higher-risk periods for suicide among VA patients receiving depression treatment: prioritizing suicide prevention efforts. Journal of Affective Disorders. 2009;112:50–58. doi: 10.1016/j.jad.2008.08.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Silver Spring, Md. US Food and Drug Administration; [Feb 3, 2005]. FDA Public Health Advisory: Class Suicidality Labeling Language for Antidepressants. Available at www.fda.gov/cder/drug/antidepressants/PI_template.pdf. [Google Scholar]
- 13.Practice guideline for the treatment of patients with major depressive disorder (revision) American Journal of Psychiatry. 2000;157(suppl 4):1–45. [PubMed] [Google Scholar]
- 14.Clinical Practice Guideline, no 5 AHCPR pub no 93-0551. Rockville, Md: Agency for Health Care Policy and Research; 1993. Depression Guideline Panel: Depression in Primary Care: Vol 2. Treatment of Major Depression. [Google Scholar]
- 15.Olfson M, Marcus SC, Druss B, et al. National trends in the outpatient treatment of depression. JAMA. 2002;287:203–209. doi: 10.1001/jama.287.2.203. [DOI] [PubMed] [Google Scholar]
- 16.Libby AM, Brent DA, Morrato EH, et al. Decline in treatment of pediatric depression after FDA advisory on risk of suicidality with SSRIs. American Journal of Psychiatry. 2007;164:884–891. doi: 10.1176/ajp.2007.164.6.884. [DOI] [PubMed] [Google Scholar]
- 17.Valuck RJ, Libby AM, Orton HD, et al. Spillover effects on treatment of adult depression in primary care after FDA advisory on risk of pediatric suicidality with SSRIs. American Journal of Psychiatry. 2007;164:1198–1205. doi: 10.1176/appi.ajp.2007.07010007. [DOI] [PubMed] [Google Scholar]
- 18.Olfson M, Marcus SC, Druss BG. Effects of Food and Drug Administration warnings on antidepressant use in a national sample. Archives of General Psychiatry. 2008;65:94–101. doi: 10.1001/archgenpsychiatry.2007.5. [DOI] [PubMed] [Google Scholar]
- 19.Cohen JT, Neumann PJ, Weinstein MC. Does preventive care save money? Health economics and the presidential candidates. New England Journal of Medicine. 2008;358:661–663. doi: 10.1056/NEJMp0708558. [DOI] [PubMed] [Google Scholar]
- 20.Bridges CB, Thompson WW, Meltzer MI, et al. Effectiveness and cost-benefit of influenza vaccination of healthy working adults: a randomized controlled trial. JAMA. 2000;284:1655–1663. doi: 10.1001/jama.284.13.1655. [DOI] [PubMed] [Google Scholar]
- 21.Kerlikowske K, Salzmann P, Phillips KA, et al. Continuing screening mammography in women aged 70 to 79 years: impact on life expectancy and cost-effectiveness. JAMA. 1999;282:2156–2163. doi: 10.1001/jama.282.22.2156. [DOI] [PubMed] [Google Scholar]
- 22.Mohr PE, Neumann PJ, Franco SJ, et al. The case for daily dialysis: its impact on costs and quality of life. American Journal of Kidney Diseases. 2001;37:777–789. doi: 10.1016/s0272-6386(01)80127-x. [DOI] [PubMed] [Google Scholar]
- 23.Selby-Harrington M, Sorenson JR, Quade D, et al. Increasing Medicaid child health screenings: the effectiveness of mailed pamphlets, phone calls, and home visits. American Journal of Public Health. 1995;85:1412–1417. doi: 10.2105/ajph.85.10.1412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Stout NK, Rosenberg MA, Trentham-Dietz A, et al. Retrospective cost-effectiveness analysis of screening mammography. Journal of the National Cancer Institute. 2006;98:774–782. doi: 10.1093/jnci/djj210. [DOI] [PubMed] [Google Scholar]
- 25.Health Plan Employer Data and Information Set. Washington, DC: National Committee on Quality Assurance; 2006. [Google Scholar]
- 26.Phibbs CS, Bhandari A, Yu W, et al. Estimating the costs of VA ambulatory care. Medical Care Research and Review. 2003;60(suppl 3):54S–73S. doi: 10.1177/1077558703256725. [DOI] [PubMed] [Google Scholar]
- 27.Sloan KL, Montez-Rath ME, Spiro A, III, et al. Development and validation of a psychiatric case-mix system. Medical Care. 2006;44:568–580. doi: 10.1097/01.mlr.0000215819.76050.a1. [DOI] [PubMed] [Google Scholar]
- 28.Yu W, Wagner TH, Barnett PG. Determinants of cost among people who died in VA nursing homes. Medical Care Research and Review. 2006;63:477–498. doi: 10.1177/1077558706288843. [DOI] [PubMed] [Google Scholar]
- 29.Liu CF, Hedrick SC, Chaney EF, et al. Cost-effectiveness of collaborative care for depression in a primary care veteran population. Psychiatric Services. 2003;54:698–704. doi: 10.1176/appi.ps.54.5.698. [DOI] [PubMed] [Google Scholar]
- 30.Von Korff M, Katon W, Bush T, et al. Treatment costs, cost offset, and cost-effectiveness of collaborative management of depression. Psychosomatic Medicine. 1998;60:143–149. doi: 10.1097/00006842-199803000-00005. [DOI] [PubMed] [Google Scholar]
- 31.Simon GE, VonKorff M, Rutter C, et al. Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ. 2000;320:550–554. doi: 10.1136/bmj.320.7234.550. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Budget of the United States Government, Fiscal Year 2006. Washington, DC: Department of Veterans Affairs; 2006. Available at georgewbush-whitehouse.archives.gov/omb/budget/fy2006/veterans.html. [Google Scholar]
- 33.Katon W, Von Korff M, Lin E, et al. Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA. 1995;273:1026–1031. [PubMed] [Google Scholar]
- 34.Mann JJ, Apter A, Bertolote J, et al. Suicide prevention strategies: a systematic review. JAMA. 2005;294:2064–2074. doi: 10.1001/jama.294.16.2064. [DOI] [PubMed] [Google Scholar]
- 35.Stettin GD, Yao J, Verbrugge RR, et al. Frequency of follow-up care for adult and pediatric patients during initiation of antidepressant therapy. American Journal of Managed Care. 2006;12:453–461. [PubMed] [Google Scholar]
- 36.Liu CFC-F, Fortney JJ, Vivell SS, et al. Time allocation and caseload capacity in telephone depression care management. American Journal of Managed Care. 2007;13:652–660. [PubMed] [Google Scholar]