Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2012 Apr 25.
Published in final edited form as: Circ Cardiovasc Qual Outcomes. 2011 Apr 19;4(3):283–292. doi: 10.1161/CIRCOUTCOMES.110.960013

Real-World Lessons From the Implementation of a Depression Screening Protocol in Acute Myocardial Infarction Patients: Implications For the AHA Depression Screening Advisory

Kim G Smolderen *,, Donna M Buchanan *,, Alpesh A Amin *,, Kensey Gosch *, Karen Nugent *, Lisa Riggs *, Geri Seavey *, John A Spertus *,
PMCID: PMC3336360  NIHMSID: NIHMS369036  PMID: 21505152

Abstract

Background

The American Heart Association (AHA) statement has recommended routine screening for depression in coronary artery disease with a 2-stage implementation of the Patient Health Questionnaire (PHQ). As there is little evidence on feasibility, accuracy, and impact of such a program on depression recognition in coronary patients, the AHA recommendation has met substantial debate and criticism.

Methods and Results

Before the AHA statement was released, the Mid America Heart and Vascular Institute (MAHVI) had implemented a depression screening protocol for acute myocardial infarction (AMI) patients virtually identical to the AHA recommendations. To (1) evaluate this MAHVI quality improvement initiative, (2) compare MAHVI’s depression recognition rates with those of other hospitals, and (3) examine health care providers’ implementation feedback, we compared the results of MAHVI’s screening program with data from a parallel prospective AMI registry and interviewed MAHVI providers. Depressive symptoms (PHQ-2, PHQ-9) were assessed among 503 MAHVI AMI patients and compared with concurrent depression assessments among 3,533 patients at 23 U.S. centers without a screening protocol. A qualitative summary of providers’ suggestions for improvement was also generated. A total of 135 (26.8%) eligible MAHVI patients did not get screened. Among screened patients, 90.9% depressed (PHQ-9≥10) patients were recognized. The agreement between the screening and registry data using the full PHQ-9 was 61.5% for positive cases (PHQ-9≥10); but only 35.6% for the PHQ-2 alone. Although MAHVI had a slightly higher overall depression recognition rate (38.3%) than other centers not using a depression screening protocol (31.5%), the difference was not statistically significant (P=0.31). Staff feedback suggested that a single-stage screening protocol with continuous feedback could improve compliance.

Conclusion

In this early effort to implement a depression screening protocol, a large proportion of patients did not get screened, and only a modest impact on depression recognition rates was realized. Simplifying the protocol by using the PHQ-9 alone and providing more support and feedback may improve the rates of depression detection and treatment.

Keywords: Myocardial Infarction, Risk Factors, AHA Medical/Scientific Statements, Patient Centered Care

Introduction

Depression is a common co-morbidity in acute myocardial infarction (AMI) patients and is associated with adverse long-term outcomes.13 It is also well documented that the majority of coronary artery disease (CAD) patients with significant depression are not recognized at the time of their AMI.4, 5 Accordingly, there has been increasing pressure to improve depression recognition and treatment in CAD, including the incorporation of depression screening recommendations into guidelines for the management of acute and chronic CAD.6, 7 The American Heart Association (AHA) recently published a scientific statement emphasizing the importance of depression screening in CAD and advocating an explicit 2-step protocol for routine clinical practice using the Patient Health Questionnaire.6 Given the prevalence of depression in CAD patients,1, 8 and the fact that treating depression can improve both depressive symptoms and quality of life,9 the AHA recommendations would appear to be an important potential advance in clinical care. Congruent with the logic of the AHA, a multi-disciplinary team at Saint Luke’s Mid America Heart and Vascular Institute (MAHVI) designed and implemented a depression screening protocol in April 2005. This protocol was implemented as part of routine clinical AMI care; after prior evaluations had indicated that depression recognition rates for hospitalized AMI patients at MAHVI were low (25%).4

Recently, however, significant criticism of the AHA’s recommendations for widespread depression screening has been raised. These include concerns about the feasibility, accuracy, and consequences of ubiquitous depression screening, which are currently unknown.1012 Given doubts about the potential for routine depression screening in CAD patients to improve depression recognition or treatment, more evidence on the feasibility and outcomes (e.g. depression recognition) of routine depression screening is needed. We sought to address this gap in knowledge by (1) evaluating the performance of the implemented depression screening protocol within MAHVI, including feasibility and validity against concurrent assessments by trained interviewers; (2) comparing MAHVI’s current depression recognition rates with depression recognition rates at 23 other US centers that did not have a depression screening protocol in place; and (3) assessing MAHVI providers’ perspectives on the implementation of the depression screening protocol. Given the concerns about routine depression screening in the setting of AMI, as proposed in the 2008 AHA advisory,6 the evaluation of a real-world experience with a comparable depression protocol could provide valuable feedback both with respect to the potential of the AHA recommendations to improve depression recognition and to highlight opportunities to better implement depression recognition protocols in AMI patients.

METHODS

Participants and Study Design

The primary objective was to report a single-center experience of the implementation and performance of a formal depression screening protocol (Figure 1, Objective 1). This protocol was implemented at Saint Luke’s MAHVI, Kansas City, MO in April 1, 2005, and was consistent with the AHA Advisory that was subsequently published in 2008.6 Concurrent with the implementation of this screening protocol, AMI patients from MAHVI – together with AMI patients from 23 other U.S. hospitals – were consecutively enrolled between April 11, 2005 and December 31, 2008 into the prospective multi-center Translational Research Investigating Underlying disparities in acute Myocardial infarction Patients’ Health Status (TRIUMPH) study.

Figure 1. The Main Objectives and Data Sources of the Study.

Figure 1

Abbreviations: MAHVI, Mid America Heart and Vascular Institute, PHQ, patient health questionnaire; TRIUMPH, Translational Research Investigating Underlying disparities in acute Myocardial infarction Patients’ Health Status registry.

The group of patients screened within MAHVI will be referred to as “MAHVI”; MAHVI patients that underwent parallel depression assessments within TRIUMPH will be denoted as “TRIUMPH-MAHVI”; and the remaining group of patients that were enrolled for all other centers in the TRIUMPH registry will be referred to as “TRIUMPH-ALL” (Figure 2).

Figure 2. Overview of Screening Process and Registry Data.

Figure 2

Abbreviations: AMI, acute myocardial infarction; TRIUMPH registry, Translational Research Investigating Underlying disparities in acute Myocardial infarction Patients’ Health Status registry; PHQ, patient health questionnaire.

Patients in the TRIUMPH registry were eligible for inclusion if they were 18 years or older, had elevated cardiac enzymes (troponin-I or creatinine kinase-MB) within 24 hours of hospital admission and supporting evidence suggestive of AMI, including prolonged ischemic symptoms or electrocardiographic ST changes. Patients were excluded if they were transferred to the participating hospital from another facility >24 hours after initial presentation, were incarcerated, refused participation, were unable to provide consent, did not speak English or Spanish, or expired or were discharged prior to being contacted by the investigators. Demographic, clinical, and psychological data for all TRIUMPH patients were collected from chart abstraction and standardized baseline interviews by trained hospital research staff during the index AMI admission. All participants provided written informed consent and the study protocol was approved by the institutional review board at each participating center.

In order to evaluate the performance of the depression screening protocol (Figure 1, Objective 1), data on depressive symptoms obtained from the MAHVI screening protocol were analyzed for those patients (TRIUMPH-MAHVI) whose depressive symptoms were similarly assessed in the TRIUMPH registry, so that the concordance between the two assessments could be evaluated. Next, to provide a context for interpreting MAHVI recognition rates, we compared MAHVI depression recognition rates with those from the remaining TRIUMPH sites (TRIUMPH-ALL) that had not implemented a formal depression screening protocol (Figure 1, Objective 2). Finally, a descriptive approach was adopted to evaluate post-implementation feedback on the MAHVI screening protocol and to explore what health care providers perceived as barriers for the implementation and how the protocol might be improved. (Figure 1, Objective 3).

Measures

MAHVI Depression Screening Protocol

As part of a quality of care initiative prepared by a multi-disciplinary team (clinicians, researchers, and quality managers), a standardized 2-step depression screening protocol was designed and implemented at MAHVI in patients who were on an acute coronary syndrome (ACS) care management pathway (Online Data Supplement).13 This pathway was incorporated into MAHVI’s AMI pathway, which mandated depression screening by nursing staff for each patient during their index admission. This protocol required the 2-item Patient Health Questionnaire (PHQ-2) to be administered as a first step13 in defining whether the patient was at risk for major depressive symptoms and to determine whether the full PHQ-9 was required. Specifically, as soon as patients were medically stabilized, patients were asked whether over the past 2 weeks, (1) they have been feeling down, depressed, or hopeless and (2) whether they felt little interest or pleasure in doing things they normally would have enjoyed. Items on the PHQ-2 are answered along a 4-point Likert scale (0=not at all to 3=nearly every day); using a cut-off of ≥1 on the PHQ-2, a sensitivity of 91% and a specificity of 64% for the diagnosis of major depression has been established in CAD patients.14 Scores ≥1 automatically led to the next step of the screening protocol - the administration of the full PHQ-9 - which was performed immediately after completion of the PHQ-2.

The PHQ-9 is a validated tool for depression screening that incorporates each of the 9 Diagnostic and Statistical Manual of Mental Disorders, 4th Edition criteria, 1517 and of which the first two items comprise the PHQ-2. Similar to the PHQ-2, 4-item Likert scales are used and responses are summed to create a score between 0 and 27 points. A PHQ-9 score of ≥10 has a sensitivity and specificity of 88% for major depression.1820 Depending upon the PHQ-9 sum score; the MAHVI depression screening protocol recommended different actions (Online Data Supplement). The required steps were that the nursing staff would notify the physician that patients had a clinically relevant score on the PHQ-9, and place order sheets in the patients’ chart. Physicians would then indicate the appropriate depression treatment plan on the patient’s chart and had to include this information in the discharge letter. To facilitate these steps, pre-printed order sheets were inserted by nursing staff to be selected and signed by the clinician and a pre-formatted macro of recommendations was available to clinicians at the time of discharge summary dictation. Treatment options were selected by clinicians and included the following: (1) pharmacy consultations to recommend and initiate anti-depressant medications, (2) social services consultations for depression outpatient treatment options, (3) nursing staff provision of educational materials about depression, including the opportunity to view an educational video, (4) chaplain consultation, and (5) in-hospital psychiatry consultations. The last option was mandatory when a patient indicated suicidal ideation.

Depression Screening in The TRIUMPH Study

Parallel with the implementation of the MAHVI protocol, a multi-center, prospective registry of AMI patients’ outcomes was conducted at MAHVI and 23 other centers. Data collectors at each center were trained in the administration of the PHQ and this was prospectively implemented at each center in each consenting AMI patient. For the TRIUMPH registry data, depressive symptoms were assessed with the full PHQ-9. Interviews were conducted after patients were medically stabilized.

Depression Recognition

Depression recognition rates were prospectively documented within the TRIUMPH study. To be classified as recognized, trained data abstractors looked through the physician notes, discharge diagnoses, discharge medications (to screen for the use of anti-depressant medications) and discharge summaries for any documentation that the patient’s significant depressive symptoms or depression was being recognized during the index AMI. To ensure that we did not misclassify the use of anti-depressive medications as indicating depression recognition, patients who were prescribed antidepressant medications solely for the purposes of smoking cessation or neuralgic pains (n=24) were not classified as having recognized depression.

This information on depression recognition was available within the TRIUMPH registry and was used to determine the proportion of recognized depressed patients that were screened within the MAHVI screening protocol (Objective 1, Figure 1) and to compare MAHVI’s overall depression recognition rates with depression recognition rates across TRIUMPH-ALL centers; 23 centers that did not have a formal depression screening protocol in place (Objective 2, Figure 1).

Perceived Barriers and Opportunities for Depression Screening

Qualitative data were obtained from a convenience sample of MAHVI health care providers to identify how well the quality-improvement protocol had been received in daily clinical practice (Objective 3, Figure 1). The convenience sample consisted of 3 nurses, a social worker, 2 nurse practitioners, 3 medical residents, and 2 cardiologists who were recruited between August 1, 2009 and September 31, 2009. Post-implementation feedback was documented using a standardized, open-ended interview approach with the following two questions being asked to all interviewees: (1) “What is your experience with the ACS depression screening protocol?” and (2) “Do you have any suggestions to optimize the ACS depression screening protocol?” The health care providers were all interviewed in person and interviews were led by 3 interviewers (KN and KS performed all interviews with the nurses and social worker, AA interviewed the physicians and other health care providers). Interviews ranged from 10 to 20 minutes in length. Data were recorded by taking notes during the interview.

Statistical Analyses

Evaluate the Performance of Depression Screening Protocol Within MAHVI

Numbers of patients who did and who did not receive screening at MAHVI and reasons for not screening were evaluated. To compare baseline characteristics of patients who were screened per MAHVI’s depression screening protocol and those who were not, Student’s t-tests (for normally distributed continuous variables), Wilcoxon tests (for continuous variables not following a normal distribution), and Chi-square or Fisher’s Exacts tests for categorical variables were used, as appropriate.

Next, for MAHVI patients who received routine depression screening in the hospital and had a positive PHQ-2 screen, the proportion of patients in the following PHQ-9 score categories were provided: PHQ-9 score <5 (no depressive symptoms); PHQ-9 score 5–9 (mild depressive symptoms; PHQ-9 score ≥10 (moderate to severe depressive symptoms). Similarly, we described parallel PHQ-2 and PHQ-9 registry data obtained for the TRIUMPH-MAHVI patients.

The concordance between the PHQ-2 MAHVI screening and TRIUMPH-MAHVI registry data was determined by (1) generating cross-comparisons (for PHQ-2 ≥1 across the MAHVI screening and TRIUMPH-MAHVI registry data; using the McNemar’s test), (2) determining the test-retest reliability (correlating continuous PHQ-2 MAHVI screening and TRIUMPH-MAHVI registry data), and (3) calculating the Cohen’s kappa coefficient (defined as the agreement between the MAHVI screening and TRIUMPH-MAHVI registry data who each classified a patient’s responses on the PHQ-2 as ‘positive’ [i.e., presence of clinically relevant depressive symptoms; PHQ-2 ≥1] or ‘negative’ [i.e., absence of clinically relevant depressive symptoms; PHQ-2=0]).21,22 Similarly, the concordance between the MAHVI screening and TRIUMPH-MAHVI registry data was determined for the PHQ-9 data: (1) cross-comparisons (for PHQ-9≥10 across the MAHVI screening and TRIUMPH-MAHVI registry data; using the McNemar’s test) were performed; (2) the test-reliability, and (3) Cohen’s kappa coefficient were calculated. Finally, MAHVI depression recognition rates are described for patients who were screened and who had clinically relevant depressive symptoms (PHQ-9 score ≥10).

Contextualize MAHVI’s Overall Depression Recognition Rates

Overall depression recognition rates for MAHVI (including screened and unscreened patients) and for the TRIUMPH-ALL group (i.e., 23 other hospitals from the TRIUMPH registry for which no systematic screening protocol was in place) were summarized by the mean rate of recognition among patients with PHQ-9≥10 during the TRIUMPH interviews. To test for the statistical difference between the depression recognition rate at MAHVI and the TRIUMPH-ALL sites, a hierarchical logistic regression model, adjusting for clustering by site, was constructed to evaluate the effect of having a program in place on depression recognition. All statistical analyses were conducted with SAS software version 9.2 (SAS Institute Inc, Cary, North Carolina). All statistical tests were 2-tailed and P-values <.05 were considered as statistically significant.

Document Health Care Providers’ Perspectives on MAHVI Depression Screening Protocol

Field notes obtained from the interviews were reviewed and were searched for the presence of common themes regarding reported barriers and opportunities for improvement of the depression protocol. The identified categories were named by the researchers (AA, DB, KN, KG, KS) and responses were categorized accordingly. For both the implementation barriers and opportunities for improvement of the depression screening protocol, the top 5 themes were identified.

RESULTS

Performance of Depression Screening Protocol Within MAHVI

Success of Implementation

A total of 503 AMI patients from MAHVI were eligible for parallel depression assessment – consisting of the in-hospital depression screening per standardized protocol (MAHVI patients) and the depression data obtained from the concurrent TRIUMPH registry (TRIUMPH-MAHVI patients)- during their index AMI admission. The mean age of this cohort was 58 ± 11 years and 29% was female. Among these patients, more than 1 in 4 patients (26.8%) did not receive routine screening during their hospital stay (Table 1 and Figure 2). Median time from admission to depression screening per protocol (MAHVI group) was 1.0 days (Interquartile Range 0.0–2.0), slightly shorter than the median time from AMI admission to depression assessment within the parallel TRIUMPH registry (TRIUMPH-MAHVI), which was 2.0 days (Interquartile Range 1.0–3.0 days) (P<.0001).

Table 1.

Baseline characteristics of patients who did and who did not received routine depression screening during index AMI hospitalization: data collected from the MAHVI within the TRIUMPH registry.

Received Depression Screening
Yes n=368 (73.2%) No n=135 (26.8%) P Value
Demographics,
 Age, years, mean ± SD 58.1 ± 11.4 59.3 ± 11.1 .27
 Female sex, No. (%) 98 (26.6) 49 (36.3) .04
 Race, No. (%) .62
  White/Caucasian 330 (89.7) 120 (88.9)
  Black/African American 31 (8.4) 14 (10.4)
  Other 7 (1.9) 1 (0.7)
Socioeconomic factors, No. (%)
 Married 239 (65.1) 81 (60.0) .29
 Greater than high school education 224 (61.0) 86 (63.7) .59
 Having no insurance 54 (14.5) 18 (13.3) .74
 Working full- or part-time 2229 (62.7) 79 (58.5) .39
Medical history, No. (%)
 Hypercholesterolemia 176 (47.8) 63 (46.7) .82
 Hypertension 207 (56.3) 85 (63.0) .18
 Peripheral arterial disease 17 (4.6) 8 (5.9) .55
 Diabetes mellitus 73 (19.8) 27 (20.0) .97
 Prior AMI 27 (7.3) 25 (18.5) <.001
 Prior angina 15 (4.1) 14 (10.4) .007
 Prior CABG 29 (7.9) 12 (8.9) .71
 Prior PCI 61 (16.6) 27 (20.0) .37
 Prior stroke 10 (2.7) 6 (4.4) .39
 Chronic renal failure 11 (3.0) 5 (3.7) .78
 Chronic lung disease 19 (5.2) 14 (10.4) .04
 Chronic heart failure 11 (3.0) 3 (2.2) .77
 Cancer (other than skin) 23 (6.3) 7 (5.2) .66
 Smoked within last 30 days 149 (41.2) 60 (44.8) .47
 Body Mass Index, kg/m2, mean ± SD 29.7 ± 5.9 29.1 ± 5.9 .29
Clinical characteristics index AMI admission, No. (%)
 ST-elevation MI, No. (%) 247 (67.1) 64 (47.4) <.001
 Ejection fraction <40%, No. (%) 48 (13.0) 24 (17.8) .18
 Killip class, No. (%) .16
  I (No heart failure) 344 (93.7) 121 (89.6)
  II (Heart failure) 17 (4.6) 9 (6.7)
  III (Pulmonary edema) 4 (1.1) 5 (3.7)
  IV (Cardiogenic shock) 2 (0.5) 0 (0.0)
 Initial systolic blood pressure, mm Hg, mean ± SD 149.1 ± 30.8 145.9 ± 33.8 .33
 Initial heart rate, beats per minute, mean ± SD 79.2 ± 19.0 80.3 ± 22.8 .62
 Hospital length of stay, Median (IQR) 3.0 (3.0, 4.5) 4.0 (3.0, 6.0) .14
In-hospital AMI treatment
 In-hospital PCI 332 (90.2) 100 (74.1) <.001
 Thrombolytic therapy 29 (7.9) 5 (3.7) .10
In-hospital complications, No. (%)
 Bleeding 81 (22.0) 37 (27.4) .21
 Cardiac arrest 3 (0.8) 5 (3.7) .04
 Cardiogenic shock 16 (4.3) 8 (5.9) .46
 CVA 1 (0.3) 0 (0.0) 1.00
 AMI 0 (0.0) 1 (0.7) .27
 Dialysis 1 (0.3) 1 (0.7) .47
Depressive symptoms and history
 PHQ-9 score in TRIUMPH, mean ± SD 4.8 ± 4.8 5.7 ± 4.8 .04
 History of depression requiring treatment, No. (%) 14 (3.8) 6 (4.4) .75
 Currently taking medications or receiving counselling for depression, No. (%) 40 (10.9) 16 (11.9) .76

Abbreviations: TRIUMPH, Translational Research Investigating Underlying disparities in acute Myocardial infarction Patients’ Health Status; SD, standard deviation; AMI, acute myocardial infarction; CABG, coronary artery bypass grafting; PCI, percutaneous coronary interventions; IQR, interquartile range; ACE-inhibitor, angiotensin-converting enzyme inhibitor; CVA, cerebrovascular accident; PHQ, patient health questionnaire.

Compared with MAHVI patients who did receive screening, a greater proportion of non-screened MAHVI patients was female, had a history of AMI, angina, lung disease, and experienced an in-hospital cardiac arrest. These patients were also less likely to have higher PHQ-9 scores within TRIUMPH, to present with an ST-elevation AMI and were less likely to undergo an in-hospital percutaneous coronary intervention (Table 1).

For the majority of non-screened MAHVI patients, no valid reason for non-screening could be found; with a change in the patients’ clinical pathway shortly after admission being the most reported reason as to why patients did not receive screening (Figure 2, left). Other reasons for non-screening included patients that were going for surgery and patients being too sick at the time of screening.

Validity of MAHVI Screening and TRIUMPH-MAHVI Registry Data

Of those that were screened per in-hospital MAHVI depression protocol, 20.4% had a positive PHQ-2 screen (PHQ-2 ≥1), of which 30.1% classified for clinically relevant depressive symptoms, with a PHQ-9 score ≥10 (Figure 2, left).

From the TRIUMPH-MAHVI registry data obtained within the same MAHVI patients (Figure 2, right), it became evident that among those who did not receive clinical depression screening, almost half (47.4%) screened positive on the PHQ-2, and of these patients, more than 1 in 3 patients (35.9%) had clinically relevant depressive symptoms with a PHQ-9 score ≥10.

Table 2 describes the concordance (column percentages are provided) in scoring between the MAHVI screening and TRIUMPH-MAHVI registry data for the PHQ-2 (Table 2a) and PHQ-9 (Table 2b) data. When comparing PHQ-2 data obtained from the MAHVI clinical screening protocol versus the TRIUMPH-MAHVI registry data, the concordance between positive cases (PHQ-2 ≥1) was low-moderate; 35.6% (95% CI = 28.2%–42.9%) of patients who screened positive based on the MAHVI in-patient clinical screening protocol, also had a positive PHQ-2 screen in the TRIUMPH-MAHVI registry data, whereas the concordance for negative cases was much higher (91.7%) (Table 2a). The inter-observer variation was substantial, as expressed by a Kappa statistic of .29, judged to indicate only fair agreement.23 The correlation between the continuous PHQ-2 MAHVI screening and PHQ-2 TRIUMPH-MAHVI registry scores was r=0.43 (P=.01), which was judged to be moderate. The McNemar’s test indicated that there was a significant difference between the two different assessments (MAHVI screening and TRIUMPH-MAHVI registry data) using the PHQ-2 (P<.0001).

Table 2.

Congruency Between (a) PHQ-2 and (b) PHQ-9 MAHVI Screening and TRIUMPH-MAHVI Registry Data.*

(a)
TRIUMPH-MAHVI Registry Data
MAHVI Screening Data PHQ-2=0 PHQ-2≥1 Total n
PHQ-2=0 188 (91.7%) 105 (64.4%) 293
PHQ-2≥1 17 (8.3%) 58 (35.6%) 75
Total n 205 163 368
(b)
TRIUMPH-MAHVI Registry Data
MAHVI Screening Data PHQ-9<10 PHQ-9≥10 Total n
PHQ-9<10 41 (87.2%) 10 (38.5%) 51
PHQ-9≥10 6 (12.8%) 16 (61.5%) 22
Total n 47 26 73
*

Data are represented as No. (%); column percentages are provided.

Abbreviations: MAHVI, Mid America Heart and Vascular Institute; TRIUMPH, Translational Research Investigating Underlying disparities in acute Myocardial infarction Patients’ Health Status, PHQ, patient health questionnaire.

In contrast to the low-moderate concordance between MAHVI and TRIUMPH-MAHVI PHQ-2 data, the agreement between PHQ-9 data from the 2 assessments was 61.5% (95% CI=42.8%–80.2%) for the positive cases (PHQ-9 ≥10) and 87.2% for the negative cases. The Kappa coefficient was .51 and the correlation between continuous PHQ-9 scores from MAHVI clinical screening and TRIUMPH-MAHVI registry data was r=0.54 (P=.01), which were both judged to indicate moderate agreement23. The McNemar’s test indicated that there was no difference between the two different assessments (screening and registry data) using the PHQ-9 (P=.32).

Proportion of Recognized Depressed MAHVI Patients That Were Screened

For 9 in 10 screened MAHVI patients (90.9%) with clinically relevant depressive symptoms (PHQ-9 ≥10), further action (“recognized” depressed patients) was undertaken, meaning that they received a diagnosis of depression in the hospital chart, were assigned a diagnosis of depression at hospital discharge, were prescribed depression treatment, or were referred for further depression management at discharge (Figure 2, bottom left).

Inter-institutional Comparison of MAHVI’s Overall Depression Recognition Rates

Depressive symptoms were assessed among a total of 3,533 AMI patients enrolled from the 23 TRIUMPH centers that did not have a formal screening protocol, in addition to the 503 patients enrolled from MAHVI. Of the total TRIUMPH-ALL patients assessed (n=4,036), 752 (18.6%) had clinically relevant depressive symptoms (PHQ≥10). The average overall depression recognition rate among those with a PHQ score ≥10 across TRIUMPH sites was 31.5%, range between 0% and 62.5% (Figure 3). The overall proportion of depressed patients (including screened and non-screened patients) being recognized within MAHVI was 38.3% and did not significantly differ from the average recognition rate (P=0.31) across sites. Comparisons with site-adjusted means confirmed these findings.

Figure 3. Variation of Proportion of Patients Being Recognized as Depressed in Hospital Chart Across Sites Within the overall TRIUMPH Registry.

Figure 3

Site 1 denotes MAHVI, the site where the formal screening protocol was implemented. The dashed line indicates the averaged depression recognition rate.

Health Care Providers’ Perspectives on MAHVI Depression Screening Protocol

Perceived Barriers to Implementing the Depression Screening Protocol

Responses to the interview questions of nursing and clinical staff working with the MAHVI depression screening protocol were categorized into the most frequently reported barriers preventing the successful completion of the depression screening protocol. Themes included “competing priorities in a short length of stay” (e.g., “Last on priority list”), “protocol and logistic issues” (e.g., “Multiple steps make it difficult”), “concerns about patients’ reactions” (e.g., “Older people get upset”), “lack of ownership/responsibility about process” (e.g., “Wonder if we are stepping on toes of primary care physicians”), and “lack of education and feedback” (e.g., “Vaguely remember initial education”) were the 5-most reported barriers (see Table 3 for a complete overview, by profession, and examples of comments).

Table 3.

Most Reported Barriers by Clinicians, Nurses, and Other Health Professionals Involved in MAHVI’s Routine Depression Screening Protocol.

Theme Examples of Comments
1 Competing priorities especially in an era of short length of stay “Too many things to pay attention to” [resident]
“Last on the priority list” [nurse]
“Fighting against time” [social worker]
2 Protocol logistics/process issues/multiple steps “Order sets not always on chart” [resident]
“Sometimes sticker is missed” [nurse practitioner]
“Multiple steps make it difficult” [nurse]
3 Concerned about patients’ reactions/resistance about screening/consult “Older people get upset” [nurse]
“Patients are overwhelmed already” [nurse]
“I sometimes re-phrase” [nurse]
4 Feel not responsible/lack of ownership about process “Wonder if we are stepping on toes of primary care physicians” [cardiologist]
“I consider the sticker to be documentation” [cardiologist]
“The more the process is taken out of my hands, the better and faster the patient will get the appropriate care” [cardiologist]
5 Education and feedback about protocol “More follow education and feedback to the staff is needed” [cardiologist]
“Vaguely remember initial education” [resident]
“Some nurses are not aware of the protocol” [nurse]

Other more infrequently articulated barriers referred to “role confusion about responsibilities” (e.g., “Should they see a psychiatrist in the hospital, follow up with their primary care physician or psychiatrist or should I give them an antidepressant?” [said by a cardiologist]), “health care providers’ assumptions/biases” (e.g., “Patients have to be motivated” [said by nurse]), or “unfamiliarity/feeling unqualified to work with mental disease” (e.g., “Not sure cardiologists are qualified to treat depression” [said by cardiologist]).

Perceived Opportunities to Improving the Depression Screening Protocol

Nursing and clinical staff were also invited to express their views on how they think the process could be improved and what opportunities there are towards that end. The 5-most reported opportunities referred to providing “more education” (e.g., “Provide more education at start of rotation”, the implementation of an “automatic psychiatry consult” when patients screened positive (e.g., “Make psychiatry referral automatic for positive screens”), “improving the visibility of the protocol” (e.g., “Place order sheet in with progress notes/sticker”, “providing more reinforcement/feedback” to sustain interest in the process (e.g., “Need follow-up education”), and the incorporation of the screening protocol in already existing “chart audits” (e.g., “Consider including the screening as a part of the chart audits for other documentation issues”) (Table 4 for complete overview by profession and examples of comments). Less frequent suggestions for improvement included “having 2 nurses to sign off” (e.g., “Consider having 2 nurses sign off to ensure that it is done” [said by nurse practitioner) and “provide clinical directions for different depressive symptom classifications” (e.g., “Consider better guidance on what to do for different PHQ scores” [said by cardiologist]).

Table 4.

Most Reported Suggestions by Clinicians, Nurses, and Other Health Professionals to Improve MAHVI’s Routine Depression Screening Protocol.

Theme Example of Comments
1 More education “Consider focusing education to those cardiologists that round more often in the hospital” [cardiologist]”
“More education at start of rotation” [resident]
“Follow-up education to everyone involved” [nurse practitioner]
2 Automatic psychiatry consult “Consider automatic psychiatry consult” [cardiologist]
“Make psychiatry referral automatic for positive screens” [resident]
“Why can’t there be an automatic consult; without the extra order of the physician?”[nurse]
3 Improve visibility of protocol “Stickers are small, hard to see” [resident]
“Place order sheet in with progress notes/sticker” [cardiologist]
“Consider placing the stickers on a different color paper so they are easier to find/see” [nurse practitioner]
4 Provide reinforcement/feedback “Need follow-up education” [resident]
“Give more education [nurse]
“Worked at the beginning, but need to re-fresh” [social worker]
5 Include in chart audits “Consider including the screening as a part of the chart audits for other documentation issues” [nurse practitioner]
“Add to core measure sheet” [nurse]

Discussion

In light of the controversy surrounding depression screening and the AHA recommendation that this should be routinely performed in CAD patients,11, 12 this study provides unique real-world insights into the feasibility, validity, consequences, and opportunities for improvement of the AHA advisory recommendations. Moreover, concurrent assessments from a parallel registry allowed for the evaluation of the performance of the depression screening protocol and the comparison of depression recognition rates of a center that used the protocol with 23 other centers that did not employ a formal process of depression screening. As such, this study is the first to report on how routine screening - as proposed in the recent AHA guidelines6 - impacts depression recognition.

Despite the intent to provide routine screening to all AMI patients as part of a quality of care improvement initiative, over 1 in 4 patients were not screened, suggesting only modest feasibility in implementation and demanding further insights into how to further improve routine depression screening. Underscoring the importance of screening, however, we found that if patients were screened per hospital protocol and a positive case was identified, a clinical response to the diagnosis was undertaken in 9 out of 10 cases. The consensus on the ‘positive cases’ – or those with significant depressive symptoms - between MAHVI’s clinically-driven depression recognition protocol and the MAHVI-TRIUMPH-based assessments, was disappointing, especially with the PHQ-2 instrument. We also found that while our 38% depression recognition rate was substantially better than our previously reported rate of 25% 4, MAHVI’s current recognition rates were similar to those of 23 other US centers without a formal screening protocol. Finally, interviews with nursing and clinical staff elucidated that time constraints, failure to pay attention to all steps of the protocol, feeling uncomfortable or not responsible for addressing patients’ mental health, and lack of education and feedback were important barriers to successful completion of the protocol. These clinicians suggested that a more simplified depression screening protocol with the entire PHQ-9, with more follow-up and feedback on performance, might be helpful and could potentially improve the screening protocol.

These findings supplement a large body of research demonstrating that depression following AMI is associated with adverse outcomes, including suboptimal health status outcomes,24, 25 and worse prognosis as compared with non-depressed counterparts.3, 26, 27 It also extends the insights from several intervention trials and clinical care initiatives seeking to address this problem.9, 2831 All of these prior studies apply to CAD patients who were actually identified as having significant depressive symptoms, but these studies were not able to focus on the problem of unrecognized depressive symptoms in real-world practice. Our findings, in a contemporary multi-center AMI population, reveal that almost 7 out of 10 patients with significant depressive symptoms (PHQ-9 score ≥10) are not recognized and are thus not even eligible for treatment of this common and burdensome comorbidity, regardless of the potential impact of treatment on patients’ cardiovascular outcomes. Unfortunately, while the AHA advisory proposes a clinically rational approach to improving recognition, we have identified significant limitations in its implementation at our center and more refinement to define the optimal approach is needed. Thus our data support some of the concerns of critics of the AHA’s recommendations.10, 11

From our real-world experience, we learned 4 important lessons. First, a substantial proportion did not get screening and the parallel TRIUMPH registry data indicated that a lot of these unscreened patients had significant depressive symptoms. Among unscreened patients, there were a greater proportion of women and patients with a prior cardiac history; vulnerable groups of patients at increased risk for having depression.1, 32 Prioritized action will need to go into more complete implementation to improve the recognition of depression among unscreened patients. Second, given that the agreement on the identified ‘positive cases’ was disappointing with the brief 2-item instrument, as compared with the results from the full PHQ-9 instrument, we believe that the full PHQ-9 should be used for depression screening. Standard completion of the PHQ-9 takes minimal additional time once the PHQ-2 is being performed, simplifies the process of screening and appears to be more reproducible and accurate. Additionally, despite the user-friendliness and strong performance characteristics to detect a major depressive disorder, relatively little is known about the performance characteristics of depression screening instruments in specific populations, such as AMI patients.33 The limited concordance between different assessments during patients’ AMI admission – especially when using the PHQ-2 – requires additional research specifically with regards to the variability in results due to its timing and mode of administration in a population wherein the acute condition itself challenges the evaluation of patients’ mood status. Third, studying the site variability on overall depression recognition across 24 U.S. centers illustrates that depression remains widely unrecognized. Given the fact that 9 out of 10 of MAHVI patients who were screened per protocol, were actually also recognized. Given the encouraging promise of collaborative care and stepped care models for depression treatment, as exemplified for patients’ health status in the Bypassing the Blues Trial9 and potentially patients’ prognosis in the Coronary Psychosocial Evaluation Studies (COPES) intervention trial, our data underscores the opportunity to improve the recognition and treatment of depression.31 Fourth, the identified barriers and suggestions raised by the nursing and clinical staff collectively point to a need for better support, follow-up education and feedback, and a simplified process supported by psychiatric or psychological staff. These findings are consistent with prior research in primary care implicating that depression screening protocols whereby staff is sufficiently supported and the process is coordinated by a qualified case manager will be the best way to optimize chances of success in improving outcomes for somatic patients with comorbid depression.34, 35

Our results should be interpreted in the context of several potential limitations. First, because our quality-improvement initiative concerns a single center, our findings may not necessarily translate to other centers’ experiences. Nevertheless, the insights from practitioners on how to improve the process – particularly with regular education and feedback on performance – may assist other institutions in developing more effective protocols. Second, the reported observations, particularly regarding the validity of the screening protocol, may have been influenced by differences in the timing of assessments and changes in patients’ depressive symptoms during the acute recovery from an AMI. While some have argued that depression screening should occur in an outpatient setting, when patients are more stable, a robust literature documents the prognostic significance of depressive symptoms at the time of an AMI3, 2625 and identifying and preventing patients’ risks for adverse outcomes is a cornerstone of AMI care. Finally, we restricted our analysis to the cohort of MAHVI AMI patients who were also enrolled in TRIUMPH and did not assess the performance in those not enrolled.

In conclusion, the real-world evaluation of a 2-step depression screening protocol in AMI patients - consistent with the recent AHA advisory – and its comparison with parallel registry data suggested the following: in those who were screened, the initial screen - using the PHQ-2 instrument - may not be as accurate as one using the full PHQ-9 instrument. Feedback from clinical and nursing staff supported this notion from a more practical standpoint, as noted in the suggestions that a simplified process, with fewer steps, would be preferred. Unfortunately, our experience also documented that a lot of patients were missed by the screening protocol, and centers wishing to implement a systematic depression screening protocol will need to find novel strategies with which to reinforce and sustain such a program in clinical practice. Finally, continuing efforts, both in research and in clinical practice, are needed to further refine strategies that may help to improve detection, care and outcomes of depressed AMI patients. By improving the recognition of significant depressive symptoms, and implementing evolving treatment strategies, an important opportunity to further optimize the care and outcomes of depressed AMI patients may be realized.

Supplementary Material

Supplemental Material

Acknowledgments

Funding Sources

  • The TRIUMPH study was supported by grants from the National Heart, Lung, and Blood Institute Specialized Center of Clinically Oriented Research in Cardiac Dysfunction and Disease (grant no. P50 HL077113).

  • Dr. Smolderen was supported by the Outcomes Research post-doctoral fellowship awarded by the American Heart Association Pharmaceutical Roundtable and David and Stevie Spina.

  • The funding organizations and sponsors of the study had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.

Footnotes

Disclosures

None.

References

  • 1.Thombs BD, Bass EB, Ford DE, Stewart KJ, Tsilidis KK, Patel U, Fauerbach JA, Bush DE, Ziegelstein RC. Prevalence of depression in survivors of acute myocardial infarction. J Gen Intern Med. 2006;21:30–38. doi: 10.1111/j.1525-1497.2005.00269.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Frasure-Smith N, Lesperance F, Gravel G, Masson A, Juneau M, Talajic M, Bourassa MG. Social support, depression, and mortality during the first year after myocardial infarction. Circulation. 2000;101:1919–1924. doi: 10.1161/01.cir.101.16.1919. [DOI] [PubMed] [Google Scholar]
  • 3.Parashar S, Rumsfeld JS, Spertus JA, Reid KJ, Wenger NK, Krumholz HM, Amin A, Weintraub WS, Lichtman J, Dawood N, Vaccarino V. Time course of depression and outcome of myocardial infarction. Arch Intern Med. 2006;166:2035–2043. doi: 10.1001/archinte.166.18.2035. [DOI] [PubMed] [Google Scholar]
  • 4.Amin AA, Jones AM, Nugent K, Rumsfeld JS, Spertus JA. The prevalence of unrecognized depression in patients with acute coronary syndrome. Am Heart J. 2006;152:928–934. doi: 10.1016/j.ahj.2006.05.006. [DOI] [PubMed] [Google Scholar]
  • 5.Smolderen KG, Spertus JA, Reid KJ, Buchanan DM, Krumholz HM, Denollet J, Vaccarino V, Chan PS. The association of cognitive and somatic depressive symptoms with depression recognition and outcomes after myocardial infarction. Circ Cardiovasc Qual Outcomes. 2009;2:328–337. doi: 10.1161/CIRCOUTCOMES.109.868588. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lichtman JH, Bigger JT, Jr, Blumenthal JA, Frasure-Smith N, Kaufmann PG, Lesperance F, Mark DB, Sheps DS, Taylor CB, Froelicher ES. Depression and Coronary Heart Disease. Recommendations for Screening, Referral, and Treatment. A Science Advisory From the American Heart Association Prevention Committee of the Council on Cardiovascular Nursing, Council on Clinical Cardiology, Council on Epidemiology and Prevention, and Interdisciplinary Council on Quality of Care and Outcomes Research. Circulation. 2008;118:1768–1775. doi: 10.1161/CIRCULATIONAHA.108.190769. [DOI] [PubMed] [Google Scholar]
  • 7.Davidson KW, Kupfer DJ, Bigger JT, Califf RM, Carney RM, Coyne JC, Czajkowski SM, Frank E, Frasure-Smith N, Freedland KE, Froelicher ES, Glassman AH, Katon WJ, Kaufmann PG, Kessler RC, Kraemer HC, Krishnan KR, Lesperance F, Rieckmann N, Sheps DS, Suls JM. Assessment and treatment of depression in patients with cardiovascular disease: National Heart, Lung, and Blood Institute Working Group Report. Psychosom Med. 2006;68:645–650. doi: 10.1097/01.psy.0000233233.48738.22. [DOI] [PubMed] [Google Scholar]
  • 8.Barth J, Schumacher M, Herrmann-Lingen C. Depression as a risk factor for mortality in patients with coronary heart disease: a meta-analysis. Psychosom Med. 2004;66:802–813. doi: 10.1097/01.psy.0000146332.53619.b2. [DOI] [PubMed] [Google Scholar]
  • 9.Rollman BL, Belnap BH, LeMenager MS, Mazumdar S, Houck PR, Counihan PJ, Kapoor WN, Schulberg HC, Reynolds CF., 3rd Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial. JAMA. 2009;302:2095–2103. doi: 10.1001/jama.2009.1670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Thombs BD, de Jonge P, Coyne JC, Whooley MA, Frasure-Smith N, Mitchell AJ, Zuidersma M, Eze-Nliam C, Lima BB, Smith CG, Soderlund K, Ziegelstein RC. Depression screening and patient outcomes in cardiovascular care: a systematic review. JAMA. 2008;300:2161–2171. doi: 10.1001/jama.2008.667. [DOI] [PubMed] [Google Scholar]
  • 11.Ziegelstein RC, Thombs BD, Coyne JC, de Jonge P. Routine screening for depression in patients with coronary heart disease never mind. J Am Coll Cardiol. 2009;54:886–890. doi: 10.1016/j.jacc.2009.01.082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Thombs BD, Jewett LR, Knafo R, Coyne JC, Ziegelstein RC. Learning from history: a commentary on the American Heart Association Science Advisory on depression screening. Am Heart J. 2009;158:503–505. doi: 10.1016/j.ahj.2009.07.032. [DOI] [PubMed] [Google Scholar]
  • 13.Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41:1284–1292. doi: 10.1097/01.MLR.0000093487.78664.3C. [DOI] [PubMed] [Google Scholar]
  • 14.Thombs BD, Ziegelstein RC, Whooley MA. Optimizing detection of major depression among patients with coronary artery disease using the patient health questionnaire: data from the heart and soul study. J Gen Intern Med. 2008;23:2014–2017. doi: 10.1007/s11606-008-0802-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Spitzer RL, Williams JB, Kroenke K, Linzer M, deGruy FV, 3rd, Hahn SR, Brody D, Johnson JG. Utility of a new procedure for diagnosing mental disorders in primary care. The PRIME-MD 1000 study. JAMA. 1994;272:1749–1756. [PubMed] [Google Scholar]
  • 16.American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) 4. Washington, DC: American Psychiatric Publishing; 1994. [Google Scholar]
  • 17.Patient Health Questionnaire-9. Pfizer Inc; [Accessed January 21, 2011]. Available at: http://www.phqscreeners.com/pdfs/02_PHQ-9/English.pdf. [Google Scholar]
  • 18.Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22:1596–1602. doi: 10.1007/s11606-007-0333-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. 1999;282:1737–1744. doi: 10.1001/jama.282.18.1737. [DOI] [PubMed] [Google Scholar]
  • 20.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46. [Google Scholar]
  • 22.Durkalski VL, Palesch YY, Lipsitz SR, Rust PF. Analysis of clustered matched-pair data. Stat Med. 2003;22:2417–2428. doi: 10.1002/sim.1438. [DOI] [PubMed] [Google Scholar]
  • 23.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. [PubMed] [Google Scholar]
  • 24.Rumsfeld JS, Havranek E, Masoudi FA, Peterson ED, Jones P, Tooley JF, Krumholz HM, Spertus JA. Depressive symptoms are the strongest predictors of short-term declines in health status in patients with heart failure. J Am Coll Cardiol. 2003;42:1811–1817. doi: 10.1016/j.jacc.2003.07.013. [DOI] [PubMed] [Google Scholar]
  • 25.Ruo B, Rumsfeld JS, Hlatky MA, Liu H, Browner WS, Whooley MA. Depressive symptoms and health-related quality of life: the Heart and Soul Study. JAMA. 2003;290:215–221. doi: 10.1001/jama.290.2.215. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.van Melle JP, de Jonge P, Spijkerman TA, Tijssen JG, Ormel J, van Veldhuisen DJ, van den Brink RH, van den Berg MP. Prognostic association of depression following myocardial infarction with mortality and cardiovascular events: a meta-analysis. Psychosom Med. 2004;66:814–822. doi: 10.1097/01.psy.0000146294.82810.9c. [DOI] [PubMed] [Google Scholar]
  • 27.Frasure-Smith N, Lesperance F, Talajic M. Depression following myocardial infarction. Impact on 6-month survival. JAMA. 1993;270:1819–1825. [PubMed] [Google Scholar]
  • 28.Lesperance F, Frasure-Smith N, Koszycki D, Laliberte MA, van Zyl LT, Baker B, Swenson JR, Ghatavi K, Abramson BL, Dorian P, Guertin MC. Effects of citalopram and interpersonal psychotherapy on depression in patients with coronary artery disease: the Canadian Cardiac Randomized Evaluation of Antidepressant and Psychotherapy Efficacy (CREATE) trial. JAMA. 2007;297:367–379. doi: 10.1001/jama.297.4.367. [DOI] [PubMed] [Google Scholar]
  • 29.Sowden G, Mastromauro CA, Januzzi JL, Fricchione GL, Huffman JC. Detection of depression in cardiac inpatients: Feasibility and results of systematic screening. Am Heart J. 2010;159:780–787. doi: 10.1016/j.ahj.2010.02.029. [DOI] [PubMed] [Google Scholar]
  • 30.Burg MM, Lesperance F, Rieckmann N, Clemow L, Skotzko C, Davidson KW. Treating persistent depressive symptoms in post-ACS patients: the project COPES phase-I randomized controlled trial. Contemp Clin Trials. 2008;29:231–240. doi: 10.1016/j.cct.2007.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Davidson KW, Rieckmann N, Clemow L, Schwartz JE, Shimbo D, Medina V, Albanese G, Kronish I, Hegel M, Burg MM. Enhanced depression care for patients with acute coronary syndrome and persistent depressive symptoms: coronary psychosocial evaluation studies randomized controlled trial. Arch Intern Med. 2010;170:600–608. doi: 10.1001/archinternmed.2010.29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mallik S, Spertus JA, Reid KJ, Krumholz HM, Rumsfeld JS, Weintraub WS, Agarwal P, Santra M, Bidyasar S, Lichtman JH, Wenger NK, Vaccarino V. Depressive symptoms after acute myocardial infarction: evidence for highest rates in younger women. Arch Intern Med. 2006;166:876–883. doi: 10.1001/archinte.166.8.876. [DOI] [PubMed] [Google Scholar]
  • 33.Thombs BD, Magyar-Russell G, Bass EB, Stewart KJ, Tsilidis KK, Bush DE, Fauerbach JA, McCann UD, Ziegelstein RC. Performance characteristics of depression screening instruments in survivors of acute myocardial infarction: review of the evidence. Psychosomatics. 2007;48:185–194. doi: 10.1176/appi.psy.48.3.185. [DOI] [PubMed] [Google Scholar]
  • 34.Gilbody S, Sheldon T, House A. Screening and case-finding instruments for depression: a meta-analysis. CMAJ. 2008;178:997–1003. doi: 10.1503/cmaj.070281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Gilbody S, Bower P, Whitty P. Costs and consequences of enhanced primary care for depression: systematic review of randomised economic evaluations. Br J Psychiatry. 2006;189:297–308. doi: 10.1192/bjp.bp.105.016006. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental Material

RESOURCES