Skip to main content
PMC home page
Implementation Science : IS logoLink to Implementation Science : IS
. 2010 Aug 25;5:66. doi: 10.1186/1748-5908-5-66

The importance of organizational characteristics for improving outcomes in patients with chronic disease: a systematic review of congestive heart failure

Luci K Leykum 1,✉, Michael Parchman 2, Jacqueline Pugh 1, Valerie Lawrence 1, Polly H Noël 1, Reuben R McDaniel Jr 3
PMCID: PMC2936445  PMID: 20735859

Abstract

Background

Despite applications of models of care and organizational or system-level interventions to improve patient outcomes for chronic disease, consistent improvements have not been achieved. This may reflect a mismatch between the interventions and the nature of the settings in which they are attempted. The application of complex adaptive systems (CAS) framework to understand clinical systems and inform efforts to improve them may lead to more successful interventions. We performed a systematic review of interventions to improve outcomes of patients with congestive heart failure (CHF) to examine whether interventions consistent with CAS are more likely to be effective. We then examine differences between interventions that are most effective for improving outcomes for patients with CHF versus previously published data for type 2 diabetes to explore the potential impact of the nature of the disease on the types of interventions that are more likely to be effective.

Methods

We conducted a systematic review of the literature between 1998 and 2008 of organizational interventions to improve care of patients with CHF. Two independent reviewers independently assessed studies that met inclusion criteria to determine whether each reported intervention reflected one or more CAS characteristics. The effectiveness of interventions was rated as either 0 (no effect), 0.5 (mixed effect), or 1.0 (effective) based on the type, number, and significance of reported outcomes. Fisher's exact test was used to examine the association between CAS characteristics and intervention effectiveness. Specific CAS characteristics associated with intervention effectiveness for CHF were contrasted with previously published data for type 2 diabetes.

Results and discussion

Forty-four studies describing 46 interventions met eligibility criteria. All interventions utilized at least one CAS characteristic, and 85% were either 'mixed effect' or 'effective' in terms of outcomes. The number of CAS characteristics present in each intervention was associated with effectiveness (p < 0.001), supporting the idea that interventions consistent with CAS are more likely to be effective. The individual CAS characteristics associated with CHF intervention effectiveness were learning, self-organization, and co-evolution, a finding different from our previously published analysis of interventions for diabetes. We suggest this difference may be related to the degree of uncertainty involved in caring for patients with diabetes versus CHF.

Conclusion

These results suggest that for interventions to be effective, they must be consistent with the CAS nature of clinical systems. The difference in specific CAS characteristics associated with intervention effectiveness for CHF and diabetes suggests that interventions must also take into account attributes of the disease.

Background

Successful management of chronic disease in routine practice is an elusive task [1,2]. As the number of patients with chronic medical illness and the literature regarding their optimal management have grown, attempts have been made to improve their care by implementing new models of care delivery. Implementation of these models involves intervening in specific ways in clinical settings and organizations, and each model has organizational elements that are considered necessary for model implementation. For example, in the chronic care model, delivery system design and information systems are among the elements that are specifically identified [3].

The number of interventions on an organizational level to improve delivery of care and outcomes for patients with chronic disease has grown. However, these care models and organizational strategies have not met with uniform success [4-14]. We believe that an important reason for this variation in outcomes is that interventions do not adequately take into account the characteristics of clinical systems in which patients receive care.

Clinical microsystems are the building blocks of healthcare delivery: the individual clinics, units, or other areas where care is delivered. The complex adaptive system (CAS) framework has been applied to clinical microsystems as a theoretical model for better understanding them [15-22]. This framework suggests that clinical settings are environments in which individuals learn, inter-relate, self-organize, and co-evolve in response to changes in their internal and external environments, in turn shaping those environments [15,19]. Because inputs and outputs in CAS may not be proportional or predictable, interventions that are successful in one setting may not be successful in another. However, evidence suggests that interventions congruent with the CAS framework and characteristics are in general more likely to be effective [21-25].

The insight that clinical settings are CASs is important to the field of implementation research, as it provides guidance for how to approach disseminating research findings into routine care. The CAS framework suggests that local contexts and local interactions between individuals are critical considerations in designing interventions, and that leveraging these may lead to improvements in system performance. However, we wanted to expand on this insight by exploring the possibility that interventions must also be congruent with the nature of the disease or diseases of the patients being cared for. Diseases may mediate the way that interventions influence a patient's care. The level of complexity of different diseases, and the ways that chronic diseases impact patients' lives, varies greatly depending on the type of disease, leading to the need for different approaches. For example, self-monitoring in diabetes may be more difficult than congestive heart failure (CHF) because it may be more difficult to monitor carbohydrates and calories than salt, and involves the pain of fingersticks versus standing on a scale to check weight. Therefore, the most effective patterns of communication between patients with type 2 diabetes and their providers may be different from those for patients with CHF, which in turn may affect the way that providers and staff interact and structure the delivery of care for those groups of patients. Because of this, we believe that for interventions whose goal is to improve the performance of a clinical system to be most effective, they must take into account not only the nature of the system, but also the nature of the disease.

The purpose of this paper is twofold. First, we build on the literature suggesting that interventions consistent with CAS are more likely to be effective [22] by conducting a systematic review of organizational interventions focused on improving care of patients with CHF. This work builds on our previously published systematic review of interventions to improve outcomes for patients with Type 2 diabetes, expanding the data regarding the importance of considering health care settings as CAS beyond a single chronic disease. Like diabetes, CHF is a common disease whose management is broadly relevant. We also chose CHF because of the growing number of studies of interventions to improve CHF outcomes through changing the way that care is delivered in clinical settings.

Our second purpose is to compare the findings of the specific types of interventions that appear to be most effective for CHF and diabetes, to identify differences in the specific CAS characteristics associated with more effective outcomes for each disease. We hypothesized that there are fundamental differences between CHF and diabetes in terms of their impact on patients' day-to-day lives, the behaviors that are required for their successful management, and the structure of care delivery that best supports successful management.

Methods

Systematic review of organizational interventions for CHF

Our methods mirrored those in our previously published systematic review of organizational interventions to improve care of patients with type 2 diabetes [22]. Specific elements are as follows.

Search strategy

We defined organizational interventions as those that explicitly attempt to affect or change organizational structures or processes to implement evidence-based practice. Our search strategy was based on four components: the strategy developed by the Effective Practice and Organization of Care (EPOC) Group of the Cochrane Collaboration [26]; additional search terms for types of organizational interventions not included in EPOC, such as total quality improvement, PDSA (Plan-Do-Study-Act), and practice redesign; additional search terms identified in recent systematic reviews of quality improvement initiatives; and bibliographies and Medline indexing terms of relevant publications.

To focus the search on CHF, we added disease-specific MeSH and text word terms, ran a preliminary search, and reviewed 2,559 titles and abstracts (determined by saturation, until no further new terms were identified), for additional text word terms. The search terms are listed in Additional File 1. We did not search the management literature, nor did we seek out unpublished data. We searched Medline from 1989 through 17 July 2008.

Inclusion and exclusion criteria

We included randomized, quasi-randomized, or controlled clinical trials published in English and conducted in economically developed countries identified as such by the International Monetary Fund or the Organization for Economic Cooperation and Development [27]. We excluded non-English articles, with the rationale that non-English studies comprise only 1% of the EPOC registry. Because our goal was to understand interventions in routine outpatient practice, and to have uniformity in the types of settings included, we excluded studies conducted in nursing home or palliative care settings. To focus on the impact of interventions of process of care or patient outcomes, we excluded studies reporting only the following non-clinical outcomes: patient or provider knowledge; self-efficacy; satisfaction; or other attitudes and beliefs. To minimize heterogeneity among study populations, we excluded studies of cor pulmonale patients exclusively. Finally, to focus on interventions that attempted to improve care by changing the organizations or settings in which care was delivered, we excluded: care pathway interventions without organizational components (e.g., patient or provider education only); work site health interventions; exercise rehabilitation or diet only; and disease prevention or screening only.

Four investigators independently reviewed overlapping groups of differing halves of the citations' titles and abstracts generated by the full literature search to assess agreement regarding potentially eligible publications. If eligibility was uncertain after review of the title and abstract, the full article was reviewed. Eligible studies were independently reviewed and jointly abstracted in detail by teams of two investigators. Disagreements were resolved by consensus of the group of investigators.

Assessment of leveraging of characteristics of CAS

Eligible publications of organizational interventions as defined by the inclusion and exclusion criteria were then independently evaluated by two raters with content expertise in complexity science to assess the extent to which each reported intervention utilized the following four recognized CAS characteristics [15,19,22]: individuals' capacity/ability to learn; the interconnections between individuals; the ability of participants to self-organize; and the tendency of participants to co-evolve. Each intervention was given a point for each of the characteristics present in the study design, for a possible lowest score of 0 and highest score of 4. If a study contained more than one intervention, each was assessed separately. Definitions of each characteristic, along with examples of specific interventions felt to reflect each characteristic, are summarized in Table 1. An example of an intervention felt to include all four CAS characteristics included the addition of a nurse practitioner-led clinic (changing the interconnections between patients and providers), protocol development, and patient education (learning). Patients received individualized feedback (self-organization), and the frequency of visits and type of feedback changed depending on the patient's progress or symptoms (self-organization and co-evolution). An intervention that included only one CAS element was one in which data from a one-time patient survey was used to generate standardized care suggestions embedded within an electronic health record (only assessed as changing interconnections among patients and providers by adding a new contact point). Additional File 2 contains detail of each reported intervention and its CAS characteristic rating. The raters were blinded to the outcomes of the studies. The kappa for these scores between reviewers was 0.84, with conflicts subsequently resolved by discussion.

Table 1.

Characteristics of Complex Adaptive Systems Abstracted

Characteristic Definition Example
Agents who Learn • People can and will process information, as well as react to changes in information • 'Health Buddy' with educational content
• Teach guidelines
Interconnections • Change in pattern of interactions, including non-verbal communication, among agents
• Introducing new agents into the system		 • Letters to patients
• Nurse-led heart failure group clinic
• Clinical reminders
Self-organization • Order is created in a system without explicit hierarchical direction • Flexibility in tailoring intervention to individual patients
Co-evolution • The system and the environment influence each other's development • Individualized 'HOME' treatment plan that changes over time
Open in a new tab

Assessment of reported outcomes

Because of the great heterogeneity among reported outcomes, we did not use effect size as the outcome variable. Instead, we used a rating scale to assess the effectiveness of the intervention. The outcomes of each study were rated by two independent reviewers on a scale of 0 (no effect), 0.5 (mixed results), and 1 (intervention effective) based on the type (process versus outcome), number, and statistical significance of outcomes reported. Table 2 summarizes the criteria for each rating category, as well as provides examples of outcomes felt to reflect each category of effectiveness. Reviewers were blinded to study intervention, author, and title of manuscript, and one outcome rater was different from the intervention raters. The kappa for these scores was 0.86 with conflicts resolved by discussion.

Table 2.

Criteria used to classify intervention effectiveness, with examples of outcomes reflecting each level of effectiveness

Outcome Score Criteria Example
0 • No statistically differences between control and intervention groups, or between intervention and baseline, on process or outcome measures • No difference in adherence, NYHA class, # visits, or # hospitalizations
0.5 • Trends without significance
• Mixed outcomes (significant improvement in minority of measures)
• Significant improvement compared with baseline, but not with control		 • Significant improvement in adherence, trends for CHF-related admission and total number of hospital days
1 • Statistically significant improvement:
-all outcomes if ≤3 endpoints
-majority of outcomes if > 3 endpoints		 • Significant reduction in all-cause mortality and all-cause admissions at 3 months
Open in a new tab

Statistical analysis of association between CAS characteristics and intervention effectiveness

We used Fisher's exact test to test the significance of the relationship between total number of characteristics of CASs utilized in an intervention and the strength of outcomes reported, as well as between each individual characteristic and the strength of outcomes. Because a mismatch between the unit of allocation and analysis may bias a study towards positive results, we divided studies into two groups based on whether a unit of analysis error was present. A second analysis using Fisher's exact test was performed including only those studies that did not contain a unit of analysis error. Finally, a third analysis using logistic regression was performed to weight studies based on both sample size and duration of intervention, with outcome rating as the independent variable, and CAS score, sample size, and intervention duration as independent predictors.

All statistical analysis was performed using Stata 9.2 (College Station, Texas).

Analysis contrasting CAS characteristics associated with effectiveness for CHF and diabetes

The relationship between each individual CAS characteristic utilized in an intervention and strength of reported outcomes was assessed, using Fisher's exact test with and without intervention with unit of analysis error, as well as logistic regression. The individual characteristics associated with intervention effectiveness for CHF were compared with those previously reported for diabetes [22].

Results

Systematic review of organizational interventions for CHF

Our search identified 2,510 publications for CHF. Of those, 112 were potentially eligible based on review of title and abstract, and were fully reviewed by a team of two investigators. Based on this review, 44 articles were eligible for inclusion [28-71]. Figure 1 details the numbers of articles eligible and ineligible at each stage of review. Seven studies had unit of allocation error, in which the unit of randomization was either the provider or clinic, but the unit of analysis was the patient. Two studies reported two distinct interventions [50,59]; each intervention was analyzed separately for a total of 46 interventions across 44 studies. The CAS scores for each study are contained in Additional File 2.

Figure 1.

Figure 1

Open in a new tab

Articles eligible and ineligible at each stage of review.

Only 13 interventions out of 46 (28%) received a rating of 1 for outcomes through demonstrating significant improvement in most or all reported outcomes; all others were felt to have mixed or negative results. All interventions incorporated at least one CAS characteristic, with 41% utilizing two CAS characteristics, 28% utilizing three, and 24% utilizing four. Ninety-three percent of reported interventions were judged to change the pattern of interconnections between individuals, typically through the introduction of a new person such as a case manager. Thirty-five interventions (76%) impacted learning; sixteen (35%) allowed self-organization of study participants; and in thirty (65%), the intervention evolved over time based on factors such as the patient's status or symptoms.

The association between number of CAS characteristics leveraged in an intervention and its effectiveness is shown in Table 3. None of the studies utilizing only one or two characteristics demonstrated significant improvement in most or all outcomes. All studies utilizing three or four CAS characteristics demonstrated at least mixed results, and ninety-one percent of those using all four CAS characteristics received the highest rating of effectiveness based on having demonstrated statistically significant improvement in most or all outcomes. This association between number of CAS characteristics utilized and the effectiveness of an intervention was significant (p < 0.001), and remained so after studies with unit of allocation error were excluded (p < 0.001). This association also remained significant in logistic regression analysis, adjusting for sample size and intervention duration (p < 0.001).

Table 3.

Distribution of CAS and intervention effectiveness for CHF studies

Total CAS
Score		 Rating of Intervention Effectiveness Total No. Studies with each CAS Score
0 0.5 1
1 1 2 0 3
2 6 13 0 19
3 0 10 3 13
4 0 1 10 11
Total 7 26 13 46
Open in a new tab

P < 0.001

Three individual CAS characteristics were associated with CHF intervention effectiveness: learning (p = 0.05), self-organization (p < 0.001), and co-evolution (p = 0.002). These associations remained significant after excluding studies with unit of analysis error. The association between interconnections and effectiveness was not significant (p = 0.72). The detail of analysis for individual CAS characteristics and intervention effectiveness is shown in Additional File 3.

Analysis contrasting CHF and diabetes

A systematic review of interventions to improve care of patients with diabetes through changing the way health care organizations delivered care was previously published. The methods for that review were identical to those reported here with the exception of the disease-specific search terms used and 32 studies were identified. In that review, the presence of CAS characteristics and effectiveness of interventions were also assessed, and the association between the two was performed with Fisher's exact test, with and without studies with unit of allocation error. We used those data to compare the differences between the individual CAS characteristics associated with intervention effectiveness for CHF and diabetes.

The association of individual CAS characteristics with intervention effectiveness between studies of organizational interventions for patients with type 2 diabetes, and those with CHF is shown in Table 4. Only the CAS characteristic 'co-evolution' was significantly associated with intervention effectiveness in both diabetes and CHF. Learning and self-organization were associated intervention effectiveness for CHF, and interconnections were associated with intervention effectiveness for diabetes.

Table 4.

Association between individual CAS characteristic and intervention effectiveness for type 2 diabetes [22] and CHF

CAS characteristic type 2 diabetes22 CHF
Proportion of studies utilizing Association with effectiveness Proportion of studies utilizing Association with effectiveness
Learning 80% p = 0.07 76% p = 0.05
Interconnections 77% p = 0.05 93% P = 0.72
Self-organization 27% p = 0.58 35% p < 0.001
Co-evolution 70% p = 0.003 65% p = 0.002
Open in a new tab

Discussion

This systematic review of interventions to improve outcomes of patients with CHF through changing care delivery processes in clinical settings is consistent with literature reporting that interventions that attempt to improve patient outcomes through impacting the organizations in which care is delivered have mixed results [2,4-6]. In this review, the majority (72%) of interventions were not effective in significantly improving outcomes. Our analysis of these interventions through the lens of a CAS perspective again demonstrates that interventions consistent with a CAS perspective are more likely to be effective in improving outcomes. We interpret this as providing further evidence that the clinical settings are CASs. For interventions to be effective in improving patient outcomes, they must take this into account.

The difference in the individual CAS characteristics associated with intervention effectiveness for patients with type 2 diabetes and CHF brings a new perspective to the consideration of clinical settings as CASs. Specifically, we believe that when implementing interventions to improve outcomes of patients with chronic disease, not only must the characteristics of the organization be considered, but so must the characteristics of the disease and its treatment. Interventions must be appropriately matched to the level of complexity of not only the organization, but also of the disease, as disease and treatment characteristics may influence what interventions are more likely to be effective.

The interplay of differences between chronic diseases within the context of CAS clinical systems will affect which approaches are more or less likely to be effective for patients with a specific disease. The level of uncertainty inherent in diseases and their treatments may be an important contributor to these differences. To illustrate this point, Table 5 outlines how potential differences between type 2 diabetes and CHF in terms of uncertainty may influence the CAS characteristics that were associated with intervention effectiveness for each disease. For example, the myriad combinations of lifestyle and medication approaches to managing type 2 diabetes may be more complex and nuanced than those for CHF, and the symptoms of worsening glycemic control may be more subtle and insidious than worsening volume status, leading to greater uncertainty in the management of diabetes relative to CHF [72]. This greater uncertainty may influence the effectiveness of CAS characteristics in interventions, or the effectiveness of combinations of characteristics. Because one way that individuals can navigate uncertainty is through relationships, interconnections may be particularly important with increasing uncertainty.

Table 5.

Potential differences between type 2 diabetes and CHF with regards to uncertainty, and how they might influence CAS characteristic effectiveness

CAS characteristic type 2 diabetes CHF
Learning Treatment is nuanced and complex, making efforts to improve outcomes through learning more difficult. Less uncertainty in treatment guidelines allows more prescriptive, algorithmic approaches to management that may be more easily learned.
Interconnections Greater degree of uncertainty in terms of symptoms and management, leading to greater reliance on interconnections to manage disease. Lesser degree of uncertainty in terms of symptoms and management may lead interventions focused on interconnections less effective.
Self-organization Greater uncertainty in management and symptoms of exacerbation may make efforts to self-organize more difficult. Less uncertainty regarding management and symptoms of exacerbation may make efforts to self-organize more effective.
Co-evolution Course and symptoms evolve over time in unique trajectory. Course and symptoms evolve over time in unique trajectory.
Open in a new tab

However, for both CHF and type 2 diabetes, patients have a chronic disease that is changing over time, and the recognition of the dynamic nature of the evolution of disease in interventions is important. Also in both cases, the fact that the clinical settings in which patients receive care are CASs is an important contextual consideration, as no two are exactly alike.

The implication of these findings for implementation research whose goal is to change organizations to improve care of patients with chronic disease is that we must shift our focus in intervention design. While considerations such as cost, ease of implementation, and level of disruption to the clinical setting are important, the levels of complexity of the organization and the disease are even more important. Intervention design for chronic disease requires a greater level of nuance, individualization, flexibility, and assessment over time. Specific implications of this insight include the need to pay attention to or explicitly change the relationships between individuals as a strategy to improve outcomes, the importance of allowing 'local' input or control into the intervention design, and the need to provide feedback regarding the impact of the intervention and the possibility to change the intervention based on this feedback.

This study has several limitations. The first is the relatively small number of studies of organizational interventions. However, despite these small numbers, the associations found are significant ones. A more overarching limitation is the difficulty in applying the lens of a CASs perspective to traditional intervention design, with specific regard to assigning scores regarding CAS characteristics retrospectively. Our method of independent review of interventions and results using groups of separate reviewers was intended to offset this methodological limitation, and our kappa scores suggest that reviewers did have a consistent ability to make these retrospective assessments.

Other limitations include the possibility of publication bias, which may have led either to negative studies not being published, or to the interventions being described in less detail, making assessment of CAS characteristics more difficult. Negative studies are well represented in the distribution of outcomes in the included studies, and the inter-rater consistency suggests that sufficient information was available to make an assessment. All raters are from the same institution, and the possibility of bias in terms of the CAS characteristics on which we focused is possible, but made less likely by our use of characteristics consistently recognized as key in the CAS literature.

Finally, this analysis is limited to studies of patients with type 2 diabetes and CHF. The applicability of our findings to other chronic diseases, or to acute disease processes, has yet to be demonstrated. However, we believe that the strength of our results across a combined 76 examples of interventions (46 CHF and 32 diabetes) for two distinct chronic diseases is at least suggestive of the range of application of the CAS framework in clinical settings.

Summary

The significant association between CAS characteristics and effectiveness of reported outcomes for patients with CHF builds on the idea that for interventions to be effective, they must be consistent with the CAS nature of the clinical systems in which they are applied. However, the fact that different CAS characteristics are associated with intervention effectiveness for CHF and type 2 diabetes suggests that the nature of the diseases being treated may mediate the intervention effectiveness. We suggest that the level of uncertainty associated with a disease and its treatment may be an important characteristic that must be considered in designing interventions to lead to the greatest improvement in patient outcomes.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

LKL conceived this analysis using the database conceived by VL, PN, and JP, rated studies, performed preliminary statistical analysis, interpreted findings, and drafted the manuscript. MP rated studies, interpreted findings, and helped to draft the manuscript. JP participated in the design of the study and helped to draft the manuscript. VL conceived the systematic review and database, rated studies, and helped to draft the manuscript. PN conceived the systematic review and database and helped to draft the manuscript. RMcD participated in the design of the study, provided theoretical expertise, interpreted findings, and helped to draft the manuscript. All authors have read and approved the final manuscript.

Supplementary Material

Additional file 1

Search strategy to identify studies of organizational interventions to improve outcomes for patients with congestive heart failure. Search completed 17 July 2008. Additional file 1 is a word document detailing the keywords and number of results identified by each keyword used in our search strategy.

Click here for file (226.5KB, DOC)
Additional file 2

Summary of eligible studies of organizational interventions on outcomes of patients with congestive heart failure. Additional file 2 is a word document listing each eligible study, along with details regarding sample size, our ratings of its intervention and the number of CAS characteristics leveraged, follow-up duration, and presence or absence of unit of analysis error.

Click here for file (103KB, DOCX)
Additional file 3

Detail of analysis for individual CAS characteristics and intervention effectiveness for CHF. Additional file 3 is a table in word document format that lists each CAS characteristic, the number of studies in which the characteristic was utilized, and the range of intervention effectiveness scores for those studies.

Click here for file (63.2KB, DOCX)

Contributor Information

Luci K Leykum, Email: leykum@uthscsa.edu.

Michael Parchman, Email: parchman@uthscsa.edu.

Jacqueline Pugh, Email: jacqueline.pugh@va.gov.

Valerie Lawrence, Email: Vlawrence@uthscsa.edu.

Polly H Noël, Email: Noel@uthscsa.edu.

Reuben R McDaniel, Jr, Email: reuben.mcdaniel@mccombs.utexas.edu.

Acknowledgements

The research reported here was supported by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service (TRX # 01-091 & REA 05-129). Investigator salary support is provided through this funding, and through the South Texas Veterans Health Care System. Dr. McDaniel receives support from the IC2 Institute of the University of Texas at Austin. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.

References

  1. Andrade SE, Gurwitz JH, Field TS, Kelleher M, Majumdar SR, Reed G, Black R. Hypertension management: the care gap between clinical guidelines and clinical practice. Am J Managed Care. 2004;10(7):481–6. [PubMed] [Google Scholar]
  2. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282(15):1458–65. doi: 10.1001/jama.282.15.1458. [DOI] [PubMed] [Google Scholar]
  3. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA. 2002;288(15):1909–14. doi: 10.1001/jama.288.15.1909. [DOI] [PubMed] [Google Scholar]
  4. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):iii–iv. doi: 10.3310/hta8060. 1-72. [DOI] [PubMed] [Google Scholar]
  5. Solberg LI, Kottke TE, Brekke ML, Magnan S, Davidson G, Calomeni CA, Conn SA. Failure of a continuous quality improvement intervention to increase the delivery of preventive services. A randomized trial. Eff Clin Pract. 2000;3(3):105–15. [PubMed] [Google Scholar]
  6. Warsi A, Wang PS, LaValley MP, Avorn J, Solomon DH. Self-management education programs in chronic disease: a systematic review and methodological critique of the literature. Arch Intern Med. 2004;164(15):1641–9. doi: 10.1001/archinte.164.15.1641. [DOI] [PubMed] [Google Scholar]
  7. Weingarten SR, Henning JM, Badamgarov E, Knight K, Hasselbad V, Gano A, Ofman JJ. Interventions used in disease management programmes for patients with chronic illness - which ones work? Meta-analysis of published reports. BMJ. 2002;325(7370):925. doi: 10.1136/bmj.325.7370.925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Zhang NJ, Wan TT, Rossiter LF, Murawski MM, Patel UB. Evaluation of chronic disease management on outcomes and cost of care for Medicaid beneficiaries. Health Policy. 2008;86(2-3):345–54. doi: 10.1016/j.healthpol.2007.11.011. [DOI] [PubMed] [Google Scholar]
  9. Windham BG, Bennett RG, Gottlieb S. Care management interventions for older patients with congestive heart failure. Am J Managed Care. 2003;9(6):447–59. [PubMed] [Google Scholar]
  10. Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA. 2009;301(6):603–18. doi: 10.1001/jama.2009.126. [DOI] [PubMed] [Google Scholar]
  11. Green BB, Cook AJ, Ralston JD, Fishman PA, Catz SL, Carlson J, Carrell D, Tyll L, Larson EB, Thompson RS. Effectiveness of home blood pressure monitoring, web communication, and pharmacist care on hypertension control: a randomized controlled trial. JAMA. 2008;299(24):2857–67. doi: 10.1001/jama.299.24.2857. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Gonseth J, Buallar-Castillon P, Banegas JR, Rodriquez-Artalajo F. The effectiveness of disease management programmes in reducing hospital readmission in older patients with heart failure: a systematic review and meta-analysis of published reports. Eur Heart J. 2004;25(18):1570–95. doi: 10.1016/j.ehj.2004.04.022. [DOI] [PubMed] [Google Scholar]
  13. Niesink A, Trappenburg JC, DeWeert-van Oene GH, Lammers JW, Verheij TJ, Schrijvers AJ. Systematic review of the effects of chronic disease management on quality-of-life in people with chronic obstructive pulmonary disease. Respiratory Med. 2007;101(11):2233–9. doi: 10.1016/j.rmed.2007.07.017. [DOI] [PubMed] [Google Scholar]
  14. Bosch M, van der Weijden T, Drol R, Schers H, Akkermans R, Neissen L, Wensing M. Structured chronic primary care and health-related quality of life in chronic heart failure. BMC Health Services Res. 2009;9:104. doi: 10.1186/1472-6963-9-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Plsek PE, Greenhalgh T. Complexity science: The challenge of complexity in health care. Bmj. 2001;323(7313):625–8. doi: 10.1136/bmj.323.7313.625. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Miller WL, McDaniel RR Jr, Crabtree BF, Stange KC. Practice jazz: understanding variation in family practices using complexity science. J Fam Pract. 2001;50(10):872–8. [PubMed] [Google Scholar]
  17. Stroebel CK, McDaniel RR Jr, Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005;31(8):438–46. doi: 10.1016/s1553-7250(05)31057-9. [DOI] [PubMed] [Google Scholar]
  18. Plsek P. Redesigning Health Care with Insights from the Science of Complex Adaptive Systems. Crossing the Quality Chasm: A New Heath System for the 21st Century: National Academy of Sciences. 2000. pp. 309–322.
  19. Cilliers P. Complexity and Postmodernism: Understanding Complex Systems. New York, NY: Routledge; 1998. [Google Scholar]
  20. Maguire S, McKelvey B, Mirabeau L, Oztas N. The SAGE Handbook of Organization Studies, SAGE Publications. 2. 2006. Complexity Science and Organization Studies; pp. 165–214. [Google Scholar]
  21. Litaker D, Tomolo A, Liberatore V, Stange K, Aron D. Using Complexity Theory to Build Interventions that Improve Health Care Delivery in Primary Care. J Gen Intern Med. 2006;21:S30–4. doi: 10.1007/s11606-006-0272-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Leykum LK, Pugh J, Lawrence V, Parchman M, Noel PH, Cornell J, McDaniel RR. Organizational interventions employing principles of complexity science have improved outcomes for patients with type 2 diabetes. Imp Sci. 2007;2:8. doi: 10.1186/1748-5908-2-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Join Comm J Qual and Pt Safety. 2005;31(8):438–46. doi: 10.1016/s1553-7250(05)31057-9. [DOI] [PubMed] [Google Scholar]
  24. Hibbard JH, Greene J, Tusler M. Improving the outcomes of disease management by tailoring care to the patient's level of activation. 2009. pp. 353–60. [PubMed]
  25. Christensen J, Griffiths KM, Gulliver A, Clack D, Kljakovic M, Wells L. Models in the delivery of depression care: a systematic review of randomized and controlled intervention trials. BMC family practice. 2008;9:25. doi: 10.1186/1471-2296-9-25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Shojania KG, Ranji SR, Shaw LK, Charo LN, Lai JC, Rushakoff RJ, McDonald KM, Owens DK. In: Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Technical Review 9 (Contract No. 290-02-0017 to the Stanford University-UCSF Evidence-based Practice Center). AHRQ Publication No. 04-0051-2. Shojania KG, McDonald KM, Wachter RM, Owens DK, editor. Vol. 2. Rockville, MD: Agency for Healthcare Research and Quality; 2004. Diabetes Mellitus Care. [PubMed] [Google Scholar]
  27. NationMaster - Encyclopedia: Developed countries. http://www.nationmaster.com/encyclopedia/Developed-countries accessed on 11/20/2003.
  28. Rich MW, Beckham V, Wittenberg C, Leven CL, Freedland KE, Carney RM. A multidisciplinary intervention to prevent the readmission of elderly patients with congestive heart failure. N Engl J Med. 1995;333(18):1190–7. doi: 10.1056/NEJM199511023331806. [DOI] [PubMed] [Google Scholar]
  29. Ekman I, Andersson B, Ehnfors M, Matejka G, Persson B, Fagerberg B. Feasibility of a nurse-monitored, outpatient-care programme for elderly patients with moderate-to-severe, chronic heart failure. Eur Heart J. 1998;19(8):1254–60. doi: 10.1053/euhj.1998.1095. [DOI] [PubMed] [Google Scholar]
  30. Cline CM, Israelsson BY, Willenheimer RB, Broms K, Erhardt LR. Cost effective management programme for heart failure reduces hospitalisation. Heart. 1998;80(5):442–6. doi: 10.1136/hrt.80.5.442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Jaarsma T, Halfens R, Huijer Abu-Saad H, Dracup K, Gorgels T, van Ree J, Stappers J. Effects of education and support on self-care and resource utilization in patients with heart failure. Eur Heart J. 1999;20(9):673–82. doi: 10.1053/euhj.1998.1341. [DOI] [PubMed] [Google Scholar]
  32. Stewart S, Vandenbroek AJ, Pearson S, Horowitz JD. Prolonged beneficial effects of a home-based intervention on unplanned readmissions and mortaility among patients with congestive heart failure. Archives of Internal Medicine. 1999;159(3):257–61. doi: 10.1001/archinte.159.3.257. [DOI] [PubMed] [Google Scholar]
  33. Gattis WA, Hasselblad V, Whellan DJ, O'Connor CM. Reduction in heart failure events by the addition of a clinical pharmacist to the heart failure management team: results of the Pharmacist in Heart Failure Assessment Recommendation and Monitoring (PHARM) Study. Arch Intern Med. 1999;159(16):1939–45. doi: 10.1001/archinte.159.16.1939. [DOI] [PubMed] [Google Scholar]
  34. Stewart S, Marley JE, Horowitz JD. Effects of a multidisciplinary, home-based intervention on unplanned readmissions and survival among patients with chronic congestive heart failure: a randomised controlled study. Lancet. 1999;354(9184):1077–83. doi: 10.1016/S0140-6736(99)03428-5. [DOI] [PubMed] [Google Scholar]
  35. de Lusignan S, Wells A, Johnson P, Meredith K, Leatham E. Compliance and effectiveness of one year's home telemonitoring. The report of a pilot study of patients with chronic heart failure. European Journal of Heart Failure. 2001;3(6):723–30. doi: 10.1016/S1388-9842(01)00190-8. [DOI] [PubMed] [Google Scholar]
  36. Pugh LC, Havens DS, Xie S, Robinson JM, Blaha C. Case management for elderly persons with heart failure: the quality of life and cost outcomes. MEDSURG Nursing. 2001;10(2):71–8. [Google Scholar]
  37. Jerant AF, Azari R, Nesbitt TS. Reducing the cost of frequent hospital admissions for congestive heart failure: a randomized trial of a home telecare intervention. Medical Care. 2001;39(11):1234–45. doi: 10.1097/00005650-200111000-00010. [DOI] [PubMed] [Google Scholar]
  38. Blue L, Lang E, McMurray JJ, Davie AP, McDonagh TA, Murdoch DR, Petrie MC, Connolly E, Norrie J, Round CE, Ford I, Morrison CE. Randomised controlled trial of specialist nurse intervention in heart failure. BMJ. 2001;323(7315):715–8. doi: 10.1136/bmj.323.7315.715. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. McDonald K, Ledwidge M, Cahill J, Quigley P, Maurer B, Travers B, Ryder M, Kieran E, Timmons L, Ryan E. Heart failure management: multidisciplinary care has intrinsic benefit above the optimization of medical care. Journal of Cardiac Failure. 2002;8(3):142–8. doi: 10.1054/jcaf.2002.124340. [DOI] [PubMed] [Google Scholar]
  40. Doughty RN, Wright SP, Pearl A, Walsh HJ, Muncaster S, Whalley GA, Gamble G, Sharpe N. Randomized, controlled trial of integrated heart failure management: The Auckland Heart Failure Management Study. European Heart Journal. 2002;23(2):139–46. doi: 10.1053/euhj.2001.2712. [DOI] [PubMed] [Google Scholar]
  41. Kasper EK, Gerstenblith G, Hefter G, Van Anden E, Brinker JA, Thiemann DR, Terrin M, Forman S, Gottlieb SH. A randomized trial of the efficacy of multidisciplinary care in heart failure outpatients at high risk of hospital readmission. Journal of the American College of Cardiology. 2002;39(3):471–80. doi: 10.1016/S0735-1097(01)01761-2. [DOI] [PubMed] [Google Scholar]
  42. Harrison MB, Browne GB, Roberts J, Tugwell P, Gafni A, Graham ID. Quality of life of individuals with heart failure: a randomized trial of the effectiveness of two models of hospital-to-home transition. Med Care. 2002;40(4):271–82. doi: 10.1097/00005650-200204000-00003. [DOI] [PubMed] [Google Scholar]
  43. Capomolla S, Febo O, Ceresa M, Caporotondi A, Guazzotti G, La Rovere M, Ferrari M, Lenta F, Baldin S, Vaccarini C, Gnemmi M, Pinna G, Maestri R, Abelli P, Verdirosi S, Cobelli F. Cost/utility ratio in chronic heart failure: comparison between heart failure management program delivered by day-hospital and usual care. J Am Coll Cardiol. 2002;40(7):1259–66. doi: 10.1016/S0735-1097(02)02140-X. [DOI] [PubMed] [Google Scholar]
  44. Riegel B, Carlson B, Kopp Z, LePetri B, Glaser D, Unger A. Effect of a standardized nurse case-management telephone intervention on resource use in patients with chronic heart failure. Arch Intern Med. 2002;162(6):705–12. doi: 10.1001/archinte.162.6.705. [DOI] [PubMed] [Google Scholar]
  45. Bouvy ML, Heerdink ER, Urquhart J, Grobbee DE, Hoes AW, Leufkens HG, Hoe AW. Effect of a pharmacist-led intervention on diuretic compliance in heart failure patients: a randomized controlled study.[erratum appears in J Card Fail. 2003 Dec;9(6):481 Note: Hoe Arno W [corrected to Hoes Arno W]] Journal of Cardiac Failure. 2003;9(5):404–11. doi: 10.1054/S1071-9164(03)00130-1. [DOI] [PubMed] [Google Scholar]
  46. Bucci C, Jackevicius C, McFarlane K, Liu P. Pharmacist's contribution in a heart function clinic: patient perception and medication appropriateness. Canadian Journal of Cardiology. 2003;19(4):391–6. [PubMed] [Google Scholar]
  47. Stromberg A, Martensson J, Fridlund B, Levin LA, Karlsson JE, Dahlstrom U. Nurse-led heart failure clinics improve survival and self-care behaviour in patients with heart failure: results from a prospective, randomised trial. European Heart Journal. 2003;24(11):1014–23. doi: 10.1016/S0195-668X(03)00112-X. [DOI] [PubMed] [Google Scholar]
  48. LaFramboise LM, Todero CM, Zimmerman L, Agrawal S. Comparison of Health Buddy with traditional approaches to heart failure management. Family and Community Health. 2003;26(4):275–88. doi: 10.1097/00003727-200310000-00005. [DOI] [PubMed] [Google Scholar]
  49. Barnason S, Zimmerman L, Nieveen J, Schmaderer M, Carranza B, Reilly S. Impact of a home communication intervention for coronary artery bypass graft patients with ischemic heart failure on self-efficacy, coronary disease risk factor modification and functioning. Heart and Lung: Journal of Acute and Critical Care. 2003;32(3):147–58. doi: 10.1016/S0147-9563(03)00036-0. [DOI] [PubMed] [Google Scholar]
  50. Ansari M, Shlipak MG, Heidenreich PA, Van Ostaeyen D, Pohl EC, Browner WS, Massie BM. Improving guideline adherence: a randomized trial evaluating strategies to increase beta-blocker use in heart failure. Circulation. 2003;107(22):2799–804. doi: 10.1161/01.CIR.0000070952.08969.5B. [DOI] [PubMed] [Google Scholar]
  51. Goldberg LR, Piette JD, Walsh MN, Frank TA, Jaski BE, Smith AL, Rodriguez R, Mancini DM, Hopton LA, Orav EJ, Loh E. WHARF Investigators. Randomized trial of a daily electronic home monitoring system in patients with advanced heart failure: the Weight Monitoring in Heart Failure (WHARF) trial. American Heart Journal. 2003;146(4):705–12. doi: 10.1016/S0002-8703(03)00393-4. [DOI] [PubMed] [Google Scholar]
  52. Laramee AS, Levinsky SK, Sargent J, Ross R, Callas P. Case management in a heterogeneous congestive heart failure population: a randomized controlled trial. Archives of Internal Medicine. 2003;163(7):809–17. doi: 10.1001/archinte.163.7.809. [DOI] [PubMed] [Google Scholar]
  53. Atienza F, Anguita M, Martinez-Alzamora N, Osca J, Ojeda S, Almenar L, Ridocci F, Valles F, de Velasco JA. PRICE Study Group. Multicenter randomized trial of a comprehensive hospital discharge and outpatient heart failure management program. European Journal of Heart Failure. 2004;6(5):643–52. doi: 10.1016/j.ejheart.2003.11.023. [DOI] [PubMed] [Google Scholar]
  54. Tsuyuki RT, Fradette M, Johnson JA, Bungard TJ, Eurich DT, Ashton T, Gordon W, Ikuta R, Kornder J, Mackay E, Manyari D, O'Reilly K, Semchuk W. A multicenter disease management program for hospitalized patients with heart failure. J Card Fail. 2004;10(6):473–80. doi: 10.1016/j.cardfail.2004.02.005. [DOI] [PubMed] [Google Scholar]
  55. Feldman PH, Peng TR, Murtaugh CM, Kelleher C, Donelson SM, McCann ME, Putnam ME. A randomized intervention to improve heart failure outcomes in community-based home health care. Home Health Care Services Quarterly. 2004;23(1):1–23. doi: 10.1300/J027v23n01_01. [DOI] [PubMed] [Google Scholar]
  56. Kimmelstiel C, Levine D, Perry K, Patel AR, Sadaniantz A, Gorham N, Cunnie M, Duggan L, Cotter L, Shea-Albright P, Poppas A, LaBresh K, Forman D, Brill D, Rand W, Gregory D, Udelson JE, Lorell B, Konstam V, Furlong K, Konstam MA. Randomized, controlled evaluation of short- and long-term benefits of heart failure disease management within a diverse privider network: the SPAC-CHF trial. Circulation. 2004;110(11):1450–5. doi: 10.1161/01.CIR.0000141562.22216.00. [DOI] [PubMed] [Google Scholar]
  57. Subramanian U, Fihn SD, Weinberger M, Plue L, Smith FE, Udris EM, McDonell MB, Eckert GJ, Temkit M, Zhou XH, Chen L, Tierney WM. A controlled trial of including symptom data in computer-based care suggestions for managing patients with chronic heart failure. American Journal of Medicine. 2004;116(6):375–84. doi: 10.1016/j.amjmed.2003.11.021. [DOI] [PubMed] [Google Scholar]
  58. Bruggink-Andre de la Porte PW, Lok DJ, van Wijngaarden J, Cornel JH, Pruijsers-Lamers D, van Veldhuisen DJ, Hoes AW. Heart failure programmes in countries with a primary care-based health care system. Are additional trials necessary? Design of the DEAL-HF study. European Journal of Heart Failure. 2005;7(5):910–20. doi: 10.1016/j.ejheart.2004.11.004. [DOI] [PubMed] [Google Scholar]
  59. Murtaugh CM, Pezzin LE, McDonald MV, Feldman PH, Peng TR. Just-in-time evidence based e-mail 'reminders' in home health care: impact on nurse practices. Health Services Research. 2005;40(3):849–64. doi: 10.1111/j.1475-6773.2005.00388.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Caldwell MA, Peters KJ, Dracup KA. A simplified education program improves knowledge, self-care behavior, and disease severity in heart failure patients in rural settings. American Heart Journal. 2005;150(5):983. doi: 10.1016/j.ahj.2005.08.005. [DOI] [PubMed] [Google Scholar]
  61. Nucifora G, Albanese MC, De Biaggio P, Caliandro D, Gregori D, Goss P, Miani D, Fresco C, Rossi P, Bulfoni A, Fioretti PM. Lack of improvement of clinical outcomes by a low-cost, hospital-based heart failure management programme. Journal of Cardiovascular Medicine. 2006;7(8):614–22. doi: 10.2459/01.JCM.0000237910.34000.58. [DOI] [PubMed] [Google Scholar]
  62. Inglis SC, Pearson S, Treen S, Gallasch T, Horowitz JD, Stewart S. Extending the horizon in chronic heart failure: effects of multidisciplinary, home-based intervention relative to usual care. Circulation. 2006;114(23):2466–73. doi: 10.1161/CIRCULATIONAHA.106.638122. [DOI] [PubMed] [Google Scholar]
  63. Spaeder J, Najjar SS, Gerstenblith G, Hefter G, Kern L, Palmer JG, Gottlieb SH, Kasper EK. Rapid titration of carvedilol in patients with congestive heart failure: a randomized trial of automated telemedicine versus frequent outpatient clinic visits. American Heart Journal. 2006;151(4):844.e1–10. doi: 10.1016/j.ahj.2005.06.044. [DOI] [PubMed] [Google Scholar]
  64. Pearson S, Inglis SC, McLennan SN, Brennan L, Russell M, Wilkinson D, Thompson DR, Stewart S. Prolonged effects of a home-based intervention in patients with chronic illness. Archives of Internal Medicine. 2006;166(6):645–50. doi: 10.1001/archinte.166.6.645. [DOI] [PubMed] [Google Scholar]
  65. Triller DM, Hamilton Ra. Effect of pharmaceutical care services on outcomes for home care patients with heart failure. American Journal of Health-System Pharmacy. 2007;64(21):2244–9. doi: 10.2146/ajhp050492. [DOI] [PubMed] [Google Scholar]
  66. Khunti K, Stone M, Paul S, Baines J, Gisborne L, Farooqi A, Luan X, Squire I. Disease management programme for secondary prevention of coronary heart disease and heart failure in primary care: a cluster randomised controlled trial. Heart. 2007;93(11):1398–405. doi: 10.1136/hrt.2006.106955. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Rao A, Walsh J. Impact of specialist care in patients with newly diagnosed heart failure: a randomised controlled study. International Journal of Cardiology. 2007;115(2):196–202. doi: 10.1016/j.ijcard.2006.03.010. [DOI] [PubMed] [Google Scholar]
  68. Heidenreich PA, Gholami P, Sahay A, Massie B, Goldstein MK. Clinical reminders attached to echocardiography reports of patients with reduced left ventricular ejection fraction increase use of beta-blockers: a randomized trial. Circulation. 2007;115(22):2829–34. doi: 10.1161/CIRCULATIONAHA.106.684753. [DOI] [PubMed] [Google Scholar]
  69. Kashem A, Droogan MT, Santamore WP, Wald JW, Bove AA. Managing heart failure care using an internet-based telemedicine system. Journal of Cardiac Failure. 2008;14(2):121–6. doi: 10.1016/j.cardfail.2007.10.014. [DOI] [PubMed] [Google Scholar]
  70. Kwok T, Lee J, Woo J, Lee DT, Griffith S. A randomized controlled trial of a community nurse-supported hospital discharge programme in older patients with chronic heart failure. Journal of Clinical Nursing. 2008;17(1):109–17. doi: 10.1111/j.1365-2702.2007.01978.x. [DOI] [PubMed] [Google Scholar]
  71. Azad N, Molnar F, Byszewski A. Lessons learned from a multidisciplinary heart failure clinic for older women: a randomised controlled trial. Age & Ageing. 2008;37(3):282–7. doi: 10.1093/ageing/afn013. [DOI] [PubMed] [Google Scholar]
  72. Griffiths F, Anto N, Chow E, Manazar U, Van Royen P, Bastiaens H. Understanding the diversity and dynamics of living with diabetes: a feasibility study. Chronic Illn. 2007;3:29–45. doi: 10.1177/1742395307079194. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1

Search strategy to identify studies of organizational interventions to improve outcomes for patients with congestive heart failure. Search completed 17 July 2008. Additional file 1 is a word document detailing the keywords and number of results identified by each keyword used in our search strategy.

Click here for file (226.5KB, DOC)
Additional file 2

Summary of eligible studies of organizational interventions on outcomes of patients with congestive heart failure. Additional file 2 is a word document listing each eligible study, along with details regarding sample size, our ratings of its intervention and the number of CAS characteristics leveraged, follow-up duration, and presence or absence of unit of analysis error.

Click here for file (103KB, DOCX)
Additional file 3

Detail of analysis for individual CAS characteristics and intervention effectiveness for CHF. Additional file 3 is a table in word document format that lists each CAS characteristic, the number of studies in which the characteristic was utilized, and the range of intervention effectiveness scores for those studies.

Click here for file (63.2KB, DOCX)

Articles from Implementation Science : IS are provided here courtesy of BMC

RESOURCES