Abstract
Background
An organization-wide inequity-reduction quality improvement (QI) initiative was implemented in primary care clinics serving disadvantaged Arab and Jewish populations. Using the Chronic Care Model (CCM), this study investigated the types of interventions associated with success in inequity reduction.
Methods
Semi-structured interviews were conducted with 80 staff members from 26 target clinics, and information about intervention types was coded by CCM and clinical domains (e.g. diabetes, hypertension and lipid control; performance of mammography tests). Relationships between type and number of interventions implemented and inequity reduction were assessed.
Results
Target clinics implemented 454 different interventions, on average 17.5 interventions per clinic. Interventions focused on Decision support and Community linkages were positively correlated with improvement in the composite quality score (P < 0.05). Conversely, focusing on a specific clinical domain was not correlated with a higher quality score.
Conclusions
Focusing on training team members in selected QI topics and/or tailoring interventions to meet community needs was key to the interventions' success. Such findings, especially in light of the lack of association between QI and a focus on a specific clinical domain, support other calls for adopting a systems approach to achieving wide-scale inequity reduction.
Keywords: inequity, chronic disease, primary care, quality improvement
Introduction
Inequity in health and health care in Israel is pervasive on many levels. Despite the availability of national health insurance since 1995,1 differences in health indicators and the distribution and quality of health services are apparent by ethnic, religious, socioeconomic, education and employment status and by geographic location.2 For example, infant mortality is more than twice as high among Muslims as it is among Jews3; income-related inequities are reported across most of the common chronic conditions, including hypertension, heart diseases, diabetes, depression and respiratory diseases4; and the chances of dying from heart diseases for women with lower levels of education have risen in the past two decades from two to five times, compared with more educated women.5–9 Inequity in the distribution of healthcare services in Israel has also been widely documented; there are significant gaps in specialty care, rehabilitation, and imaging services by geographic location and socioeconomic status (SES).4,10
Despite evidence of the growing inequity,7 programs to address this phenomenon have been, until quite recently, mainly sporadic. Israel's health authorities began to comprehensively address health inequity just less than a decade ago,11 mainly through promoting equitable healthcare distribution by expanding services in the north and south peripheral regions, expanding dental care to children, and adding a geographical parameter to the allocation formula that distributes resources among the health funds.12,13
In addition to these national inequity reduction efforts, in 2008 the largest health fund in Israel, Clalit Health Services (Clalit), which covers and provides services to ∼54% of the Israeli population, launched a comprehensive inequity reduction program embedded within its primary care clinics. Clalit's strategy employed a quality improvement (QI) scheme aimed at reducing gaps in a composite measure, the Quality Indicator Disparity Scale (QUIDS), of seven health and healthcare indicators, spanning prevention and control of the common chronic conditions diabetes, hypertension and lipid control; prevention of anemia in infants; mammography screening; fecal occult blood tests and influenza vaccinations.14
Clalit's strategy succeeded in reducing inequity between clinics serving low-SES Arab and Jewish minority groups and the general Clalit population.14,15 However, inconsistencies in implementation and outcomes between the various participating clinics have been identified. Such variation is not uncommon in QI inequity reduction efforts16; some studies favor QI for minimizing health and healthcare gaps,15,17 whereas some show increased inequities over time.18,19 Yet, understanding the source of such inconsistencies is challenging, because current literature describes the intervention approach only generally, without specifying the types and scope of interventions and organizational mechanisms put in place to support QI implementation.20–22
Because chronic conditions account for most inequities in health outcomes,23 a suggested framework for understanding how QI initiatives work is the Chronic Care Model (CCM).24,25 According to the CCM, the essential elements for providing high-quality chronic care are Delivery System Design; provision of Patient Self-Management; Decision, Information and Health System Support; and creation of Community Linkages.25 The CCM components are associated with improved delivery and quality of care in general26,27; however, how the main elements of chronic care management are associated with QI in inequity reduction efforts is unclear.23
Thus, the aim of this study was to identify what types of interventions (classified according to the CCM categories as well as the seven clinical domains of the QUIDS) are implemented as part of Clalit's inequity reduction strategy, and to test whether this classification can contribute to the understanding of variations in inequity reduction outcomes.
Methods
Setting
The study was conducted in Clalit, an insurer and integrated delivery system provider for over four million enrollees (53% market share). Clalit's organizational structure consists of a central management, eight geographical regional headquarters, and three to four sub-regional headquarters per region. Each region is responsible for its member population, providing all primary and specialty care, as well as imaging, labs and pharmacy services. Primary clinics are organized in teams of physicians, nurses, pharmacists and administrative personal. Clalit's integrative Electronic Health Record based information system facilitates the monitoring of quality across a wide range of clinical domains, enabling the generation of reports and feedback to individual units (such as primary care clinics) and to all managerial levels.
Within the inequity reduction initiative, Clalit identified 55 clinics with significant gaps in the quality of care, serving ∼400 000 people (∼10% of Clalit's total enrolled population) of mainly socioeconomically disadvantaged and minority populations. The 55 clinics were those with the 10% lowest scores on the composite QUIDS score. For each clinic the set target was to close the gap between the clinic's QUIDS score and that of all other comparable clinics (medium to large, serving 5000 persons or more) in its region. While this target was set by Clalit's central management, the strategies and interventions applied by the target clinics were conceived at the regional, sub-regional and clinic levels.
Study population
The current study was conducted in 26 of the 55 target clinics and their associated managerial levels (sub-regional headquarters for each 2–4 clinics and region's headquarters). The 26 target clinics were randomly selected, representing rural and urban areas, and serve patients from a variety of ethnic and cultural population groups.
In each targeted clinic, interviews were held with the inter-professional managerial team, comprising medical director, nursing director, head of administration and pharmacist (in clinics having an in-house pharmacy). We also interviewed the medical and nursing directors of each clinic's sub-regional and regional headquarters. This selection was affected by the need to gather a variety of perspectives, as individuals working in the same clinic or health sector often have different views of policy and procedures.28
Procedure
Interviews were conducted between April and September 2010 by two of the authors (S.S.-S. and E.S.) with 80 team members at the 26 target clinics, 19 sub-regional managers and 10 regional headquarters directors. The interview guide, adapted from the work of Chin et al.,29 focused on eliciting the perceptions of leaders and staff about what makes inequity reduction QI initiatives sustainable. The guide was reviewed by three of the authors (S.S.-S., E.S. and M.G.) to establish validity. Interview questions were aimed at identifying interventions geared toward overall improvement in work processes, as well as in each of the seven clinical areas represented by the QUIDS. Questions focused on the types of interventions implemented and on the relations among the clinics' team members and between the clinics and the sub-regional and regional teams.
Interviews were transcribed and analyzed to elicit information on the types of interventions employed. A key informant was identified for each target clinic. The information provided by the key informant was augmented by information from interviews with other clinic team members. Upon completion of the interviews, a summary was sent to each target clinic for additional comments and approval of content.
Outcome
Outcome was defined as change in the QUIDS14 between 2009 and 2011. The QUIDS is a weighted score of seven quality indicators: (i) diabetes control (percentage of all registered diabetes patients with HbA1c <9%); (ii) blood pressure control (percentage of all registered hypertensive patients with BP ≤160/100 mm Hg); (iii) lipids control (percentage of all known hyperlipidemia patients with LDL <100 mg/dl); (iv) anemia prevalence in infants (percentage of infants aged 9–18 months with hemoglobin >105 g/l); (v) performance of mammography screening (once every 2 years, for women aged 50–75 years); (vi) performance of fecal occult blood tests (once every year for persons aged 50–75 years) and (vii) influenza vaccinations in targeted populations (>65 years of age or chronically ill). The seven indicators were then weighed to form a composite score (QUIDS) from 0 (poor quality) to 100 (excellent quality). Details of the weighing scheme are provided elsewhere.14
Coding instrument and measures
We mapped the types of interventions that target clinics employed using an adaptation of a tool developed by Grossman et al.,24 which classified interventions according to the CCM domains: (i) delivery system design, (ii) self-management support, (iii) decision support, (iv) information systems, (v) community linkages and (vi) health system organization.23 We also classified interventions according to the specific clinical domain which they pertained to, or as ‘general interventions’ if they did not pertain to a specific clinical area. For example, use of a mobile mammography screening unit was classified both as a ‘mammography screening clinical indicator specific intervention’ and as an intervention pertaining to ‘Delivery System Design’. Conversely, implementing weekly multidisciplinary team meetings to devise a QI work plan was classified as a ‘general intervention’ and as pertaining to ‘Delivery System Design’.
The coding instrument was pilot-tested by two of the authors (S.S.-S. and E.S.), who independently classified data from four clinics and discussed their findings to reach consensus. Agreement between the two raters approached 100%. We used these data to calculate the overall number of interventions employed, the number of interventions according to each CCM category, and the number of interventions according to the seven clinical domains plus the ‘general interventions’ category. Table 1 provides examples of common interventions according to each CCM category or clinical domain.
Table 1.
CCM | Examples of common interventions |
---|---|
Delivery system design |
|
Self-management support |
|
Decision support |
|
Information systems |
|
Community linkages |
|
Health system organization |
|
Clinical quality indicators | |
Diabetes |
|
Hypertension |
|
Lipid |
|
Mammography |
|
Fecal occult blood test |
|
Anemia |
|
Flu vaccinations |
|
Analysis
We examined baseline characteristics of target and comparable clinics in terms of size, ethnicity and SES. SES levels were defined by geocoding technique linking the primary clinic's address with Israel's Central Bureau of Statistics socioeconomic indicator score rating all towns in Israel, with 1 representing towns of low SES and 10 high SES.14 We calculated the QUIDS score for each target clinic and all other comparable clinics (all medium to large, serving 5000 persons or more) in the same region at baseline (2009) and at 2-year follow-up (2011).
In an exploratory analysis, we used the Pearson coefficient to examine the association between the number of interventions employed by target clinics according to each CCM category and each clinical domain, and change in QUIDS score.
The study protocol was approved by the Committee on Human Studies, Clalit Health Services (authorization no. 172/2011).
Results
Characteristics of target clinics and comparison clinics
The total number of enrollees in the target clinics was 217 306, and in the comparable clinics was 1 310 840. In target clinics, most enrollees were of Arab ethnicity (78.1%); as opposed to a Jewish majority (57.1%) in comparable clinics. Most enrollees in the target clinics were of low SES (78.91%). In comparison, only 48.79% of the enrollees in the comparable clinics were of low SES, and enrollees were dispersed between all three clinic SES categories. Examination of the difference in the individual target clinics' QUIDS scores pre- and post-implementation of intervention (2009–11) showed an average 7.2% improvement in QUIDS scores but no change in the comparable clinics (Table 2). The gap between target and comparable clinics' QUIDS scores narrowed from 0.062 to 0.021 difference (reduction of 66.1%). Yet, this achievement was not uniform and reduction ranged between 23.55 and 100%.
Table 2.
Comparison clinics N = 1 310 840 N (%) |
Target clinics N = 217 306 N (%) |
|
---|---|---|
Region (%) | ||
A | 304 721 (90.93) | 30 403 (9.07) |
B | 457 413 (84.01) | 87 061 (15.99) |
C | 161 720 (83.71) | 31 463 (16.29) |
D | 386 986 (84.98) | 68 379 (15.02) |
Ethnicity (%) | ||
General Jewish population | 57.07 | 21.14 |
Ultra-Orthodox Jews | 0.24 | 0.76 |
Arab | 42.70 | 78.10 |
Socioeconomic status (%) | ||
Low | 48.79 | 78.91 |
Medium | 36.60 | 21.09 |
High | 14.62 | – |
QUIDs Score 2009, mean (SD) | 0.638 (0.017) | 0.576 (0.042) |
QUIDs Score 2011, mean (SD) | 0.639 (0.004) | 0.618 (0.035) |
Percent change in QUIDs Score (2009–11) | 0.1% | 7.2% |
Interventions implemented
Target clinics implemented a total of 454 different interventions, an average of 17.5 per clinic (Table 3). On average, clinics implemented four different interventions per CCM category. Delivery system design was the CCM strategy most used, averaging 8.7 interventions per clinic. Next was the use of the organization's information systems. Interventions focusing on Health System Organization, stemming from central management involvement, such as financial support, were implemented in just two target clinics.
Table 3.
Total number of Interventions | Average per clinic (SD) | |
---|---|---|
CCM | ||
Delivery system design | 225 | 8.7 (3.0) |
Self-management support | 40 | 1.5 (1.6) |
Decision support | 33 | 1.3 (1.0) |
Information systems | 119 | 4.6 (1.8) |
Community linkages | 34 | 1.3 (1.4) |
Health system organization | 3 | 0.1 (0.3) |
Average across all clinics | 4.4 (3.1) | |
Clinical quality indicators | ||
Diabetes | 90 | 3.5 (1.7) |
Hypertension | 17 | 0.7 (1.2) |
Lipid | 14 | 0.5 (0.9) |
Mammography | 81 | 3.1 (1.1) |
Fecal occult blood test | 48 | 1.9 (1.0) |
Anemia | 7 | 0.3 (0.8) |
Flu vaccinations | 21 | 0.8 (0.9) |
General interventions | 176 | 13.0 (2.2) |
Average across all clinics | 3.0 (1.2) |
Among the interventions implemented by target clinics according to clinical domains, general non-clinical interventions, such as improvements to teamwork, were the most common. Of the seven clinical domains, the most common interventions were geared toward improving diabetes control (average 3.5), followed by mammography screening (average 3.1) and performance of fecal occult blood tests (average 1.9). Interventions to improve the reduction in prevalence of anemia in infants were rare (average 0.27).
Association between number of interventions and difference in QUIDS scores
Analyses of the number of interventions implemented by target clinics in the six different CCM categories showed a statistically significant positive relationship between the number implemented for decision support and QUIDS improvement (P< 0.05). Another CCM domain that positively correlated with QUIDS improvement was community linkages (P < 0.05). No other statistically significant correlations of this kind were found. Nor did we find any significant relationship between the number of interventions implemented in each of the seven clinical domains and QUIDS improvement (Table 4).
Table 4.
Difference in QUIDs Score 2009–11*Pearson r | |
---|---|
CCM | |
Number of interventions | |
Delivery system design | −0.125 |
Self-management support | −0.381 |
Decision support | 0.451* |
Information systems | −0.261 |
Community linkages | 0.437* |
Health system organization | 0.008 |
Quality indicators | |
Diabetes | −0.120 |
Hypertension | −0.344 |
Lipid | −0.115 |
Mammography | 0.227 |
Fecal occult blood test | −0.283 |
Anemia | −0.191 |
Flu Vaccination | 0.107 |
*P < 0.05; **P < 0.01.
Discussion
Main findings of the study
This study provides detailed data on the number and types of interventions implemented as part of an organization-wide QI initiative directed at reducing inequities in health and health care, by targeting minority and low-SES clinics with low achievements on the selected inequity-associated quality measures. We measured the effectiveness of the intervention according to the CCM as well as the seven clinical quality indicators which were the focus of the program.
Our study shows that almost 40% of all interventions implemented were not geared toward a specific quality indicator but instead focused on general improvements that could benefit quality of care across several domains. Classification according to the CCM categories showed that target clinics were particularly active in the areas of delivery system design focusing on the reorganization of the clinic's teamwork and implementing proactive follow-ups, along with interventions centered on information systems, improving the use of patients' electronic health records for management of care as well as the generation of auditing tools using aggregated performance data.
What is already known on this topic
A focus on delivery system design and information systems was also reported by Grossman et al.,23 who evaluated the health-disparities collaborative QI program and its effect on inequity reduction. Delivery system design and/or the fostering of information systems is considered essential in launching actions to reduce inequity.30 Thorlby et al.30 interviewed staff at healthcare organizations and found that information systems were viewed as essential components of QI efforts, as they allowed not only identification of existing inequities but also tailoring of interventions accordingly.
Our finding that a focus on decision support and/or the promoting of community linkages is associated with inequity reduction is supported by a recent review by Clarke et al.31 It indicated that because inequities are often the result of challenges embedded in the management of complex systems, it is essential to shift responsibility for change from the patient to the organization. Such a change from a mostly patient-education centered approach to a focus on an organization-wide and/or community-wide initiative has the potential to reach a broader target population and achieve sustainability over time. Similarly, Chin et al.32 report that training healthcare teams in health inequity issues may help improve care and reduce quality gaps. Clarke et al.'s review31 also states that although community-based interventions are relatively sparse, they have shown promise in reducing inequity. Similarly, our study found that target clinics implemented unique community-tailored interventions, such as a culturally tailored cooking classes for Arab diabetic patients; partnerships with religious community leaders to promote screening, vaccinations or a healthy lifestyle; or collaborations to promote community health days. Creating community linkages by stepping outside the clinic walls and into the community may have helped target clinics' teams to better understand local patients' needs and thus achieve greater effectiveness in overall inequity reduction.33,34
What this study adds
Our results show that target clinics that participated in an organization-wide inequity reduction program, implemented a wide range of interventions. While the most common types of intervention focused on improving the care practice roles of clinic employees and reorganizing teamwork (delivery system design) or on using electronic health records to better manage patient care (information systems), these intervention types were not correlated with the interventions' outcomes, and might present a ‘necessary but not sufficient’ condition for success. We identified that focusing on training clinic team members in selected QI topics (decision support) and/or tailoring interventions to meet community needs (community linkages) was key to the interventions' success.
We found no significant relationship between the number of interventions implemented in the seven clinical indicators and QI. This may in part be because success depends on quality, not quantity. Such null findings provide support for the need to tailor interventions to the particular needs of patients and populations, especially those of minorities or other unique groups. The QI framework often fails to contend with a population's cultural barriers and needs.34 Cooper et al.35 state that interventions will not be sustainable over time if they are not adapted and made relevant to both the organization and the patient. Such findings, especially in light of the lack of association between QI and a focus on a specific clinical domain, support other calls for adopting a systems approach to achieving wide-scale inequity reduction.
Limitations of the study
Several limitations to this study should be considered. First, the sample of clinics was relatively small. However, our focus was on eliciting information about the types of interventions employed by target clinics through a rigorous comprehensive and validated assessment, including interviews with 109 employees directly involved in the program. Still, future studies should examine the relation between the types of interventions employed and success in inequity reduction across a broad range of populations and clinics. Additionally, information obtained from interviews may be subject to recall bias. Nonetheless, this was the most comprehensive source available, as no official documentation of intervention types was available. To overcome this shortfall, we identified the key informant for each target clinic and complemented the information retrieved through interviews with other clinic staff as well as managers at relevant sub-regional and regional units. Finally, other characteristics may have contributed to the outcome. Studies have shown that the organizational context,36,37 such as perceived team effectiveness,38 composition of the clinic's team39 and organizational culture,40 affects the inequity reduction process. Future studies should examine the effect of organizational context on the implementation process and outcomes of inequity reduction initiatives.
Funding
The study was supported in part by a PhD scholarship (awarded to Spitzer-Shohat) from the Israel National Institute for Health Policy Research (NIHPR). The NIHPR had no role in the design and conduct of this study, the analysis or interpretation of the data, or the preparation of the manuscript.
Acknowledgements
Kristen Ebert-Wagner provided language editing and copyediting of the manuscript.
References
- 1. National Health Insurance Law, 1994. Ministry of Health. http://www.health.gov.il/LegislationLibrary/Bituah_01.pdf (20 December 2015, date last accessed).
- 2. Epstein L, Goldwag R, Isma'il S et al. . Reducing Health Inequality and Health Inequity in Israel: Towards A National Policy and Action Program. Jerusalem: The Myers-JDC-Brookdale Institute, 2006(The Smokler Center for Health Policy Research). [Google Scholar]
- 3. Amitai Y, Haklai Z, Tarabeia J et al. . Infant mortality in Israel during 1950–2000: rates, causes, demographic characteristics and trends. Paediatr Perinat Epidemiol 2005;19(2):145–51. [DOI] [PubMed] [Google Scholar]
- 4. Shmueli A. Income-related inequalities in health and health services use in Israel. Isr J Health Policy Res 2014;3:37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Epstein L, Horev T. Inequality in Health and in the Health System [in Hebrew]. Jerusalem: Taub Center for Social Policy Studies in Israel, 2007. [Google Scholar]
- 6. Horev T. Narrowing Health Inequalities: International Experience and its Implications for Israel. Jeusalem: (Hebrew): Taub Center for Social Studies in Israel, 2008. [Google Scholar]
- 7. Averbuch E, Avni S, editors. Health Inequality and Coping with it. Jerusalem: Israel Ministry of Health, Administration for Strategic and Economic Planning, 2014. Hebrew, Jerusalem. [Google Scholar]
- 8. Manor Y, Shmueli A, Ben-Yehuda A et al. . The National Program for Community Medicine Quality Indicators in Israel for the Years 2011–2013. Jerusalem: (Hebrew): MOH, 2011. [Google Scholar]
- 9. Gross R, Bremly-Grinberg S, Rosen B. Co-payments: ramifications on accessibility of services and equity. Law Bus. 2007;6:197–224. (Hebrew). [Google Scholar]
- 10. Brammli Greenberg S. Inequalities in waiting times by socioeconomic status – a possible causal mechanism. Isr J Health Policy Res 2015;4:2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Avni S, Filc D, Davidovitch N. The Israeli Medical Association's discourse on health inequity. Soc Sci Med 2015;144:119–26. [DOI] [PubMed] [Google Scholar]
- 12. Ministry of Health, 2010. Ministry of Health Inequalities in Health and Coping with Them MOH, Jerusalem, 2010. (Hebrew). [Google Scholar]
- 13. OECD. OECD Reviews of Health Care Quality: Israel 2012: Raising Standards. Paris: OECD Publishing, 2012. [Google Scholar]
- 14. Balicer RD, Shadmi E, Lieberman N et al. . Reducing health disparities: strategy planning and implementation in Israel's largest health care organization. Health Serv Res 2011;46(4):1281–99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Balicer RD, Hoshen M, Cohen-Stavi C et al. . Sustained reduction in health disparities achieved through targeted quality improvement: one-year follow-up on a three-year intervention. Health Serv Res 2015;506:1891–909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Nadeem E, Olin SS, Hill LC et al. . Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q 2013;91(2):354–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Jean-Jacques M, Persell SD, Thompson JA et al. . Changes in disparities following the implementation of a health information technology-supported quality improvement initiative. J Gen Intern Med 2012;27(1):71–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Casalino LP, Elster A, Eisenberg A et al. . Will pay-for-performance and quality reporting affect health care disparities? Health Aff (Millwood) 2007;26(3):w405–14. [DOI] [PubMed] [Google Scholar]
- 19. Jones RG, Trivedi AN, Ayanian JZ. Factors influencing the effectiveness of interventions to reduce racial and ethnic disparities in health care. Soc Sci Med 2010;70(3):337–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Dixon A, Khachatryan A, Gilmour S. Does general practice reduce health inequalities? Analysis of quality and outcomes framework data. Eur J Public Health 2012;22(1):9–13. [DOI] [PubMed] [Google Scholar]
- 21. Shaw EK, Chase SM, Howard J et al. . More black box to explore: how quality improvement collaboratives shape practice change. J Am Board Fam Med 2012;25(2):149–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Bauer UE, Briss PA, Goodman RA et al. . Prevention of chronic disease in the 21st century: elimination of the leading preventable causes of premature death and disability in the USA. Lancet 2014;384(9937):45–52. [DOI] [PubMed] [Google Scholar]
- 23. Grossman E, Keegan T, Lessler AL et al. . Inside the health disparities collaboratives: a detailed exploration of quality improvement at community health centers. Med Care 2008;46(5):489–96. [DOI] [PubMed] [Google Scholar]
- 24. Cramm JM, Rutten-Van Molken MP, Nieboer AP. The potential for integrated care programmes to improve quality of care as assessed by patients with COPD: early results from a real-world implementation study in The Netherlands. Int J Integr Care 2012;12:e191–Sep. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Wagner EH, Austin BT, Davis C et al. . Improving chronic illness care: translating evidence into action. Health Aff (Millwood) 2001;20(6):64–78. [DOI] [PubMed] [Google Scholar]
- 26. Peterson LE, Blackburn B, Phillips RL et al. . Improving quality of care for diabetes through a maintenance of certification activity: family physicians’ use of the chronic care model. J Contin Educ Health Prof 2014Winter;34(1):47–55. [DOI] [PubMed] [Google Scholar]
- 27. Cramm JM, Nieboer AP. Short and long term improvements in quality of chronic care delivery predict program sustainability. Soc Sci Med 2014;101:148–54. [DOI] [PubMed] [Google Scholar]
- 28. Yin RK. Enhancing the quality of case studies in health services research. Health Serv Res 1999;34(5 Pt 2):1209–24. [PMC free article] [PubMed] [Google Scholar]
- 29. Chin MH, Kirchhoff AC, Schlotthauer AE et al. . Sustaining quality improvement in community health centers: perceptions of leaders and staff. J Ambul Care Manage 2008;31(4):319–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Thorlby R, Jorgensen S, Siegel B et al. . How health care organizations are using data on patients’ race and ethnicity to improve quality of care. Milbank Q 2011;89(2):226–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Clarke AR, Goddu AP, Nocon RS et al. . Thirty years of disparities intervention research: what are we doing to close racial and ethnic gaps in health care? Med Care 2013;51(11):1020–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Chin MH, Clarke AR, Nocon RS et al. . A roadmap and best practices for organizations to reduce racial and ethnic disparities in health care. J Gen Intern Med 2012;27(8):992–1000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Lemay CA, Beagan BM, Ferguson WJ et al. . Lessons learned from a collaborative to improve care for patients with diabetes in 17 community health centers, Massachusetts, 2006. Prev Chronic Dis 2010;7(4):A83. [PMC free article] [PubMed] [Google Scholar]
- 34. Wilkes AE, Bordenave K, Vinci L et al. . Addressing diabetes racial and ethnic disparities: lessons learned from quality improvement collaboratives. Diabetes Manag (Lond) 2011;1(6):653–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Cooper LA, Marsteller JA, Noronha GJ et al. . A multi-level system quality improvement intervention to reduce racial disparities in hypertension care and control: study protocol. Implement Sci 2013;8:60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Kaplan HC, Brady PW, Dritz MC et al. . The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q 2010;88(4):500–59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Baker C, Loughren EA, Crone D et al. . A process evaluation of the NHS Health Check care pathway in a primary care setting. J. Public Health 2015;37(2):202–9. [DOI] [PubMed] [Google Scholar]
- 38. Shortell SM, Marsteller JA, Lin M et al. . The role of perceived team effectiveness in improving chronic illness care. Med Care 2004;42(11):1040–8. [DOI] [PubMed] [Google Scholar]
- 39. Meltzer D, Chung J, Khalili P et al. . Exploring the use of social network methods in designing healthcare quality improvement teams. Soc Sci Med 2010;71(6):1119–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Deo S, McInnes K, Corbett CJ et al. . Associations between organizational characteristics and quality improvement activities of clinics participating in a quality improvement collaborative. Med Care 2009;47(9):1026–30. [DOI] [PMC free article] [PubMed] [Google Scholar]