Abstract
Simple Summary
Liver cancer is a growing problem that largely impacts people with cirrhosis. This article describes the Veterans Health Administration’s national cirrhosis quality improvement program and its focus on early detection of liver cancer.
Abstract
After implementing a successful hepatitis C elimination program, the Veterans Health Administration’s (VHA) Hepatic Innovation Team (HIT) Collaborative pivoted to focus on improving cirrhosis care. This national program developed teams of providers across the country and engaged them in using systems redesign methods and population health approaches to improve care. The HIT Collaborative developed an Advanced Liver Disease (ALD) Dashboard to identify Veterans with cirrhosis who were due for surveillance for hepatocellular carcinoma (HCC) and other liver care, promoted the use of an HCC Clinical Reminder in the electronic health record, and provided training and networking opportunities. This evaluation aimed to describe the VHA’s approach to improving cirrhosis care and identify the facility factors and HIT activities associated with HCC surveillance rates, using a quasi-experimental design. Across all VHA facilities, as the HIT focused on cirrhosis between 2018–2019, HCC surveillance rates increased from 46% (IQR 37–53%) to 51% (IQR 42–60%, p < 0.001). The median HCC surveillance rate was 57% in facilities with high ALD Dashboard utilization compared with 45% in facilities with lower utilization (p < 0.001) and 58% in facilities using the HCC Clinical Reminder compared with 47% in facilities not using this tool (p < 0.001) in FY19. Increased use of the ALD Dashboard and adoption of the HCC Clinical Reminder were independently, significantly associated with HCC surveillance rates in multivariate models, controlling for other facility characteristics. In conclusion, the VHA’s HIT Collaborative is a national healthcare initiative associated with significant improvement in HCC surveillance rates.
Keywords: implementation, hepatoma, learning collaborative, screening
1. Introduction
The incidence of hepatocellular carcinoma (HCC) continues to rise globally [1,2,3], paralleling the rising incidence of cirrhosis [4]. While guidelines recommend that persons with cirrhosis undergo biannual HCC surveillance with imaging [5,6,7,8], adherence to these guidelines remains low across all sectors of healthcare [9,10]. Such gaps between evidence or guidelines and clinical practice have been identified across healthcare systems and clinical areas. The Veterans Health Administration (VHA) is a national, learning healthcare system that has proactively addressed evidence to practice gaps and the so-called “quality chasm” by building capacity in systems redesign [11]. Adapted from manufacturing and engineering settings, systems redesign methods engage stakeholders in continuous quality improvement strategies to address the efficiency and safety of medical care [12].
VHA has been a national leader in teaching and using systems redesign methods to improve healthcare [13,14], particularly in the area of hepatitis C virus (HCV) elimination [15,16]. In 2014, VHA developed the Hepatic Innovation Team (HIT) Collaborative to implement systemic changes that would facilitate the roll-out of then-new direct-acting antiviral HCV treatments [16]. The HIT Collaborative remains a VHA-wide program of interdisciplinary healthcare providers organized into regional teams (defined by Veterans Integrated Service Networks or VISNs) and led by a national leadership team. This network of over 400 VHA clinicians and staff includes hepatologists, pharmacists, infectious disease providers, systems redesign experts, implementation scientists, and health services researchers. After working together to cure over 85% of Veterans with HCV, the HIT Collaborative transitioned to a focus on cirrhosis care in 2018. This transition leveraged the existing HIT infrastructure and leadership support to focus on cirrhosis care including HCC surveillance and surveillance for and treatment of varices [17,18,19].
This evaluation of the HIT Collaborative’s impact on HCC surveillance rates aimed to describe the VHA’s approach to improving cirrhosis care and identify the facility factors and HIT activities associated with HCC surveillance rates.
2. Materials and Methods
2.1. Cirrhosis and HCC Surveillance Definitions
The HIT Collaborative Leadership Team engaged a Technical Advisory Group of hepatologists, policy makers, researchers, and systems redesign experts to develop goals and metrics for cirrhosis care. Through a series of meetings, consensus-building activities, and review of the existing scientific literature, the data definitions of cirrhosis and HCC surveillance were established. Following national guidelines, 6-month surveillance was recommended, although an 8-month period was allowable for purposes of the measure, as recommended by the group.
All data were defined in and extracted from the VHA Corporate Data Warehouse and captured through a national VHA Advanced Liver Disease (ALD) Dashboard (described below). Veterans were defined as “in care” in their primary facility if they had at least one encounter or prescription over the prior 18 months. Veterans were associated with the VHA facility where they were assigned to primary care or, in the absence of primary care assignment, where they had their most recent visit or prescription activity in the prior 18 months. Veterans were classified as having cirrhosis based on diagnosis codes and problem list diagnoses consistent with cirrhosis or its complications (Supplementary Table S1: Cirrhosis codes and definitions). Veterans with cirrhosis were excluded from the HCC surveillance denominator for purposes of this evaluation if they had prior HCC or a limited life expectancy, defined as Child class C disease or a code for hospice care. Data sources used to define HCC surveillance included radiology codes, health factors specifying HCC surveillance, encounter and inpatient procedure codes, and fee-basis (non-VHA care) procedure codes. HCC surveillance was defined by the following CPT codes, which include abdominal ultrasound, MRI with contrast, or CT with contrast (74160, 74170, 74177, 74178, 74185, 74182, 74183, 76700, 76705). Imaging performed outside of VHA was also captured if it was manually input into the ALD Dashboard.
2.2. Facility Variables
Facility covariates that were assessed included complexity, specialty care availability, caseload, HIT participation, and adoption of HIT-related tools. Facility complexity was categorized following standard VHA nomenclature into five levels (1a, 1b, 1c, 2, and 3), using an algorithm that incorporates patient volume, patient morbidity, availability of services and specialties, and research resources, with level 1a representing the most complex facilities [20]. Facilities with on-site gastroenterology or hepatology specialists were considered to have “specialty care”. Facility caseload was defined as the number of Veterans with cirrhosis assigned to the facility at the end of fiscal year (FY) 2018, divided into quartiles.
2.3. HIT Membership and Use of the Advanced Liver Disease Dashboard, and HCC Clinical Reminder
HIT engagement was evaluated as (1) any participation at the facility, or any members of the facilities on the HIT rosters and (2) usage of HIT-endorsed data tools. The number of clinicians or staff members listed on the team roster was collected for each station, and engagement was defined as having at least one person on this team.
Two data tools were disseminated by the HIT: the Advanced Liver Disease (ALD) Dashboard and the HCC Clinical Reminder. The ALD Dashboard is a population management tool that was developed by a HIT-supported Dashboard Workgroup. Providers can use the ALD Dashboard to identify Veterans in their facilities and assess HCC surveillance status and other aspects of liver disease and overall health (Figure 1). Dashboard usage was categorized in two ways: (1) as a continuous number of logins and (2) as the continuous number of users, both at the facility level over the fiscal year.
The HCC Clinical Reminder activates in a Veteran’s electronic medical record when HCC surveillance is due. This HCC reminder was developed for national implementation by members of VISN 21 and offered to all facilities who opted in during FY18. If a facility had installed and turned on the HCC Clinical Reminder, the facility was defined as “using” the HCC Clinical Reminder in that fiscal year.
2.4. Analysis
All data analyses were conducted in RStudio version 1.2.5033. Figures and tables were created using Microsoft Office products (excel and word). Veterans were aggregated by facility and the median HCC surveillance rates at the facility level were compared at the end of FYs 2018 and 2019 using Wilcoxon rank sum testing. Multivariable linear regression models were used to assess the factors independently associated with HCC surveillance in each FY. In these models, ALD Dashboard use was modeled as high vs. low, defined by median number of logins, use of the HCC Clinical Reminder was included as a binary covariate, and caseload was included as a continuous covariate. Models were assessed for collinearity using a prespecified variance inflation factor of five.
3. Results
3.1. HIT Activities
The HIT Collaborative Leadership Team engaged regional teams in monthly calls and quarterly data reviews. These calls provided a forum for teams to share “best practices” and quality improvement work, using standard systems redesign tools [12,21]. The presentations and resources could be accessed on a SharePoint webpage between meetings. Additionally, the HIT Collaborative Leadership Team was available to provide technical assistance and coaching between calls. They provided education about the ALD Dashboard and HCC Clinical Reminder, trained clinicians in systems redesign methods, and developed a tool to estimate the cost of facility-level cirrhosis care. The Leadership Team offered on-site visits to all 18 VISN teams, during which time they worked with teams to set goals, assess data, and develop quality improvement strategies.
3.2. Facility Characteristics and HIT Engagement
At the start of 2018 (baseline), the majority of 130 VHA facilities had on-site specialty gastroenterology or hepatology care, and 87% had HIT members on site (Table 1). In FY18, 67,210 Veterans engaged in VHA care were identified as having cirrhosis, with this number increasing to 73,108 in FY19. In FY18, the median number of Veterans per facility with cirrhosis was 429 (IQR 238–689); this increased to 450 (264–773) in FY19. In FY18, there were 392 HIT members, with a median of two members per facility (range 1–15). In FY19, HIT membership grew to 476, with a median of three members per facility.
Table 1.
Characteristics | Facilities n (%) |
---|---|
Facility complexity | |
1 (high) | 77 (59%) |
2 | 24 (18%) |
3 (low) | 29 (22%) |
On-site GI specialty care | |
Yes | 106 (82%) |
No | 24 (18%) |
HIT member at facility | |
Yes | 113 (87%) |
No | 17 (13%) |
ALD Dashboard utilization | |
High | 34 (26%) |
Low | 96 (74%) |
HCC Clinical Reminder use | |
Yes | 20 (15%) |
No | 110 (85%) |
Abbreviations: GI: gastroenterology, which includes hepatology; HIT: Hepatic Innovation Team; ALD: advanced liver disease; HCC: hepatocellular carcinoma * high ALD Dashboard utilization = above the median number of log-ins.
3.3. Advanced Liver Disease Dashboard
Between December 2017 and September 2018, the ALD Dashboard had been used by 125 of 130 facilities (96%) across all 18 VISNs. The total number of unique users was 562 (median four per site) and total number of logins was 3252 (median of 16 logins per user).
3.4. HCC Clinical Reminder
In FY18, at baseline, 21 facilities (16%) had adopted the HCC Clinical Reminder. By FY19, adoption doubled to 30%.
3.5. HCC Surveillance Rates
The median HCC surveillance rate in FY18 was 46% (IQR 37–53%) (Figure 2). Surveillance rates increased significantly to 51% (IQR 42–60%) by the end of FY19 (p < 0.01).
Several facility characteristics were associated with HCC surveillance rates in bivariate analyses (Table 2). Median HCC surveillance rates were 53% in facilities with gastroenterology or hepatology specialists on site compared with 41% in facilities without specialists, p = 0.003. Overall facility complexity was also significantly associated with HCC surveillance rates, with 49% surveillance in facilities with the highest complexity vs. 36% in those with lower complexity scores in FY18 and 54% vs. 44% in FY19 (p < 0.001).
Table 2.
Facility Characteristics | HCC Surveillance Rate (%) | |||
---|---|---|---|---|
FY18 | p | FY19 | p | |
Complexity | <0.001 | <0.001 | ||
1 (high) | 49 | 54 | ||
2 | 44 | 47 | ||
3 (low) | 36 | 44 | ||
Quartile of case load | <0.001 | 0.35 | ||
1 (low) | 40 | 49 | ||
2 | 43 | 50 | ||
3 | 49 | 53 | ||
4 (high) | 49 | 51 | ||
On-site GI specialty care | <0.001 | 0.003 | ||
Yes | 48 | 53 | ||
No | 37 | 41 | ||
HIT member at facility | 0.12 | 0.003 | ||
Yes | 41 | 52 | ||
No | 46 | 42 | ||
ALD Dashboard utilization | <0.001 | <0.001 | ||
High | 51 | 57 | ||
Low | 40 | 45 | ||
HCC Clinical Reminder use | <0.001 | <0.001 | ||
Yes | 53 | 58 | ||
No | 44 | 47 |
Abbreviations: FY=fiscal year; GI: gastroenterology, which includes hepatology; HIT: Hepatic Innovation Team; ALD: advanced liver disease; HCC: hepatocellular carcinoma; high ALD Dashboard utilization = above the median number of log-ins.
Facilities with higher ALD Dashboard utilization and those utilizing the HCC Clinical Reminder had significantly higher HCC surveillance rates in both years (Table 2). The number of HIT members was not significantly associated with HCC surveillance in either year, but having at least one HIT member was significantly associated with HCC surveillance in FY19. In contrast, caseload was significantly associated with HCC surveillance rates only in FY18, when facilities with the higher caseloads had higher surveillance rates. However, over FY19, with HIT implementation, surveillance rates increased by a median of 8% in the facilities with the lowest vs. 1% in facilities with the highest caseload. Consequently, by the end of FY19, caseload was no longer significantly associated with HCC surveillance rate.
3.6. Factors Associated with HCC Surveillance in Multivariable Models
In multivariable models (Table 3), the factors independently, significantly associated with HCC surveillance in both years included ALD Dashboard utilization, HCC Clinical Reminder adoption, and higher facility complexity, controlling for other facility characteristics, and caseload (volume of Veterans with cirrhosis). Sensitivity analyses were conducted modeling HCC surveillance as an ordinal variable by quartile, with no significant changes in the associations.
Table 3.
Covariates | FY18 | FY19 | ||||
---|---|---|---|---|---|---|
β | SE | p | β | SE | p | |
Complexity | 0.068 | 0.022 | 0.002 | 0.042 | 0.027 | Ns |
On-site GI specialty care | 0.036 | 0.024 | Ns | 0.066 | 0.030 | 0.026 |
ALD Dashboard utilization | 0.067 | 0.018 | <0.001 | 0.072 | 0.022 | 0.001 |
HCC Clinical Reminder | 0.054 | 0.025 | 0.029 | 0.076 | 0.023 | 0.001 |
* Caseload (number of Veterans with cirrhosis) and having a HIT member in the facility were included in the models but were not significantly associated with HCC surveillance in either year. Abbreviation: GI: gastroenterology; HIT: hepatic innovation team; ALD: advanced liver disease; Ns = non-significant (>0.05).
4. Discussion
The HIT Collaborative is a novel, national VHA program that has employed a population health approach and systems redesign methods to address evidence to practice gaps in cirrhosis care. Over the first two years of the HIT’s focus on cirrhosis care, HCC surveillance rates significantly increased across a heterogenous group of facilities. The facilities with the most improvement were those that utilized the tools provided by the HIT, including an ALD Dashboard and an HCC Clinical Reminder. It is notable that smaller facilities without specialty care that used these tools were also able to increase their surveillance rates such that facility caseload and complexity were not associated with HCC surveillance rates once the HIT supports were in place.
Cirrhosis is a complex medical illness that requires ongoing chronic disease management. While prior studies have targeted specific aspects of cirrhosis care, such as prevention of readmission, this national, proactive, coordinated approach to surveillance is unique to VHA. Our evaluation demonstrated an association between a data-informed, provider-centered program and improved adherence to disease management guidelines.
While the HCC surveillance rates remained moderate, it is notable that the VHA was outperforming other healthcare systems in terms of HCC surveillance rates even prior to the HIT’s focus in this area. Guideline-concordant surveillance rates in other healthcare systems have been reported to be as low as 2–11%, with pooled estimate of HCC surveillance rates of 24% in a recent metanalysis [22,23,24]. VHA’s rate thus appears to be twice that of other healthcare systems and the continuous data monitoring and ongoing process improvement will aim to improve upon these rates. These findings indicate that the multipronged, proactive, population based VHA approach could benefit other integrated healthcare systems and may be adaptable to other healthcare settings.
Creating effective provider-facing interventions can be challenging, as there are often numerous barriers to implementing evidence-based medical practices [25]. It is generally appreciated that provider education and guideline dissemination are not sufficient to change practice [25,26]. In contrast, learning collaboratives are evidence-based implementation approaches that have had success in other clinical areas [27,28,29]. Learning collaboratives operate via building stakeholder interrelationships and employing modeling, education, and support to promote behavior changes. The HIT Collaborative specifically engaged stakeholders, provided a centralized data infrastructure with accompanying metrics and goals, and developed coordinated training and support for regional coordinators. The HIT Collaborative provided an infrastructure for communication and stakeholder engagement. Such an approach allowed for rapid dissemination of information and support for clinicians.
These data support that one key to VHA’s success in addressing evidence to practice gaps has been the development and wide adoption of data tools. Other research has demonstrated the effectiveness of data feedback both through audit-and-feedback mechanisms and through specific use of tailored electronic health record tools [30,31,32,33]. Notably, the combination of health record tools and systems redesign approaches have worked in other clinical areas [34]. However, none of these approaches are effective if they are not acceptable to clinicians and utilized in practice. The doubling of the HCC Clinical Reminder utilization in the first year of HIT implementation suggests that the HIT Collaborative helped to disseminate this clinical tool.
The ALD Dashboard provided information to clinicians and to leadership and was used to inform practice and policy. These data allowed national-level policymakers to evaluate efforts and develop tailored approaches to address implementation barriers. For example, in response to feedback, the Dashboard was adapted to allow providers to feedback data about why Veterans may not be engaged in surveillance (e.g., competing comorbidities, refusal). As we move forward, these data will allow the HIT Collaborative Leadership Team to design tailored strategies to address causes of non-surveillance. For example, if a primary barrier is related to refusal by Veterans to undergo surveillance, then direct patient outreach, transportation assistance, or bundled appointments could be employed to increase surveillance. In contrast, if scheduling or radiology capacity emerge as issues, then leadership can address this through internal, systems redesign approaches or engaging scheduling or radiology experts in quality improvement efforts. Thus, the bidirectional flow of information supports clinicians and leadership to improve the quality of care.
In any implementation effort, a one-size-fits-all approach is often insufficient. The HIT Collaborative has also allowed leadership to identify facilities requiring enhanced support. Ongoing work includes outreach to these facilities with opportunities to improve cirrhosis care [35]. This population-level approach allows leadership to target resources efficiently, providing more intensive resources to later adopting facilities. Such an approach is particularly beneficial when the system experiences stress, such as during the COVID pandemic.
5. Conclusions
VHA developed a national program that successfully focused on improving HCC surveillance rates for Veterans. By providing user-friendly data in the form of a Dashboard, clinical reminder, education, technical assistance, and an infrastructure for sharing best practices, VHA developed a population health approach to cirrhosis care that could be adopted by other healthcare systems aiming to improve access to evidence-based care.
Acknowledgments
The authors would like to acknowledge the contributions of Brittney Neely and Shauna McInnes who provided administrative and technical support for this work.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/cancers13092251/s1, Table S1: Cirrhosis codes and definitions.
Author Contributions
S.S.R. and V.Y. contributed equally to this paper. Conceptualization, T.R.M., S.S.R., V.Y., R.G., C.L., and S.G.; methodology, S.S.R., V.Y., L.A.B., J.S.B., K.R.-B.-D., and T.R.M.; formal analysis, V.Y.; data curation, K.R.-B.-D., D.S., and V.Y.; data interpretation, A.P., H.M., E.C., M.S., A.N., M.C., D.R., and J.A.D.; writing—original draft preparation, S.S.R.; writing—review and editing, all authors. All authors have read and agreed to the published version of the manuscript.
Funding
This evaluation was funded by the VHA HIV, Hepatitis and Related Conditions Program Office (HHRC) in service of the Hepatic Innovation Team Program Evaluation and the VA Quality Enhancement Research Initiative, grant number PEC 19-307.
Institutional Review Board Statement
Ethical review and approval were waived for this study, due to the study being defined as a quality improvement project per VHA Handbook 1058.05/VHA Program Guide 1200.21 that did not require IRB oversight.
Informed Consent Statement
Not applicable.
Data Availability Statement
These analyses were performed using VHA data. Deidentified data can be provided upon request pending ethical approval and in accordance with VHA guidelines and permissions.
Conflicts of Interest
The authors declare no conflict of interest. The VHA helped to support the time of the authors and leadership of HHRC were included in the interpretation of data, manuscript writing, and decision to publish. Study design and data collection were completed by the evaluation team. The opinions expressed in this manuscript are those of the authors and do not reflect the official position of the US Government.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Kanwal F., Hoang T., Kramer J.R., Asch S.M., Goetz M.B., Zeringue A., Richardson P., El-Serag H.B. Increasing prevalence of HCC and cirrhosis in patients with chronic hepatitis C virus infection. Gastroenterology. 2011;140:1182–1188. doi: 10.1053/j.gastro.2010.12.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Beste L.A., Leipertz S.L., Green P.K., Dominitz J.A., Ross D., Ioannou G.N. Trends in burden of cirrhosis and hepatocellular carcinoma by underlying liver disease in US veterans, 2001–2013. Gastroenterology. 2015;149:1471–1482. doi: 10.1053/j.gastro.2015.07.056. [DOI] [PubMed] [Google Scholar]
- 3.Ryerson A.B., Eheman C.R., Altekruse S.F., Ward J.W., Jemal A., Sherman R.L., Henley S.J., Holtzman D., Lake A., Noone A.M., et al. Annual Report to the Nation on the Status of Cancer, 1975–2012, featuring the increasing incidence of liver cancer. Cancer. 2016;122:1312–1337. doi: 10.1002/cncr.29936. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Yoon Y.H., Chen C.M. Surveillance Report #105: Liver Cirrhosis Mortality in the United States: National, State, and Regional Trends, 2000–2013. National Institute on Alcohol Abuse and Alcoholism; Bethesda, MD, USA: 2016. [Google Scholar]
- 5.Cadier B., Bulsei J., Nahon P., Seror O., Laurent A., Rosa I., Layese R., Costentin C., Cagnot C., Durand-Zaleski I., et al. Early detection and curative treatment of hepatocellular carcinoma: A cost-effectiveness analysis in France and in the United States. Hepatology. 2017;65:1237–1248. doi: 10.1002/hep.28961. [DOI] [PubMed] [Google Scholar]
- 6.Marrero J.A., Kulik L.M., Sirlin C.B., Zhu A.X., Finn R.S., Abecassis M.M., Roberts L.R., Heimbach J.K. Diagnosis, Staging, and Management of Hepatocellular Carcinoma: 2018 Practice Guidance by the American Association for the Study of Liver Diseases. Hepatology. 2018;68:723–750. doi: 10.1002/hep.29913. [DOI] [PubMed] [Google Scholar]
- 7.Wu C.Y., Hsu Y.C., Ho H.J., Chen Y.J., Lee T.Y., Lin J.T. Association between ultrasonography screening and mortality in patients with hepatocellular carcinoma: A nationwide cohort study. Gut. 2016;65:693–701. doi: 10.1136/gutjnl-2014-308786. [DOI] [PubMed] [Google Scholar]
- 8.Yang J.D., Mannalithara A., Piscitello A.J., Kisiel J.B., Gores G.J., Roberts L.R., Kim W.R. Impact of surveillance for hepatocellular carcinoma on survival in patients with compensated cirrhosis. Hepatology. 2018;68:78–88. doi: 10.1002/hep.29594. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Davila J.A., Henderson L., Kramer J.R., Kanwal F., Richardson P.A., Duan Z., El-Serag H.B. Utilization of surveillance for hepatocellular carcinoma among hepatitis C virus-infected veterans in the United States. Ann. Intern. Med. 2011;154:85–93. doi: 10.7326/0003-4819-154-2-201101180-00006. [DOI] [PubMed] [Google Scholar]
- 10.Goldberg D.S., Valderrama A., Kamalakar R., Sansgiry S.S., Babajanyan S., Lewis J.D. Hepatocellular carcinoma surveillance rates in commercially insured patients with noncirrhotic chronic hepatitis B. J. Viral Hepat. 2015;22:727–736. doi: 10.1111/jvh.12381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Institute of Medicine (US) Committee on Quality of Health Care in America . Crossing the Quality Chasm: A New Health System for the 21st Century. The National Academies Press; Washington, DC, USA: 2001. [PubMed] [Google Scholar]
- 12.De Koning H., Verver J.P., van den Heuvel J., Bisgaard S., Does R.J. Lean six sigma in healthcare. J. Healthc. Qual. 2006;28:4–11. doi: 10.1111/j.1945-1474.2006.tb00596.x. [DOI] [PubMed] [Google Scholar]
- 13.Gilman S.C., Chokshi D.A., Bowen J.L., Rugen K.W., Cox M. Connecting the dots: Interprofessional health education and delivery system redesign at the Veterans Health Administration. Acad. Med. 2014;89:1113–1116. doi: 10.1097/ACM.0000000000000312. [DOI] [PubMed] [Google Scholar]
- 14.Lukas C.V., Holmes S.K., Cohen A.B., Restuccia J., Cramer I.E., Shwartz M., Charns M.P. Transformational change in health care systems: An organizational model. Health Care Manag. Rev. 2007;32:309–320. doi: 10.1097/01.HMR.0000296785.29718.5d. [DOI] [PubMed] [Google Scholar]
- 15.Belperio P.S., Chartier M., Gonzalez R.I., Park A.M., Ross D.B., Morgan T.R., Backus L.I. Hepatitis C Care in the Department of Veterans Affairs: Building a Foundation for Success. Infect. Dis. Clin. N. Am. 2018;32:281–292. doi: 10.1016/j.idc.2018.02.011. [DOI] [PubMed] [Google Scholar]
- 16.Park A., Gonzalez R., Chartier M., Rogal S., Yakovchenko V., Ross D., Morgan T.R. Screening and Treating Hepatitis C in the VA: Achieving Excellence Using Lean and System Redesign. Fed. Pract. 2018;35:24–29. [PMC free article] [PubMed] [Google Scholar]
- 17.Belperio P.S., Chartier M., Ross D.B., Alaigh P., Shulkin D. Curing Hepatitis C Virus Infection: Best Practices From the U.S. Department of Veterans Affairs. Ann. Intern. Med. 2017;167:499–504. doi: 10.7326/M17-1073. [DOI] [PubMed] [Google Scholar]
- 18.Rogal S.S., Yakovchenko V., Waltz T.J., Powell B.J., Kirchner J.E., Proctor E.K., Gonzalez R., Park A., Ross D., Morgan T.R., et al. The association between implementation strategy use and the uptake of hepatitis C treatment in a national sample. Implement. Sci. 2017;12:60. doi: 10.1186/s13012-017-0588-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Rogal S.S., Yakovchenko V., Waltz T.J., Powell B.J., Gonzalez R., Park A., Chartier M., Ross D., Morgan T.R., Kirchner J.E., et al. Longitudinal assessment of the association between implementation strategy use and the uptake of hepatitis C treatment: Year 2. Implement. Sci. 2019;14:36. doi: 10.1186/s13012-019-0881-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Veterans Health Administration VHA Facility Complexity Model 2015. [(accessed on 12 December 2016)]; Available online: http://opes.vssc.med.va.gov/FacilityComplexityLevels/Pages/default.aspx.
- 21.Elsasser E.J., White C.A., Jones M.R. Implementation of a transformational plan of care at a Veterans Affairs medical center. Am. J. Health Syst. Pharm. 2018;75:S72–S76. doi: 10.2146/ajhp170485. [DOI] [PubMed] [Google Scholar]
- 22.Abara W.E., Spradling P., Zhong Y., Moorman A., Teshale E.H., Rupp L., Gordon S.C., Schmidt M., Boscarino J.A., Daida Y.G., et al. Hepatocellular Carcinoma Surveillance in a Cohort of Chronic Hepatitis C Virus-Infected Patients with Cirrhosis. J. Gastrointest. Cancer. 2020;51:461–468. doi: 10.1007/s12029-019-00255-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Wolf E., Rich N.E., Marrero J.A., Parikh N.D., Singal A.G. Use of Hepatocellular Carcinoma Surveillance in Patients With Cirrhosis: A Systematic Review and Meta-Analysis. Hepatology. 2021;73:713–725. doi: 10.1002/hep.31309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Singal A.G., Tiro J., Li X., Adams-Huet B., Chubak J. Hepatocellular Carcinoma Surveillance Among Patients With Cirrhosis in a Population-based Integrated Health Care Delivery System. J. Clin. Gastroenterol. 2017;51:650–655. doi: 10.1097/MCG.0000000000000708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Pedersen E.R., Rubenstein L., Kandrack R., Danz M., Belsher B., Motala A., Booth M., Larkin J., Hempel S. Elusive search for effective provider interventions: A systematic review of provider interventions to increase adherence to evidence-based treatment for depression. Implement. Sci. 2018;13:99. doi: 10.1186/s13012-018-0788-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Thomson M.J., Lok A.S., Tapper E.B. Optimizing medication management for patients with cirrhosis: Evidence-based strategies and their outcomes. Liver Int. 2018;38:1882–1890. doi: 10.1111/liv.13892. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Harder V.S., Shaw J.S., McCulloch C.E., Kill L., Robinson K.J., Shepard M.T., Cabana M.D., Bardach N.S. Statewide Asthma Learning Collaborative Participation and Asthma-Related Emergency Department Use. Pediatrics. 2020;146 doi: 10.1542/peds.2020-0213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Penney L.S., Homoya B.J., Damush T.M., Rattray N.A., Miech E.J., Myers L.J., Baird S., Cheatham A., Bravata D.M. Seeding Structures for a Community of Practice Focused on Transient Ischemic Attack (TIA): Implementing Across Disciplines and Waves. J. Gen. Intern. Med. 2021;36:313–321. doi: 10.1007/s11606-020-06135-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Quimby K.D., Kawatu J.E., Saul K.M., Schamus L.A. Implementation of a Learning Collaborative Model Increases Chlamydia Screening at 37 Family Planning Clinics: Lessons Learned From 3 Cohorts. Sex Transm. Dis. 2021;48:5–11. doi: 10.1097/OLQ.0000000000001268. [DOI] [PubMed] [Google Scholar]
- 30.Cox C.K., Bugosh M.D., Fenner D.E., Smith R., Swenson C.W. Antibiotic use during repair of obstetrical anal sphincter injury: A quality improvement initiative. Int. J. Gynaecol. Obstet. 2021 doi: 10.1002/ijgo.13623. [DOI] [PubMed] [Google Scholar]
- 31.Hysong S.J., Best R.G., Pugh J.A. Audit and feedback and clinical practice guideline adherence: Making feedback actionable. Implement. Sci. 2006;1:9. doi: 10.1186/1748-5908-1-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ivers N., Jamtvedt G., Flottorp S., Young J.M., Odgaard-Jensen J., French S.D., O’Brien M.A., Johansen M., Grimshaw J., Oxman A.D. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst. Rev. 2012:CD000259. doi: 10.1002/14651858.CD000259.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ivers N.M., Sales A., Colquhoun H., Michie S., Foy R., Francis J.J., Grimshaw J.M. No more ‘business as usual’ with audit and feedback interventions: Towards an agenda for a reinvigorated intervention. Implement. Sci. 2014;9:14. doi: 10.1186/1748-5908-9-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Bajaj P., Kollipara U., Koganti R., Wang D.C., Chennu N., Bhat D., Mutz J., Willett D., Fish J., Karp D. Coupled Effect of Electronic Medical Record Modifications and Lean Six Sigma Methodology on Rheumatoid Arthritis Disease Activity Measurement and Treat-to-Target Outcomes. ACR Open Rheumatol. 2021;3:164–172. doi: 10.1002/acr2.11233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Rogal S.S., Yakovchenko V., Morgan T., Bajaj J.S., Gonzalez R., Park A., Beste L., Miech E.J., Lamorte C., Neely B., et al. Getting to implementation: A protocol for a Hybrid III stepped wedge cluster randomized evaluation of using data-driven implementation strategies to improve cirrhosis care for Veterans. Implement. Sci. 2020;15:92. doi: 10.1186/s13012-020-01050-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
These analyses were performed using VHA data. Deidentified data can be provided upon request pending ethical approval and in accordance with VHA guidelines and permissions.