Skip to main content
Health Services Research logoLink to Health Services Research
. 2024 Aug 21;59(Suppl 2):e14372. doi: 10.1111/1475-6773.14372

Evolution of the Veterans Health Administration Learning Health System: 25 years of QUERI

Melissa M Garrido 1,2,3,, Amy M Kilbourne 4,5
PMCID: PMC11540571  PMID: 39168964

The Veterans Health Administration (VHA) is among the nation's largest integrated health systems and among the largest learning health systems. A learning health system combines institution‐specific data generation and evaluation with context from the broader research, clinical, and policy communities to inform and implement approaches to improve access to, quality, efficiency, and cost of care. 1 , 2 Instrumental to the establishment of the VHA as a learning health system was the founding of the national Quality Enhancement Research Initiative (QUERI) program, an operational evaluation and quality improvement program. QUERI was established in 1998, and in the years since its founding, initiatives have evolved from implementation of guideline‐based care for specific conditions to the conduct of system‐wide quality improvement and implementation science efforts to the support of evidence‐based policymaking. 3 , 4 , 5 This special issue highlights scientific contributions and real‐world impacts emanating from 25 years of initiatives stemming from QUERI that reflect rapid translation of research into practice.

QUERI was established with a goal of becoming “…a national system to translate research discoveries and innovations into patient care and health systems improvement”. 3 Initial translation efforts were focused on nine conditions or groups of conditions that are prevalent among veterans: heart disease, cerebrovascular disease, type II diabetes, colorectal cancer, prostate disease, spinal cord injury, HIV/AIDS, mental health conditions, and substance use disorders. This initial focus laid the groundwork for projects featured in an article in this issue by Damschroder, Hamilton, and colleagues, who summarize the far‐reaching impacts from a decade of diabetes‐focused QUERI projects. 6 Evaluations of the implementation of the VA's Diabetes Prevention Program led to insights into how to improve the reach of other, related programs; the effectiveness of an online version of the program; and the importance of gender‐specific tailoring of prevention programs.

In the past decade, QUERI has expanded its focus to address broader health system issues that affect multiple conditions and veterans' overall well‐being. 4 The Veterans Access, Choice, and Accountability Act of 2014 (Choice Act) mandated the creation of a commission to examine methods to improve veterans' access to care. In their report, the Commission on Care recommended that the VA leverage data and continuous improvement principles to ensure equitable access to high‐quality care. 7 Around the same time, the Office of Management and Budget urged federal agencies to use evidence to support budget and operational decisions. 8 QUERI's expanded focus was in response to these recommendations, notably by using a learning health system framework for evidence generation and evaluation of quality improvement strategies to inform policy. 4

1. LEVERAGING HEALTH SYSTEM DATA TO GENERATE EVIDENCE

Several articles in this issue highlight the ways in which data can be leveraged within a large health system to identify potential targets for improvement. Shannon et al analyze data from the VA's Survey of Healthcare Experiences of Patients and identify racial disparities in access to VHA care, particularly among veterans belonging to underrepresented groups. 9 Authors of other articles in this issue leveraged data from the VHA's electronic health record (EHR). Using EHR data, Honken et al demonstrate that a program in which funding was made available to hire social workers as members of primary care teams was associated with increased social work service use among rural veterans. 10 Leung et al found that integrated mental health and primary care service provision was associated with higher short‐term depression follow‐up care but not treatment completion. 11

2. IMPLEMENTING EVIDENCE‐BASED PROGRAMS AND TREATMENTS

As part of its focus on continuous quality improvement, QUERI supports studies of the effectiveness of different strategies to implement evidence‐based programs and treatments. This issue features evaluations of the implementation of programs targeting obesity, homelessness, opioid use disorder, and patient safety. Damschroder and colleagues find that although a virtual quality improvement training program does not increase the reach of a weight management program, it is associated with increased use of quality improvement methods. 12 Wyse and colleagues describe the development of an implementation strategy to increase access to buprenorphine in primary care settings for veterans with opioid use disorder. 13 Oberman and colleagues demonstrate the effectiveness of the evidence‐based quality improvement strategy in increasing access to medications for opioid use disorder in primary and mental health care settings. 14 The importance of collaboration and training opportunities for implementation is highlighted by Montgomery et al in their evaluation of the implementation of health care navigator services for veterans with unstable housing 15 and by Sullivan et al in their evaluation of the implementation of a guidebook to standardize patient safety practices. 16 Finley emphasizes the role of trust in forming effective partnerships with non‐VA organizations to implement a suicide risk mitigation program. 17

3. SCALING UP EVIDENCE‐BASED INTERVENTIONS

Continuous quality improvement also relies on the successful scale‐up of evidence‐based interventions. In this issue, the authors highlight the importance of flexibility when scaling up an intervention. Cordasco and colleagues outline an iterative, structured approach they used to adapt and scale up a case management implementation strategy for unstably housed veterans. 18 Blok and colleagues find that early adopters of a family caregiver training intervention were more likely to make adaptations to the intervention. 19 Reisinger and colleagues catalogue implementation strategies used by the VA's Office of Rural Health to see which are most useful for large enterprises implementing initiatives—using iterative strategies was one of the most frequently employed strategies. 20 Other work featured in this issue focuses on estimating the costs of different implementation strategies, which also affect scale‐up. Daniels and colleagues estimate the start‐up costs for using implementation facilitation to set up multidisciplinary pain clinics. 21 Kaufman and colleagues compare the costs associated with two different methods of implementing a mobility improvement intervention among hospitalized older adults. 22

4. EVIDENCE‐BASED POLICYMAKING

More recently, QUERI‐funded work has focused on evidence‐based policymaking. The Foundations for Evidence‐based Policymaking Act of 2018 (Evidence Act) mandated that all cabinet‐level agencies use evidence to support budget and policy decisions. All agencies submit annual evaluation plans and “learning agendas”, strategic documents outlining gaps in evidence needed to support policy and budget decisions, to the Office of Management and Budget to comply with the Evidence Act. The VHA's fiscal years 2022–2026 learning agendas focus on access to care, suicide risk mitigation, and pain management with opioid risk mitigation. A QUERI‐funded center—the Partnered Evidence‐based Policy Resource Center—coordinates the development of these documents for the VHA, and work featured in the VHA's fiscal year 2023 annual evaluation plan 23 and the access to care learning agenda is highlighted in this issue. Shafer and colleagues demonstrate that increasing mental health staffing levels is associated with the initiation of mental health care among transitioning service members. 24

Increasingly, QUERI investigators are being called upon to aid VHA operations leaders in responding to legislative mandates. The VA Maintaining Internal Systems and Strengthening Integrated Outside Networks Act of 2018 (MISSION Act), Commander John Scott Hannon Veterans Mental Health Care Improvement Act of 2019, and Honoring our PACT Act of 2022 are recent examples of legislation calling for additional evidence and mandated reports. 25 , 26 , 27 In this issue, Matthieu and colleagues describe congressionally mandated reports and the process for planning and executing evaluations so that they can effectively inform responses to the mandated reports and programmatic or policy changes. 28

5. EVOLVING INFRASTRUCTURE TO SUPPORT RAPID TRANSLATION OF RESEARCH INTO PRACTICE

As QUERI's focus has evolved from disease‐specific to complex system‐level and policy issues, its infrastructure has also evolved. Early models of continuous quality improvement were more siloed, slowing the communication of evidence and needs for evidence. In contrast, learning health system models of quality improvement rely on the formation of a community of evaluators, implementation experts, and operations leaders who are in constant communication about needs for data, development of evidence, and application of findings. 29 Learning health system models use an iterative process of identifying operational priorities, identifying gaps in evidence to address priorities, rapid and rigorous evaluation to address questions, and communication back to operational stakeholders. 5 Two commentaries in this issue highlight the evolution of QUERI as a learning health system: Beck and colleagues depict QUERI's process for identifying and addressing changing VHA priorities using the example of chronic pain and opioid use disorder. 30 Braganza and colleagues describe QUERI's rapid response team mechanism—a novel infrastructure developed to allow investigators to address operations and policy needs in a timely manner. 31

6. CONCLUSION

Over 25 years, the QUERI program has evolved to meet changing needs of the VHA health care system. Its guiding principles are now being adopted by QUERI's parent program, the VA's Health Systems Research portfolio. Specifically, Health Systems Research priorities are based on the QUERI learning health system framework for establishing evidence generation and evaluation priorities, and are aligned with the VA's Strategic Plan. 5 Moreover, the Health Systems Research portfolio funds centers of innovation and consortia of research to support foundational learning in health systems research, namely implementation science; data science and informatics; science of patient, provider, and community engagement; systems science; and policy science and analysis. 32 These foundational methods support the underlying infrastructures needed for learning health systems to implement embedded research, evaluation, and quality improvement to achieve veteran health care improvement. 33 Together, QUERI and VA Health Systems Research are committed to developing and translating evidence to improve Quintuple Aim goals, including improving care access, quality, costs and value, equity, and experience, serving as a national model for how to use learning health systems to translate evidence into practice and policy.

Garrido MM, Kilbourne AM. Evolution of the Veterans Health Administration Learning Health System: 25 years of QUERI . Health Serv Res. 2024;59(Suppl. 2):e14372. doi: 10.1111/1475-6773.14372

The views expressed are those of the authors and do not necessarily represent the views of the US Department of Veterans Affairs.

[Correction added on 8 October 2024, after first online publication: The copyright line was changed.]

REFERENCES

  • 1. Guise JM, Savitz LA, Friedman CP. Mind the gap: putting evidence into practice in the era of learning health systems. J Gen Intern Med. 2018;33(12):2237‐2239. doi: 10.1007/s11606-018-4633-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Easterling D, Perry AC, Woodside R, Patel T, Gesell SB. Clarifying the concept of a learning health system for healthcare delivery organizations: implications from a qualitative analysis of the scientific literature. Learn Health Syst. 2022;6(2):e10287. doi: 10.1002/lrh2.10287 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Feussner JR, Kizer KW, Demakis JG. The Quality Enhancement Research Initiative (QUERI): from evidence to action. Med Care. 2000;38:I‐1‐I‐6. doi: 10.1097/00005650-200006001-00001 [DOI] [PubMed] [Google Scholar]
  • 4. Kilbourne AM, Elwy AR, Sales AE, Atkins D. Accelerating research impact in a learning health care system: VA's Quality Enhancement Research Initiative in the choice act era. Med Care. 2017;55(Suppl 1):S4‐S12. doi: 10.1097/MLR.0000000000000683 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Braganza MZ, Pearson E, Avila CJ, Zlowe D, Øvretveit J, Kilbourne AM. Aligning quality improvement efforts and policy goals in a national integrated health system. Health Serv Res. 2022;57(S1):9‐19. doi: 10.1111/1475-6773.13944 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Damschroder L, Hamilton A, Farmer MM, et al. Real‐world impacts from a decade of Quality Enhancement Research Initiative (QUERI)‐partnered projects to translate the diabetes prevention program in the Veterans Health Administration. Health Serv Res. 2024;59(Suppl. 2):e14349. doi: 10.1111/1475-6773.14349 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Commission on Care . Commission on Care: Final Report . 2016. Accessed July 9, 2024. https://psnet.ahrq.gov/issue/final-report-commission-care
  • 8. Office of Management and Budget . Memorandum M‐13‐17—Next Steps in the Evidence and Innovation Agenda. https://www.whitehouse.gov/wp-content/uploads/2018/10/m-13-17.pdf
  • 9. Shannon EM, Jones KT, Moy E, Steers WN, Toyama J, Washington DL. Evaluation of regional variation in racial and ethnic differences in patient experience among veterans health administration primary care users. Health Serv Res. 2024;59(Suppl. 2):e14328. doi: 10.1111/1475-6773.14328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Honken AN, Halladay CW, Wootton LE, et al. Differential effects of a social work staffing intervention on social work access among rural and highly rural veterans: a cohort study. Health Serv Res. 2024;59(Suppl. 2):e14327. doi: 10.1111/1475-6773.14327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Leung LB, Chu K, Rose DE, et al. Primary care mental health integration to improve early treatment engagement for veterans who screen positive for depression. Health Serv Res. 2024;59(Suppl. 2):e14354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Damschroder LJ, Evans R, Kim HM, et al. Effectiveness of a virtual quality improvement training program to improve reach of weight management programs within a large health system. Health Serv Res. 2024;59(Suppl. 2):e14344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Wyse JJ, Mackey K, Kauzlarich KA, et al. Improving access to buprenorphine for rural veterans in a learning health care system. Health Serv Res. 2024;59(Suppl. 2):e14346. doi: 10.1111/1475-6773.14346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Oberman RS, Huynh AK, Cummings K, et al. Engaging health care teams to increase access to medications for opioid use disorder. Health Serv Res. 2024;59(Suppl. 2):e14371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Jones K, Cusack M, True G, et al. Connecting unstably housed veterans living in rural areas to health care: perspectives from health care navigators. Health Serv Res. 2024;59(Suppl. 2):e14316. doi: 10.1111/1475-6773.14316 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Sullivan JL, Shin MH, Chan J, et al. Quality Improvement Lessons Learned from National Implementation of the “Patient Safety Events in Community Care Guidebook”. Health Serv Res. 2024;59(Suppl. 2):e14317. doi: 10.1111/1475-6773.14317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Finley EP, Frankfurt SB, Kamdar N, et al. Partnership building for scale‐up in the veteran sponsorship initiative: strategies for harnessing collaboration to accelerate impact in suicide prevention. Health Serv Res. 2024;59(Suppl. 2):e14309. doi: 10.1111/1475-6773.14309 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Cordasco KM, Gabrielian SE, Barnard J, Harris T, Finley EP. A structured approach to adapting an implementation package while scaling up a complex evidence‐based practice. Health Serv Res. 2024;59(Suppl. 2):e14313. doi: 10.1111/1475-6773.14313 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Blok AC, Drake C, Decosimo K, et al. Adaptations and early adoption of a family caregiver intervention in the veterans affairs health care system: a multimethod pragmatic approach for National Scaling. Health Serv Res. 2024;59(Suppl. 2):e14360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Reisinger HS, Barron S, Balkenende E, et al. Tracking implementation strategies in real‐world settings: VA Office of rural health Enterprise‐wide initiative portfolio. Health Serv Res. 2024;59(Suppl. 2):e14377. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Daniels SI, Cave S, Wagner TH, et al. Implementation, intervention, and downstream costs for implementation of a multidisciplinary complex pain clinic in the Veterans Health Administration. Health Serv Res. 2024;59(Suppl. 2):e14345. doi: 10.1111/1475-6773.14345 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Kaufman BG, Hastings SN, Meyer C, et al. The business case for hospital mobility programs in the veteran health care system: results from multi‐hospital implementation of the STRIDE program. Health Serv Res. 2024;59(Suppl. 2):e14307. doi: 10.1111/1475-6773.1430 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. United States Department of Veterans Affairs . Department of Veterans Affairs FY2023 Annual Evaluation Plan. Published online. n.d. Accessed July 12, 2024. https://department.va.gov/wp-content/uploads/2022/09/va-annual-evaluation-plan-2023.pdf
  • 24. Shafer PR, Yuan Y, Feyman Y, et al. Effect of mental health staffing inputs on initiation of care among recently separated veterans. Health Serv Res. 2024;59(Suppl. 2):e14333. doi: 10.1111/1475-6773.14333 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. McCain JS III, Akaka DK, Johnson SR. VA Maintaining Internal Systems and Strengthening Integrated Outside Networks Act of 2018. 2018.
  • 26. Commander John Scott Hannon Veterans Mental Health Care Improvement Act of 2019 . 2020. https://www.congress.gov/bill/116th-congress/senate-bill/785/text
  • 27. Sergeant First Class Heath Robinson Honoring Our Promise to Address Comprehensive Toxics Act of 2022 . 2022.
  • 28. Matthieu MM, Adkins DA, Jones L, et al. Linking implementation science and policy: process and tools for congressionally mandated implementation, evaluation, and reporting. Health Serv Res. 2024;59(Suppl. 2):e14357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Friedman CP. What is unique about learning health systems? Learn Health Syst. 2022;6(3):e10328. doi: 10.1002/lrh2.10328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Beck KL, Kilbourne AM, Gidmark SI, Braganza MZ. Aligning quality improvement, research, and health system goals using the QUERI priority‐setting process: a step forward in creating a learning health system. Health Serv Res. 2024;59(Suppl. 2):e14388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Braganza MZ, Gidmark SI, Taylor AL, Kilbourne AM. Quality Enhancement Research Initiative Rapid Response Teams: A learning health system approach to addressing emerging health system challenges. Health Serv Res. 2024;59(Suppl. 2):e14380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. United States Department of Veterans Affairs . Office of Research and Development Health Systems Portfolio Purview. 2024. Accessed July 14, 2024 https://www.hsrd.research.va.gov/funding/what-is-hsr.cfm
  • 33. Kilbourne AM, Jones PL, Atkins D. Accelerating implementation of research in learning health systems: lessons learned from VA health services research and NCATS clinical science translation award programs. J Clin Transl Sci. 2020;4(3):195‐200. doi: 10.1017/cts.2020.25 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust

RESOURCES