Skip to main content
Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease logoLink to Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease
editorial
. 2022 Jun 29;11(13):e026677. doi: 10.1161/JAHA.122.026677

Translating Clinical Guidelines Into Care Delivery Innovation: The Importance of Rigorous Methods for Generating Evidence

Adam N Berman 1, Jason H Wasfy 2,
PMCID: PMC9333392  PMID: 35766287

Translating novel science and clinical guidelines into practice is a vital step toward improving the health of populations. This is particularly true for outpatient management and transitional care after hospital discharge, where social determinants of health and logistical complexities can obstruct patients from receiving the therapies they need.

In the delivery of cardiovascular care, numerous apparent gaps exist. Many patients with atrial fibrillation are not on appropriate anticoagulation, 1 many heart failure readmissions appear preventable, 2 and many patients with a history of atherosclerotic cardiovascular disease are not on appropriate statin therapy. 3 These gaps raise the possibility that innovations in care delivery could be associated with major improvements in quality. The impact of such interventions can be large, similar to the treatment effects of novel drugs and devices. In fact, one recent innovation, a remote lipid management program for patients at high atherosclerotic cardiovascular disease risk, achieved a 45% overall decrease in low‐density lipoprotein through an algorithmic, navigator‐led program. 4 Given these observed quality gaps, it is critical to study the way we deliver care with the same rigor that we study other biomedical innovations.

However, evaluating differences in outcomes associated with innovations in care delivery is complex. Single‐center results may not be widely generalizable to other patient populations or health care systems. Furthermore, results of nonrandomized observational analyses may be plagued by confounding and treatment selection bias. For example, patients who receive an intervention could differ from those who do not in ways that are hard to measure or adjust for. One striking example was the “hot‐spotting” program created by the Camden Coalition of Healthcare Providers, designed to improve the quality of care and reduce spending for patients with very high utilization of healthcare services. 5 The program identified medically and socially complex patients and provided them with a wide range of comprehensive face‐to‐face services. The program reached national prominence as a model for care delivery, and versions of it were adopted around the United States. However, when the model was tested in a randomized controlled trial of 800 patients, there was no significant difference in the study's primary end point of 180‐day readmissions. The authors noted that had the study focused solely on a single‐arm comparison of the intervention group before and after program enrollment, they would have been misled by a 38% decline in readmissions. Such an apparent decline could have simply reflected regression to the mean. The true effect of the program, in this case, no effect, was only evident after being subjected to randomization with a control group. Adding to the complexity of these methodological issues, however, is that similar interventions have been effective in other single‐center randomized trials of high‐risk patients. 6 Accordingly, even randomized trials in different settings can yield discrepant results, underscoring the limited external validity of small trials.

Given the critical importance of understanding how to deliver better care and the difficulties interpreting smaller or observational analyses, large randomized controlled trials that involve multiple sites have a critical role. These types of trials, however, are logistically challenging and expensive.

As such, when large, multicenter studies of health care delivery interventions are attempted, the trialists should be warmly praised. In this issue of the Journal of the American Heart Association (JAHA), Ho and colleagues implemented a multicenter trial aimed at improving P2Y12 medication adherence after percutaneous coronary intervention (PCI). 7 Prior analyses have demonstrated that a significant percentage of patients delay filling their P2Y12 medication on hospital discharge, and many others discontinue their P2Y12 agent prematurely. Given the strong evidence for the benefit of a course of a P2Y12 inhibitor after PCI, developing approaches to increase medication adherence should improve patient outcomes.

Despite implementing a multifaceted program that included patient education, delivery of the medication to the bedside, reminder calls, and patient outreach, the intervention produced mixed results. Patients were less likely to delay filling their P2Y12 medication at discharge and were more likely to be adherent at 1 year. However, those in the intervention group had higher rates of 1‐year major adverse cardiovascular events, driven primarily by repeated. In addition, there were logistical challenges implementing the intervention, including institutional review board delays, staffing difficulties, and delays in rolling out the intervention at study sites. These reported challenges highlight how difficult large, multicenter pragmatic trials are to implement.

Using a stepped‐wedge approach, this trial demonstrates that a pragmatic intervention – designed to facilitate broad adoption – can reduce P2Y12 prescription filling delays and improve overall adherence over a 1‐year period. Although the increased rate of repeated is difficult to interpret, it is reassuring (and in line with P2Y12 clinical trial data) that subsequent myocardial infarction, stroke, and death were reduced in the intervention arm. Accordingly, despite conflicting clinical outcomes, this study is an important addition to the science of improving P2Y12 adherence after PCI.

To improve the quality of pragmatic implementation trials in cardiology, it is important to reflect on prior work to determine themes that may be helpful in designing future interventions.

Learning From Past Implementation Challenges

Complex problems that require multiple levels of interventions and are dependent on many external factors pose a challenge for implementation science. A prime example that has been studied repeatedly without significant success are interventions targeting heart failure readmissions. Despite incredibly varied, innovative, and intensive interventions, few (if any) have demonstrated success when tested in randomized controlled trials. 8 , 9 , 10 , 11 , 12 , 13 Most recently, Asch and colleagues provided patients with digital scales, electronic pill bottles, and lottery‐based financial incentives for adherence. 8 Each patient's longitudinal clinician was sent weight information via the electronic health record, and patients were called by study staff if they were not adherent to daily weights or did not open their diuretic pill bottles for an extended period. Despite the innovative design and use of behavioral economics, outcomes were identical between the intervention and control arms of the study. Although a recent randomized controlled trial in Poland demonstrated a benefit of a multimodal telemedicine approach to preventing heart failure readmissions, 14 it may lack generalizability to the US healthcare system and heart failure population with heart failure, especially considering the numerous similar studies in the United States that have produced negative results. Preventing readmissions after an acute heart failure exacerbation requires a multitude of interventions and is likely dependent on many external factors (eg, home environment and access to healthy food), which are more difficult to modify in a clinical intervention.

Clinical scenarios that require significant patient and provider “buy‐in” pose an additional barrier to success. For instance, appropriate anticoagulation in atrial fibrillation is one such arena that has been frequently targeted in implementation research. Despite a host of innovative approaches aimed at improving guideline‐recommended anticoagulation prescribing, these interventions have largely failed. 15 , 16 , 17 , 18 In the SUPPORT‐AF II (Supporting Use of Anticoagulants Through Provider Profiling of Oral Anticoagulant Therapy for Atrial Fibrillation) trial, clinicians were sent clear graphics highlighting their anticoagulation percentage relative to peers as well as information about the calculated 5‐year stroke risk (estimated via the CHA2DS2‐VASC score) for patients on their panel who have atrial fibrillation but were not on anticoagulation. 18 In addition, clinicians were offered academic detailing to learn more about the appropriate use of anticoagulation in atrial fibrillation. Despite these efforts, there was no increase in anticoagulation in the intervention group. When physicians were surveyed as to the reasons anticoagulation was not instituted, clinical gestalt (whether justifiable or not) and patient preference were the primary justifications for not initiating anticoagulation. In contrast, a study aimed at improving anticoagulation uptake in middle‐income countries through education efforts targeting both patients and clinicians yielded a significant increase in anticoagulation uptake. 19 From this and other work, we can infer that interventions requiring significant “buy‐in” to alter strongly held baseline beliefs may face implementation challenges.

Learning From Past Implementation Successes

Focused interventions with clear metrics of success may be optimal for testing innovative models of care delivery. Two such areas where novel implementation strategies have demonstrated improved outcomes include hypertension and dyslipidemia. Both conditions have clear targets and clear methods to achieve guideline‐based goals. With clear, objective targets, the management challenge is medication titration and frequent follow‐up. For these disease states, creating algorithmized pathways and training nonphysicians to institute and monitor progress have yielded impressive results. 4 , 20 , 21 Accordingly, testing interventions in clinical conditions for which there is broad management agreement may yield important information. 22 As past successes have demonstrated, creating programs that unload (rather than burden) the primary longitudinal clinician may further increase the chance of success.

Finally, interventions that harness insights from behavioral science to improve care delivery may prove beneficial. Specifically, certain types of intervention strategies, commonly known as “nudges,” are designed to influence behavior without restricting choice. 23 For instance, when researchers instituted a default opt‐out decision pathway for referral to cardiac rehabilitation, they noted a 47% increase in rehabilitation referrals. 24 This type of strategy has also been implemented in other clinical areas with promising results. 23 Intentionally designing and optimizing health technology to facilitate appropriate clinical decisions without burdening the clinician can incorporate these insights from behavioral science to improve care delivery. 25

The Necessary Path Forward for Trials in Cardiology Care Delivery Innovation

Both the importance and the difficulty of determining optimal approaches for improving care delivery cannot be overstated. As we work to close existing gaps in clinical care and as new technologies emerge, methods to widely implement evidence‐based medical practices must evolve. As part of this important work, Ho and colleagues implemented a multilayered program to improve P2Y12 adherence. Although their intervention produced mixed results, it nevertheless stands as an important model for implementation science. As a large, multicenter, step‐wedged randomized controlled trial, this work reinforces the importance – and the difficulty – of subjecting care delivery innovation to rigorous testing methods. The logistical challenges that these trialists encountered (namely, institutional review board delays, staffing difficulties, and site drop out) are likely to be a challenge for other investigators designing large, multicenter trials of care delivery. Anticipating these difficulties or exploring creative collaborations with established clinical trials groups around the country to streamline trial implementation may decrease the barriers to successful implementation research. Future endeavors should look to this work and others in this important field as guideposts for innovating, testing, and implementing novel approaches with the goal of improving care delivery.

Disclosures

Dr Wasfy is supported by a grant from the American Heart Association (18 CDA 34110215) and has received past consulting fees from Pfizer. Dr Berman has no disclosures to report.

The opinions expressed in this article are not necessarily those of the editors or of the American Heart Association.

For Disclosures, see page 3.

See Article by Ho et al.

Contributor Information

Adam N. Berman, Email: aberman@bwh.harvard.edu.

Jason H. Wasfy, Email: jwasfy@mgh.harvard.edu.

References

  • 1. Hsu JC, Maddox TM, Kennedy KF, Katz DF, Marzec LN, Lubitz SA, Gehi AK, Turakhia MP, Marcus GM. Oral anticoagulant therapy prescription in patients with atrial fibrillation across the spectrum of stroke risk: insights from the NCDR PINNACLE registry. JAMA Cardiol. 2016;1:55–62. doi: 10.1001/jamacardio.2015.0374 [DOI] [PubMed] [Google Scholar]
  • 2. Gheorghiade M, Vaduganathan M, Fonarow GC, Bonow RO. Rehospitalization for heart failure: problems and perspectives. J Am Coll Cardiol. 2013;61:391–403. doi: 10.1016/j.jacc.2012.09.038 [DOI] [PubMed] [Google Scholar]
  • 3. Rosenson RS, Kent ST, Brown TM, Farkouh ME, Levitan EB, Yun H, Sharma P, Safford MM, Kilgore M, Muntner P, et al. Underutilization of high‐intensity statin therapy after hospitalization for coronary heart disease. J Am Coll Cardiol. 2015;65:270–277. doi: 10.1016/j.jacc.2014.09.088 [DOI] [PubMed] [Google Scholar]
  • 4. Plutzky J, Benson MD, Chaney K, Bui TV, Kraft M, Matta L, McPartlin M, Zelle D, Cannon CP, Dodek A, et al. Population health management of low‐density lipoprotein cholesterol via a remote, algorithmic, navigator‐executed program. Am Heart J. 2022;243:15–27. doi: 10.1016/j.ahj.2021.08.017 [DOI] [PubMed] [Google Scholar]
  • 5. Finkelstein A, Zhou A, Taubman S, Doyle J. Health care hotspotting—a randomized, controlled trial. N Engl J Med. 2020;382:152–162. doi: 10.1056/NEJMsa1906848 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Powers BW, Modarai F, Palakodeti S, Sharma M, Mehta N, Jain SH, Garg V. Impact of complex care management on spending and utilization for high‐need, high‐cost medicaid patients. Am J Manag Care. 2020;26:e57–e63. doi: 10.37765/ajmc.2020.42402 [DOI] [PubMed] [Google Scholar]
  • 7. Ho PM, McCreight M, Bavry AA, Bosworth HB, Girotra S, Grossman PM, Helfrich C, Latif F, Lu D, Matheny M, et al. Multi‐faceted intervention to improve P2Y12 inhibitor adherence after percutaneous coronary intervention: a stepped wedge trial. J Am Heart Assoc. 2022;11:e024342. doi: 10.1161/JAHA.121.024342 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Asch DA, Troxel AB, Goldberg LR, Tanna MS, Mehta SJ, Norton LA, Zhu J, Iannotte LG, Klaiman T, Lin Y, et al. Remote monitoring and behavioral economics in managing heart failure in patients discharged from the hospital: a randomized clinical trial. JAMA Intern Med. 2022;182(6):643–649. doi: 10.1001/jamainternmed.2022.1383 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Baecker A, Meyers M, Koyama S, Taitano M, Watson H, Machado M, Nguyen HQ. Evaluation of a transitional care program after hospitalization for heart failure in an integrated health care system. JAMA Netw Open. 2020;3:e2027410. doi: 10.1001/jamanetworkopen.2020.27410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. DeVore AD, Granger BB, Fonarow GC, Al‐Khalidi HR, Albert NM, Lewis EF, Butler J, Piña IL, Allen LA, Yancy CW, et al. Effect of a hospital and postdischarge quality improvement intervention on clinical outcomes and quality of care for patients with heart failure with reduced ejection fraction: the CONNECT‐HF randomized clinical trial. JAMA. 2021;326:314–323. doi: 10.1001/jama.2021.8844 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Freund Y, Cachanado M, Delannoy Q, Laribi S, Yordanov Y, Gorlicki J, Chouihed T, Féral‐Pierssens AL, Truchot J, Desmettre T, et al. Effect of an emergency department care bundle on 30‐day hospital discharge and survival among elderly patients with acute heart failure: the ELISABETH randomized clinical trial. JAMA. 2020;324:1948–1956. doi: 10.1001/jama.2020.19378 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Van Spall HGC, Lee SF, Xie F, Oz UE, Perez R, Mitoff PR, Maingi M, Tjandrawidjaja MC, Heffernan M, Zia MI, et al. Effect of patient‐centered transitional care services on clinical outcomes in patients hospitalized for heart failure: the PACT‐HF randomized clinical trial. JAMA. 2019;321:753–761. doi: 10.1001/jama.2019.0710 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Ong MK, Romano PS, Edgington S, Aronow HU, Auerbach AD, Black JT, De Marco T, Escarce JJ, Evangelista LS, Hanna B, et al. Effectiveness of remote patient monitoring after discharge of hospitalized patients with heart failure: the better effectiveness after transition—heart failure (BEAT‐HF) randomized clinical trial. JAMA Intern Med. 2016;176:310–318. doi: 10.1001/jamainternmed.2015.7712 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Krzesinski P, Jankowska EA, Siebert J, Galas A, Piotrowicz K, Stanczyk A, Siwołowski P, Gutknecht P, Chrom P, Murawski P, et al. Effects of an outpatient intervention comprising nurse‐led non‐invasive assessments, telemedicine support and remote cardiologists' decisions in patients with heart failure (AMULET study): a randomised controlled trial. Eur J Heart Fail. 2022;24:565–577. doi: 10.1002/ejhf.2358 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Siontis KC, Montori VM, Noseworthy PA. Multimodal interventions to increase anticoagulant utilization in atrial fibrillation: futile without patient engagement? Circ Cardiovasc Qual Outcomes. 2020;13:e006418. doi: 10.1161/CIRCOUTCOMES.120.006418 [DOI] [PubMed] [Google Scholar]
  • 16. Ashburner JM, Atlas SJ, Khurshid S, Weng LC, Hulme OL, Chang Y, Singer DE, Ellinor PT, Lubitz SA. Electronic physician notifications to improve guideline‐based anticoagulation in atrial fibrillation: a randomized controlled trial. J Gen Intern Med. 2018;33:2070–2077. doi: 10.1007/s11606-018-4612-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Wang SV, Rogers JR, Jin Y, DeiCicchi D, Dejene S, Connors JM, Bates DW, Glynn RJ, Fischer MA. Stepped‐wedge randomised trial to evaluate population health intervention designed to increase appropriate anticoagulation in patients with atrial fibrillation. BMJ Qual Saf. 2019;28:835–842. doi: 10.1136/bmjqs-2019-009367 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Kapoor A, Amroze A, Vakil F, Crawford S, Der J, Mathew J, Alper E, Yogaratnam D, Javed S, Elhag R, et al. SUPPORT‐AF II: supporting use of anticoagulants through provider profiling of oral anticoagulant therapy for atrial fibrillation: a cluster‐randomized study of electronic profiling and messaging combined with academic detailing for providers making decisions about anticoagulation in patients with atrial fibrillation. Circ Cardiovasc Qual Outcomes. 2020;13:e005871. doi: 10.1161/CIRCOUTCOMES.119.005871 [DOI] [PubMed] [Google Scholar]
  • 19. Vinereanu D, Lopes RD, Bahit MC, Xavier D, Jiang J, Al‐Khalidi HR, He W, Xian Y, Ciobanu AO, Kamath DY, et al. A multifaceted intervention to improve treatment with oral anticoagulants in atrial fibrillation (IMPACT‐AF): an international, cluster‐randomised trial. Lancet. 2017;390:1737–1746. doi: 10.1016/S0140-6736(17)32165-7 [DOI] [PubMed] [Google Scholar]
  • 20. Scirica BM, Cannon CP, Fisher NDL, Gaziano TA, Zelle D, Chaney K, Miller A, Nichols H, Matta L, Gordon WJ, et al. Digital care transformation: interim report from the first 5000 patients enrolled in a remote algorithm‐based cardiovascular risk management program to improve lipid and hypertension control. Circulation. 2021;143:507–509. doi: 10.1161/CIRCULATIONAHA.120.051913 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Green BB, Cook AJ, Ralston JD, Fishman PA, Catz SL, Carlson J, Carrell D, Tyll L, Larson EB, Thompson RS. Effectiveness of home blood pressure monitoring, web communication, and pharmacist care on hypertension control: a randomized controlled trial. JAMA. 2008;299:2857–2867. doi: 10.1001/jama.299.24.2857 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Bergethon KE, Wasfy JH. Increasing the adoption and diffusion of a novel pharmacological therapy that is both mortality reducing and cost‐effective. J Am Heart Assoc. 2019;8:e011783. doi: 10.1161/JAHA.118.011783 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Patel MS, Volpp KG, Asch DA. Nudge units to improve the delivery of health care. N Engl J Med. 2018;378:214–216. doi: 10.1056/NEJMp1712984 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Adusumalli S, Jolly E, Chokshi NP, Gitelman Y, Rareshide CAL, Kolansky DM, Patel MS. Referral rates for cardiac rehabilitation among eligible inpatients after implementation of a default opt‐out decision pathway in the electronic medical record. JAMA Netw Open. 2021;4:e2033472. doi: 10.1001/jamanetworkopen.2020.33472 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Pirruccello JP, Traynor KC, Natarajan P, Brown C, Hidrue MK, Rosenfield KA, Kathiresan S, Wasfy JH. An electronic cardiac rehabilitation referral system increases cardiac rehabilitation referrals. Coron Artery Dis. 2017;28:342–345. doi: 10.1097/MCA.0000000000000491 [DOI] [PubMed] [Google Scholar]

Articles from Journal of the American Heart Association: Cardiovascular and Cerebrovascular Disease are provided here courtesy of Wiley

RESOURCES