With more than 6 million individuals living with dementia in the United States, 11 million family caregivers, and a majority of persons with dementia ultimately residing in an assisted living community or nursing home,1 providing quality dementia care across disease stages and settings is a public health imperative. Family caregivers are called on to provide extensive assistance to relatives with dementia, long-term care staff typically lack sufficient knowledge to most effectively attend to residents’ cognitive and psychosocial challenges, and optimal models of dementia care often involve providers and services that are not effectively incorporated into the health care delivery system.2 Thus, there is an immediate need to dramatically change how we care for all people living with dementia and support their caregivers. But how?
Since the passage of the 2011 National Alzheimer’s Project Act (NAPA), the National Institute on Aging’s Alzheimer’s disease and Alzheimer’s disease related dementia (AD/ADRD) research portfolio has grown 8-fold.3 This welcome investment has led to a significant expansion in the national scientific infrastructure to support descriptive and intervention studies to advance the science of dementia care. At the same time, new conceptual models have emerged to guide research and intervention development, most notably the National Institutes of Health (NIH) Stage Model. This 5-stage model aims to promote the availability and widespread uptake of effective interventions through 5 activities: basic/descriptive science (stage 0); feasibility and safety testing and refinement (stage I); efficacy testing (stages II and III); effectiveness testing (stage IV); and dissemination/implementation (stage V).4 Within this model, a primary focus of government funding has been on stages 1 to III. A critical gap identified in national research summits and other systematic reviews of the state of the science, however, is the lack of scientific emphasis on and funding support for dissemination and implementation of dementia care interventions.5–7
Among the more vexing issues facing dementia care scientists and funders is the critical question of whether an intervention is “ready” to proceed to dissemination and implementation. The answers to such a question are potentially provided by systematic reviews or meta-analyses. Multiple recent and comprehensive reviews commissioned by federal agencies (which use criteria applied to pharmacologic trials) suggest that owing to a number of methodological issues there are few interventions with proven efficacy for people living with AD/ADRD or their caregivers.8 For those who elevate such findings as definitive, the conclusion that there are few if no interventions ready for dissemination and implementation is understandable.
But are such conclusions warranted? We argue they are not. We make this argument based on the idea that meta-analytic and systematic review techniques typically do not answer the question of whether there exist any individual interventions ready for wider-scale dissemination and implementation. Meta-analyses often rely on the assumption that interventions are able to be collapsed into distinct types within which empirical findings are pooled and compared. Such an approach is reasonable when the interventions under study are easily defined and classified. However, because of intervention complexity, the nature of person-centered care, and various other issues, collapsing dementia care interventions into distinct “types” is difficult. This challenge has led to considerable inconsistency across meta-analyses and systematic reviews as to how individual dementia care interventions are classified (eg, intervention A is labeled as psychoeducational intervention in one meta-analysis and as multicomponent intervention in another), which makes any conclusions as to whether certain types of dementia care interventions are more effective than others opaque, at best.9 We see no indication that even more recent, comprehensive reviews have fully avoided this problem, and indeed it is perhaps unavoidable in dementia care.
A somewhat related issue is that meta-analytic and systematic review techniques essentially use a “between subjects” method to answer a question that essentially requires a within-subjects strategy. Traditional meta-analytic methodology fails when a series of studies consistent with the NIH Stage Model establishes the evidence base and dissemination potential of an individual intervention (eg, a pilot study followed by 1 or more randomized controlled trials, followed by translational studies) only to become obscured in systematic reviews’ inclusion or exclusion criteria and “risk of bias” ratings. The practice of systematic reviews does not capture the within-body evidence of a given intervention program that can better inform whether individual interventions are ready for implementation. Indeed, we have seen firsthand this tension when nationally commissioned evidence reviews are presented to the scientific community and individuals voice concern that the review did not appropriately characterize the evidence of an individual intervention program that was established over years of testing and refinement that then led to successful dissemination and implementation.10
There are numerous key concerns when relying too heavily on systematic reviews to guide dissemination and implementation potential.11 Most notably, because randomized controlled trials are typically conducted in highly controlled circumstances with unrepresentative samples or settings (often to maximize internal validity), recommendations generated by high-quality systematic reviews may lack relevance to public health agencies and other providers because they are not aligned with day-to-day needs and practice considerations (ie, external validity).12–14 In addition, dementia care interventions, which often incorporate multiple components and may face barriers ranging from human subjects regulations to logistical challenges, may not survive risk of bias assessments and so become excluded from reviews and meta-analyses. Recent barriers include those evidenced in promising randomized controlled trials of an online education and cognitive behavior therapy that had a 67% dropout rate,15 of the effect of music on agitation that lacked blinding,16 and of function- and behavior-focused care that indicated recruitment bias.17 In addition, systematic reviews themselves may introduce error, which may or may not have implications for conclusions of efficacy.18–20 Owing to all of the issues raised above, relying solely on systematic reviews as a definitive characterization of whether certain dementia care interventions actually “work” or not and are primed for dissemination and implementation is inappropriate.
At the other end of the spectrum, there is emphasis on advancing evidence that is “informed” by intervention studies while allowing the intervention to be adapted so as to be suitable for a given setting. From this vantage point, progression through the NIH Stage Model is less linear and more dynamic, with adaptation and modification viewed as an expected part of the scientific process to facilitate adoption by tailoring the intervention for their particular population and environment. Ultimately, pragmatic trials are designed to evaluate interventions in real-life situations,21 but even in these trials the extent of generalizability will always be limited because no one population or environment is identical to another.
How then should the dissemination and implementation of interventions be guided? Here we argue for an adaptive approach and provide an argument for its support. Implementation science expert Enola Proctor addresses the question of implementation readiness in a compelling and direct way. Simply stated, she suggests, “We implement the best evidence we have.”22 Building on that point, we acknowledge the many merits of systematic reviews and pragmatic trials, and the necessity of conducting robust research at early stages of the NIH Stage Model to bolster the evidence supporting dementia care theories, conceptual models, and intervention mechanisms that result in more consistent efficacy and effectiveness. However, we also believe in a more dynamic, circular model of intervention development that does not necessarily progress in linear fashion through the NIH Stage Model in order to proceed to dissemination and implementation; indeed, even the graphic of the NIH Stage Model allows for a circuitous path. Moreover, we approach adaptation as a natural part of intervention development, albeit a nuanced one, and essential to the full development of an intervention. Implementation science offers comprehensive frameworks to guide various levels of adaptation in an intervention,23 and perhaps most critically offers insights as to those elements of an intervention that are adaptable (eg, “surface” elements that do not alter the core elements of an intervention), and those aspects of an intervention that, if adapted, fundamentally change its nature.24
In successful implementation, efficacy or effectiveness is only 1 component of a more complex formulation. Considered more broadly, an efficacious intervention may be too expensive to implement in the real world, require too much training, depend on a workforce that is scarce or unprepared, involve technologies that are costly or outdated, have overly complex procedures, or not matter to various stakeholders. Alternatively, an intervention with low or moderate efficacy or effectiveness may be valued by caregivers, people with dementia, health care systems, or community-based care organizations for numerous reasons: their current dementia care is suboptimal or harmful; the intervention is easy to use and deemed acceptable, appropriate, and feasible; and training requirements to implement the intervention seamlessly fit everyday operations and workflows. We emphasize that adopting a more contextual-based approach—one that considers factors other than P values in classic efficacy trials, or meeting the risk of bias bar in systematic reviews—to determine which interventions are “ready” for dissemination and implementation can truncate the long and leaky intervention pipeline and ultimately result in true changes in dementia care.11
Based on this point of view, we put forward 3 guiding principles when considering dissemination and implementation readiness of dementia care interventions:
The evidence base of dementia care interventions requires ongoing development. Until NAPA, support for the design and evaluation of dementia care interventions was limited. An ongoing focus on stage 0–stage III research, as is now readily available through an expanded federal research infrastructure, is welcome and we hope will continue to build the evidence base. National research recommendations to enhance the rigor of dementia care intervention science are available5,6,25 and are guiding this critical, ongoing work.
We must incorporate implementation science principles throughout the life cycle of intervention development. Considering intervention development in strictly linear fashion is not conducive to creating dementia care innovations that are scalable, sustainable, and adaptable. There exist various methodological innovations that can facilitate and expedite the dissemination and implementation process and should be integrated throughout the life cycle of intervention development (ie, stage 0 to stage V).12 These foci include robust stakeholder engagement,26 health equity frameworks, implementation science models including those that can guide adaptation,23,24 and advanced intervention designs that optimize an intervention for subsequent implementation in different health care settings and racially and ethnically diverse populations.27,28
The heterogeneous nature of intervention evidence is to be embraced, not shunned. We argue that a fuller accounting of available research, including translational and observational studies, is needed when taking stock of the evidence supporting dementia care interventions. Limiting scientific and lay discourse to results of systematic reviews and meta-analyses does a disservice to the needs of providers, families, and persons living with dementia and omits important contextual information.10,14 It calls to mind the proverbial “throwing out the baby with the bathwater.”
Adopting a broader contextual perspective when designing, evaluating, and disseminating or implementing dementia care interventions is necessary to ensure that people living with AD/ADRD, their caregivers, and professional care providers have access to the most promising programs available.29 Indeed, given the considerable investment of time, resources, and people that has occurred to advance dementia care intervention science, creating more effective pathways to dissemination and implementation is not simply a scholarly endeavor but an ethical one.
Acknowledgments
This work was supported by the National Institute on Aging (NIA) of the National Institutes of Health under Award U54AG063546 [which funds the NIA Imbedded Pragmatic Alzheimer’s Disease (AD) and AD-Related Dementias Clinical Trials (IMPACT) Collaboratory]. The content is solely the responsibility of the author and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
The authors declare no conflicts of interest.
References
- 1.The Alzheimer’s Association. 2021. Alzheimer’s disease facts and figures. Alzheimers Dement 2021;17:327–406. [DOI] [PubMed] [Google Scholar]
- 2.Coe NB, Boyd CM, Chodosh J. Chronic care, dementia care management, and financial considerations. J Am Med Dir Assoc 2021;22:1371–1376. [DOI] [PubMed] [Google Scholar]
- 3.Hodes R Alzheimer’s disease and related dementias research update: Advisory Council on Alzheimer’s Research, Care, and Services Meeting. National Institute on Aging. 2021. Available at: https://aspe.hhs.gov/sites/default/files/private/aspe-files/265461/mtg40-slides10.pdf. Accessed August 18, 2021. [Google Scholar]
- 4.Onken LS, Carroll KM, Shoham V, et al. Reenvisioning clinical science: Unifying the discipline to improve the public health. Clin Psychol Sci 2014;2:22–34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Gitlin LN, Maslow K. Research summit on dementia care: Overview and recommendations. Advisory Council on Alzheimer’s Research, Care, and Services. 2017. Available at: https://aspe.hhs.gov/advisory-council-october-2017-meeting-presentation-care-summit-overview-and-recommendations. Accessed January 12, 2018. [Google Scholar]
- 6.National Institute on Aging. National Research Summit on Care, Services, and Supports for Persons with Dementia and Their Caregivers: Summit Virtual Meeting Series—Summary Report. Bethesda, MD: National Institute on Aging/National Institutes of Health. 2020. Available at: https://www.nia.nih.gov/sites/default/files/2021-01/DementiaCareSummitReport.pdf. Accessed August 18, 2021. [Google Scholar]
- 7.National Academies of Sciences, Engineering, and Medicine. Reducing the Impact of Dementia in America: A Decadal Survey of the Behavioral and Social Sciences. Washington, DC: The National Academies Press; 2021. [PubMed] [Google Scholar]
- 8.Butler M, Gaugler JE, Talley KMC, et al. Care Interventions for People Living With Dementia and Their Caregivers. Rockville, MD: Agency for Healthcare Research and Quality; 2020. [Google Scholar]
- 9.Gaugler JE, Jutkowitz E, Shippee TP, Brasure M. Consistency of dementia caregiver intervention classification: An evidence-based synthesis. Int Psychogeriatr 2017;29:19–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hodgson N, Gitlin LN. Implementing and sustaining family care programs in real world settings: barriers and facilitators. In: Gaugler JE, editor. Bridging the Family Care Gap. Washington, DC: Academic Press; 2021. p. 179–220. [Google Scholar]
- 11.Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health 2009;30:151–174. [DOI] [PubMed] [Google Scholar]
- 12.Gitlin LN, Baier RR, Jutkowitz E, et al. Dissemination and implementation of evidence-based dementia care using embedded pragmatic trials. J Am Geriatr Soc 2020;68:S28–S36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gitlin LN, Hodgson N. Caregivers as therapeutic agents in dementia care: The evidence-base for interventions supporting their role. In: Gaugler JE, Kane RL, editors. Family Caregiving in the New Normal. Philadelphia, PA: Elsevier; 2015. p. 305–356. [Google Scholar]
- 14.Gitlin LN, Marx K, Stanley IH, Hodgson N. Translating evidence-based dementia caregiving interventions into practice: State-of-the-science and next steps. Gerontologist 2015;55:210–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fossey J, Charlesworth G, Fowler JA, et al. Online education and cognitive behavior therapy improve dementia caregivers’ mental health: A randomized trial. J Am Med Dir Assoc 2021;22:1403–1409.e1401. [DOI] [PubMed] [Google Scholar]
- 16.Harrison TC, Blozis SA, Schmidt B, et al. Music compared with auditory books: A randomized controlled study among long-term care residents with Alzheimer’s disease or related dementia. J Am Med Dir Assoc 2021;22:1415–1420. [DOI] [PubMed] [Google Scholar]
- 17.Galik EM, Resnick B, Holmes SD, et al. A cluster randomized controlled trial testing the impact of function and behavior focused care for nursing home residents with dementia. J Am Med Dir Assoc 2021;22:1421–1428.e1424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lee YF, Hsu TW, Liang CS, et al. The efficacy and safety of tube feeding in advanced dementia patients: A systemic review and meta-analysis study. J Am Med Dir Assoc 2021;22:357–363. [DOI] [PubMed] [Google Scholar]
- 19.Gualberto Cintra MT, de Rezende NA, da Gama Torres HO. Questions about the results described in the article “The efficacy and safety of tube feeding in advanced dementia patients: A systemic review and meta-analysis study.”. J Am Med Dir Assoc 2021;22:1561. [DOI] [PubMed] [Google Scholar]
- 20.Liang CS, Chu CS. Response letter regarding “questions about the results described in the article: ‘the efficacy and safety of tube feeding in advanced dementia patients: A systemic review and meta-analysis study.’”. J Am Med Dir Assoc 2021;22:1561–1562. [DOI] [PubMed] [Google Scholar]
- 21.Zimmerman S, Sloane PD. Making pragmatic trials pragmatic in post-acute and long-term care settings. J Am Med Dir Assoc 2019;20:107–109. [DOI] [PubMed] [Google Scholar]
- 22.Proctor E Implementation outcomes: Their role in treatment success. NIA IMPACT Collaboratory Grand Rounds, 2020. Available at: https://dcricollab.dcri.duke.edu/sites/impact/Knowledge%20Repository/2020-11-19-GR-Slides-IMPACT.pdf. Accessed August 18, 2021. [Google Scholar]
- 23.Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci 2019;14:58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Baumann A, Cabassa LJ, Stirman SW. Adaptation in dissemination and implementation science. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. Oxford: Oxford University Press; 2017. p. 286–300. [Google Scholar]
- 25.National Academies of Sciences, Engineering, and Medicine. Meeting the Challenge of Caring for Persons Living with Dementia and Their Care Partners and Caregivers: A Way Forward. Washington, DC: The National Academies Press; 2021. [PubMed] [Google Scholar]
- 26.Minkler M, Salvatore AL. Participatory approaches for study design and analysis in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice. Oxford: Oxford University Press; 2017. p. 175–191. [Google Scholar]
- 27.Collins LM. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (MOST). New York: Springer; 2018. [Google Scholar]
- 28.Curran GM, Bauer M, Mittman B, et al. Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012;50:217–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gitlin LN, Czaja SJ, editors. Behavioral Intervention Research: Designing, Evaluating, and Implementing. New York: Springer; 2016. [Google Scholar]
