Abstract
This article provides an overview of evidence to support a call to action for dementia researchers to ensure that “what matters to people living with dementia” should be at the heart of any decision‐making around the choices and design of outcome measures. There have been sufficient reviews observing how the outcome measures that have been used in previous research have not been those that have been valued by people living with dementia or their carers. If researchers continue to use existing measures that are not valued by people living with dementia, they will waste limited research resources by using measures that are not sufficiently sensitive to detect changes that might be attributed to interventions. It is time for researchers to collaborate internationally to ensure that resources are invested in designing and validating new approaches for measurement of psychosocial outcomes for those living with dementia.
Highlights
Outcome measures that have been used in previous research have not been those that have been valued by people living with dementia or their carers.
Existing outcome measures have been shown not to be fit for purpose and tend to focus on symptom reduction or broad conceptualizations of quality of life.
Dementia researchers will need to collaborate internationally to ensure that resources are invested in designing and validating new approaches for measurement of psychosocial outcomes for those living with dementia.
Keywords: Alzheimer's disease, core outcome set, dementia, measurement, outcome
1. BACKGROUND
It has been both a privilege and opportunity to be able to highlight the progress on the importance of this topic through presenting a keynote presentation at the Workshop on Clinically Meaningful Outcomes in Alzheimer's disease and related dementias (AD/ADRD) Trials, held on March 12, 2024. This article summarizes that presentation by one of the authors (S.R.) and the discussion afterwards. We hope it will encourage more dementia researchers to critically consider “what matters to people living with dementia” when making decisions on the choices and design of outcome measures. If the outcomes do not reflect what matters to people with dementia, researchers are likely to be measuring the wrong things. The article initially outlines some background detail on the basics of outcome measurement—definitions, literature, and challenges. Then we highlight previous research on the development of a core outcome set for what matters most to people with dementia living at home 1 , 2 , 3 , 4 , 5 showing that the outcome measures that have been used in previous research have not been those that have been valued by people living with dementia or their carers. Finally, we outline some discussion, reflections, and implications for research with a focus upon the current state of outcome measurement and possible ways forward and a call to action. There are a variety of definitions of an outcome. It is “a natural or artificially designated point in the care of an individual or population suitable for assessing the effect of an intervention, or lack of intervention.” 6 It is also important to recognize the temporal nature of outcomes, which are “a measurable change in health status, sometimes attributable to a risk factor or an intervention.” 7 A patient‐reported outcome (PRO) is “any report of the status of a patient's health condition that comes directly from the patient without interpretation of the patient's response by a clinician or anyone else.” 8 And patient‐reported outcome measures (PROMs) “are instruments that are used to measure the PROs, most often self‐report questionnaires.” 9 The selection of appropriate outcomes, or domains of outcomes, is a crucial part of designing trials and evaluations in ways that minimize bias. Furthermore, outcomes need to be relevant and important to key stakeholders or interested parties making decisions about health and social care, especially in the choice of the primary outcome measure. 10 Outcome measures designed to measure change within individuals over time are dependent not only on their reliability and validity, but also on their responsiveness, their ability to detect minimal clinically important differences. 11
Where might researchers start to look to identify appropriate outcome measures? From our experience of working in this field for over a decade, we identify the following sources, but these are by no means exhaustive:
Systematic reviews on the quality of outcome measurement instruments would be a good place to start. For example, one might look in the COSMIN Database for Systematic Reviews to investigate whether a review of interest is available. The COSMIN initiative aims to improve the selection of outcome measurement instruments for research and clinical practice by developing methodology and practical tools for selecting the most suitable outcome measurement instrument. As part of this initiative, COSMIN systematically collects systematic reviews of outcome measurement instruments. Such systematic reviews are important tools for the selection of outcome measurement instruments for research and clinical practice and for identifying gaps in knowledge on the quality measurement properties of outcome measurement instruments.
The Core Outcome Measures in Effectiveness Trials (COMET) initiative https://www.comet‐initiative.org/ brings together people interested in the development and application of agreed standardized sets of outcomes, known as “core outcome sets” (COS). These sets represent the minimum that should be measured and reported in all clinical trials of a specific condition, but COS are also suitable for use in routine care, clinical audit, and research other than randomized trials. The existence or use of a core outcome set does not imply that outcomes in a particular study should be restricted to those in the relevant core outcome set. Rather, there is an expectation that the core outcomes will be collected and reported, making it easier for the results of studies to be compared, contrasted, and combined as appropriate, while researchers continue to explore other outcomes as well.
The Patient‐Reported Outcomes Measurement Information System PROMIS: PROMIS (healthmeasures.net) displays a set of reliable and valid patient‐reported outcome measurement instruments for measuring aspects of physical, mental, and social health, which can universally be applied to adults and children with or without (chronic) diseases. However, at the time of writing none are focused specifically on dementia.
For clinical practice purposes, the International Consortium for Health Outcomes Measurement (ICHOM) produce standard outcome sets patient‐centered outcomes through value‐based healthcare and have recommended the outcomes “that matter most to persons with Dementia”. This standard set of outcomes includes measures for motor function, communication, sleep, learning disorders, aggression, caregiver burden, and overall quality of life. These are recommended for providers of care around the world to measure and monitor the outcomes, with the ultimate goal of improving the value of care. However, this was developed with minimal input from people living with dementia and used existing conceptualizations of outcomes/domains.
There are a number of reviews and consensus exercises that explore what outcomes have been and should be measured in either care or trials of effectiveness for interventions designed for people living with dementia. Some of these claim to look at what outcomes “matter most,” but there are differences in how this is done. Some reviews are focused on what has been measured previously. For example, a team of researchers aimed to describe the outcome measures used in dementia and mild cognitive impairment intervention studies, with particular interest in those evaluating patient‐centered outcomes of functional performance and quality of life. They reviewed 676 dementia trials and 129 mild cognitive impairment trials identified from the Cochrane Dementia and Cognitive Improvement Review Group's register of studies, ALOIS, representing all registered dementia and mild cognitive impairment intervention studies over a 10‐year period (2004–2014). 12 What was striking was only 13% of studies measured quality of life. Seventy percent of trials reported cognitive outcomes and 29% measured functional performance. The authors noted that “This focus on cognitive performance questions the extent to which intervention studies for dementia are evaluating outcome measures which are relevant to individual patients and their carers.” And they also noted that “The heterogeneity in measures, use of bespoke tools, and poor descriptions of test strategy all support the need for a more standardized approach to the conduct and reporting of outcomes assessments.” 12
Similarly, the Real world Outcomes across the Alzheimer's Disease Spectrum for better care: Multi‐modal data Access Platform (ROADMAP) consortium carried out a systematic review of what outcomes are important to patients with mild cognitive impairment or Alzheimer's disease (AD), carers, and professionals. 13 They identified 32 clinical, practical, and personal outcomes across 7 domains from the 34 included studies. They sought research studies that elicited information from stakeholders, addressing the research question: Which outcomes of AD across the spectrum are prioritized by patients, caregivers, and health care professionals? These included clinical (memory, mental health), practical (ability to undertake activities of daily living, access to health information), and personal (desire for patient autonomy, maintenance of identity) outcomes of the disease. They also identified several additional outcomes that are infrequently assessed in clinical trial settings, including preservation of the patient's personality or the accessibility of health services and disease information. These concepts may be captured by patient‐reported outcome and experience measures that help to evaluate the effectiveness of treatments and assess the quality of care. This may help with improving patient and carer engagement with clinical trials, which in turn may help with recruitment to trials.
Another group of U.S. researchers have conducted an interview‐based study assessing what matters most to patients with or at risk for Alzheimer's and care partners with 60 individuals and care partners across five AD stages (n = 12 each); non‐clinically impaired individuals with AD pathology; individuals with mild cognitive impairment and AD pathology; individuals with mild AD; individuals with moderate AD and their care partners, and care partners of individuals with severe AD. 14 , 15 This is part of the “What Matters Most (WMM) series,” an initiative to better understand and assess treatment‐related needs, symptoms, impacts, and outcomes of individuals at risk for or living with AD and the care partners of individuals living with AD. The WMM researchers conducted qualitative research with individuals at risk for or living with mild AD and care partners of individuals with more advanced AD to identify a comprehensive set of 42 AD symptoms, impacts, and treatment‐related outcomes that are meaningful to individuals across the AD continuum. The interview guide was driven by the concepts and domains included in the Alzheimer's Disease Assessment Scale–Cognitive (ADAS‐Cog) 16 and information from the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders. This may explain the emphasis on symptoms and deficits (in memory, communication, concentration, planning, orientation, and so on) and why these findings are not consistent with those from the research described earlier 12 , 13 or the research highlighted in the following section, which consults with people living with dementia to formulate the questions asked. The later review 17 highlighted wider concepts of importance to individuals affected by AD that go beyond the common understanding of “cognition” or “function” alone, reflecting a desire to maintain independence, overall physical and mental health, emotional well‐being, and safety.
Around the same time, our UK research team, as part of Work Programme 3 of the Neighbourhood and Dementia Study, developed a core outcome set for non‐pharmacological community‐based interventions for people living with dementia at home. As a precursor to this, we reviewed previous exercises that have sought to attain consensus on outcomes and measures in dementia care and research. 13 , 18 , 19 , 20 , 21 , 22 There was a great deal of variation in the outcomes recommended. We noted that people living with dementia were rarely consulted. Most prior consensus exercises place more emphasis and weight upon the participation of professionals relative to people living with dementia, so it was unclear if outcomes being recommended are important to people living with dementia. It seemed that the choice of outcomes may be driven more by expectations of the health care professionals and the research community, 23 and this is continued in a more recent consensus exercise with only one person living with dementia participating. 24 We also noticed that recommendations about outcomes were heavily shaped by existing conceptualization of what constitutes an outcome, domains, or items within. If the starting point in these exercises is too constrained by existing, and in some cases quite dated, thinking, it follows that some researchers may not consider whether these existing conceptualizations actually reflect what people with lived experience think is important. 24 There are a number of other challenges when measuring outcomes for people living with dementia in research. These include: the heterogenous profile of the condition; the variety in residential settings of people living with dementia; the high degree of variability of outcome measures and tools. These all prevent comparisons of effectiveness across studies. Another challenge in dementia care is balancing the outcomes for people with dementia and their carers, especially where these may provide conflicting pictures. In addition, there is a broad range of outcome measures with only a small proportion being used more than once. 23 How do we really get trialists and researchers to decide on the same outcome measures, or what the measures should be?
2. THE DEVELOPMENT OF A CORE OUTCOME SET FOR WHAT MATTERS MOST TO PEOPLE WITH DEMENTIA LIVING AT HOME
One approach that has a lot of potential to address these challenges in outcome measurement is the development of a core outcome set. The idea of a core outcomes set is simple. You undertake research to attain consensus from the key stakeholders on what is most important, or core, and then you review the existing measures against these core outcomes. The output is a recommendation of what outcomes should be measured as a minimum (possibly alongside other outcomes or measures), and how to measure them across all trials within the scope of the core outcomes set. This enhances comparability, responsiveness, and relevance of research, and it also reduces waste. It is important to note that studies of core outcomes sets require updating periodically and further testing and refining that reflect the views of people from diverse different social and cultural groups. At the time of writing, there are 19 studies that are classified as dementia‐related core outcome sets published and listed in the COMET initiative database. One of these was Work Programme 3 of the Neighbourhood and Dementia Study; the aim of this study is to establish an agreed standardized core outcome set (COS) for use when evaluating nonpharmacological health and social care interventions for people with dementia living at home. We had an underpinning value of co‐research philosophy, and we embedded the participation of people living with dementia and their care partners as co‐researchers throughout the study to design creative and inclusive methods and processes. 5 We had two main research questions in relation to non‐pharmacological community‐based interventions for people living with dementia at home. Which outcomes should be measured from the perspective of people living with dementia, their care partners, health and social care professionals and policymakers and service commissioners, and research leaders, and how should these outcomes to be measured?
We used a three‐phase mixed‐methods study design, and conducted interviews or focus groups with people living with dementia and a systematic literature review in Phase 1 (Table 1). We identified possible outcomes, and then reduced these down to a manageable number and reworked the outcomes into a suitable format so respondents could answer questions on them in Phase 1, which consisted of a Delphi survey and consensus meeting. The study protocol describes the inclusion criteria, and recruitment and consent process for all participant groups; we recruited from the UK. 4 The 54 outcomes that made up the Delphi survey 3 did not include outcomes relating to care partners, delivery of care or processes, or costs or economic‐related outcomes. Of the 288 respondents who rated the importance of the outcome items in Round 1 (21 people living with dementia, 58 care partners, 137 relevant health and social care professionals, 60 researchers, and 12 policy makers), 246 completed Round 2 (85% response rate). For our consensus meeting, we enlisted the support of the late Tony Husband (the renowned cartoonist and illustrator), as we wanted to make the findings accessible to as many people as possible. He documented the discussions at the consensus meeting (https://www.bbc.co.uk/news/av/uk‐england‐lancashire‐49049562). Twenty participants attended the consensus meeting.
TABLE 1.
Number of outcome items identified in each phase of Work Programme 3 Neighbourhood and Dementia mixed‐methods study design.
|
We reached consensus for the inclusion of 13 outcome items to determine what matters most to people living with dementia: positive social relationships; ability to communicate; feeling safe and secure at home; feeling valued and respected by others; being able to have a laugh with other people; being able to engage in activities you enjoy; keeping interested in things you like; being aware of your surroundings; finding your way around a familiar place; being as clean and as comfortable as you would like; not falling; being able to see, hear, and understand; and feeling able to maintain your identity. 1 We grouped the outcome items into four domains. Self‐managing dementia symptoms, independence, friendly neighborhood and home, and quality of life. In contrast to existing trials where cognitive performance outcomes dominate, 12 only 3 of the 13 items prioritized in the two rounds of the Delphi survey and the consensus meeting were symptom‐related outcomes. It is important to note that after rating the importance of each outcome in the second round of the Delphi survey, participants were able to change how they rated the outcomes. After being given access to how other participants in other participant groups had rated the outcomes, there were actually a lot of changes recorded. So, 76% came from professional groups and 65% of these changed how they rated the outcomes to align themselves to the views of people living with dementia.
Given the lack of meaningful participation of people living with dementia in previous consensus exercises, we would suggest that not only did we develop a meaningful method of creative data collection and capture, but also an approach that gave equal weight to the views of people living with dementia and privileged their experience. The final set of core outcome items highlighting what matters most to people living with dementia is presented in Figure 1.
FIGURE 1.

What matters most to people living with dementia.
Many of the core outcome items have substantive overlap with the emergent concept of social health, which is a shift in focus from symptoms deficit and disability toward capacity and the potential of the person with dementia. 25 This is consistent with the work of researchers in the Early detection and timely INTERvention in DEMentia (INTERDEM) network who initiated the Social Health And REserve in the Dementia patient journey (SHARED) project, which is designed to uncover the links between social and brain factors connected to cognitive decline. It is the first international effort to harmonize work on social variables and examine their link to the onset and course of cognitive decline. Social health is a driver for stimulating the use of cognitive reserve through the active facilitation and utilization of the individual's capacities and those of the social environment that slow cognitive impairment or maintain cognitive function in old age. Cognitive reserve is the brain's ability to use brain networks more efficiently or to recruit alternative networks in the presence of pathology. Having a strong social health is associated with reduced risk of cognitive decline and dementia, 26 , 27 , 28 , 29 , 30 , 31 and poor social health is a risk factor. 26 , 32 Combinations of social health characteristics have a cumulative effect on cognitive functioning. 33 , 34
In phase two of our study, we conducted an extensive systematic literature review to identify outcome measurement instruments that have been used previously in dementia care research to determine how, or even if, the outcome items can be measured. We looked at English‐language questionnaires that people living with dementia complete themselves as subjective questions and are used in social research in the community. We did not include drug trials or those designed for clinical or institutional care settings. We extracted outcomes from 357 sources and identified 347 potential measures. Seventy‐six measures met our inclusion criteria. In order to identify how our 13 outcome measures should be measured, the first step was to ascertain whether the 76 measures were relevant for our purpose; do they reflect any of the 13 core outcomes? To do this, we undertook a screening exercise where we simply compared each of the 76 outcome measurement instrument items with each of the 13 core outcomes, trying to identify where there was a good match. We did this for each item on a four‐point rating scale: very good, adequate, doubtful, and inadequate. If 85% of items in any of the outcome measures had been rated > adequate, we would have then further assessed content validity, internal consistency, and responsiveness. There were a lot of inadequately rated items on most of the instruments and none of the outcome measures reached this standard.
We found an incredible level of dissonance between the core outcome items and the contents of these outcome measurement instruments. Our criterion for relevance was the number/percentage of COS items covered in the instrument. No instruments met the face validity threshold of 85% of items having at least adequate face validity with single or multiple COS items. The majority of instruments had extremely low relevance in respect to face validity with COS items, and some had no relevance. The Engagement and Independence in Dementia Questionnaire (EID‐Q) was found to have the most overlap with the scope and focus of the COS items. 35 The EID‐Q is a relatively new instrument and was rated as adequate or very good for 7 of the 26 outcome items representing: meaningful activities; losing interest; personal hygiene and cleanliness; a sense of who you are; communication; importance of relationships; and feeling valued and respected by others.
Many of the most frequently used and known measures fared poorly. One example is the measure of health‐related quality of life in dementia (DEMQOL). 36 , 37 , 38 This has been through a rigorous development over 20 years ago. It is the only self‐report quality of life measure that is recommended for use in the UK National Institute for Health and Care Excellence (https://www.nice.org.uk/guidance/qs184) quality standards that should be considered when commissioning or providing dementia services. The DEMQOL has 29 items, of which only 2 of outcome measure instrument items were considered relevant to our 13‐item core outcome set, and only 2 items in our core outcome set were deemed overlapping (adequate or very good) to the DEMQOL items.
3. REFLECTIONS AND IMPLICATIONS FOR RESEARCH
Existing outcome measures used in community‐based intervention studies do not reflect what key stakeholders deem to be important, and this was echoed after this keynote presentation at the Workshop on Clinically Meaningful Outcomes in AD/ADRD. David Cella noted during his presentation later in the Workshop that he had checked if the 13 items were represented in the United States National Institutes of Health's Patient‐Reported Outcomes Measurement Information System (PROMIS), which represents a state‐of‐the‐science model for standardized PRO assessment of health‐related quality of life. 39 PROMIS includes over 300 measures of physical, mental, and social health for use with the general population and with individuals living with chronic conditions; however, it was not developed for people with dementia. He noted that not all of the 13 outcome items could be addressed within PROMIS and maybe this can be a moment in time where the research community commits to developing positive outcome values. This echoed our finding that some of the 13 outcome items were not represented in the outcome measures in the trials we looked at in the first phase of our research. 2 For example, feeling safe and secure, feeling valued and respected by others, and having a laugh, and continuing good relationships with people who are important to you.
Our research highlights that existing outcome measurement instruments do not really reflect what key stakeholders value. Could these findings help to explain the lack of or minimal positive findings in recent trials? There have been a number of trials of psychosocial interventions for people living with dementia, where there were indications of improved psychological well‐being in those who received the intervention, but either the primary or the secondary outcome measures did not indicate a positive difference. One example is the journeying through the dementia psychosocial intervention study. 40 The authors note that the lack of positive findings was due to existing outcome measures being used in the trial that were not sufficiently sensitive to detect changes that might be attributed to interventions of this kind. They also note that new approaches are required for measurement of psychosocial outcomes for those with mild dementia. In addition, most of the secondary outcome measures had not been validated in dementia populations due to an absence of available instruments to measure positive outcomes in people with dementia, and they might have been insensitive to differences or changes in outcomes over time or in health status. This might explain some of the small differences observed between the treatment groups. Use of the existing instruments, although unavoidable, was a limitation of the trial. There were similar issues in another study, the Goal‐oriented cognitive rehabilitation for early‐stage Alzheimer's and related dementias: the GREAT RCT. 41 This showed that the qualitative findings were at odds with the results from the secondary outcome measures. The intervention may have provided wider benefits that were not detected by standardized measures. Similarly, in the REMCARE trial of reminiscence groups, 42 there was a lack of positive findings, and this stands in contrast to the reported enjoyment and benefits reported by participants and facilitators. The authors also recommended that interventions for people with dementia should be evaluated in relation to their immediate, within‐session effects, rather than focusing on longer‐term changes. 43 They refer to an older smaller evaluation of an art gallery access program that went beyond many dementia activities. 43 They illustrate the problem of outcome measurement that despite no evidence for lasting effects, all participants involved wanted the program to continue, highlighting the sentiment that the activities were deemed highly worthwhile in the moment. The perspective study of Gilmore‐Bykovskyi et al. helpfully outlines four directions to expand and integrate what matters most to individuals living with AD/ADRD into trial outcome evaluation. 44
The emphasis on the 13 outcome items is also borne out in a couple of recent Dutch qualitative studies. The first study explored how people with dementia in the Netherlands experience their everyday lives, providing insight into what is important to them to live the best they can at home. 45 A co‐researcher group of seven people with dementia was consulted during the analysis. Six dimensions of what matters most in everyday life were identified: (1) Engaging in meaningful activities, which included routines, household chores, leisure, day activities, and volunteering or work; (2) Keeping a sense of connection, in relationships within the home, with family, friends, groups, and the neighborhood; (3) Having a sense of belonging, which included attachments inside and outside the home, and to cherished objects; (4) Connecting to self, which included the ability to reflect on past experiences, live in the present moment and anticipate the future; (5) Adjusting to ongoing changes, which included alterations in sensory perceptions, perceptions of the physical environment, and navigating shifts in interpersonal dynamics; and (6) Being open to help and support, from professionals, community, and society. The authors note that for people with dementia, everyday life is a continuous balancing act between what matters most and what can be achieved daily. This is not only related to dementia but is also embedded in the wider perspective of life history, relational networks, and the physical environment. This study highlights the importance of identifying what matters most to people with dementia to provide person‐centered support.
Another Dutch study 46 examined how people living with early dementia realize their well‐being, without treating dementia as a central concern in the conversations or methods. They included people who were able to realize high levels of well‐being. The two main themes focused upon how participants attained well‐being: (1) living a fulfilling life and (2) having a positive attitude toward life by means of engaging in activities, engaging with others, appreciating the good things in life, and coping with difficulties in a positive way. It is difficult to see how the existing outcome measures could capture these concepts. Similarly, others more recently have commented that “the systematic nature of traditional methods and goal‐oriented well‐being definitions does not fit with dementia's changeability, which requires more regular renegotiation in relation to other occurring factors that unfold in a given moment. By rejecting well‐being as a goal or scaled outcome, the value of in‐the‐moment engagements of people with dementia can be understood, and the unpredictable nature of their symptoms accommodated for.” 47 They encourage researchers to use inclusive, participatory, place‐based, relational, and in the moment methods.
Our systematic review of 76 existing outcome measures revealed a disconnect between those measures and the core outcomes. 2 Researchers must work with people living with dementia to develop and test new measures that assess outcomes that matter. Other work that has also shown how people with dementia might live well with the condition indicates that asset‐based factors such as self‐efficacy and humor contribute significantly to overall well‐being. 48 These findings align with the development of an alternative asset/strengths‐based conceptual framework of well‐being in dementia to help guide instrument development and a more precise matching of intervention aims with outcome measurement. 49 Although many studies demonstrate that people with dementia can give reliable accounts of their life using existing dementia‐specific quality of life self‐report instruments, these measures do not capture the full range of outcomes that people with dementia consider important.
Can researchers measure clinically meaningful change if the outcome measures do not reflect what matters most to people living with dementia? Clearly we cannot until more work is done. Focusing on relevant outcomes is fundamental for measuring impact and it goes to the heart of evaluation science. Focusing on relevant outcomes is fundamental for measuring impact. Rossi et al., in their highly influential text, noted “We recommend that evaluators invest the necessary time and resources to develop and test appropriate outcome measures. A poorly conceptualized outcome measure may not properly represent the goals and objectives of the program being evaluated, leading to questions about its validity. An unreliable outcome measure is likely to underestimate the effectiveness of a program and could lead to incorrect inferences about the program's impact. In short, an irrelevant or unreliable measure can completely undermine the worth of an impact assessment by producing misleading estimates. Only if outcome measures are valid and reliable can impact estimates be regarded as credible.” 50 Some estimate that up to 85%–90% of research funding is wasted due to poor use of resources. 51 , 52 , 53 So if we continue measuring irrelevant or unreliable measures that are not valued by people living with dementia, this will continue to undermine the worth of dementia trials by producing misleading estimates and waste limited research resources. Existing outcome measures do not sufficiently measure what matters most to people living with dementia or the concept of social health. They tend to focus on symptom reduction or broad conceptualizations of quality of life. It is surprising that measuring the most appropriate outcomes has had so little research focus given that clinical trials are only as credible as their outcomes. Academics are also faced with the ever‐present real impetus to obtain research funding, measure, and evaluate, which can perpetuate the difficulties with existing measures because there often is only a short amount of time to select the measures for a research funding proposal. Researchers may understandably look at a review or other studies and they may choose particular outcome measures based on those. But there will be many factors to explain the discrepancy, including the difficulties of obtaining funding for the development of outcome measures.
Will these findings help convince dementia researchers why what matters most to people living with dementia should matter to them? Ideally for the field to progress, this work needs to function as a call to action to dementia care researchers. Ideally researchers will work together and avoid duplication of effort and work as an international network to facilitate better research and make progress on person‐centered measurement and evaluation. Can we develop and test new measures rapidly through an international collaborative of researchers to ensure that ethnic and socio‐economic diverse people living with dementia across the progression of disease and their care partners have their voices heard and are central to the research process so that we have meaningful outcomes consistent with what matters most to diverse people living with dementia and their care partners? Can we use technology to support real‐time, in the moment measurement? One of the vehicles for achieving all of this and addressing the challenges in outcome measurement might be to develop a global organization committed to improving outcomes for people living with dementia. This could be modeled on successful established initiatives in other disease areas, for example, Outcome Measures in Rheumatology (OMERACT), a global, volunteer‐driven, not‐for‐profit initiative, aimed at improving outcome measurement in rheumatology. Being able to measure the core outcome set items that are highlighted would herald a paradigm shift for dementia research in the future and also be responsive to what key stakeholders value.
CONFLICT OF INTEREST STATEMENT
The authors have no conflicts of interest to disclose. Author disclosures are available in the supporting information.
Supporting information
Supporting Information
ACKNOWLEDGMENTS
This study was based on the work undertaken as part of Work Programme 3 (WP3) of the Neighbourhoods and Dementia mixed‐methods study (https://sites. manchester.ac.uk/neighbourhoods‐and‐dementia/). Thank you to the participants in WP3, the respective member involvement groups and study advisory group, and also the late Tony Husband for being the resident cartoonist. Tony sadly passed away in 2023. Thank you to Claire McGinty for assistance with Endnote references. Thank you to the organizers of the National Institute on Aging for the Workshop on Clinically Meaningful Outcomes in AD/ADRD Trials | National Institute on Aging (nih.gov) for providing a platform for this work.
The Neighbourhoods and Dementia mixed‐methods study was funded jointly by the Economic and Social Research Council (ESRC) and the National Institute for Health Research (NIHR) [ES/L001772/1]. ESRC is part of UK Research and Innovation (UKRI). The views expressed are those of the authors and not necessarily those of the ESRC, UKRI, NHS, the NIHR, or the Department of Health and Social Care.
All human subjects provided informed consent. This work was also funded by the National Institute for Health and Care Research.
Reilly ST, Harding AJE. Making outcome measures matter: Why should “what matters to people living with dementia” matter to dementia researchers? Alzheimer's Dement. 2025;21:e70359. 10.1002/alz.70359
REFERENCES
- 1. Reilly ST, Harding AJE, Morbey H, et al. What is important to people with dementia living at home? A set of core outcome items for use in the evaluation of non‐pharmacological community‐based health and social care interventions. Age and Ageing. 2020;49(4):664‐671. doi: 10.1093/ageing/afaa015 [DOI] [Google Scholar]
- 2. Harding AJE, Morbey H, Ahmed F, et al. A core outcome set for nonpharmacological community‐based interventions for people living with dementia at home: a systematic review of outcome measurement instruments. Gerontologist. 2021;61(8):e435‐e448. doi: 10.1093/geront/gnaa071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Harding AJE, Morbey H, Ahmed F, et al. What is important to people living with dementia?: the ‘long‐list’ of outcome items in the development of a core outcome set for use in the evaluation of non‐pharmacological community‐based health and social care interventions. BMC Geriatr. 2019;19(1). doi: 10.1186/s12877-019-1103-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Harding AJE, Morbey H, Ahmed F, et al. Developing a core outcome set for people living with dementia at home in their neighbourhoods and communities: study protocol for use in the evaluation of non‐pharmacological community‐based health and social care interventions. Trials. 2018;19(1). doi: 10.1186/s13063-018-2584-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Morbey H, Harding AJE, Swarbrick C, et al. Involving people living with dementia in research: an accessible modified Delphi survey for core outcome set development. Curr Control Trials Cardiovasc Med. 2019;20(1):12‐12. doi: 10.1186/s13063-018-3069-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. McCallum A. What is an outcome and why look at them?. Crit Public Health. 1993;4:4. doi: 10.1080/09581599308406906 [DOI] [Google Scholar]
- 7. Pencheon D . The Good Indicators Guide: Understanding how to use and choose indicators. 2008. NHS Institute for Innovation and Imrovement: Coventry.
- 8. US Food and Drug Administration CfDEaR , Center for Biologics Evaluation and Research , Center for Devices and Radiological Health . Patient‐Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. 2009. http://purl.access.gpo.gov/GPO/LPS113413
- 9. Powers JH, Patrick DL, Walton MK, et al. Clinician‐reported outcome assessments of treatment benefit: report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force. Value Health. 2017;20(1):2‐14. doi: 10.1016/j.jval.2016.11.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Williamson PR, Altman DG, Blazeby JM, et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13(1):132. doi: 10.1186/1745-6215-13-132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Guyatt G, Walter S, Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987;40(2):171‐178. doi: 10.1016/0021-9681(87)90069-5 [DOI] [PubMed] [Google Scholar]
- 12. Harrison JK, Noel‐Storr AH, Demeyere N, Reynish EL, Quinn TJ. Outcomes measures in a decade of dementia and mild cognitive impairment trials. Alzheimers Res Ther. 2016;8(1). doi: 10.1186/s13195-016-0216-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Tochel C, Smith M, Baldwin H, et al. What outcomes are important to patients with mild cognitive impairment or Alzheimer's disease, their caregivers, and health‐care professionals? A systematic review. Alzheimers Dement. 2019;11(1):231‐247. doi: 10.1016/j.dadm.2018.12.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Dibenedetti DB, Slota C, Wronski SL, et al. Assessing what matters most to patients with or at risk for Alzheimer's and care partners: a qualitative study evaluating symptoms, impacts, and outcomes. Alzheimers Res Ther. 2020;12(1). doi: 10.1186/s13195-020-00659-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Hauber B, Paulsen R, Krasa HB, et al. Assessing what matters to people affected by Alzheimer's disease: a quantitative analysis. Neurol Ther. 2023;12(2):505‐527. doi: 10.1007/s40120-023-00445-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Rosen WG, Mohs RC, Davis KL. A new rating scale for Alzheimer's disease. Am J Psychiatry. 1984;141(11):1356‐1364. doi: 10.1176/ajp.141.11.1356 [DOI] [PubMed] [Google Scholar]
- 17. Dibenedetti DB, Menne H, Paulsen R, et al. Technical review of clinical outcomes assessments across the continuum of Alzheimer's disease. Neurol Ther. 2023;12(2):571‐595. doi: 10.1007/s40120-023-00443-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Katona C, Livingston G, Cooper C, Ames D, Brodaty H, Chiu E. International Psychogeriatric Association consensus statement on defining and measuring treatment benefits in dementia. Int Psychogeriatr. 2007;19(3):345‐354. doi: 10.1017/s1041610207005145 [DOI] [PubMed] [Google Scholar]
- 19. Measurement ICHO. The International Consortium for Health Outcomes Measurement Standard Set for Dementia. 2016. https://www.ichom.org/patient‐centered‐outcome‐measure/dementia/
- 20. Research EJP‐ND. Dementia outcome measures: Charting new territory. 2015. https://neurodegenerationresearch.eu/wp‐content/uploads/2015/10/JPND‐Report‐Fountain.pdf
- 21. Moniz‐Cook E, Vernooij‐Dassen M, Woods R, et al. A European consensus on outcome measures for psychosocial intervention research in dementia care. Aging Ment Health. 2008;12(1):14‐29. doi: 10.1080/13607860801919850 [DOI] [PubMed] [Google Scholar]
- 22. Webster L, Groskreutz D, Grinbergs‐Saull A, et al. Core outcome measures for interventions to prevent or slow the progress of dementia for people living with mild to moderate dementia: systematic review and consensus recommendations. PLoS One. 2017;12(6):e0179521. doi: 10.1371/journal.pone.0179521 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Couch E, Lawrence V, Co M, Prina M. Outcomes tested in non‐pharmacological interventions in mild cognitive impairment and mild dementia: a scoping review. BMJ Open. 2020;10(4):e035980. doi: 10.1136/bmjopen-2019-035980 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Ellison TS, Cappa SF, Garrett D, et al. Outcome measures for Alzheimer's disease: a global inter‐societal Delphi consensus. Alzheimers Dement. 2023;19(6):2707‐2729. doi: 10.1002/alz.12945 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Vernooij‐Dassen M, Verspoor E, Samtani S, et al. Recognition of social health: a conceptual framework in the context of dementia research. Front Psychiatry. 2022;13. doi: 10.3389/fpsyt.2022.1052009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Penninkilampi R, Casey A‐N, Singh MF, Brodaty H. The association between social engagement, loneliness, and risk of dementia: a systematic review and meta‐analysis. J Alzheimers Dis. 2018;66(4):1619‐1633. doi: 10.3233/jad-180439 [DOI] [PubMed] [Google Scholar]
- 27. Kelly ME, Duff H, Kelly S, et al. The impact of social activities, social networks, social support and social relationships on the cognitive functioning of healthy older adults: a systematic review. Syst Rev. 2017;6(1). doi: 10.1186/s13643-017-0632-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Kelly F. Abusive interactions: research in locked wards for people with dementia. Social Policy Soc. 2010;9(2):267‐277. [Google Scholar]
- 29. Livingston G, Huntley J, Sommerlad A, et al. Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet. 2020;396(10248):413‐446. doi: 10.1016/s0140-6736(20)30367-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Samtani S, Mahalingam G, Lam BCP, et al. Associations between social connections and cognition: a global collaborative individual participant data meta‐analysis. Lancet Healthy Longevity. 2022;3(11):e740‐e753. doi: 10.1016/s2666-7568(22)00199-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Maddock J, Gallo F, Wolters FJ, et al. Social health and change in cognitive capability among older adults: findings from four European longitudinal studies. Gerontology. 2023;69(11):1330‐1346. doi: 10.1159/000531969 [DOI] [PubMed] [Google Scholar]
- 32. Kuiper JS, Zuidersma M, Oude Voshaar RC, et al. Social relationships and risk of dementia: a systematic review and meta‐analysis of longitudinal cohort studies. Ageing Res Rev. 2015;22:39‐57. doi: 10.1016/j.arr.2015.04.006 [DOI] [PubMed] [Google Scholar]
- 33. Saito T, Murata C, Saito M, Takeda T, Kondo K. Influence of social relationship domains and their combinations on incident dementia: a prospective cohort study. J Epidemiol Commun Health. 2018;72(1):7‐12. doi: 10.1136/jech-2017-209811 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Opdebeeck C, Matthews FE, Wu YT, Woods RT, Brayne C, Clare L. Cognitive reserve as a moderator of the negative association between mood and cognition: evidence from a population‐representative cohort. Psychol Med. 2018;48(1):61‐71. doi: 10.1017/s003329171700126x [DOI] [PubMed] [Google Scholar]
- 35. Stoner C, Orrell M, Spector A. Psychometric properties and factor analysis of the Engagement and Independence in Dementia Questionnaire (EID‐Q). Dement Geriatr Cogn Disord. 2018;46(3‐4):119‐127. doi: 10.1159/000488484 [DOI] [PubMed] [Google Scholar]
- 36. Smith SC, Lamping DL, Banerjee S, et al. Development of a new measure of health‐related quality of life for people with dementia: DEMQOL. 2007;37(5):737‐746. doi: 10.1017/S0033291706009469 [DOI] [PubMed] [Google Scholar]
- 37. Smith SC, Murray J, Banerjee S, et al. What constitutes health‐related quality of life in dementia? Development of a conceptual framework for people with dementia and their carers. 2005;20(9):889‐895. doi: 10.1002/gps.1374 [DOI] [PubMed] [Google Scholar]
- 38. Smith S, Lamping D, Banerjee S, et al. Measurement of health‐related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology. Health Technol Assess. 2005;9(10):1‐112. doi: 10.3310/hta9100 [DOI] [PubMed] [Google Scholar]
- 39. Cella D, Riley W, Stone A, et al. The Patient‐Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self‐reported health outcome item banks: 2005‐2008. J Clin Epidemiol. 2010;63(11):1179‐1194. doi: 10.1016/j.jclinepi.2010.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Mountain GA, Cooper CL, Wright J, et al. The Journeying through Dementia psychosocial intervention versus usual care study: a single‐blind, parallel group, phase 3 trial. Lancet Healthy Longevity. 2022;3(4):e276‐e285. doi: 10.1016/s2666-7568(22)00059-9 [DOI] [PubMed] [Google Scholar]
- 41. Clare L, Kudlicka A, Oyebode JR, et al. Goal‐oriented cognitive rehabilitation for early‐stage Alzheimer's and related dementias: the GREAT RCT. Health Technol Assess . Mar. 2019;23(10):1‐242. doi: 10.3310/hta23100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Woods RT, Orrell M, Bruce E, et al. REMCARE: pragmatic multi‐centre randomised trial of reminiscence groups for people with dementia and their family carers: effectiveness and economic analysis. PLoS One. 2016;11(4):e0152843. doi: 10.1371/journal.pone.0152843 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. MacPherson S. An Art Gallery Access Programme for people with dementia: ‘You do it for the moment’. Aging Mental Health. 2009;13:744‐752. doi: 10.1080/13607860902918207 [DOI] [PubMed] [Google Scholar]
- 44. Gilmore‐Bykovskyi A, Dillon K, Fields B, Benson C, Farrar Edwards D. Meaningful to whom? Minimal clinically important differences and the priorities of individuals living with dementia for everyday function. Alzheimers Dement (N Y). 2025;11(1):e70052. doi: 10.1002/trc2.70052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Huizenga J, Scheffelaar A, Bleijenberg N, Wilken JP, Keady J, Van Regenmortel T. What matters most: exploring the everyday lives of people with dementia. Int J Geriatr Psychiatry. 2023;38(8). doi: 10.1002/gps.5983 [DOI] [PubMed] [Google Scholar]
- 46. Kloos N, Bielderman A, Gerritsen DL. Learning from people with dementia what works well for well‐being: interviews and focus groups. Gerontologist. 2024;64(9). doi: 10.1093/geront/gnae077 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Ward MC, Milligan C, Rose EE, Elliott M. ‘Being’ and ‘doing’ well in the moment: theoretical and relational contributions of health geography to living well with dementia. Area. 2023;00:1‐8. doi: 10.1111/area.12899 [DOI] [Google Scholar]
- 48. Lamont RA, Nelis SM, Quinn C, et al. Psychological predictors of ‘living well’ with dementia: findings from the IDEAL study. Aging Ment Health. 2020;24(6):956‐964. doi: 10.1080/13607863.2019.1566811 [DOI] [PubMed] [Google Scholar]
- 49. Clarke C, Woods B, Moniz‐Cook E, et al. Measuring the well‐being of people with dementia: a conceptual scoping review. Health Qual Life Outcomes. 2020;18(1). doi: 10.1186/s12955-020-01440-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Rossi PHF, Howard E. Lipsey, Mark W. Evaluation ‐ A Systematic Approach. 6th ed. Sage Publications. 1998.
- 51. Glasziou P, Chalmers I. Research waste is still a scandal—an essay by Paul Glasziou and Iain Chalmers. BMJ. 2018;363:k4645. doi: 10.1136/bmj.k4645 [DOI] [Google Scholar]
- 52. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86‐89. doi: 10.1016/S0140-6736(09)60329-9 [DOI] [PubMed] [Google Scholar]
- 53. Pirosca S, Shiely F, Clarke M, Treweek S. Tolerating bad health research: the continuing scandal. Trials. 2022;23(1):458. doi: 10.1186/s13063-022-06415-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supporting Information
