Active Involvement of People with Dementia: A Systematic Review of Studies Developing Supportive Technologies

Abstract

 Although there are promising benefits of supportive technology in dementia care, use of these technologies is still limited. It is challenging for researchers and developers in this field to actively involve people with dementia in development. This review updates and builds on existing knowledge by including a contemporary and relevant perspective. This perspective was gained by including search words and search databases from the field of Human Computer Interaction (HCI) and Design, as these fields were expected to supply novel insights in the complex task of actively involving people with dementia in developing supportive technologies. A total of 49 out of 3456 studies were included which describe the development of a great variety of technologies. Often people with dementia were involved in the generative or evaluative phase of the development. Interviews and observations were most commonly used methods. In seven articles the people with dementia were co-designers. This literature review reflects that people with dementia can influence the development of technology in regards to content, design, and even the initial idea, although the impact on how they experience their own involvement remains largely unknown. There is a lack of specific knowledge on appropriate methods and materials for active involvement of people with dementia in supportive technology development, even when including articles from the field of HCI and Design. Future research is needed to further appreciate and improve the desired role of people with dementia in meaningful technology development.

INTRODUCTION

There are over 50 million people living with dementia worldwide, and this number is still increasing [1]. For people with dementia, everyday life is full of challenges due to difficulties with memory, thinking, orientation, language, comprehension, action, and judgement. Moreover, these impairments become more salient over time. For both the person with dementia, as well as their informal caregivers, the syndrome has a great impact on their experienced well-being [2]. Since there is currently no cure, there is an urgent need for interventions that support independence and well-being in everyday life.

The potential benefits of supportive technology

Technology is often suggested as a means to accomplish the aforementioned support. The development of supportive technologies is seen as a worldwide priority in large national and international funding programs. For instance, the European Active and Assisted Living (AAL) program has a total budget of € 700 million to distribute between 2014 and 2020 [3]. Examples of supportive technologies that are developed in these programs are sensor systems, smartphones with low complexity, reminiscence applications, and electronic calendars. These (or combinations of) technologies can promote safety, foster communication, provide multi-sensory stimulation, or act as memory aids [4]. However, despite their apparent benefits, the use of supportive technologies in dementia care is still limited. Low adoption rates of assistive technology may signal unmet user needs and wishes in product design.

The risk of inappropriate, unappealing, or less usable products is of course higher as a designer’s perceptions and competences diverge farther from those of the users’ gap which is probably wider when designing for users with dementia. This might result in products with a too strong focus on feelings of safety (e.g., monitoring risk), instead of improving the experience of the impairment itself [5]. Furthermore, for progressive syndromes, such as dementia, current supportive technologies might not be sufficiently flexible to serve the changing needs of their users. Moreover, there is a great variety within the group ‘people with dementia’, such as differences in demographics (e.g., socioeconomic status) and personality (e.g., acceptance of the diagnosis), but also due to the diversity of specific diseases, each with different behavioral, cognitive, and emotional consequences. In itself, this diversity already creates a great challenge for researchers and developers aiming to design technologies that people with dementia truly want and are able to use. It is, therefore, vital to have extensive insight in the dynamic needs, wishes, and abilities of people with dementia.

The different human-centered design practices

For the general population, the collection of user insights is typically supported through human-centered design (HCD) practices [6]. A successful design practice is guided by design research [7], which are two distinct but interconnected activities in technology development. Outcomes of the design practices are used as research material (research-through-design), and research insights are preferably further applied into design outcomes to steer the development. This iterative process can be divided in several phases, all with their own objectives and types of design research. One example of such an iterative design process is provided by Sanders and Stappers [8] and approaches the role of the user as co-designer. HCD can have different of these approaches, such as participatory design, ethnography, empathic design, and co-design [9]. These approaches differ in the nature and intensity of the relationship between designers and users. For instance, is the user an informant or considered an equal partner and is the focus merely on research (what is) or on design (what could be). Strong HCD promises better products by closing the gap between designers and users. But, core symptoms of the dementia syndrome, e.g., lowered capacity in retrospective and abstract thinking, present a major challenge for the different approaches of human-centered design practices with people with dementia [10].

Involving people with dementia in development of technology

Earlier literature reviews show the importance of involving people with dementia and their informal caregivers in the development of new supportive or assistive technologies [11–14]. They also suggest that, in the majority of studies, people with dementia have had a rather passive role in the development phase, at best serving as an object of study or informant. Their involvement generally occurs in the evaluation phases of technology development and renders insights in the effectiveness, usefulness and acceptability of the developed devices. Few studies report on the involvement of people with dementia throughout the entire development process, e.g., as a continuous equal partner or co-designer. The lack of this involvement is noteworthy since co-design practiced from the start of the development process can have an impact with positive, long-range consequences on the user experience of the eventual design outcome [15]. Co-design with people with dementia can yield an enhanced sense of control in participants [16] and can ultimately lead to a more empathic understanding of the user group [17]. Empathic understanding enables designers and developers to gain fully relevant and intimate user insights needed for more meaningful and suitable technology development. However, involving people with dementia as co-designers in the development can be challenging due to the characteristics of the syndrome, which vary over time and between different diseases implied under the umbrella term ‘dementia’. Being a co-designer might require certain levels of sensory, cognitive, and motoric abilities, which decrease for a person with dementia [18]. The large variety within and between people with dementia adds to the overall challenge of successful co-design with this user group.

A broader perspective needed for state-of-the-art knowledge

There is limited knowledge about the specific research methods and materials needed to actively involve people with dementia in the entire development process of meaningful supportive technologies. Either successful co-design may be non-existent, or alternatively, the latest studies on successful co-design with people with dementia are not systematically reviewed yet. The most recent systematic review on methodology in this field was performed before 2011 [12]. Because of the increased interest in developing supportive technologies in recent years, we expect that a substantial amount of new research has been performed. Moreover, the commonly used search engines (Cochrane library, PubMed, EMBASE, and CINAHL database) may have limited the outcomes to the field of medical and healthcare research and, therefore, potentially lack relevant contributions from the areas of Human Computer Interaction (HCI) and Design (such as the proceedings of CHI Human Factors in Computing Systems conference). Since the development of supportive technology is an inherently interdisciplinary process, it is expected that relevant complementary knowledge will be available when including research from HCI and Design fields. In addition, designers are well appreciated in their ability to embrace complexity [15], which might give useful insights in how to involve people with dementia in developing meaningful supportive technologies.

The aim of our review is therefore to update and expand the existing body of knowledge by including a new and relevant perspective. This perspective represents an additional step toward achieving a more complete understanding of how people with dementia can have an active role in the different phases of development of new supportive technologies. We provide a detailed analysis on how the different fields use research methods and materials to support people with dementia in their role as an active informant or co-designer in the design and development of supportive technologies. The impact of these roles and research methods on the developed technology is presented as well as the impact on the experiences of people with dementia in the different development phases. To complement the earlier reviews, the following questions are addressed:

• 1.In which phase of development of technology are people with dementia actively involved?
• 2.What specific role do people with dementia have in the development?
• 3.Which research methods and materials are used to involve people with dementia?
• 4.What is the impact of the active involvement on the technology development and on the participants themselves?

MATERIALS AND METHODS

Search strategy

Our initial search strategy was based on the search strategy of the most recent review on co-design with people with dementia of Span and colleagues [12]. They created search strings within three categories: ‘dementia’, ‘technology’, and ‘involvement’ and used the search engines Cochrane library, PubMed, PsycInfo, EMBASE, and CINAHL. For the purpose of the current review, we extended this existing search strategy on three levels by: 1) the time-frame, 2) the search keywords, and 3) the search engines. First, our extended timeframe also includes articles published from July 2011 to July 2017. Second, the search strings were extended in the categories ‘technology’ (by adding new words, such as, ‘platforms’, ‘sensors’, ‘robotics’) and ‘involvement’ (e.g., ‘co-design’, ‘service design’, ‘brainstorm’). Third, the search was also performed in other databases (ACM Digital Library and Web of Science) to expand the review to the field of HCI and design. To gather insight in the value of the added search strings and added databases, we performed separate searches in the time-frame of the review of Span and colleagues [12] as well (including papers until July 2011). An overview of the different searches is shown in Table 1. The searches were first performed in PubMed. Strings from Pubmed were later translated for use in the other databases. The Supplementary Material shows the complete (new) search string.

Table 1.

The current review adds to existing work in terms of timeframe (search 1), search keywords (search 2), and search engines (search 3) and resulted in 49 new articles

Selection of studies

We selected articles written in English. Articles were only included when 1) they described (parts of) a development process for new supportive technology meant to be used by people with dementia, and when 2) people with dementia were actively involved in this process (either as active informant or co-designer). We excluded literature reviews and other overview papers describing reflections on projects without actual application of outcomes in the development of technology. Titles and abstracts were independently screened (by the first and third author) to identify relevant articles. Full texts were obtained to check when abstracts missed required information to decide for inclusion or exclusion. Eventually, full-text articles were assessed for eligibility by two reviewers (the first and second author) by using a relevance score on a scale of 0 (not relevant at all) to 10 (very relevant). This relevance score identified whether new and clearly reported outcomes qualified for further analysis. Studies with a relevance mean score below 5 were excluded. When the difference between relevance ratings of both researchers transcended the limits of agreement (mean ± 1.96 * SD) [19], the discrepancy was resolved through discussions until consensus was reached.

Quality assessment

The included articles were evaluated on content and methodology. To appraise the methodological quality of the articles, we used the Mixed Methods Appraisal Tool (MMAT) from [20]. This tool is suitable for all study designs and was, therefore, appropriate for the current review. The first author rated the methodological quality criteria individually. These were discussed with the second author. Scores (from 0 to 100) and a descriptive summary of the use of the MMAT criteria can be found in the results section.

Analysis

The following information was gathered from the selected articles: name of the overall project, the type of technology developed, the characteristics of participants with dementia, the method of study and the quality score. It was checked whether an informal caregiver was involved, since they can play an important role in the participation of people with dementia. To answer the research questions of this review, an inventory was made of different elements including the phases of technology development, the role of the person with dementia, the used research methods and materials and the subsequent impact of this role on the technology and the person themselves.

Phases of technology development

To assess in which phase of the development the person with dementia had a role, the design research process described by Sanders and Stappers [8] was used. This design process starts with a pre-design phase (phase 1) that aims at understanding people’s experiences in the context of their lives. In the generative phase (phase 2), the first ideas of a new design are constructed by performing co-design activities. In the evaluative phase (phase 3), the iterative development of the technology occurs and users test different prototypes. The actual use of the new technology is researched in the post-design phase (phase 4).

Role of people with dementia

We assessed the level of involvement of people with dementia in the development of supportive technology. In accordance with earlier work [12], the role of the person with dementia was identified either as an active informant or as a co-designer [21]. When a user is an active informant, the researcher uses methods such as interviews to generate knowledge to use in the development process. When a user is a co-designer, the user is an equal partner in the process and plays a crucial role multiple phases of the process to develop knowledge, generate ideas and co-develop concepts.

Research methods and materials in the phases of development

The research methods used in the articles were gathered and indexed. If reported, the type of the method was also identified (e.g., structured or semi-structured interviews). Besides the research methods, the materials used in applying these methods were included in the overview (e.g., elicitation material). In case prototypes of the technology were used, these were categorized based on their level of functioning. We discriminate between low-fidelity prototypes (mock-ups, Wizard-of-Oz prototypes) and high-fidelity prototypes (alpha prototypes, beta prototypes, and fully functional prototypes) corresponding to the work of Preece and colleagues [22]. Low-fidelity prototypes are simple, cheap, and quick to produce and easily modified. These types of prototypes can be built by paper and pencil and are used in the earlier phases of development in order to get feedback from users on early ideas and concepts. The Wizard-of-Oz prototype is a system operated by a man-behind-the-scenes, appearing to be fully functional. On the other hand, high-fidelity prototypes actually use the platforms and technology of the eventual product. These prototypes are therefore also good for testing the technical functioning.

Impact of involvement on technology and participants

Next, the impact of the involvement of people with dementia on the technology that was developed was defined as one of three categories: no directly reported impact (0), one aspect was changed (1), or multiple aspects were changed (2+). This impact includes, for example, the user requirements or interface improvements derived from the research activities. Next to the outcomes for the supportive technology, the involvement of people with dementia was expected to have an impact on themselves. Whenever described in the article, their experiences were categorized as negative (–) or positive (+).

RESULTS

The search in the digital libraries was conducted in July 2017. Figure 1 presents the flow chart for the selection of articles. In total, 49 articles were included in the final review. Among the 49 articles, 40 describe a qualitative research study (24 qualitative description, 10 case studies, three ethnography, one narrative and three combined different types of studies). Eight articles describe a mixed method study (six embedded design, one sequential design and one case report). Furthermore, also one quantitative descriptive study was included. The MMAT scores varied among the included studies: 13 articles scored 100%, 12 articles scored 75%, 10 articles scored 50%, 13 articles scored 25%, and one study scored 0%. These latter scores were mainly given to studies with unclear research questions and/or ill-reported data analysis. In Table 2 the characteristics of the articles are summarized.

Fig.1.

Flowchart of selection process.

Table 2.

Description of included articles

Search	Publication Author Project [Ref]	Technology developed	Main characteristics of participants with dementia			Informal caregiver as participant?	Research method (MMAT)	Quality score (MMAT)
			N=	Stage of dementia	Living conditions
1	Karlsson et al., 2011 COGKNOW [70]	Platform with reminder system, GPS and sensors for surveillance	2	Mild to moderate (MMSE)	At home	Yes	Qualitative research: Case study1	100%
1	Span et al. 2017 DecideGuide [47]	Website/portal	Five research activities: 23; 9; 12; 3; 4	Mild to moderate	Five participants living in nursing home	No	Qualitative research: Case study	100%
1	Meiland et al. 2012 COGKNOW [46]	Platform with reminder system, GPS and sensors for surveillance	Three research activities: 16; 14; 12	Mild to moderate (MMSE)	At home	Yes	Mixed method research: Embedded design2	100%
1	Lopes et al. 2016 [41]	Item locator	Five research activities: 11; 10; 4; 5; 9	Not reported	At home	Yes	Qualitative research: Qualitative description3	75%
1	Boman et al. 2014 [43]	Video conferencing	4	Mild to moderate (time since diagnosis)	At home	Yes	Qualitative research: Case study	100%
1	Wang et al., 2017 [45]	Tele-operated robot	10	Mild to severe (MMSE)	At home	Yes	Qualitative research: Qualitative description	75%
1	Peeters et al., 2016 [57]	Music intervention	5	Mild to severe	Not reported	Yes	Qualitative research: Case study	25%
1	Meiland et al., 2014 ROSETTA [48]	Sensors for surveillance	Four research activities: 3; 3; 4; 4	Not reported	At home	Yes	Qualitative research: Qualitative description	75%
1	Suijkerbuijk et al., 2015 [55]	Light armature	12	Not reported	At home	Yes	Qualitative research: Qualitative description	100%
1	Olsson et al., 2013 [58]	GPS for localization	5	Mild to moderate (MMSE)	At home	Yes	Qualitative research: Qualitative description	100%
1	Boman et al., 2014 [53]	Video conferencing	Two research activities: 2; 4	Mild to moderate (time since diagnosis)	Not reported	Yes	Qualitative research: Qualitative description	100%
1	Kerkhof et al., 2015 [44]	Reminder system	7	Not reported	In nursing home	Yes	Qualitative research: Qualitative description	100%
1	Hattink et al., 2016 ROSETTA [54]	Sensors for surveillance	42	Mild to severe (MMSE)	At home	Yes	Mixed method research: Embedded design	75%
1	Pakrasi et al., 2015 [71]	Video conferencing	26	Mild to severe	At home	Yes	Qualitative research: Qualitative description	25%
1	Dethlefs et al., 2017 [52]	Cognitive stimulation	10	Mild to moderate (CDR)	Not reported	No	Quantitative research: Quantitative description	25%
1	Jacova et al., 2015 [36]	Website / Portal	Two research activities: 5; 6	Mild (MMSE)	Not reported	No	Mixed method research: Embedded design	75%
1	McCabe &Innes, 2013 [72]	GPS for localization	12	Not reported	Not reported	Yes	Qualitative research: Qualitative description	75%
1	Wang et al., 2011 [73]	Automated wheelchair	6	Mild to moderate (MMSE)	In nursing home	No	Mixed method research: Embedded design	75%
1	Hattink et al., 2016 [74]	Website / Portal	Three research activities: 4; 88; 6	Not reported	At home	Yes	Mixed method research: Embedded design	50%
1	Wolters et al., 2016 [65]	Reminder system	Two research activities: 2; 4	Not reported	At home	Yes	Qualitative research: Qualitative description	75%
1	Begum et al., 2013 Ed [75]	Tele-operated robot	5	Mild to severe (MMSE)	At home	Yes	Mixed method research: Sequential explanatory design4	50%
2	Alm et al., 2004 CIRCA [35]	Reminiscence platform	Three research activities: Multiple; 6; 9	Mild to severe (MMSE)	At home	Yes	Qualitative research: Qualitative description	25%
2	Van Rijn et al., 2010 [37]	Group activity intervention	Two research activities: group; 12	Not reported	Not reported	Yes	Qualitative research: Narrative5	50%
2	Span et al., 2015 DecideGuide [49]	Website / Portal	4	Mild (Reisberg scale)	At home	Yes	Qualitative research: Qualitative description	100%
3	Hagethorn et al., 2008 [38]	GPS for navigation	Three research activities: 7,4,6	Not reported	Not reported	Not clear	Qualitative research: Qualitative description	50%
3	Cohene, Baecker &Marziali, 2005 [42]	Lifelogging system	1	Moderate	In nursing home	Yes	Qualitative research: Case study	75%
3	Nugent et al., 2011 [76]	Reminder system	4	Mild (MMSE)	At home	Yes	Qualitative research: Case study	25%
3	Alm et al., 2005 CIRCA [77]	Reminiscence platform	Two research activities: 40, 18	Mild to severe (MMSE)	In nursing home	Not clear	Mixed methods: Embedded design	25%
3	De Beer et al., 2010 [23]	Medicine dispenser	Two different activities: individuals; 2	Not reported	At home	Yes	Qualitative research: Qualitative description	25%
3	Morán &Meza-Kubo, 2009 [78]	Cognitive stimulation	10	Not reported	In nursing home	No	Qualitative research: Qualitative description	50%
3	Gibson et al., 2016 [56]	App for reminiscence	7	Not reported	At home	Yes	Mixed method: Case report6	50%
3	Wan et al., 2016 [79]	GPS for localization	2	Not reported	1 in nursing home	Yes	Qualitative research: Case study	50%
3	Morrissey et al., 2016 [24]	Music intervention	Different research activities: multiple users at multiple sites	Not reported	In nursing home	No	Qualitative research: Ethnography7	75%
3	König et al., 2016 [80]	Reminder system	12	Mild to moderate	In nursing home	Yes	Qualitative research: Qualitative description	50%
3	Bennett, Hinder &Cater, 2016 [25]	Music intervention in rocking chair	Three research activities: individual and groups; 8; group	Not reported	In nursing home	No	Qualitative research: Ethnography	25%
3	Wu et al., 2016 [26]	GPS for navigation	Three research activities: 10; several; 5	Mild	Not reported	No	Qualitative research: Qualitative description	25%
3	Ly et al., 2015 [27]	Sensors and lighting cues for indoor navigation	Three research activities: several; 12; 4	Moderate to severe	In nursing home	No	Qualitative research: Qualitative description	0%
3	Holbø, Bøthun &Dahl, 2013 [39]	GPS for navigation	Three research activities: 3; 3; 3	Mild	At home	Yes	Qualitative research: Case study	75%
3	Mayer &Zach, 2013 [51]	Platform with reminder system and communication	Three research activities: 5,6,5	Mild to moderate	Not reported	Yes	Qualitative research: Qualitative description	25%
3	Jordan et al., 2013 [33]	Platform for communication	Two research activities: 2; 5	Mild to moderate	At home	Yes	Qualitative research: Case study	100%
3	Lindsay et al., 2012 [17]	GPS for localization	Different research activities: 16, 2	Mild to moderate	At home and in nursing home	Yes	Qualitative research: Qualitative description and Case study	50%
3	Schneider et al., 2013 [28]	Platform with reminder system and communication	Different research activities: 3, 9, group	Not reported	Not reported	Yes	Qualitative research: Qualitative description	25%
3	Boyd et al., 2014 [29]	Video conferencing	Three research activities; groups, groups, 2	Mild to moderate (MMSE)	At home	Yes	Qualitative research: Case study	25%
3	Donnelly et al., 2010 [30]	Reminder system	Two research activities; individuals, 4	Mild (MMSE)	At home	Yes	Qualitative research: Qualitative description	50%
3	Nugent et al., 2008 COGKNOW [81]	Platform with reminder system, GPS and sensors for surveillance	Two research activities: 17, 16	Mild	At home	Yes	Qualitative research: Qualitative description	25%
3	Lee &Dey, 2007 [40]	Lifelogging system	Two research activities: 5; 5	Mild to moderate	At home	Yes	Qualitative research: Ethnography and qualitative description	75%
3	Tobiasson et al., 2015 [50]	Game for physical exercise	Different activities: 10, 12	Moderate to severe	In nursing home	Yes	Qualitative research: Qualitative description	100%
3	Huldtgren et al., 2016 [31]	Reminiscence in book	Different research activities: groups, 8	Not reported	In nursing home	No	Qualitative research: Qualitative description	100%
3	Lazar et al. 2017 [32]	Platform for communication and social sharing	Different research activities: group and individuals; 2	Not reported	In nursing home	Yes	Qualitative research: Ethnography and case study	100%

¹“In-depth exploration and/or explanation of issues intrinsic to a particular case. A case can be anything from a decision-making process, to a person, an organization, or a country.” [20]. ²“The qualitative and quantitative components are concomitant. The purpose is to support a qualitative study with a quantitative sub-study (measures), or to better understand a specific issue of a quantitative study using a qualitative sub-study.” [20]. ³“There is no specific methodology, but a qualitative data collection and analysis, e.g., in-depth interviews or focus groups, and hybrid thematic analysis (inductive and deductive.” [20]. ⁴“The quantitative component is followed by the qualitative. The purpose is to explain quantitative results using qualitative findings.” [20]. ⁵“The study analyses life experiences of an individual or a group.” [20]. ⁶“A collection of individuals with similar characteristics are used to describe an outcome.“ [20]. ⁷“The aim of the study is to describe and interpret the shared cultural behaviour of a group of individuals.” [20].

The articles differed by the purpose of supportive technologies (as can be seen in Table 3), the number of people with dementia included in the study, and the stage of dementia of these participants.

Table 3.

Variety of purposes (not mutual exclusive) of supportive technology developed in included articles

Purpose of Technology	Reference numbers and Name of projects (if applicable)
Support in daily life
Reminder system	[28, 30, 33, 44, 51, 65, 76, 80] and COGKNOW project
Medicine dispenser	[23]
Robot	Ed project [45, 75]
Item locator	[41] and COGKNOW project [46, 70, 82]
Automatic wheelchair	[73]
Light armature	[55]
Safety
Sensors for surveillance	Rosetta project [48, 54] and COGKNOW project [46, 70, 82]
Indoor navigation support system	[83]
Outdoor localization system	[17, 26, 28, 58, 72, 79] and COGKNOW project [46, 70, 82]
Outdoor navigation support system	[38, 39]
Meaningful activities
Reminiscence	[31, 33, 56] and CIRCA project [35, 77]
Musical interventions	[24, 25, 57]
Lifelogging	[40, 42]
Cognitive stimulation	[52, 78]
Physical exercise	[50]
Group activity	[37]
Communication
Video conferencing	[28, 29, 51, 71] and Easy-to-use videophone project [43, 53] and COGKNOW project [46, 70, 82]
Sending text messages	[33]
Social sharing	[32]
Information
Informational websites	[74] and DecideGuide project [47, 49]
Clinical testing
Cognitive screening	[36]

In ten out of 49 articles the numbers of participants with dementia were not or only partly reported, mainly when multiple (observational) sessions in intramural care settings were performed [23–32]. Several articles (including [29, 33]) report reasons for a relatively low number of participants in their study, which can be categorized in issues related to the health status of the person with dementia, difficulties with technology or the planning of the study. The level of dementia of the participants is usually defined in stages. From the 49 articles, 16 articles involved people in mild to moderate stages. Other reported stages were mild (n = 7), mild to severe (n = 5), moderate to severe (n = 2), and moderate (n = 1). When the stage of dementia is reported (n = 31), only 22 studies report some form of clinical measurements; the Mini-Mental State Examination (MMSE) [34] score was used most often (n = 13). A large number of studies (n = 18) did not report the stage of dementia at all. In 37 of the 49 articles the informal caregiver was also actively involved as a participant, for example, by being interviewed or as support in the research activity with the person with dementia.

Phase of technology development

We discriminated between four phases in technology development: pre-design, generative, evaluative, and post-design (Fig. 2). Researchers actively involved people with dementia most often in the evaluative phase of development (n = 38), but also quite regularly in the generative phase (n = 25). The majority of the articles describing activities in this generative phase (17 out of 25) stem from the HCI and Design field (i.e., found in search 3). Studies reporting activities in the post-design phase do not include any insights from activities in earlier phases. About half of all selected articles describe research activities performed in one phase of development (n = 26), although they sometimes describe several research activities within this phase. For example, two articles describe multiple rounds of user testing in the evaluative phase [35, 36]. In 20 articles, the described research activities with people with dementia occur in two phases. Often (n = 15) these are the generative phase and the evaluative phase. Two articles describe the involvement of people with dementia in the pre-design phase and the evaluative phase [37, 38] and three articles describe activities in the pre-design phase and generative phase [17, 39, 40]. Furthermore, in three articles the research activities cover three phases of the technology development process: pre-design, generative, and evaluative [32, 41, 42]. In several studies, activities in the other phases are described but were not conducted with people with dementia directly such as interviewing in the generative phase with (informal) carers [24, 33, 37] and experts [28, 32] or brainstorming in the generative phase within the project team [38, 41]. The input of others is regarded as very relevant in the development of new technology, but multiple studies also report relatively large differences between preferences of informal caregivers and people with dementia [43–46]. Informal caregivers, for example, prioritize functionalities to monitor the safety of their relative as more important than the person with dementia themselves.

Fig.2.

Four phases of technology development.

Role of people with dementia

In a limited number of articles (n = 7), the people with dementia were involved in multiple phases of development and were iteratively consulted to co-design the technology. Four of these articles report that the people with dementia involved were in mild to moderate stages of dementia. In all seven studies the original idea of the technology or service to be developed was already formed before the involvement of people with dementia, such as an interactive webtool [47] or an integration of three existing supportive technologies [48]. In some studies, design choices were still made by the researchers themselves. Researchers in two articles actually design different prototypes in order to let the person with dementia steer design choices [23, 42]. None of the seven co-design articles describe measurements on whether the people with dementia felt as equal partners in the project. In the remaining articles (n = 42), the people with dementia were involved as informant in the projects, although some studies do report that they work according the participatory design approach. Either the research described in these articles only covered one phase of development (e.g., [46, 49, 50]) or the people with dementia did not actively contribute in subsequent research activities [37, 51].

Research methods and materials in all phases of development

The most common methods for involving people with dementia, in all phases of development, are interviews and observations (see Table 4). In some cases, different types of elicitation material were used during the interviews (e.g., scenarios, pictures, mock-ups), but this is not standard practice. Several researchers reported problems with the interview method if no elicitation material was used, such as people with dementia having troubles answering abstract questions [52], difficulties with assessing and communicating their own experiences [46, 51], and giving socially desirable answers [46, 53]. In the reviewed articles, observations were usually conducted when people were invited to test a beta-prototype in the evaluation phase (n = 27). Some researchers elucidate this by stating that people with dementia cannot imagine how a non-functional prototype is supposed to work [52] or have trouble comprehending low fidelity prototypes [47]. On the other hand, downsides of using functional prototypes are shared in the studies as well such as people with dementia being afraid of breaking the technology [51], timing issues with installation procedures [54], and technical failures affecting the attitude toward the system [30, 49]. Other researchers also report using low fidelity prototypes, such as paper prototypes, Wizard-of-Oz prototypes, or alpha prototypes. Paper prototypes were mainly used as a representation of the final product, instead of being used during a co-design activity. One article describes a design research activity with creative materials, such as foam and Lego, used to generate ideas for the technology under development [39].

Table 4.

Different methods and materials used in design research phases of technology development

Phase	Pre-design	Generative	Evaluative	Post-design
Reference numbers	[17, 32, 37–42, 78]	[15, 23, 25–30, 32, 33, 35, 39–42, 47,48,51,53,65,70,72,77,79,81]	[23, 25–27, 29–32, 33, 35–38, 41–43, 45–49, 51, 52, 54–58, 70, 71, 73–77, 79–81]	[24, 44, 50]
Methods used with people with dementia (number of studies that used this method)	Interviews	Interviews	Interviews	Interviews
	Semi-structured (1)	Semi-structured (5)	Semi-structured (14)	Semi-structured (2)
	Unstructured (1)	Structured (1)	Structured (6)
		Unstructured (1)	Unstructured (6)
	Observations	Observations	Observations	Observations
	Controlled (1)	Controlled (3)	Controlled (17)	Participant (2)
	Unstructured (2)	Unstructured (4)	Unstructured (9)
	Participant (3)	Participant (4)	Participant (1)
	Group sessions	Group sessions	Group sessions
	Focus groups (1)	Focus groups (8)	Focus groups (2)
		Workshops (6)	Workshop (1)
	Diary Written (1) Photo (1)	Personal design sessions (1)	Self-administered questionnaires Standardized (5)
			Other (4)
Materials used (number of studies that used this material)	Neck worn cameras (1)	Neck worn cameras (1)	Prototypes	Finished product (2)
		Scenarios (6)	Wizard-of-Oz prototype (4)	Probes and other prompts
		Mock-ups	Alpha prototype (6)	All sorts; different music instruments, sheets of material etc. (1)
		Sketches and digital images (4)	Beta prototype (27)
		Paper prototypes (5)	Fully functional prototype (3)
		Tangible objects (4)	Probes and other prompts
		Probes and other prompts	Technology (1)
		Personal photos (2) and other pictures (4)	Probekit/game (1)
		Existing technology (4)
		Lego (1)
		Games (1)
		Creative material; foam, post-its (1)

In general, authors provide only a limited rationale as to why they choose certain research methods and materials. Two studies researched the technology as well as the used methods and materials [55, 56]. Both studies argue for minimizing the need for retrospective reflection in a research activity with people with dementia.

Impact of involvement on technology and participants

The impact of the involvement of people with dementia on technology development was identified in terms of changes to the technology and in terms of experiences of the participants themselves (Table 5). Out of the total number of 49 included articles, 11 articles did not report directly applied changes as a result of users’ involvement, in 19 articles one change was made to the technology and in 19 articles multiple changes were attributed to the input of participants with dementia. As expected, the type of changes differed according to the phase of the development in which the input of people with dementia was collected. In the earlier phases, participants could have an influence on the conceptual idea and rationale [39, 57] and the functionalities of the system (e.g., [48]), while in the later phases the changes were more related to interface design (e.g., [35, 49] or implementation issues [44]. It was not always clear whether the reported changes were actually further developed in the remainder of the project.

Table 5.

Role of participants with dementia and the impact of this role on technology and experience of participation

Publication Author Project	Design approach	Role of person with dementia	Impact of involvementon technology	Impact of involvement on person with dementia
		Informant Co-designer	0 = no changes	– = negative impact
			1 = one aspect
			2 + = multiple aspects	+= positive impact
Karlsson et al., 2011	User-driven design	Informant	0	+	Participants were relaxed, despite being observed. Interviews at the homes of the participants ensured familiar environments.
COGKNOW [70]
Span et al. 2017 DecideGuide [47]	Participatory design	Co-designer	2+	– & +	People with dementia were asked why they participated. Reasons were (1) to be useful by contributing to research activities, (2) to contribute to a better quality of life for future dementia patients, and (3) give one’s opinion. Researchers report no signs of distress during interviews. Most participants enjoyed in sharing their experiences, although talking about some topics was emotional.
Meiland et al. 2012 COGKNOW [46]	Participatory design	Informant	0	Not described	The expectations of the users regarding the device to be developed could not always be met. Time constraints limited the ability to develop all functionalities suggested by users who participated in more than one cycle.
Lopes et al. 2016 [41]	Action research	Co-designer	1	+	People with dementia asked for solutions that would be easy to use or that could be integrated in a more global assistive solution (personal robot, mobile phone...).
					People with dementia were empowered because of their participation in all phases of development, including requirement determination and prototype testing.
Boman et al. 2014 [43]	Inclusive design	Informant	2+	+	People with dementia pointed out that it should be possible to adjust the features of the videophone to each individual’s needs and wishes. Other functionalities were also reviewed. Albeit facing some problems in the test sessions, the participants with dementia strongly expressed positive feedback and appreciation of being involved.
Wang et al., 2017 Ed [45]	Not reported	Informant	1	Not described	People with dementia report the need for adaptability of the technology.
Peeters et al., 2016 [57]	Situated Cognitive Engineering	Informant	2+	–	People with dementia contributed to refinement of research rationale (including new structure of app, linking to personal life events, adding music, adding new pictures) Researchers observed that the people with dementia became very tired, less talkative, or even withdrawn towards the end of the test session.
Meiland et al., 2014 ROSETTA [48]	Participatory design	Co-designer	2+	Not described	People with dementia discussed functionalities and gave remarks on interface design issues (including icon design, amount of information, content).
Suijkerbuijk et al., 2015 [55]	Not reported	Informant	1	– & +	Comments about the aesthetics of the light armature were provided. People with dementia did not report any discomfort of participating in this study. Several aspects appeared to influence their feelings of involvement and motivation: reminding of loss of abilities; feeling of fulfilment; research activity was fun.
Olsson et al., 2013 [58]	Not reported	Informant	0	– & +	Some persons with dementia made statements about desired changes in the design of the technology, but not further defined. Despite the emotional upheaval of describing and reflecting on their situation, all of the participants (both persons with dementia and their spouses) appreciated being given an opportunity to speak with someone who showed an interest in hearing their stories.
Boman et al., 2014 [53]	Inclusive design	Informant	2+	Not described	People with dementia opted for more flexibility in design and functionalities. The videophone should be modern and attractive. Also, ideas about introducing the system to new users were shared.
Kerkhof et al., 2015 [44]	User-centered design	Informant	2+	+	Issues were mentioned regarding the implementation (installation errors, inefficient use) and needs for further development (representation of content). The authors report that some residents actually liked being able to contribute and that their input mattered, and that it was remarkable to see how articulate the people with dementia were about their needs.
Hattink et al., 2016	Not reported	Informant	0	Not described	This evaluation study showed that the Rosetta system was anticipated very useful by the participants, especially when the major technical problems would be resolved.
ROSETTA [54]
Pakrasi et al., 2015 [71]	Not reported	Informant	0	Not described	Participants reporting greater autonomy, less isolation, and improved quality of life.
Dethlefs et al., 2017 [52]	Not reported	Informant	0	Not described	This study investigates the general acceptability of computer-based cognitive stimulation.
Jacova et al., 2015 [36]	Not reported	Informant	1	Not described	People with dementia disliked lengthy written instructions, and asked for step-by-step instructions with pictorial support. Other interface issues, such as busy screen layout and consistency, were resolved.
McCabe &Innes, 2013 [72]	Not reported	Informant	1	+	People with dementia shared many insights on appropriate design for GPS systems. Participants expressed their enjoyment of taking part.
Wang et al., 2011 [73]	Not reported	Informant	1	Not described	In the design of future prototypes, further attention needs to be paid to size, form, and construction and the interaction of exterior features with how the device is perceived.
Hattink et al., 2016 [74]	Not reported	Informant	1	Not described	People with dementia had most troubles with reaching and accessing the site (e.g., logging in, typing the URL).
Wolters et al., 2016 [65]	Not reported	Informant	2+	Not described	General attitude towards cognitive assistants, timing of prompts, voice and interface preferences. Personalization of system is crucial.
Begum et al., 2013 Ed [75]	User-centered design	Informant	2+	Not described	The developer will focus on social interactive aspect of the robot in future development based on this study. Furthermore, they intend to perform a few changes to the overall appearance of the robot which include using an animated avatar for speech delivery and using a low pitch female voice.
Alm et al., 2004 CIRCA [35]	Not reported	Informant	2+	Not described	People with dementia comment on design issues (such as contrast of screen, size of the typeface, the brightness of the visual images) but also reported on the selection of stimuli available.
Van Rijn et al., 2010 [37]	Participatory design	Informant	2+	+	Interactions with the people with dementia led to the decision of not using laptop screens in the design. During user tests, the design team report that triggers are needed for people with dementia to start using the system. The people with dementia involved in the testing really enjoyed participating in the design project and the conversations they had with the team members. The design team was not only gathering design information but became providers of activities as well. Four months after the design project, the care professionals reported that some people still asked about the designers.
Span et al., 2015 DecideGuide [49]	Participatory design	Informant	1	Not described	People with dementia commented on navigation and user friendliness of the interface (such as text and buttons needed to be enlarged.
Hagethorn et al., 2008 [38]	User-centered design	Informant	2+	Not described	People with dementia were able to steer the design by commenting on important functionalities (e.g., being able to make a “free” walk, alarm function) and interface issues (few buttons, interface elements must be big).
Cohene, Baecker &Marziali, 2005 [42]	User-centered design	Co-designer	2+	Not described	During a reminiscence session, the content of the digital life story book was established. Very different prototypes were shown to the participant to inform next iterations of the design.
Nugent et al., 2011 [76]	Not reported	Informant	0	Not described	The study resulted in insights into the usage of video based reminding technology.
Alm et al., 2005 CIRCA [77]	Not reported	Informant	1	Not described	Further development will be based on the lessons learned in the evaluations; e.g., by making the system more modular.
De Beer et al., 2010 [23]	Not reported	Co-designer	2+	Not described	People with dementia explained the troubles with medicine intake and what they like about existing systems. They reflected on a first design idea, by adding the need for a portable system.
Morán &Meza-Kubo, 2009 [78]	Not reported	Informant	2+	Not described	A large set of design-insights is based on the user research, including how a session with the tele-assistant should be managed, how interaction with material should be established etc.
Gibson et al., 2016 [56]	Not reported	Informant	0	Not described	People with dementia had troubles verbalizing thoughts while simultaneously testing the app (‘thinking aloud’).
Wan et al., 2016 [79]	User-centered design	Informant	0	Not described	Researchers describe the difficulties with involving people with dementia and translating their needs into (fixed) design.
Morrissey et al., 2016 [24]	Experience-centered design	Informant	1	+	The materials of the batons were changed according to the responses of people with dementia. The interactions with the participants show that they felt free in interacting with each other and the research and that they enjoyed getting a voice.
König et al., 2016 [80]	Not reported	Informant	2+	Not described	People with dementia opted for personalization in the avatar, respond to the style of prompts given and discussed that they did not want to use the system when it would make them feel old.
Bennett, Hinder &Cater, 2016 [25]	Not reported	Informant	0	Not described	A design process is described but reported feedback from people with dementia was only positive and did not lead to changes.
Wu et al., 2016 [26]	Not reported	Informant	1	Not described	Designers found some difficulties with the auditory cues and want to improve this in further developments.
Ly et al., 2015 [27]	People-centered design	Informant	1	Not described	People with dementia had their saying in the design of the guiding cues; the ambient LED light and the color of the light.
Holbø, Bøthun &Dahl, 2013 [39]	Participatory design	Co-designer	2+	+	In individual participatory design sessions, people with dementia prioritize functions of the system. Most important was the insights given in the conceptual model of the final design. However, researchers also report that design suggestions from the workshops were not directly translated into requirements. Furthermore, researchers indicate that people were empowered (no measurements reported).
Mayer &Zach, 2013 [51]	Participatory design	Informant	2+	+	Authors report many design implications from their user research, such as the use of familiar items, simple and redundant interface design, explanatory pictures and videos. The use of games in their research created enjoyment during focus groups and relaxed atmosphere to discuss different topics.
Jordan et al., 2013 [33]	User-centered design	Informant	1	+	Most changes to the design (and added functionalities) stem from the input of carers. Only redesign of the clock was based on finding from report of people with dementia. Due to the setting, researchers report that people felt trusted, calm and willingly to participate.
Lindsay et al., 2012 [17]	Participatory design	Co-designer	2+	– & +	Participants with dementia were involved in multiple phases, impacting the functionalities of the device and the design. Authors report on disempowering effects (when taking decision based on insights), quality relationship between researchers and participants (although this might have resulted in less critical feedback) and some fixation on certain design issues that were not feasible to actual implement.
Schneider et al., 2013 [28]	User-centered design	Informant	1	Not described	New functionalities were created by input from participants with dementia in the second iteration.
Boyd et al., 2014 [29]	User-centered design	Informant	1	Not described	After a first testing of multiple prototypes, the people with dementia could opt for the most preferred version to be further developed and tested.
Donnelly et al., 2010 [30]	Not reported	Informant	1	Not described	Participants with dementia commented on the size and sound of the device.
Nugent et al., 2008	Not reported	Informant	1	Not described	People with dementia expressed their need for different forms of personalization in interface design (colors and size of buttons/fonts).
COGKNOW [81]
Lee &Dey, 2007 [40]	User-centered design	Informant	1	Not described	Photos were taken and sorted by people with dementia in order to define the type of cues needed for the system.
Tobiasson et al., 2015 [50]	Participatory design	Informant	2+	Not described	The types of game (competition) and duration of play was decided by the people with dementia. Later in the process, the console was redesigned together.
Huldtgren et al., 2016 [31]	Research-through-design	Informant	1	Not described	Many design implications were brought in by reflections from carers. One aspect coming directly from participants with dementia is related to the redesign of buttons.
Lazar et al. 2017 [32]	Not reported	Informant	0	Not described	People with dementia are involved in evaluation but no direct design implications are reported.

The vast majority of the articles do not describe how participants experience their involvement (34 out of 49). However, three studies of the 15 studies that do elaborate on the experiences of participants specifically asked people with dementia about their involvement [43, 47, 55]. The remaining studies (n = 12) report experiences without quotes and/or reference to how these experiences were gathered. Positive experiences include feelings of fulfillment, enjoyment, and empowerment. Also, appreciation for their involvement and a relaxed and trusting interaction with researchers were identified as positive aspects of involvement. Few negative experiences of participating were reported, including becoming emotional when talking about their situation [47, 55, 58] and feeling extremely tired during the research activity [57]. Disempowering effects were reported when design changes could not be implemented in the further development [17].

DISCUSSION

The increasing number of people with dementia worldwide creates a need for meaningful support in independent living and overall well-being in daily life. Also, the possibilities that technology afford, increase enormously with the continuous worldwide development of digitalization. Earlier work emphasizes the importance of involving people with dementia in the development of meaningful supportive or assistive technologies [11–14]. This systematic literature review updates and builds on the existing knowledge about the active involvement of people with dementia, by including a contemporary and relevant perspective. Ultimately a selection of 49 out of 3465 articles was made based on a search in seven different search databases.

Our review reveals that in the majority of the studies, research activities were mainly performed in one phase of technology development, often being the evaluative phase. Notably, the majority of the articles describing activities in the generative phase stem from the HCI and Design field. Because most studies (n = 42) involve the people with dementia in only one phase, their role is usually limited to being an informant. It seems especially complicated to allow people in the more advanced stages of dementia an active role as equal partner over the course of a project that might easily take several years. Merely seven studies gave the people with dementia a role as a co-designer in more than one phase of the development. However, without explicit confirmation of people feeling like being treated as equal partner during the process, the extent to which they actually actively participated in a design is debatable. Our review also highlights that the most frequently used research methods were interviews and observations. Prototypes of the technology, with different levels in functioning, were used in the evaluative phase of the development process. However, the arguments for the chosen research methods and the research materials, such as prototypes, were not extensively reported in the included articles. This is problematic because this information can be valuable for future research and earlier research indicates that people with dementia might get distressed when testing only partially functioning prototypes [28,59]. Nevertheless, this literature review reflects that people with dementia can influence the development of technology in regards to content, design, and even the initial idea, although the impact on how they experience their own involvement remains largely unknown. Within these conclusions, “people with dementia” are treated as a homogenous group, while we are well aware that the above-mentioned insights will be different for people in various stages or types of dementia.

The value of an interdisciplinary perspective

Our review shows that including search words and databases from the field of HCI and Design results in finding more relevant studies involving people with dementia. Lately, there is indeed an increasing attention in the HCI community on design with people with dementia [60]. They argue that the HCI perspective can move the research focus away from only considering medical concerns toward a broader view into context, values, and the situatedness of technology use. In the development of supportive technologies for people with dementia, the HCI and Design articles often describe design-oriented studies in the generative phase or small-scale feasibility studies in the later evaluative phase of technology development. By including these studies in the current review, we accomplished a broader view on how and when people with dementia can be involved in technology development. Furthermore, researchers from HCI and Design are familiar with using different elicitation materials (such as scenarios and mock-ups) in research activities which is reported to be helpful to get an empathic understanding of the user group and their everyday lives.

However, in line with a review in self-care technologies [61], the majority of the articles from HCI and Design seem to lack a thorough theoretical grounding. In general, the methodological quality of the included studies was difficult to assess and differed, mainly because articles do not always describe research questions and analysis with sufficient detail. The expertise from HCI and Design to iteratively co-design human-centered technologies and include people with dementia in earlier phases of development should be accompanied with the expertise from the healthcare researchers on longitudinal studies. This way we ensure that the co-designed technologies eventually impact the lives of a larger group of people with dementia. Insights in appropriate research methods and materials in earlier phases of development can potentially be useful in the later evaluative and post-design phases as well. In accordance with the broader field of digital health interventions [62], we recognize that the different abovementioned competences seem to slightly converge in the field of supportive technology development for people with dementia but are, at this moment, still merely separate worlds. However, this interdisciplinary approach should be more employed in future research to combine the strengths of both worlds to fully overcome the challenges of actively involving people with dementia in the development of well suiting technologies.

The challenge of early involvement of and co-design with people with dementia

User involvement has positive effects on the development of accessible and meaningful technology. It is, however, not an easy task when the users are people living with cognitive impairments such as dementia. General lessons from projects developing supportive technology are well shared such as the importance of establishing a proper research-participant relationship, having dementia expertise within the multidisciplinary team, spending time in informing the participant about the research and organizing a respectful exit-strategy on what to expect after participating in the project [63,64]. Nevertheless, our work shows that there is still a lack of specific knowledge on co-design methodologies for people with dementia in supportive technology development, even when including articles from the field of HCI and Design.

The reviewed articles report challenges including people with dementia in technology development because they can face difficulties answering abstract questions and communicating their own experiences over time. Informal caregivers can play an important supportive role in these activities, but cannot substitute for the involvement of people with dementia themselves since they sometimes also have different needs and opinions. The fact that most studies report on involvement of people with dementia in activities in the evaluative phase might be expected. When testing a prototype with someone with dementia, the behavior and interaction can be observed and measured, and this person can reflect on their experiences while using it. Therefore, there is less need for retrospection. It will become problematic when people with dementia are asked to reflect on their experiences over a longer period of time without the researcher in the same room. Furthermore, in the earlier phases of development (pre-design or generative) involving someone with dementia might be more challenging because the research activities require more abstract thinking [17] and interaction measures are less suitable or even impossible in the pre-design phase. To make the earlier development phases recognizable and more concrete, researchers use materials such as scenarios (e.g., [28,48,51,65]). However, the use of scenarios still needs some sort of capability to translate the scenario to someone’s own life which can be difficult for someone with dementia. Moreover, researchers also use existing technology for people with dementia to evaluate and further requirements are based on the experiences people could formulate with these existing products [17,29,41,53]. This shows that the more concrete the research materials are, the easier it potentially becomes for people with dementia to articulate their opinion about these materials. Yet, the level of openness of the material also defines the impact the person with dementia has on the eventual development of the technology. Generative tools, such as drawing and building paper prototypes, are needed to gain new insights and share plans among the entire design team [15]. Reflecting on existing technology does not directly allow for generating ideas that might entail totally different (non-technological) solutions.

Despite the expansion of the current review to the field of HCI and Design, we found only a relatively small number of articles including people with dementia as actual co-designers. We expect that this role can be beneficial, but it is still not possible to draw firm conclusions on the impact of a co-design role on the technology development. We only identified one paper that uses creative design material with people with mild dementia [39]. This highlights the limited knowledge we have on how to use the creative capacity of people with dementia and actively involve them in the early phases of technology development to steer the design agenda and truly co-design supportive technologies. So, given that the original idea of the technology or service to be developed was often already formed before the involvement of people with dementia, this raises the question whether the field is at this point still more technology driven instead of user driven. This might be a fundamental reason why the uptake of technology by people with dementia is currently so limited.

Strengths and limitations

Next to the abovementioned value of expanding our search in multiple ways including expansion to our search to the field of HCI and Design, our results show that there is an increased interest in involving people with dementia in the development of supportive technologies. This demonstrates the relevance of the current review to update the existing body of knowledge. Furthermore, the strengths of the current review are also in the rigor of the methodology, by independently screening a high number of abstracts, titles, and full papers by multiple researchers. Additionally, by using earlier work for the search strategy, this review builds on existing knowledge which is highly needed in this field [66]. The extension of the search key words and search databases resulted in a list of articles that, to our beliefs, include all relevant studies on design and technology development for people with dementia available in the scientific literature.

Nevertheless, the following limitations have to be considered. Although we attempted to objectively rate the articles on different criteria, we acknowledge that criteria could only be assessed based on available descriptions in the article and then subjectively assessed (e.g., the impact of the involvement of people with dementia on the technology developed). Similar problems are also mentioned in related work [12]. However, a structured approach was followed and whenever there was disagreement between both raters, consensus was reached by discussion. Due to our scope of including articles that report on 1) active involvement of people with dementia and 2) technology development, we might have limited the insights from studies such as the creative work with people with dementia living in care facilities that did not involve technology development [67,68]. This might have had given some additional insights in useful research methods and materials. In particular, we recognize that need elicitation studies, without clear identification of being part of technology development, are now not included in this review. Given the large number of articles found within the current scope, the value of focusing our search seemed necessary. Our results, therefore, present insights for the specific field of developing supportive technologies for people with dementia.

Conclusion

This review reveals that there is a growing amount of research projects in order to develop supportive technologies for people with dementia (e.g., within the European AAL Program). Compared to earlier work [12], there is an increase in studies eliciting an active involvement of people with dementia. By adding studies from the HCI and Design fields, the current review has outlined a more balanced view on where in the development process people with dementia can be involved. Not only are people with dementia able to evaluate technology, they can also play an important role in the generative phase of development to steer the design of supportive technology. Involving people with dementia as co-designers in the development of technology is deemed challenging, but not impossible. However, even with the update and expansion in the current review, specific insights in appropriate research methods and materials is still lacking. Extensive reports on the methodology and evaluation of the experiences of involvement of the people with dementia themselves are generally missing. This makes appreciation and further improvement of the active involvement and co-design difficult within this interdisciplinary field. Especially since some of the current developments can be regarded as more technology-driven instead of user-driven, our results emphasize the importance of a better understanding of how people with dementia can and ought to be involved. Future research should therefore continue to focus on and describe how research methods and materials could be shaped, chosen and applied. This does not need to interfere with the explorative nature of design activities when writing detailed method stories of these design activities with different people with dementia [18]. In line with person-centered dementia care [69], the research methods and materials should consider users’ changing individual strengths and vulnerabilities, and give people with dementia their desired role in the development of supportive technology. Only when people with dementia have the right sense of control, the gained empathic understanding of this user group by designers, developers and researchers will result in more meaningful and suitable technology.