Abstract
There is increasing interest in the use of technology to support social health in dementia. The primary objective of this systematic review was to synthesize evidence of effectiveness of digital technologies used by people with dementia to improve self-management and social participation. Records published from 1 January 2007 to 9 April 2020 were identified from Pubmed, PsycInfo, Web of Science, CINAHL, and the Cochrane Central Register of Controlled Trials. Controlled interventional studies evaluating interventions based on any digital technology were included if: primary users of the technology had dementia or mild cognitive impairment (MCI); and the study reported outcomes relevant to self-management or social participation. Studies were clustered by population, intervention, and outcomes, and narrative synthesis was undertaken. Of 1394 records identified, nine met the inclusion criteria: two were deemed to be of poor methodological quality, six of fair quality, and one of good quality. Three clusters of technologies were identified: virtual reality, wearables, and software applications. We identified weak evidence that digital technologies may provide less benefit to people with dementia than people with MCI. Future research should address the methodological limitations and narrow scope of existing work. In the absence of strong evidence, clinicians and caregivers must use their judgement to appraise available technologies on a case-by-case basis.
Keywords: dementia, mild cognitive impairment, digital technology, social health, social participation, self-management, caregiver support
1. Introduction
Social participation and the ability to manage our own lives are vital to good health, particularly to good “social health” [1]. It is, therefore, deeply concerning that social isolation is a common experience for people living with dementia [2,3]. There are many factors that contribute to social isolation, including stigma, loss of independence, and inaccessibility of public spaces [4,5,6]. In addition to addressing factors that cause or exacerbate social isolation, solutions to facilitate good social health in dementia have been made a global priority [7]. A particular area of interest in addressing social health in dementia has been the use of digital technologies to facilitate self-management and social participation [7,8,9,10].
The importance of social health and the consequences for people with dementia of insufficient social participation have been highlighted by the impacts of “lockdown” measures in response to the 2020 COVID-19 pandemic [11]. The pandemic has also increased the urgency of implementing effective technological solutions to overcome the restrictions on physical interaction and the pressure on health and care systems. Governments in some countries, including the Netherlands, have made emergency funding available to health and care institutions to invest in digital technologies in response to these challenges [12].
Despite intensifying interest and investment, previous reviews of the literature have failed to consistently demonstrate high-quality evidence of the effectiveness of technological solutions in improving cognitive functioning, self-management, or social participation for people with dementia or mild cognitive impairment (MCI) [13,14,15]. At the same time, advances in digital technology continue at an exponential rate and the application of technologies aiming to improve social participation and self-management is a rapidly growing commercial and scientific field [16,17]. To gain insight into the factors that actually work well and those that do not, this review aims to capture the latest scientific evidence of the effectiveness of digital technologies for facilitating self-management and social participation for people with dementia.
The concept of social health has been defined in the context of dementia as the capacity to fulfil one’s potential and obligations, management of one’s own life, and participation in meaningful and social activities [18]. This review was conducted within the scope of a European project to evaluate technology for self-management and social participation [19], and therefore focuses on these latter two components of social health. By a European consensus, self-management has been defined as “the ability to preserve autonomy and to solve problems in daily life, as well as to adapt to and cope with the practical and emotional consequences of dementia” [18]. Social participation has been defined as “the act of being occupied or involved with meaningful activities and social interactions and having social ties and relationships, which are meaningful to the person living with dementia themselves”.
A distinction can be made between technologies based on the intended user of the technology—either health and care professionals or people with dementia themselves [20]. In this review, we focus on technologies that are used by people with dementia themselves. This represents the most direct form of support for self-management. Such technologies may include software applications or “apps” designed to be used by the person with dementia, or include specific hardware components such as tablet computers, virtual reality (VR) devices, or wearable technologies. This review does not consider so-called “ambient” technologies that require no interaction of the person with dementia (such as fall monitors installed in homes or other “smart home” technologies) or technologies designed to be used only by caregivers or health and care professionals (such as medical devices). A distinction can also be made between people experiencing impaired cognition with a diagnosis of dementia and people with MCI. In this study, we are interested in both dementia and MCI. The primary objective of this study is to identify and evaluate effect studies of interventions based on the use of digital technologies by people with dementia or MCI to facilitate self-management and social participation.
The use of digital technologies by people with dementia or MCI to improve social health is complex. Many people living with dementia receive some form of help, care, or support with certain activities. This may be from a professional or an informal caregiver, such as a spouse, family member, or volunteer. In our experience conducting research on technology used by people with dementia or MCI, informal caregivers often play an important role in the effective use of technology, however the nature and quality of interactions can vary. The relationship between the person with dementia and caregiver may, therefore, be an important contextual factor, alongside the design, content, and implementation of the technology, which influence the effectiveness of the intervention [18]. The caregiver characteristics and outcomes should, therefore, ideally be taken into account when evaluating such an intervention [21,22]. In acknowledgement of these complexities, there are two further secondary objectives of this review: firstly, to identify the relationship between the caregiver and the person with dementia or MCI, as well as outcomes relating to caregivers in included studies; secondly, to identify any facilitators and barriers to the implementation of technology in the included studies.
2. Materials and Methods
This systematic review was carried out with reference to the PRISMA guidelines and best practices as outlined by the Centre for Reviews and Dissemination [23].
2.1. Data Sources and Search Strategy
A systematic search strategy was developed by D.N. and C.P. Searches were conducted of the following databases, within the date range of 1 January 2007 to 9 April 2020: Pubmed, APA PsycInfo, Web of Science, Cumulative Index of Nursing and Allied Health Literature (CINAHL), and the Cochrane Central Register of Controlled Trials. To identify non-indexed and indexed articles, MeSH terms, thesaurus terms, and non-MeSH terms were included. The full search strings used are available in Supplementary Materials. Search terms related to “dementia”, “computer-assisted technology”, and “social health”. Results of the searches were exported to appropriate reference management software and de-duplicated before undergoing screening. Where trial registry entries were identified but there were no published results listed in the registry, a further search using Google Scholar was conducted using the trial registration number as the search term, and any articles identified were screened for inclusion in the review. The protocol for this review was not published in advance.
2.2. Inclusion and Exclusion Criteria
Inclusion criteria were controlled effect studies into digital technology interventions focused primarily at people with a diagnosis of dementia or MCI and published in 2007 or later.
The year 2007 was chosen because this is the year that the first iPhone smart phone was launched. We limited the study to controlled interventional studies, as such studies can provide strong evidence for drawing causal inferences about the effectiveness of interventions compared to non-controlled or observational studies. We did not specify what the nature of the control intervention should be. Primary target-users of the technological intervention in included studies were adults with a diagnosis of dementia (of any etiology) or with MCI. MCI is diagnosed on the basis of objective cognitive impairment, without significant impact on daily life and activities [24]. However, between two and four of every ten people with MCI go on to develop dementia, and we expected that many studies would have included participants with MCI in addition to people with dementia. An intervention met the definition of a digital technology if it was inherently dependent on any electronic device that comprised, or interfaced with, any kind of computer. Self-management and social participation are both aspects of daily life, and therefore we decided to include only studies that assessed outcomes in an ecologically valid setting in this review. We excluded studies that reported on outcomes theoretically related to social participation or self-management, but only using measurements obtained under laboratory conditions.
To be included in this review, the authors of the original papers did not have to explicitly name “self-management” or “social participation” as outcomes of objectives of the study. The reviewers included all studies that reported outcome measures relevant to self-management or social participation based on the operational definitions noted in the introduction to this article. With respect to measures that might be relevant to self-management, we decided not to include studies that only reported on basic activities of daily living (BADL). Whilst BADL are relevant to self-management, a measure of BADL alone is not sufficient to meet the operationalized definition of self-management in dementia. Studies that reported on instrumental activities of daily living (IADL) or measures of autonomy or self-efficacy in addition to, or instead of, BADL were considered for inclusion in this review. Studies in which the person with dementia was supported in the use of the digital technology by a formal or informal caregiver were also included, as were studies in which the technology was used by the caregiver independently of the person with dementia, as long as the person with dementia also used the digital technology.
Accordingly, records were excluded from this review if they were: (1) published before 2007; (2) not reporting on an interventional study; (3) not reporting on a controlled study; (4) not reporting on participants with dementia or MCI; (5) not reporting on an intervention that met the definition of a digital technology; (6) reporting on an intervention that was exclusively a medical or diagnostic device; (7) reporting on a technology that the people with dementia or MCI did not use themselves; (8) reported on an intervention that was not aimed at improving self-management or social participation; (9) reported on outcomes that were only measured in a laboratory environment; or (10) only reporting on BADL in relation to self-management (not complemented by any measure of IADL, autonomy, independence, self-efficacy, or some other aspect of self-management).
2.3. Study Selection and Data Extraction
All references identified were screened independently by one junior and one senior researcher (D.N. or F.v.d.B.; and E.F., R.M.D., K.D., or T.E.). A first round of screening took place on the basis of the published title and abstract. Studies not excluded on the basis of abstract screening were screened on the basis of full texts. If consensus between two independent reviewers could not be reached, a third independent reviewer was available to make a definitive decision as to whether the reference should be included in the review. Where required, translation from languages other than English and Dutch was carried out by qualified translators.
Data were extracted from included articles by means of a standardized data extraction form. This form was piloted and reviewed after the extraction of data from the first study, resulting in minor revisions. Data extraction from all included studies was performed by a junior researcher (D.N.) and checked by a senior researcher (R.M.D. or T.E.). General study characteristics extracted included the study design, sample size, setting, and population characteristics (age, gender, and health status or diagnosis). With respect to the primary focus of the review, extracted data described: the nature of the digital technology used (relevant hardware and software components); the intended function of the technology within the context of the intervention; the intended user of the technology; the outcomes measured, which related to social participation or self-management (including specific instruments used); and the results of the intervention. In line with the secondary focus of the review, data were also extracted concerning: any statements relating to facilitators or barriers experienced in implementing the intervention in the context of the study; and whether any caregiver outcomes were measured (and if so, the results).
2.4. Methodological Quality and Weight of Evidence
Weight of evidence was assessed on the basis of the Evidence for Policy and Practice Information (EPPI) weight-of-evidence approach (WoE) [25]. This approach provides a framework for weight-of-evidence assessment, which breaks down the assessment into four judgements. The intrinsic quality of included studies (WoE A) is a judgement of the quality of methodological design and risk of bias in the original study. The appropriateness of the method in the context of the review (WoE B) is a judgement of the extent to which the research design of the original study is appropriate to address the current review question. The relevance of each study to the review question (WoE C) is a judgement of how closely the original study population, intervention, and outcome measures match those of the current review question. Finally, an overall judgement is made, taking into account the three judgements named above (WoE D). The WoE framework can be combined with tools to conduct the individual WoE assessments. In this review, we used the National Institute of Health (NIH) tool for the assessment of randomized controlled studies to provide structure to our assessment of the internal validity of the included studies (WoE A) [26]. The weight-of-evidence assessment for all included studies was conducted independently by two junior reviewers (D.N. and F.v.d.B.). Judgements WoE A could be judged as good, fair, or poor. WoE B to WoE D were judged as high, fair, or low. These assessments were checked with a senior researcher (RMD) and any disagreements were resolved.
2.5. Synthesis
We anticipated considerable heterogeneity of interventions, study protocols, and outcome measures between studies included in this review, as the scope of the cited definitions of self-management and social participation was broad. Similarly, many different digital technologies exist, which could in theory be applied to the facilitation of social participation and self-management, from personal computers and touch screen devices, to wearable technologies, to software applications. The data synthesis was, therefore, undertaken by means of a narrative synthesis approach, which is well-suited to the synthesis of heterogeneous literature [27]. Included studies were grouped into clusters on the basis of the extracted data regarding population, nature of the technology, and intervention components and outcomes measured. With respect to studies analyzing the same interventions or the same outcomes, descriptions of the presence and direction of effects were noted. We did not plan to conduct any further statistical meta-analysis because of the expected heterogeneity in technological interventions and small number of included studies.
To categorize any statements made on facilitators and barriers of implementation of the technologies, we used the UK Medical Research Council (MRC) guidance for conducting process evaluations. This guidance defines several factors that can influence the final outcomes of intervention studies, including the context (the social and physical environment in which the intervention is received), implementation of the intervention (what participants actually receive), and mechanisms of impact (participants’ responses and interactions with the intervention, mediators, and unexpected pathways leading to the outcomes measured) [22].
3. Results
The literature search across the databases returned 2135 results. Figure 1 illustrates the screening process. After deduplication, 1394 unique records remained. Initial title screening was carried out by D.N. to remove any records that were irrelevant to this review. This resulted in the removal of 424 records. The remaining 970 records were screened on the basis of their associated abstract—and where applicable, associated trial registry information—by two reviewers independently. Forty-six records were identified based on the abstract as appropriate for assessment by a close reading of the full text. One further record was identified for full-text screening as a separate abstract was not available.
Of the 47 full texts that were read, only nine studies met all of our inclusion criteria [28,29,30,31,32,33,34,35,36]. Sixteen records were excluded because they were determined not to be reporting results from controlled interventional studies [37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52]. Eight records were excluded because outcomes of the intervention were only measured in a laboratory environment [53,54,55,56,57,58,59,60]. Six records were excluded because they did not report any outcomes that were directly related to social participation or self-management [61,62,63,64,65,66]. Four records reported on BADLs only [67,68,69,70]. Three studies were excluded because although participants with some form of cognitive impairment were included in the study, the outcomes were not reported separately from outcomes from those who were either cognitively healthy or had other pathologies [71,72,73]. One record was excluded because it was discovered to be a protocol only, not reporting any results [74].
3.1. Characteristics of Included Studies
The aim and key elements of the included interventions are described below. Details regarding the design and methods of the included studies are shown in Table 1. As anticipated, the studies that we identified were heterogenous with respect to the specific target population, nature of the intervention, control group intervention, and outcomes measured. Most challenging to interpret were the results of the three studies in which there was also heterogeneity within the studies themselves, because participants with formal diagnoses of dementia or MCI were included and analyzed together with participants with subjective cognitive impairment, objective but non-diagnostic cognitive impairment, or even non-cognitively impaired participants [29,31,36].
Table 1.
Authors, Year, and Language of Publication | Setting and Reported Funding Source | Study Design and Sample Size | Experimental Intervention | Control or Comparison Intervention | Sample Characteristics | Outcome Measures Relevant to Self-Management | Outcome Measures Relevant to Social Participation | Outcome Measures Related to Caregivers |
---|---|---|---|---|---|---|---|---|
Lee et al. 2013 (English). [28] | Hong Kong. Both outpatient and inpatient; urban setting. Source of funding not reported. | Single-center, single-blinded, three-arm, randomized controlled trial (RCT). Measurements at baseline, 6 weeks, and 3 months; n = 24 (7 experimental; 6 offline training; 6 control). | Computerized errorless memory training program (CELP). | (Therapist-led errorless learning programme) TELP arm: Therapist-led memory training Control arm: waiting list. |
Persons with ‘early dementia’ (Clinical Dementia Rating Scale [CDR] = 1); Mean age: 77.7 ± 6.07; 6 male, 13 female. Mean Mini Mental-State Examination (MMSE) CELP group 15.3 ± 2.7; mean MMSE TELP group 17.0 ± 3.5; mean MMSE control 17.6 ± 4.7 | Hong Kong Lawton Instrumental Activities of Daily Living Scale (HKLIADL) | None | None |
Liao et al. 2020 (English). [29] | Taiwan. Community-dwelling, recruited through community and day care centers. Funding from Taiwan Ministry of Science and Technology. | Single-center, single-blinded, two-arm RCT. Measurements at baseline and after 12 weeks; n = 42 (21 experimental; 21 control). | Microsoft Kinect VR system, for Tai Chi, resistance, and aerobic exercises. | Combined physical and cognitive training | Older adults with MCI (MMSE ≥ 24, Montreal Cognitive Assessment [MoCA] < 26); VR group: mean age 75.5 ± 5.2, 11 female, 7 male; control group: mean age 73.1 ± 6.8; 12 female, 4 male. | Lawton Instrumental Activities of Daily Living scale (LIADL) | None | None |
McCarron et al.2019 (English). [30] | United States of America. Described as community setting. Funding from United States National Institute on Aging to Advanced Medical Electronics. | Pilot single-center, non-blinded, two-arm RCT. Measurements at baseline, 3 months, and 6 months; n = 48 (20 experimental; 28 control). | Social Support Aid (SSA) mobile phone-based facial recognition application. | Usual care | Persons diagnosed with dementia (n = 29), persons with self-reported memory loss or concerns (n = 19). Mean age 74.90 ± 6.98; 23 male, 25 female. | None | Self-reported satisfaction with social contacts. Pleasant Events Schedule—Alzheimer’s Disease (PES-AD); Dementia Quality of Life (DQoL). | None |
Mrakic-Sposta et al. 2018 (English). [31] | Italy. Not further described. Funding from the Italian Ministry of Education, Universities, and Research (MIUR). | Pilot single-center, non-blinded, two-arm RCT. Measurements at baseline and after 6 weeks; n = 10 (5 experimental; 5 control). | VR-based program combining aerobic exercise and cognitive training. | No treatment | Persons described as having MCI (n = 6), described as mild dementia (n = 4). Mean age: 73.3 ± 5.7 years; MMSE 23 ± 3.4; 4 male, 6 female. |
Functional Activities Questionnaire (FAQ) | None | None |
Nishihura et al. 2019 (English). [32] | Japan. Community dwelling participants recruited via day care center. Funding from the Japan Society for the Promotion of Science. | Single-centre, non-blinded, randomized cross-over study. Measurements at baseline, after 12 weeks, and after 24 weeks; n = 27 (15 experimental; 12 control). | Electric calendar software application for Android tablet. | Waiting list | Alzheimer’s disease (n = 12), cerebrovascular dementia (n = 5), senile dementia (n = 2), alcoholic dementia (n = 1), healthy older persons (n = 7). Mean age: 81.5 ± 6.9 years; mean MMSE 22 ± 4.0; 9 male, 18 female. |
Semi-structured interviews with participants and their caregivers. | None | None |
Park and Park 2018 (English). [33] | Korea. Community dwelling participants recruited via community welfare centers. No external funding received. | Single-blinded RCT. Measurements at baseline and after 10-week intervention; n = 78 (39 experimental; 39 control) | Non-specific computer training (NCT) with Nintendo Wii sports games. | Cognition-specific computer training (CCT) using the CoTras program. | MCI (MMSE NCT 26.41 ± 1.94, CCT group 26.67 ± 1.68); NCT group age 66.95 ± 4.10, CCT age 67.64 ± 4.55. 42 male, 36 female (NCT 20 male, 19 female; CCT 22 male, 17 female) | 36-Item Short-Form Health Survey (SF-36) 1 | SF-36 2 | |
Pietilä et al. 2017 (Finnish). [34] | Finland. Community dwelling participants. Funding from the Miina Sillanpää Foundation. | Single-center, single-blinded, two-arm, RCT. Measurements at baseline, 13 weeks, and 6 months; n = 53 (28 experimental; 25 control) | FORAMEN rehab program, delivered by tablet computer. | Waiting list | Persons with early stage “mild” Alzheimer’s disease. Mean age 69.0 ± 5.0; 28 male, 27 female. Mean MMSE experimental group: 23.1 ± 3.8. Mean MMSE control group: 20.9 ± 3.8 | Alzheimer’s Disease Cooperative Study Activities of Daily Living Scale (ADCS-ADL) | None | Beck Depression Inventory (BDI-II); World Health Organization Quality of Life BREF (WHOQOL-BREF); Care of Older People in Europe (COPE-index) |
Silva et al. 2017 (English). [35] | United Kingdom. Community dwelling, recruited through day care centers. Funding from Region of Bourgogne (FABER); Fondation Médéric; and the Portuguese Foundation for Science and Technology. | Single-center, single-blinded, three-arm RCT. Measurements at baseline, after 6 weeks, and 6 months; n = 51 (17 experimental; 17 offline memory support; 17 control). | SenseCam wearable camera. | Memo+ arm: a pencil and paper cognitive training program. Control arm: daily activities diary |
Diagnosed probable Alzheimer’s disease. Sensecam group mean age: 75.41 ± 5.26; mean MMSE 21.88 ± 3.33 Memo + group mean age: 71.71 ± 5.15; mean MMSE 21.53 ± 3.01 Control group: mean age 73.82 ± 5.74; mean MMSE 22.82 ± 1.85 |
Adults and Older Adults Functional Assessment Inventory (IAFAI). | World Health Organization Quality of Life OLD (WHOQOL-OLD) 3 | None |
Vanoh et al. 2019 (English). [36] | Malaysia. Community dwelling participants. Funding from the Ministry of Higher Education Malaysia. | Single-center, single-blinded, two-arm, RCT. Measurements at baseline and 6 months; n = 60 (30 experimental; 30 control). | WESIHAT 2.0© web-based wellness application. | Dietary counselling based on the “Healthy Eating” pamphlet produced by Ministry of Health Malaysia | Older adults with MMSE 16–28. Mean MMSE WESIHAT group 28.3 ± 1.78; mean MMSE control group 27.0 ± 2.63; mean age: 67.84 ± 5.65; 21 male, 29 female |
World Health Organization Disability Assessment Scale (WHODAS 2.0) 12-item version 4 | Medical Outcome Social Support Survey (MOSS); WHODAS 2.0 12-item version 5; three-item loneliness scale. | None |
1 Role-emotional and role-physical subscales relevant. 2 Social functioning subscale relevant. 3 Social participation subscale relevant. 4 Mobility, self-care, and household/life activities subscales relevant. 5 Social/getting along and society/participation subscales relevant.
Each study included in this review evaluated a different intervention. We identified three technology-related clusters to which the experimental interventions belonged.
- Virtual reality (VR)-based interventions
-
-Combined physical and cognitive VR-based training [31]: The primary aims of the intervention were to improve the user’s cognitive function and reduce neuronal oxidative stress. A VR-based program combining aerobic exercise and cognitive training was administered over 6 weeks, in three sessions per week (18 sessions total). Each session was of 40–45 min duration, in which participants interacted with three virtual environments (15–20 min cycle in a virtual park, 5 min crossing at virtual crossroads, 20 min shopping in a virtual supermarket).
-
-VR-based physical and cognitive training [29]: The primary aims of the intervention were to improve the user’s cognitive function and performance of IADL. The Microsoft Kinect system was used to engage participants in Tai Chi, resistance and aerobic exercises, and simulated functional tasks, such as window cleaning and stair climbing. The HTC VIVE system (VR glasses) was used to engage participants in VR games based on IADL (such as shopping and food preparation). The intervention was delivered in sessions (three sessions per week for 12 weeks, 36 sessions in total). Each session lasted one hour (40 min physical activity, 20 min cognitive training).
-
-VR-based non-specific computer training [33]: The aims of the intervention were to improve users’ cognitive function and quality of life. Users were trained to use the Nintendo Wii to engage in virtual reality sports activities, including table tennis, fencing, and archery. The intervention was delivered by occupational therapists, during three sessions per week for ten weeks, of 10 min duration.
-
-
- Other wearable technologies
-
-Social Support Aid, a web-based mobile app with a smartwatch [30]: The primary aim of the intervention was to improve the users’ social engagement. Social Support Aid is a mobile phone-based app, which connects to a smart watch. Facial recognition software is used to assist people with dementia in the identification (names and relationships) of people that they interact with. Participants were given the technology to use for 6 months and were free to use it as much or as little as they chose.
-
-SenseCam, a wearable camera [35]: The primary aims of the intervention were to improve the cognitive function (specifically episodic and autobiographical memory), and the wellbeing and quality of life of the user. The SenseCam wearable camera was worn by participants around the neck while performing routine activities. The images captured were reviewed and discussed with a psychologist at interval appointments (face-to-face, twice per week). Participants were given SenseCam to wear for six weeks and were encouraged to wear the camera every day for the longest time possible.
-
-
- Software applications
-
-Tablet-based cognitive training and rehabilitation [34]: The primary aims of the intervention were to improve cognitive function and functional capabilities of the user, and to unburden the user’s informal caregiver. A tablet computer was used for guided and independent cognitive training. Participants also engaged in a wellbeing program via the tablet, with videocalls for peer support. The telerehabilitation program was administered over 13 weeks—guided for the first 9 weeks, then completed independently for the remaining 4 weeks. Participants engaged in seven face-to-face sessions (four sessions of 4–6 h each for patients and family members together, and three peer support sessions of 2 h each separately for patients and family members).
-
-Electric calendar [32]: The primary aims of the intervention were to improve the user’s cognitive function and reduce behavioral disturbances by means of a software application for an Android tablet with page-a-day calendar, clock, and alarm function for scheduled “events”. The intention was that the person with dementia or MCI would regularly view the calendar and interact with alarms. The calendar was set-up and kept up to date by a caregiver. The calendar was continuously present in the participant’s home for 12 weeks.
-
-WESIHAT 2.0©, a web-based health education tool [36]: The primary aim of the intervention was to improve cognitive function of the user. Secondary aims were to improve users’ functional capabilities, social support, mood, and quality of life, and to reduce loneliness. A web-based application with four components: (1) a screening tool for risk of memory impairment; (2) lifestyle advice for promoting memory and health; (3) health diary; (4) healthy food menu, with meal preparation tips, shopping guidelines, and a nutrition-related quiz. Participants were exposed to the application in sessions: four sessions per week for six months (at least 100 sessions total). Sessions lasted at least 30 min.
-
-Computerized errorless learning program (CELP) for memory training [28]: The primary aim of the intervention was to improve the cognitive function of the user. Improving mood and functional capabilities were secondary aims. The memory training included several components: basic training on various memory types; the use of mnemonics and learning principles, as well as name–face association; and advanced memory training and strategies for applying memory techniques to ADLs. Participants received the intervention in sessions: approximately two sessions per week up to a total of twelve sessions. Each session lasted around 30 min.
-
-
3.2. Quality and Weight-of-Evidence Assessment of Included Studies
Table 2 summarizes the quality assessment and weight of evidence of the included studies.
Table 2.
Authors | WoE A *, Intrinsic Methodological Quality (Good, Fair, Poor) |
WoE B, Appropriateness of Method in Context of this Review (High, Fair, Low) | WoE C, Relevance of Study to this Review Question (High, Fair, Low) |
WoE D, Overall Assessment (High, Fair, Low) |
---|---|---|---|---|
Lee et al. [28] | Poor | Fair | Low | Low |
Liao et al. [29] | Fair | Fair | Low | Fair |
McCarron et al. [30] | Fair | Fair | Low | Fair |
Mrakic-Sposta et al. [31] | Fair | Fair | Low | Fair |
Nishihura et al. [32] | Poor | Low | Low | Low |
Park and Park. [33] | Good | Low | Low | Fair |
Pietilä et al. [34] | Fair | Fair | Low | Fair |
Silva et al. [35] | Fair | High | Low | Fair |
Vanoh et al. [36] | Fair | Fair | Low | Fair |
* Assessed using the National Institute of Health (NIH) tool for the assessment of randomized controlled studies [26]. WoE: Weight-of-evidence.
Only one of the included studies was found to be of good methodological quality [33]. Six studies, considered to be of a good or fair methodological quality, reported outcomes relevant to self-management [29,31,33,34,35,36]. Four studies of a good or fair methodological quality reported outcomes relevant to social participation [30,33,35,36]. In our assessment, all of the studies faced methodological issues relating to small sample sizes (range n = 10 to n = 78) and effectively blinding participants, investigators, or both to group assignment. Only three studies clearly reported that an intention to treat analysis was conducted [30,33,34].
None of the studies that we identified were judged to be of high relevance to the primary review question. Only three of the studies investigated outcomes that were relevant to both self-management and social participation [33,35,36]. None of the studies described their primary outcomes as “self-management” or “social participation”, or cited the same definitions of those terms that we used to design this review. In most of the studies identified, outcomes relevant to self-management or social participation were considered secondary, most commonly to a primary outcome of cognitive function.
Seven of the nine included studies were judged to be of a fair overall weight of evidence. These studies were included in the narrative synthesis [29,30,31,33,34,35,36]. The two studies judged to be of poor quality and of overall low weight of evidence pertained to software applications, and evaluated outcomes relevant to self-management but not social participation [28,32]. Neither reported quantitative, statistically significant effects of the interventions evaluated compared to the control group. Because of their low quality and low weight of evidence, they were excluded from further synthesis with respect to the self-management outcomes reported.
3.3. Results of Included Studies
The reported results with respect to self-management, social participation, and caregiver outcomes are shown in Table 3.
Table 3.
Authors | Outcome Measure | Results |
---|---|---|
Lee et al. [28] | HK-LIADL Scale (self-management) | Effect of intervention not statistically significant |
Liao et al. [29] | LIADL (self-management) | Significant group and group by time interaction effects, in favor of the experimental group (group, p < 0.001, ƞ2p = 0.87; interaction, p < 0.01, ƞ2p = 0.217). |
McCarron et al. [30] | PES-AD (social participation) | Effect of intervention not statistically significant |
DQoL (social participation) | Effect of intervention not statistically significant | |
Mrakic-Sposta et al. [31] | FAQ (self-management) | Effect of intervention not statistically significant |
Nishihura et al. [32] | Semi-structured interviews (self-management) | SSI results not fully reported. Summary statement that positive self-management behavior changes were observed by caregivers in intervention group |
Park and Park. [33] | SF-36 (self-management and social participation) | Role-emotional subscale: Significant group-by-time effect in favor of NCT (4.18 (95%CI 3.72 to 4.63), ƞ2p = 0.821 Role-physical subscale: Effect of intervention not statistically significant Social functioning subscale: Effect of intervention not statistically significant |
Pietilä et al. [34] | ADCS-ADL (self-management) | Effect of intervention not statistically significant |
BDI-II (caregiver) | Effect of intervention not statistically significant | |
WHOQOL-BREF (caregiver) | Effect of intervention not statistically significant | |
COPE index (caregiver) | Subscales analyzed separately. Significant improvement in intervention group vs. control with respect to positive attitudes (p = 0.023). Effect size not reported. No statistically significant differences on other subscales. |
|
Silva et al. [35] | IAFAI (self-management) | Global scores: statistically significant visit effect (F[2,43] = 16.26, p < 0.01, ƞ2p = 0.28) and group by visit interaction (F[2,43] = 8.71, p < 0.01, ƞ2p = 0.29). IADL familiar subscale: statistically significant visit effect (F[2,43] = 5.31, p < 0.01, ƞ2p = 0.11) and group by visit interaction (F[2,43] = 5.40, p < 0.01, ƞ2p = 0.21). IADL advanced subscale: statistically significant visit effect (F[2,43] = 11.74, p < 0.01, ƞ2p = 0.22) and group by visit interaction (F[2,43] = 4.83, p < 0.01, ƞ2p = 0.19). All reported significant effects demonstrated improvements in intervention group vs control |
WHOQOL-OLD * (social participation) | No subscale analyses for social participation reported. Overall, effect of intervention not statistically significant |
|
Vanoh et al. [36] | WHODAS 2.0 (self-management and social participation) | No subscale analyses for social participation and self-management reported. Significant group, time, and interaction effects, in favor of the intervention group (group, p < 0.01, ƞ2p = 0.341; Time, p < 0.05, ƞ2p = 0.128; interaction p < 0.01, ƞ2p = 0.191) |
MOSS (social participation) | The four subscales were analyzed separately. Significant group by time interaction effects for informational support (p < 0.05, ƞ2p = 0.123) and tangible support (p < 0.01, ƞ2p = 0.186). No statistically significant group, time, or interaction effects with respect to positive social interaction or affective support |
|
Three-item loneliness scale (social participation) | Significant effect of group (p < 0.05, ƞ2p = 0.184) but no statistically significant time or interaction effects |
* Social participation subscale relevant.
Of the studies reporting self-management outcomes, all reported on IADL but none reported on other aspects of self-management, such as self-efficacy or experienced autonomy [28,29,31,32,33,34,35,36]. Three studies reported no statistically significant effects of the intervention compared to the control group [28,31,34], four reported positive effects of the intervention compared to the control group [29,33,35,36], and none reported significant negative effects of intervention compared to control. One study reported only qualitative outcomes [32]. Effect sizes of positive results with respect to self-management outcomes were large, according to Cohen’s benchmarks (ƞ2p = 0.191, ƞ2p = 0.217, ƞ2p = 0.29, and ƞ2 = 0.821, as measured by WHODAS, LIADL, IAFAI, and SF-36, respectively) [75]. To identify possible trends and generate hypotheses for future research, we clustered the studies of good or fair weight of evidence, which evaluated self-management outcomes, with respect to the target-users of the intervention and with respect to the technology used. With respect to the target population, four distinct “clusters” were identified: users diagnosed with dementia (n = 2 studies, both finding no significant effects of interventions [34,35]); users diagnosed with MCI or dementia (n = 1 study, finding no significant effects of intervention [31]); users diagnosed with MCI (n = 2 studies, both finding a positive effect of the intervention [29,33]); and users diagnosed with dementia or MCI, or with no formally diagnosed cognitive impairment (n = 1 study, finding a positive effect of the intervention [36]). The three clusters with respect to the nature of the digital technology on which the interventions were based were: VR (n = 3 studies, one reporting no significant effects of the intervention [31], two reporting a positive effect of the intervention [29,33]); wearables (n = 1 study, reporting a positive effect of the intervention [35]); and software applications (n = 2 studies, one reporting no significant effects of the intervention [34], one reporting positive effects of the intervention [36]).
As shown in Table 1 and Table 2, four of the included studies evaluated outcomes with respect to the social participation of target-users [30,33,35,36]. In three cases [30,33,35], no significant effects of the intervention were reported and one study identified positive effects of the intervention [36]. None of the included studies reported significant negative effects of the intervention. The effect sizes of the positive results (ƞ2p = 0.123 and ƞ2p = 0.191 with respect to outcomes measured by the MOSS and WHODAS instruments, respectively) were reasonably large [75]. Because the number of clusters with respect to target-users and types of technology would have been larger than the number of included studies, clustering was not undertaken with respect to social participation outcomes.
Only one of the included studies reported outcomes for informal caregivers of the target-user (positive effect of the intervention on one subscale of the COPE instrument, effect size not reported) [34].
3.4. Facilitators and Barriers to Implementation
Table 4 comprises the extracted statements regarding facilitators and barriers to implementation.
Table 4.
Authors | Statements Concerning Facilitators in Implementing Intervention | Classification (Implementation, Mechanism of Impact, Context) | Statements Concerning Barriers in Implementing Intervention | Classification (Implementation, Mechanism of Impact, Context) |
---|---|---|---|---|
Lee et al. [28] | Qualitative feedback from participants showed that they enjoyed and liked the memory training program. They considered that learning to use a computer was not difficult. They would recommend the training program to others. | Mechanism of impact | More regular stimulating positive feedback could be integrated into the training program. It is suggested to increase the number of training sessions from 12 to 15. | Implementation |
Liao et al. [29] | The enjoyment and attractiveness of VR characteristics may increase motivation and lead to extensive training effects, resulting in cognitive improvement. | Mechanism of impact | None identified | Not applicable (N.A.) |
McCarron et al. [30] | None identified | N.A. | The majority of participants did not find the technology useful. Reasons: (1) complexity of the SSA, (2) enrollment process, (3) impracticality, (4) stigma, and (5) functionality of the SSA. | Mechanism of impact |
Mrakic-Sposta et al. [31] | None identified | N.A. | None identified | N.A. |
Nishihura et al. [32] | Eleven of the fourteen participants received sufficient support from their main caregiver. For instance, the caregiver visited them more than once a week to maintain the electric calendar. | Context | Some negative comments about the lack of durability of the battery and difficulties inputting the schedule. Three participants mentioned they did not need it in their daily lives. | Mechanism of impact |
Feedback interviews revealed that most participants had positive impressions of using the electric calendar. | Mechanism of impact | |||
Park and Park [33] | NCT can facilitate the training in a fun manner. Thus, NCT might motivate subjects more efficiently as compared to CCT, which may decrease issues with intervention compliance. | Mechanism of Impact | CCT had to be provided at a healthcare facility. Both training groups only received training individually, without opportunity for social interaction. | Implementation |
Pietilä et al. [34] | None identified | N.A. | None identified | N.A. |
Silva et al. [35] | SenseCam does not provoke negative evaluations, but suggests a beneficial action on mood. Authors refer to research suggesting that wearable cameras are less demanding than other external aids and are also less demanding and more motivating than paper and pencil cognitive exercises. | Mechanism of impact | None identified | N.A. |
Vanoh et al. [36] | Group discussion was conducted to explain the proper ways to use the website, to describe the content in WESIHAT 2.0, and to identify the problems faced by subjects. | Implementation | Difficulties were reported by the intervention group in dealing with unknown people due to the fear of being deceived. | Implementation |
The counselling session was made interesting by having a quiz related to the content of WESIHAT 2.0 and playing free online brain games. | Mechanism of impact | The use of the compute requires complex motor functioning, language processing, and focus. | Mechanism of impact |
None of the included articles made reference to the MRC Guidance for process evaluation and the statements we extracted were not pre-categorized by the original authors. For the purposes of this synthesis, we clustered statements under the three guidance categories [22].
Most statements made by the authors of the articles in this review, about both facilitators and barriers to implementation, were categorized as concerning the mechanisms of impact of the intervention. Six of the eight statements regarding facilitators mentioned positive emotional responses of participants to the intervention being evaluated. Two statements regarding barriers to implementation cited the complexity of the technology for the user as an important barrier, while two cited perceived functional limitations of the technology evaluated. Of the four statements categorized as relating to implementation, two concerned the nature and frequency of support sessions that were provided to participants. Although all of the studies reported on background characteristics of included participants, only one statement explicitly acknowledged the participants’ backgrounds as an important contextual factor that may have influenced implementation of the intervention.
4. Discussion
This systematic review identified controlled studies evaluating the effectiveness of digital technologies used by people with dementia to improve their self-management or social participation. However, the scope of the available evidence to support answering the review question is limited. We note three important features of the records identified: significant heterogeneity, limited relevance to the review question, and limitations in methodological quality.
We only identified a small number of studies, within which the technologies evaluated could be categorized into three clusters: VR-based technologies, other wearable technologies, and software applications. However, the characteristics of the participants, interventions, and outcome measures differed between studies, such that none of the studies were directly comparable to any other study. We also noted that the nature of the control interventions varied between the included studies. This might be expected to affect the reported results with respect to between-group differences. Of the seven studies that we assessed as being of good or fair weight of evidence, three studies included an active, non-technological control group, one study included an active technological control group, and three had an inactive control intervention (defined as continuing usual care, no treatment, or waiting list). Counterintuitively, all four of the studies with an active control demonstrated at least one statistically significant, positive effect of the intervention with respect to self-management or social participation, whereas the three studies that were compared to no active control failed to demonstrate any statistically significant differences. One explanation for this could be that the statistical power of the studies with no active control groups was lower. The sample sizes of six of the studies were similar (n = 42 to n = 78) but one of the studies which had no active control was very small (n = 10). Alternatively, given that the results concern only six studies, this unexpected result could simply be down to chance.
Only one of the studies which reported positive results was of good methodological quality. For the other studies, the most notable issues were with sample size and power, inadequate blinding of participants or investigators, and inadequate statistical analysis. It is particularly noteworthy that so few of the investigators reported intention-to-treat analyses. Whilst intention-to-treat is well-established as the standard method of analyses for RCTs, previous studies have found that the majority of published RCT results lack intention-to-treat analysis [76]. All studies were judged to be of low relevance to this review question, because none of the studies used the definitions of self-management or social participation that we used for this review and because outcomes measured that were relevant to this review were mostly considered secondary (most commonly to cognitive function). It is an important distinction that most of the relevant outcomes were considered secondary, because study protocols and statistical power are generally optimized with respect to the primary rather than secondary outcomes of a study. Given that the definitions of self-management and social participation that we used were only published in 2017, it is not surprising that few investigators cited these definitions. However, this does not explain why so few studies were identified in which outcomes relevant to self-management and social participation were considered primary. It may be that investigators did not consider self-management or social participation a priority, however an alternative explanation would be that the investigators considered these outcomes dependent on a more fundamental underlying mechanism, such as improved cognition.
Overall, we identified studies of fair weight of evidence, reporting positive outcomes of the respective interventions evaluated, with large effect sizes reported. A comparable number of studies that were also of fair weight of evidence found no effect of the evaluated interventions compared to control groups. That none of the included studies reported negative effects of the interventions with respect to either self-management or social participation should not be over-interpreted. It may be that digital technologies have at least neutral effects on self-management outcomes, but other explanations, such as publication bias, could easily account for this finding. A non-publication rate of around 27% of RCT results in the field of digital health has been reported, which whilst better than in some fields of biomedical research, remains significant [77]. It is also noteworthy that two of the three studies that reported intention-to-treat analyses failed to demonstrate any between-groups differences on post-test outcomes. Overall, given the heterogeneity between included studies, their mostly fair methodological quality, and their low relevance to this review, we conclude there is weak evidence to suggest that technologies used by people with dementia and MCI may be able to help improve self-management. There is insufficient evidence at this time to draw conclusions about the impact of technology use on social participation of people with dementia or MCI.
To help researchers prioritize participant groups or interventions in the future, we attempted to cluster studies on the basis of the cognitive status of participants, the control condition, and the nature of the intervention. Owing to the small number of studies included, we were largely unable to identify trends with respect to the outcomes per cluster. However, with respect to self-management outcomes, we note that the three studies that found positive effects of the technology included, respectively, only users with MCI and users with MCI and less severe cognitive complaints (in addition to users with dementia), whereas the two interventions that targeted only target-users with formally diagnosed dementia reported no effects of the interventions. From the limited evidence that we have identified, we would tentatively hypothesize that people with a confirmed diagnosis of dementia might benefit less from using the technologies identified in this review compared to target-users with mild cognitive impairment.
A secondary objective of this review was to identify and evaluate outcomes for informal caregivers of technology used by people with dementia. We were unable to identify sufficient evidence from included studies to draw conclusions regarding outcomes of the interventions for informal caregivers. The lack of evidence might be due to investigators choosing to investigate or report caregiver outcomes separately, although we did not note any references to caregiver outcomes reported elsewhere. An alternative explanation could be that investigators deliberately chose not to investigate caregiver outcomes in parallel with outcomes for the person with dementia, perhaps because it was considered too demanding—either on their own resources or on participants.
We also set out to characterize facilitators and barriers to implementing interventions identified in previous studies. We consider it a further methodological limitation of most of the identified studies that a well-documented process evaluation, carried out alongside the RCT, was lacking. It is very important to understand which factors may have influenced the study outcomes [21,22]. Where statements about facilitators and barriers were extracted, the extent to which participants enjoyed using the technology seemed to be a factor that investigators considered important. This is presumably based on the assumption that enjoyment in using the technology would facilitate regular use, without which the intervention could not be expected to affect the outcomes measured. This may be intuitive but there are many more factors than enjoyment alone, which may have a significant modifying effect on the impact of the trial [22]. Statements made regarding complexity or limited functionality of the technology raise the question as to whether the preceding design process was sufficiently user-centered. It might be hoped that such limitations would be discovered and avoided during the design of an intervention, before formal evaluation in an RCT.
The statements regarding implementation factors provide useful information for researchers who wish to undertake further research with the interventions in question, namely how the protocol for implementing the intervention might be modified or optimized. It is, therefore, surprising that so few statements were identified. It might be that the authors of other studies did not consider the manner in which the intervention was implemented to be of importance. Alternatively, it is possible that other authors did not consider that there were any feasible modifications that could be made to the implementation of the intervention.
The lack of statements explicitly addressing contextual facilitators and barriers could be because most authors felt that there was sufficient contextual information provided in their article for readers to draw their own conclusions about the possible impact of the context on the results of the reported study. It is highly unlikely that no contextual facilitators or barriers were encountered during the other studies, however in some cases it is possible that the authors did not consider the context to have had a sufficiently large impact on their evaluation of the intervention to be worthy of reporting.
In summary, our review shows that the availability of high-quality evidence in this field does not seem to have significantly progressed from previous reviews, despite rapid growth in interest in, and spending on, technological solutions for supporting social health in dementia [7,8,9,10,12,13,14,15].
4.1. Strengths and Limitations of This Review
The most important strength of this review was the use of a systematic search strategy. We searched for, screened, and included studies published in any language. We also made use of both MeSH headings and multiple synonymous search terms in order to identify as many relevant articles as possible from the databases searched. At each stage of the screening process, all records were independently screened by at least two reviewers to avoid bias in the results.
A limitation of this review is that the execution of the search strategy was limited to English language databases, although we did not exclude any of the articles we identified just because they were not published in English. We did not include grey literature in this review, nor did we undertake a specific effort to identify possible unpublished results. We cannot, therefore, exclude the possibility that some relevant evidence was absent from our results. A further limitation stems from our decision to base this review on the definitions of social health, self-management, and social participation, as previously cited. Whilst these definitions are present in the literature, there may be alternative definitions of these concepts of which we are not aware or alternative terminology used by other investigators with the same definitions, meaning our list of search terms may, therefore, not have been sufficiently exhaustive to identify all relevant records. Finally, in the absence of published literature or recommendations, we determined as a group which instruments were relevant to the cited definitions of self-management and social participation. Other investigators may have made different judgements regarding the relevance of certain instruments and could, therefore, have made different decisions about which of the identified records should have been included in this review.
4.2. Recommendations for Future Research
Given the systematic methodological limitations of the studies identified, a fundamental question is if the RCT is the most appropriate methodological approach to evaluating these kinds of interventions. It has previously been pointed out in the literature that traditional methods of evaluation might be too time-consuming to usefully evaluate digital mental health applications [78]. It may be that there are feasible alternative forms of evaluation to the traditional RCT that would be acceptable to policy-makers, payers, and providers of health and social care. The level of evidence considered necessary and sufficient by different stakeholders for different purposes should be further investigated.
Whenever RCTs are conducted in this field, more needs to be done to ensure that studies are of a good methodological quality. Funding organizations and investigators must ensure that adequate resources are available to conduct adequately powered studies. Investigators should also improve the quality of RCTs in this field by publishing protocols in advance, conducting intention-to-treat analyses, and considering novel ways of blinding participants. In our own experience, blinding participants and investigators to group assignment is currently always a challenge when assessing technological interventions. Only one of the studies that we identified that used an “active” control group also used a technological control intervention. In clinical drug trials placebos can be used, which exactly resemble the active intervention but have no theoretical mechanism by which to improve outcomes. One might speculate that as this field develops, it may be helpful and feasible to use either a digital placebo or a “digital care as usual” condition, where care as usual includes digitally delivered components. A digital control condition would more closely resemble the experimental intervention than a non-technological control intervention. It should, therefore, be easier for investigators to conceal group assignments from participants and investigators alike. It has previously been speculated that a “digital placebo effect” exists [79]. Designs including a digital control arm should have the additional benefit of controlling more effectively for such an effect than studies that do not include a digital control arm. This would be one way of systematically improving the quality of future RCTs in this field.
We recommend that future research should focus on the most important gaps that we have identified in the current literature. We would urge investigators to make self-management and social participation, as defined in the literature, primary outcomes of their studies. Good social health is a vital component of good general health [1,7]. Clinicians, payers, and policy-makers need evidence to make informed decisions in the face of the growing availability of technological interventions [11,12,16,17]. To comprehensively assess self-management, we advise that investigators should use appropriate validated instruments to assess self-efficacy and experienced autonomy in addition to function or IADL [18]. We would also advise investigators to consider evaluating outcomes for informal caregivers, even where they are not the primary intended user of the technology, since the close relationships between people with dementia and informal caregivers are likely to moderate effects of interventions, and vice versa. Finally, we would urge investigators to conduct and report formal process evaluations and to identify facilitators and barriers that might influence study results. We recommend that investigators refer to published guidance, such as the UK Medical Research Council (MRC) guidance for conducting process evaluations [20,21].
5. Conclusions
The limited quantity and quality of the evidence does not allow for strong conclusions or recommendations for clinical practice with respect to the use of digital technologies by people with dementia or MCI for improving self-management or social participation. Rather, we have found that there is great scope to improve the scientific rigor and to expand the evidence base with respect to technologies aiming to enhance the self-management and social participation of people with dementia. We hope and expect that given the pressures created by the rapidly increasing number of people living with dementia, the global COVID-19 pandemic, and the limited ability of traditional health and social care systems to meet people’s needs, there will be rapid growth in this field in the years to come. In the meantime, healthcare professionals and informal caregivers must rely on their best judgement to evaluate the potential benefits and limitations of digital technologies for people with dementia or MCI on a case-by-case basis.
Acknowledgments
We would like to acknowledge the contributions of Isabella Degg and Piia Pietilä who helped with translation of articles written in Korean and Finnish, respectively.
Supplementary Materials
The following are available online at https://www.mdpi.com/2077-0383/10/4/604/s1, Search strings.
Author Contributions
Conceptualization, D.N.; methodology, D.N., C.P., and R.-M.D.; validation, R.-M.D.; formal Analysis, D.N.; investigation, D.N., F.v.d.B., T.E., K.D., E.F., and R.-M.D.; data curation, D.N., F.v.d.B., T.E., K.D., E.F., and R.-M.D.; writing—original draft preparation, D.N.; writing—review and editing, F.v.d.B., T.E., K.D., E.F., and R.-M.D.; visualization, D.N.; supervision, R.-M.D. All authors have read and agreed to the published version of the manuscript.
Funding
This review was carried out within the framework of the Dementia: Intersectorial Strategy for Training and Innovation Network for Current Technology (DISTINCT) Innovative Training Network, which received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement 813196. Additional funding was received from Foundation for Support VCVGZ.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are available in this article.
Conflicts of Interest
The authors declare no conflict of interests.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Huber M., Knottnerus J.A., Green L., van der Horst H., Jadad A.R., Kromhout D., Leonard B., Lorig K., Loureiro M.I., van der Meer J.W., et al. How should we define health? BMJ. 2011;343 doi: 10.1136/bmj.d4163. [DOI] [PubMed] [Google Scholar]
- 2.Alzheimer Nederland Handreiking (dag)activiteiten Bij Dementie. [(accessed on 17 December 2020)];2014 Available online: https://www.alzheimer-nederland.nl/sites/default/files/directupload/activiteiten-bij-dementie.pdf.
- 3.The Alzheimer’s Society . Dementia 2013: The Hidden Voice of Loneliness. Alzheimer’s Society; London, UK: 2013. p. 78. [Google Scholar]
- 4.Dröes R.-M., Boelens-Van Der Knoop E.C., Bos J., Meihuizen L., Ettema T.P., Gerritsen D.L., Hogeveen F., De Lange J., Schölzel-Dorenbos C.J.M. Quality of life in dementia in perspective: An explorative study of variations in opinions among people with dementia and their professional caregivers, and in literature. Dementia. 2006;5:533–558. [Google Scholar]
- 5.Van der Roest H.G., Meiland F.J.M., Comijs H.C., Derksen E., Jansen A.P.D., Van Hout H.P.J., Jonker C., Dröes R.-M. What do community-dwelling people with dementia need? A survey of those who are known to care and welfare services. Int. Psychogeriatr. 2009;21:949–965. doi: 10.1017/S1041610209990147. [DOI] [PubMed] [Google Scholar]
- 6.Martin F., Turner A., Wallace L.M., Choudhry K., Bradbury N. Perceived barriers to self-management for people with dementia in the early stages. [(accessed on 17 December 2020)];Dementia. 2013 12:481–493. doi: 10.1177/1471301211434677. Available online: http://www.ncbi.nlm.nih.gov/pubmed/24336956. [DOI] [PubMed] [Google Scholar]
- 7.World Health Organization . Dementia as a Public Health Priority. WHO; Geneva, Switzerland: 2012. [Google Scholar]
- 8.Meiland F.J.M., Innes A., Mountain G., Robinson L., van der Roest H., García-Casal J.A., Gove D., Thyrian J.R., Evans S., Dröes R.-M., et al. Technologies to Support Community-Dwelling Persons With Dementia: A Position Paper on Issues Regarding Development, Usability, Effectiveness and Cost-Effectiveness, Deployment, and Ethics. JMIR Rehabil. Assist. Technol. 2017;4:e1. doi: 10.2196/rehab.6376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Dutch National Dementia Strategy. Deltaplan Dementie. [(accessed on 17 December 2020)]; Available online: https://www.vilans.nl/vilans/media/documents/producten/zorgstandaard-dementie.pdf.
- 10.Dröes R.-M., Vermeer Y., Libert S., Gaber S., Wallcook S., Rai H., Barroso A.C., Van Santen J., Mangiaracina F., Beentjes K., et al. Best Practice Guidance Human Interaction with Technology in Dementia. Recommendations based on the research conducted in the Marie Sklodowska Curie International Training Network INDUCT. [(accessed on 17 December 2020)]; Available online: https://www.dementiainduct.eu/guidance/recommendation/3.2.2.3/
- 11.Manca R., De Marco M., Venneri A. The Impact of COVID-19 Infection and Enforced Prolonged Social Isolation on Neuropsychiatric Symptoms in Older Adults with and Without Dementia: A Review. Front. Psychiatry. 2020;11:585540. doi: 10.3389/fpsyt.2020.585540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Rijksdienst voor Ondernemend Nederland. [(accessed on 17 December 2020)]; Available online: https://www.rvo.nl/subsidie-en-financieringswijzer/set-covid-19-2-zorg-en-ondersteuning-op-afstand.
- 13.Lauriks S., Reinersmann A., van der Roest H., Meiland F.J.M., Davies R.J., Moelaert F., Mulvenna M.D., Nugent C.D., Dröes R.-M. Review of ICT-based services for identified unmet needs in people with dementia. Ageing Res. Rev. 2007;6:223–246. doi: 10.1016/j.arr.2007.07.002. [DOI] [PubMed] [Google Scholar]
- 14.Gates N.J., Vernooij R.W.M., Di Nisio M., Karim S., March E., Martinez G., Rtujes A. Computerised cognitive training for preventing dementia in people with mild cognitive impairment. Cochrane Database Syst. Rev. 2019:CD012279. doi: 10.1002/14651858.CD012279.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.García-Casal J.A., Loizeau A., Csipke E., Franco-Martín M., Perea-Bartolomé M.V., Orrell M. Computer-based cognitive interventions for people living with dementia: A systematic literature review and meta-analysis. Aging Ment. Health. 2017;21:454–467. doi: 10.1080/13607863.2015.1132677. [DOI] [PubMed] [Google Scholar]
- 16.Moore G.E. Cramming more components onto integrated circuits. Electronics. 1965;38:8. doi: 10.1109/JPROC.1998.658762. [DOI] [Google Scholar]
- 17.Waldrop M.M. The chips are down for Moore’s law. Nature. 2016;530:144–147. doi: 10.1038/530144a. [DOI] [PubMed] [Google Scholar]
- 18.Dröes R.-M., Chattat R., Diaz A., Gove D., Graff M., Murphy K., Verbeek H., Vernooij-Dassen M., Clare L., Johannessen A., et al. Social health and dementia: A European consensus on the operationalization of the concept and directions for research and practice. Aging Ment. Health. 2017;21:4–17. doi: 10.1080/13607863.2016.1254596. [DOI] [PubMed] [Google Scholar]
- 19.Neal D.P., Kerkhof Y.J.F., Ettema T.P., Muller M., Bosmans J., Finnema E., Graff M., Dijkstra K., Stek M., Dröes R.-M. Evaluation of FindMyApps: Protocol for a Randomized Controlled Trial of the effectiveness and cost-effectiveness of a tablet-based intervention to improve self-management and social participation of community-dwelling people with mild dementia, compared to usual tablet use. BMC Geriatr. 2021 doi: 10.1186/s12877-021-02038-8. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Lorenz K., Freddolino P.P., Comas-Herrera A., Knapp M., Damant J. Technology-based tools and services for people with dementia and carers: Mapping technology onto the dementia care pathway. Dementia. 2019;18:725–741. doi: 10.1177/1471301217691617. [DOI] [PubMed] [Google Scholar]
- 21.Craig P., Dieppe P., Macintyre S., Mitchie S., Nazareth I., Petticrew M. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ. 2008;337:979–983. doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Moore G.F., Audrey S., Barker M., Bond L., Bonell C., Hardeman W., Moore L., O’Cathain A., Tinati T., Wight D., et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350 doi: 10.1136/bmj.h1258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Centre for Reviews and Dissemination . CRD’s Guidance for Undertaking Reviews in Health Care. CRD, University of York; York, UK: 2009. [Google Scholar]
- 24.Mitchell A.J., Shiri-Feshki M. Rate of progression of mild cognitive impairment to dementia--meta-analysis of 41 robust inception cohort studies. Acta Psychiatr. Scand. 2009;119:252–265. doi: 10.1111/j.1600-0447.2008.01326.x. [DOI] [PubMed] [Google Scholar]
- 25.Gough D. Weight of evidence: A framework for the appraisal of the quality and relevance of evidence. Res. Pap. Educ. 2007;22:213–228. doi: 10.1080/02671520701296189. [DOI] [Google Scholar]
- 26.National Institutes of Health [(accessed on 17 December 2020)]; Available online: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools.
- 27.Mays N., Pope C., Popay J. Details of Approaches to Synthesis. A Methodological Appendix to the Paper: Systematically Reviewing Qualitative and Quantitative Evidence to Inform Management and Policy Making in the Health Field. [(accessed on 27 December 2020)]; doi: 10.1258/1355819054308576. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.113.2530&rep=rep1&type=pdf. [DOI] [PubMed]
- 28.Lee G.Y., Yip C.C.K., Yu E.C.S., Man D.W.K. Evaluation of a computer-assisted errorless learning-based memory training program for patients with early Alzheimer’s disease in Hong Kong: A pilot study. Clin. Interv. Aging. 2013;8:623–633. doi: 10.2147/CIA.S45726. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Liao Y.Y., Tseng H.-Y., Lin Y.-J., Wang C.-J., Hsu W.-C. Using virtual reality-based training to improve cognitive function, instrumental activities of daily living and neural efficiency in older adults with mild cognitive impairment. Eur. J. Phys. Rehabil. Med. 2020;56:47–57. doi: 10.23736/S1973-9087.19.05899-4. [DOI] [PubMed] [Google Scholar]
- 30.McCarron H.R., Zmora R., Gaugler J.E. A Web-Based Mobile App with a Smartwatch to Support Social Engagement in Persons With Memory Loss: Pilot Randomized Controlled Trial. JMIR Aging. 2019;2:e13378. doi: 10.2196/13378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Mrakic-Sposta S., Di Santo S.G., Franchini F., Arlati S., Zangiacomi A., Greci L., Moretti S., Jesuthasan N., Marzorati M., Rizzo G., et al. Effects of Combined Physical and Cognitive Virtual Reality-Based Training on Cognitive Impairment and Oxidative Stress in MCI Patients: A Pilot Study. Front. Aging Neurosci. 2018;10:282. doi: 10.3389/fnagi.2018.00282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Nishiura Y., Nihei M., Nakamura-Thomas H., Inoue T. Effectiveness of using assistive technology for time orientation and memory, in older adults with or without dementia. Disabil. Rehabil. Assist. Technol. 2019 doi: 10.1080/17483107.2019.1650299. [DOI] [PubMed] [Google Scholar]
- 33.Park J.-H., Park J.-H. Does cognition-specific computer training have better clinical outcomes than non-specific computer training? A single-blind, randomized controlled trial. Clin. Rehabil. 2018;32:213–222. doi: 10.1177/0269215517719951. [DOI] [PubMed] [Google Scholar]
- 34.Pietilä P., Poutiainen E., Nukari J., Launiainen H., Arifullen-Hämäläinen U., Sarajuuri J., Koskinen S. Multi-methodological rehabilitation with emphasis on cognitive training alleviates Alzheimer patients’ mood symptoms and supports coping among family members. Psykologia. 2017;52:356–375. [Google Scholar]
- 35.Silva A.R., Pinho M.S., Macedo L., Moulin C., Caldeira S., Firmino H. It is not only memory: Effects of sensecam on improving well-being in patients with mild alzheimer disease. Int. Psychogeriatr. 2017;29:741–754. doi: 10.1017/S104161021600243X. [DOI] [PubMed] [Google Scholar]
- 36.Vanoh D., Shahar S., Razali R., Ali N.M., Manaf Z.A., Mohd Noah S.A., Nur A.M. The effectiveness of a Web-Based Health Education Tool, WESIHAT 2.0, among Older Adults: A Randomized Controlled Trial. J. Alzheimer’s Dis. 2019;70:S255–S270. doi: 10.3233/JAD-180464. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Bejan A., Murko P., Müller N., König P., Kunze C. Using Surface Table Computers to Promote the Well-Being of People with Dementia. Stud. Health Technol. Inform. 2017;242:23–26. [PubMed] [Google Scholar]
- 38.Casey D., Whelan S., Barrett E., Murphy K., Santorelli A., Burke M., Kovacic T. The Impact of a Companion Robot in Combatting Loneliness in People with Dementia Living in Residential Care. The MARIO Project. Age Ageing. 2018;47:v13–v60. doi: 10.1093/ageing/afy140.51. [DOI] [Google Scholar]
- 39.Cherniack E.P. Not just fun and games: Applications of virtual reality in the identification and rehabilitation of cognitive disorders of the elderly. Disabil. Rehabil. Assist. Technol. 2011;6:283–289. doi: 10.3109/17483107.2010.542570. [DOI] [PubMed] [Google Scholar]
- 40.Maia J.C., Coutinho J.F.V., Sousa C.R., Barbosa R.G.B., Mota F.R.N., Marques M.B., Silva R.R.L., Lima R.B.S. Assistive technologies for demented elderly: A systematic review. Acta Paul. Enferm. 2018;31:651–658. doi: 10.1590/1982-0194201800089. [DOI] [Google Scholar]
- 41.Cutler C., Hicks B., Innes A. Does Digital Gaming Enable Healthy Aging for Community-Dwelling People with Dementia? Games Cult. 2016;11:104–129. doi: 10.1177/1555412015600580. [DOI] [Google Scholar]
- 42.D’Cunha N.M., Nguyen D., Naumovski N., McKune A.J., Kellett J., Georgousopoulou E.N., Frost J., Isbel S. Mini-Review of Virtual Reality-Based Interventions to Promote Well-Being for People Living with Dementia and Mild Cognitive Impairment. Gerontology. 2019;65:430–440. doi: 10.1159/000500040. [DOI] [PubMed] [Google Scholar]
- 43.Djabelkhir L., Wu Y.H., Vidal J.S., Cristancho-Lacroix V., Marlats F., Lenoir H., Carno A., Rigaud A.S. Computerized cognitive stimulation and engagement programs in older adults with mild cognitive impairment: Comparing feasibility, acceptability, and cognitive and psychosocial effects. Clin. Interv. Aging. 2017;12:1967–1975. doi: 10.2147/CIA.S145769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Djabelkhir-Jemmi L., Wu Y.H., Boubaya M., Marlats F., Lewis M., Vidal J.S., Lenoir H., Charlieux B., Isabet B., Rigaud A.S. Differential effects of a computerized cognitive stimulation program on older adults with mild cognitive impairment according to the severity of white matter hyperintensities. Clin. Interv. Aging. 2018;13:1543–1554. doi: 10.2147/CIA.S152225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Dossey L. FOMO, Digital Dementia, and Our Dangerous Experiment. Explore J. Sci. Heal. 2014;10:69–73. doi: 10.1016/j.explore.2013.12.008. [DOI] [PubMed] [Google Scholar]
- 46.Moyle W., Jones C., Murfield J., Thalib L., Beattie E., Shum D., Draper B. Using a therapeutic companion robot for dementia symptoms in long-term care: Reflections from a cluster-RCT. Aging Ment. Health. 2019;23:329–336. doi: 10.1080/13607863.2017.1421617. [DOI] [PubMed] [Google Scholar]
- 47.Sánchez-Rico A., Garel P., Notarangelo I., Quintana M., Hernández G., Asteriadis S., Popa M., Vretos N., Solachidis V., Burgos M., et al. ICT Services for Life Improvement for the Elderly. Stud. Health Technol. Inform. 2017;242:600–605. [PubMed] [Google Scholar]
- 48.Sung H.C., Chang S.M., Chin M.Y., Lee W.L. Robot-assisted therapy for improving social interactions and activity participation among institutionalized older adults: A pilot study. Asia-Pac. Psychiatry. 2015;7:1–6. doi: 10.1111/appy.12131. [DOI] [PubMed] [Google Scholar]
- 49.Tobiasson H., Sundblad Y., Walldius Å., Hedman A. Designing for Active Life: Moving and Being Moved Together with Dementia Patients. Int. J. Des. 2015;9:47–62. [Google Scholar]
- 50.Tyack C., Camic P.M., Heron M.J., Hulbert S. Viewing Art on a Tablet Computer: A Well-Being Intervention for People with Dementia and Their Caregivers. J. Appl. Gerontol. 2017;36:864–894. doi: 10.1177/0733464815617287. [DOI] [PubMed] [Google Scholar]
- 51.Weakley A., Weakley A.T., Schmitter-Edgecombe M. Compensatory strategy use improves real-world functional performance in community dwelling older adults. Neuropsychology. 2019;33:1121–1135. doi: 10.1037/neu0000591. [DOI] [PubMed] [Google Scholar]
- 52.Yamaguchi T., Foloppe D.A., Richard P., Richard E., Allain P. A Dual-Modal Virtual Reality Kitchen for (Re) Learning of Everyday Cooking Activities in Alzheimer’s Disease. Presence Teleoperators Virtual Environ. 2012;21:43–57. doi: 10.1162/PRES_a_00080. [DOI] [Google Scholar]
- 53.Astell A.J., Joddrell P., Groenewoud H., de Lange J., Goumans M., Cordia A., Schikhof Y. Does familiarity affect the enjoyment of touchscreen games for people with dementia? Int. J. Med. Inform. 2016;91:e1–e8. doi: 10.1016/j.ijmedinf.2016.02.001. [DOI] [PubMed] [Google Scholar]
- 54.In Soon K., Hee Sun K. Effects of Intervention Using PARO on the Cognition, Emotion, Problem Behavior, and Social Interaction of Elderly People with Dementia. J. Korean Acad. Community Health Nurs. Jiyeog Sahoe Ganho Hakoeji. 2018;29:300–309. [Google Scholar]
- 55.Leng F.Y., Yeo D., George S., Barr C. Comparison of iPad applications with traditional activities using person-centred care approach: Impact on well-being for persons with dementia. Dementia. 2014;13:265–273. doi: 10.1177/1471301213494514. [DOI] [PubMed] [Google Scholar]
- 56.Liang A., Piroth I., Robinson H., MacDonald B., Fisher M., Nater U.M., Skoluda N., Broadbent E. A Pilot Randomized Trial of a Companion Robot for People with Dementia Living in the Community. J. Am. Med. Dir. Assoc. 2017;18:871–878. doi: 10.1016/j.jamda.2017.05.019. [DOI] [PubMed] [Google Scholar]
- 57.O’Neill B., Moran K., Gillespie A. Scaffolding rehabilitation behaviour using a voice-mediated assistive technology for cognition. Neuropsychol. Rehabil. 2010;20:509–527. doi: 10.1080/09602010903519652. [DOI] [PubMed] [Google Scholar]
- 58.Palac D., Bullard T., Cohen J.D., Nguyen L.T., Mudar R.A., Mullen S.P. Effects of Traditional vs. iPad-Enhanced Aerobic Exercise on Wayfinding Efficacy and Cognition: A Pilot Randomized Controlled Trial. Int. J. Environ. Res. Public. Health. 2019;16:3495. doi: 10.3390/ijerph16183495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Rouaix N., Retru-Chavastel L., Rigaud A.S., Monnet C., Lenoir H., Pino M. Affective and Engagement Issues in the Conception and Assessment of a Robot-Assisted Psychomotor Therapy for Persons with Dementia. Front. Psychol. 2017;8:950. doi: 10.3389/fpsyg.2017.00950. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Song J.H. Effects of a robot pet-assisted program for elderly people with dementia. J. Korean Acad. Nurs. 2009;39:562–573. doi: 10.4040/jkan.2009.39.4.562. [DOI] [PubMed] [Google Scholar]
- 61.Bahar-Fuchs A., Webb S., Bartsch L., Clare L., Rebok G., Cherbuin N., Anstey K.J. Tailored and Adaptive Computerized Cognitive Training in Older Adults at Risk for Dementia: A Randomized Controlled Trial. J. Alzheimer’s Dis. 2017;60:889–911. doi: 10.3233/JAD-170404. [DOI] [PubMed] [Google Scholar]
- 62.Ben-Sadoun G., Sacco G., Manera V., Bourgeois J., König A., Foulon P., Fosty B., Bremond F., d’Arripe-Longueville F., Robert P. Physical and Cognitive Stimulation Using an Exergame in Subjects with Normal Aging, Mild and Moderate Cognitive Impairment. J. Alzheimer’s Dis. 2016;53:1299–1314. doi: 10.3233/JAD-160268. [DOI] [PubMed] [Google Scholar]
- 63.Poptsi E., Lazarou I., Markou N., Vassiloglou M., Nikolaidou E., Diamantidou A., Siatra V., Karathanassi E., Karakostas A., Zafeiropoulou F.K., et al. A Comparative Single-Blind Randomized Controlled Trial with Language Training in People with Mild Cognitive Impairment. Am. J. Alzheimer’s Dis. Other Dement. 2019;34:176–187. doi: 10.1177/1533317518813554. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Rostill H., Nilforooshan R., Barnaghi P., Morgan A. Technology-integrated dementia care: Trial results. Nurs. Resid. Care. 2019;21:489–494. doi: 10.12968/nrec.2019.21.9.489. [DOI] [Google Scholar]
- 65.Rouse H.J., Small D.J., Faust M.E. Assessment of Cognitive Training & Social Interaction in People with Mild to Moderate Dementia: A Pilot Study. Clin. Gerontol. 2019;42:421–434. doi: 10.1080/07317115.2019.1590489. [DOI] [PubMed] [Google Scholar]
- 66.Tsai P.F., Kitch S., Beck C., Jakobs T., Rettiganti M., Jordan K., Jakobs E., Adair S. Using an Interactive Video Simulator to Improve Certified Nursing Assistants’ Dressing Assistance and Nursing Home Residents’ Dressing Performance: A Pilot Study. CIN Comput. Inform. Nurs. 2018;36:183–192. doi: 10.1097/CIN.0000000000000415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Lee G.J., Bang H.J., Lee K.M., Kong H.H., Seo H.S., Oh M., Bang M. A comparison of the effects between 2 computerized cognitive training programs, Bettercog and COMCOG, on elderly patients with MCI and mild dementia A single-blind randomized controlled study. Medicine. 2018;97 doi: 10.1097/MD.0000000000013007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Oh J.H., Yi Y.J., Shin C.J., Park C., Kang S., Kim J., Kim I.S. Effects of Silver-Care-Robot Program on Cognitive Function, Depression, and Activities of Daily Living for Institutionalized Elderly People. J. Korean Acad. Nurs. 2015;45:388–396. doi: 10.4040/jkan.2015.45.3.388. [DOI] [PubMed] [Google Scholar]
- 69.Rohrbach N., Gulde P., Armstrong A.R., Hartig L., Abdelrazeq A., Schröder S., Neuse J., Grimmer T., Diehl-Schmid J., Hermsdörfer J. An augmented reality approach for ADL support in Alzheimer’s disease: A crossover trial. J. Neuroeng. Rehabil. 2019;16:66. doi: 10.1186/s12984-019-0530-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Kim M., Lim K.-C. Effects of a Computerized Cognitive Training on Cognitive Function, Depression, Self-esteem, and Activities of Daily Living among Older Adults with Mild Cognitive Impairment. Korean J. Adult Nurs. 2016;28:691–700. doi: 10.7475/kjan.2016.28.6.691. [DOI] [Google Scholar]
- 71.Appel L., Appel E., Bogler O., Wiseman M., Cohen L., Ein N., Abrams H.B., Campos J.L. Older Adults With Cognitive and/or Physical Impairments Can Benefit From Immersive Virtual Reality Experiences: A Feasibility Study. Front. Med. 2019;6:329. doi: 10.3389/fmed.2019.00329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Archer N., Keshavjee K., Demers C., Lee R. Online self-management interventions for chronically ill patients: Cognitive impairment and technology issues. Int. J. Med. Inform. 2014;83:264–272. doi: 10.1016/j.ijmedinf.2014.01.005. [DOI] [PubMed] [Google Scholar]
- 73.Dewar B.K., Kapur N., Kopelman M. Do memory aids help everyday memory? A controlled trial of a Memory Aids Service. Neuropsychol. Rehabil. 2018;28:614–632. doi: 10.1080/09602011.2016.1189342. [DOI] [PubMed] [Google Scholar]
- 74.Andreassen M., Boman I.L., Danielsson H., Hemmingsson H. Digital Support for Persons with Cognitive Impairment. Stud. Health Technol. Inform. 2017;242:5–8. [PubMed] [Google Scholar]
- 75.Richardson J.T.E. Eta squared and partial eta squared as measures of effect size in educational research. Educ. Res. Rev. 2011;6:135–147. doi: 10.1016/j.edurev.2010.12.001. [DOI] [Google Scholar]
- 76.Abraha I., Cozzolino F., Orso M., Marchesi M., Germani A., Lombardo G., Eusebi P., De Florio R., Luchetta M.L., Iorio A., et al. A systematic review found that deviations from intention-to-treat are common in randomized trials and systematic reviews. J. Clin. Epidemiol. 2017;84:37–46. doi: 10.1016/j.jclinepi.2016.11.012. [DOI] [PubMed] [Google Scholar]
- 77.Al-Durra M., Nolan R.P., Seto E., Cafazzo J.A., Eysenbach G. Nonpublication Rates and Characteristics of Registered Randomized Clinical Trials in Digital Health: Cross-Sectional Analysis. J. Med. Internet Res. 2018;20:e11924. doi: 10.2196/11924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Mohr D.C., Riper H., Schueller S.M. A Solution-Focused Research Approach to Achieve an Implementable Revolution in Digital Mental Health. JAMA Psychiatry. 2018;75:113–114. doi: 10.1001/jamapsychiatry.2017.3838. [DOI] [PubMed] [Google Scholar]
- 79.Torous J., Firth J. The digital placebo effect: Mobile mental health meets clinical psychiatry. Lancet Psychiatry. 2016;3:100–102. doi: 10.1016/S2215-0366(15)00565-9. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data presented in this study are available in this article.