Skip to main content
JMIR Human Factors logoLink to JMIR Human Factors
. 2021 Jul 12;8(3):e27156. doi: 10.2196/27156

Independent Use of a Home-Based Telemonitoring App by Older Patients With Multimorbidity and Mild Cognitive Impairment: Qualitative Study

Madlen Scheibe 1,, Caroline Lang 1, Diana Druschke 1, Katrin Arnold 1, Edwin Luntz 1, Jochen Schmitt 1, Vjera Holthoff-Detto 2,3
Editor: Andre Kushniruk
Reviewed by: Gubing Wang, Torhild Holthe
PMCID: PMC8314150  PMID: 34255664

Abstract

Background

The management of multimorbidity is complex and patients have a high burden of disease. When symptoms of dementia also appear, it becomes even more difficult for patients to cope with their everyday lives and manage their diseases. Home-based telemonitoring may support older patients with multimorbidity and mild cognitive impairment (MCI) in their regular monitoring and self-management. However, to date, there has been no investigation into whether patients with MCI are able to operate a telemonitoring app independently to manage their own diseases. This question has become even more important during the current COVID-19 pandemic to maintain high-quality medical care for this patient group.

Objective

We examined the following research questions: (1) How do patients with MCI assess the usability of the telemonitoring app? (2) How do patients with MCI assess the range of functions offered by the telemonitoring app? (3) Was there an additional benefit for the patients with MCI in using the telemonitoring app? (4) Were patients with MCI able to use the telemonitoring app independently and without restrictions? (5) To what extent does previous experience with smartphones, tablets, or computers influence the perceived ease of use of the telemonitoring app?

Methods

We performed a formative evaluation of a telemonitoring app. Therefore, we carried out a qualitative study and conducted guided interviews. All interviews were audio-recorded, transcribed verbatim, and analyzed using the Mayring method of structured content analysis.

Results

Twelve patients (8 women, 4 men) were interviewed; they had an average age of 78.7 years (SD 5.6) and an average Mini-Mental State Examination score of 24.5 (SD 1.6). The interviews lasted between 17 and 75 minutes (mean 41.8 minutes, SD 19.4). Nine patients reported that the telemonitoring app was easy to use. All respondents assessed the range of functions as good or adequate. Desired functionalities mainly included more innovative and varied educational material, better fit of the telemonitoring app for specific needs of patients with MCI, and a more individually tailored content. Ten of the 12 patients stated that the telemonitoring app had an additional benefit for them. Most frequently reported benefits included increased feeling of security, appreciation of regular monitoring of vital parameters, and increased independence due to telemonitoring. Eight patients were able to operate the app independently. Participants found the app easy to use regardless of whether they had prior experience with smartphones, tablets, or computers.

Conclusions

The majority of examined patients with MCI were capable of operating the telemonitoring app independently. Crucial components in attaining independent use were comprehensive personal support from the start of use and appropriate design features. This study provides initial evidence that patients with MCI could increasingly be considered as a relevant user group of telemonitoring apps.

Keywords: telemedicine; aged; multimorbidity; dementia; patient acceptance of health care; health care quality, access, and evaluation; qualitative research

Introduction

Background

Multimorbidity, defined as the simultaneous occurrence of at least two chronic diseases, is a characteristic of the health situation of older people and is common among those in high-income countries [1]. In 2019, more than 58% of adults aged 65 years or over were suffering from multimorbidity in Organisation for Economic Cooperation and Development (OECD) countries and this figure reached up to 70% or more in Germany [2]. The management of multimorbidity is often complex, and patients face several challenges in terms of understanding and self-managing the conditions and medication, regularly monitoring several clinically relevant vital parameters, and coordinating multiple medical services [3,4]. Multimorbidity is also associated with polypharmacy, including the risk of adverse drug events, a decline in physical functioning, or increased health care utilization such as emergency admissions [5-9]. This often results in decreased quality of life, including psychological distress [1,5,9]. Moreover, mental illnesses such as anxiety and depression are more common in patients with multimorbidity [3]. When symptoms of dementia also appear, it becomes even more difficult for patients to cope with their usual and independent tasks in daily life and manage their own diseases [3]. Additionally, symptoms of dementia act as risk multipliers across all age and morbidity strata, leading to worse health outcomes [10]. It is estimated that in 2019, nearly 20 million people had dementia in OECD countries. This number will more than double by 2050 if current developments continue [2]. Mild cognitive impairment (MCI) represents a preclinical, transitional stage between healthy aging and dementia. MCI has been shown to affect 10%-15% of the population 65 years and older. Each year, 10%-15% of people with amnestic MCI progress to Alzheimer disease compared to only 1%–2% of the healthy older generation [11].

Telemonitoring can play an important role in coping, compensating, and supporting cognition [12,13]. Regular home-based telemonitoring may support older patients with multimorbidity and MCI in their self-management and regular home monitoring of clinically relevant vital parameters. Furthermore, telemonitoring may help patients to feel more secure, remain longer and independently in their familiar home environment, and increase overall quality of life. At the same time, telemonitoring helps to relieve the burden on formal and informal caregivers [12-16].

There are already a large number of telemonitoring apps available for different kinds of chronic diseases, with corresponding usability and acceptance evaluations that have been summarized in several systematic reviews [17-20]. However, the number of existing studies and evaluations on telemonitoring apps focusing on multimorbidity is currently limited [21-23]. Another issue that has not yet been investigated is whether patients with MCI are able to use a telemonitoring app independently, and how they assess usability and acceptance. This target group is considerably large and so too is the associated potential for improved care. Therefore, the aim of this study was to help close this research gap.

Within our study, “usability” was defined as “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use” [24], whereas user acceptance was defined as the “attitude towards a particular situation” [25].

The question of whether patients concurrently suffering from multiple chronic diseases and MCI would be able to use telemonitoring apps has become even more important in recent months due to the COVID-19 pandemic. Telemonitoring apps can be of great value, especially for vulnerable patient groups such as the chronically ill, as patient care was only possible to a limited extent during the lockdown. For example, outpatient visits were cancelled or postponed, and the availability of in-person support services was reduced [26,27]. In addition, especially in such isolation situations, people with chronic illness depend on close health care to prevent serious complications or even death resulting from those complications [28-30]. The health care system needs to respond to the needs of patients suffering from chronic noncommunicable diseases, which are the majority of conditions [31]. Disease-tailored and easy-to-use home-based telemonitoring solutions could be a suitable measure to continue the care for chronically ill patients while maintaining the legally required social distance, and to give them the secure feeling of being well cared for [28,29,32].

Study Aims and Research Questions

This study was part of the feasibility study “Autonomy despite multimorbidity in Saxony through patient empowerment, holistic care for older people with networking of all regional institutions and service providers” (ATMoSPHAERE) performed between October 2015 and June 2019. The main aim of the study was the iterative development of a technology-based information and communication platform enabling an intersectoral networking of treating physicians in practices, nurses, therapists, social services, and patients with multimorbidity and their caregivers. The comprehensive study design has already been reported elsewhere [33,34]. Within the study, a telemonitoring app for patients was developed (see Description of the Telemonitoring App in the Methods section). The aim of this study was to perform a formative evaluation of the telemonitoring app from the perspective of older patients with multimorbidity suffering from MCI.

In detail, we examined the following research questions by means of a qualitative study: (1) How do patients with MCI assess the usability of the telemonitoring app? (2) How do patients with MCI assess the range of functions offered by the telemonitoring app? (3) Was there an additional benefit for the patients with MCI in using the telemonitoring app? (4) Were patients with MCI able to use the telemonitoring app independently and without restrictions? (5) To what extent does previous experience with smartphones, tablets, or computers influence the perceived ease of use of the telemonitoring app?

Overall, our formative evaluation had two aims. The first aim was to examine the usability of the app and possibilities of independent use to evaluate its perceived ease of use. The second aim was to evaluate the content and the additional benefits resulting from the use of the telemonitoring app to assess its perceived additional benefits. Both evaluation issues were equally relevant for an adequate evaluation to develop an individually tailored telemonitoring app.

Methods

Study Design

We opted for a formative evaluation to assess a telemonitoring app that was under development while performing this study. Patient feedback from the interviews provided important aspects for the further iterative development process of the telemonitoring app in line with the needs of the target group [35-37].

When planning the substudy, we had to consider what could be expected of this target group. We had to make sure that the formative evaluation would not lead to excessive demands over and above those caused by actual usage of the telemonitoring app. Keeping this in mind, we decided to apply only one iteration stage and chose the qualitative method of guided interviews for this target group.

We opted to use personal interviews instead of questionnaires since we expected a certain degree of insecurity and restraint toward the research topic among the participants due to a possible lack of previous experience [38]. We used this method as it was particularly advantageous for our vulnerable patient group. This method enabled a personal conversation, thus facilitating a relationship of trust to be established; if necessary, one could explain something again or, in case of ambiguities, one could specifically ask for more information. Additionally, this approach enabled us to adapt the interview guideline flexibly according to the participants and their individual characteristics (eg, health status, individual burden of disease, life situation), and their previous experience in handling tablets, smartphones, or telemedicine solutions [39-41]. At the same time, the use of an interview guideline enables comparisons between the interviews and also prevents storytelling from digressing too far [40,42,43].

Recruitment of General Practitioners and Study Patients

Potential general practitioners were partners within a network of accredited academic teaching practices. Their practices were located in the city of Dresden, Germany, with approximately 560,000 inhabitants. Interested general practitioners were recruited in network meetings. They were informed about the study and signed a declaration of consent form.

Study patients were recruited by the general practitioners. Study nurses screened patients by applying the validated measuring instruments Mini-Mental State Examination (MMSE; assessment based on [44], German version [45]) and the Clock-Drawing Test [46] to assess cognition, as well as the Timed Up & Go test [47] to assess the mobility of potential study patients. The crucial factor for study inclusion was the degree of cognitive impairment, which was assessed by an MMSE score of 20-26 at the baseline assessment. Patients who were found to be eligible and met the inclusion criteria (Textbox 1) were informed by their general practitioner about the study and received written information. After patients decided to participate, they signed a declaration of consent form. Patients could withdraw their consent at any time.

Study inclusion and exclusion criteria.

Inclusion criteria

  • Age ≥65 years

  • Multimorbidity (presence of at least two chronic diseases)

  • Mild cognitive impairment defined by a Mini-Mental State Examination (MMSE) score between 20 and 26 or mild dementia according to International Classification of Diseases (ICD)-10

  • Capable of understanding patient information and consenting to the study

  • Independent operation of television via remote control and/or computer/laptop three or more times per week

  • Unimpaired hearing

  • Sufficient motoric and sensory speech ability

  • Sufficient eyesight to follow a television program easily

Exclusion criteria

  • Missing capacity of consent

  • Unable to speak German fluently

  • Moderate to severe dementia defined by an MMSE score <20 or according to ICD-10

  • Motoric impairment (Timed-Up & Go test ≥30 seconds in initial measurement, 20-29 seconds in two repeated measurements)

  • Severe psychiatric comorbidities (eg, schizophrenic psychoses, addictions)

  • Currently participating in a comparable telemonitoring program or participation within the last 12 months

Study patients were asked about their readiness for a personal interview after using the telemonitoring app for at least 2 months. After the study patients agreed to be interviewed, a researcher informed them about the interview details. Participants were included regardless of whether or not they had prior experience with the use of smartphones, tablets, or computers.

Description of the Telemonitoring App

The telemonitoring app was provided by the technical project partner Philips Medical Systems GmbH (hereafter Philips) and consisted of the telemonitoring software Motiva, the telemonitoring hardware in the form of a tablet (ASUS ZenPad 7.0 or Samsung Tab 4), as well as a Bluetooth-enabled sphygmomanometer. Figure 1 shows images of the telemonitoring app’s user interface.

Figure 1.

Figure 1

Screenshots of the user interface of the telemonitoring app.

After study inclusion, study patients were instructed at home on the use of the hardware and software by a technician from the German Red Cross. In addition, they received a user manual where essential functions were explained in an easy-to-understand way.

Table 1 provides an overview of the functionalities offered by the telemonitoring app and the corresponding tasks that patients were responsible for performing according to the general practitioner’s treatment regime.

Table 1.

Overview of functionalities of the telemonitoring app and patient tasks to be performed.

Functionalities offered by the telemonitoring app Patient tasks to be performed
Measurement of vital data with provided measuring devices at predefined times according to the general practitioner’s treatment regime; data are automatically transmitted to the tablet and to a German Red Cross care coordination center for intervention necessity assessment Once per week: measurement of blood pressure and heart frequency
Continuous weekday monitoring of measured vital data values by case and care managers at the care coordination center; these managers contact patients in case of exceeding vital data values for possible therapeutic intervention (thresholds predefined by general practitioner) Completing intervention questionnaires providing information about the reasons for deviation to the case and care managers to derive possible therapeutic interventions
Overview of measured vital data and vital data charts Not applicable
Regular provision of patient questionnaires Once at the beginning: completing a questionnaire on general health conditions
Once per week: Completing questionnaires on treatment modifications, medication adherence, sleeping habits, pain, alcohol and tobacco consumption, and the disease-specific health status (eg, chronic heart failure and type 2 diabetes)
Depending on individual needs: completing additional questionnaires sent by the case and care managers (eg, on the topics of nutrition and depression)
Provision of educational and training material, particularly instructional videos for individual chronic diseases Not applicable
Receiving messages from the case and care managers (eg, reminder of measurement or answering questionnaires, video recommendations, or congratulations on milestones) Not applicable

All collected patient data were transferred to the ATMoSPHAERE platform and could be viewed by the responsible general practitioner (Figure 2).

Figure 2.

Figure 2

ATMoSPHAERE network including the telemonitoring app. ATMoSPHAERE: Autonomy despite multimorbidity in Saxony through patient empowerment, holistic care for older people with networking of all regional institutions and service providers.

Theoretical Framework and Interview Guideline

As a basis for the guided interviews, we developed a uniform guideline with open-ended questions (see Multimedia Appendix 1). A specially created set of usability criteria and comprehensive overview of acceptance factors with explicit regard to the requirements of older people concerning telemedicine apps has previously been developed and published by one of the authors of this study [38,48,49], which has been used in several studies to evaluate telemonitoring apps for older people [50-53]. These criteria served as the theoretical framework for guideline development. Guideline development and formulation of interview questions also were established following guidelines from the relevant methods literature [39,54,55].

Data Collection

The patient interviews were conducted between June 2016 and December 2017. Continuous study inclusion facilitated the interviewing of new study participants throughout the study period. All study patients received the same telemonitoring equipment (tablet, sphygmomanometer). To enable comparisons among patients, all interviews were based on the same interview guideline. All patients opted for a face-to-face-interview at their homes. All interviews were audio-recorded.

Data Evaluation

All interviews were transcribed verbatim. The transcripts then served as the foundation upon which consecutive data analysis was performed. All interviews were analyzed applying the method of structured content analysis developed by Mayring [56]. This is the central content analysis technique and allows for an association between the deductive and inductive creation of categories [56,57]. The analytical focus was on designing a system of categories and subcategories, as well as their characteristics [56], which in turn served as structural dimensions.

Coding started with the development of an initial deductive category system derived from the questions in the interview guideline, discussed and agreed upon within the research team (DD, KA, MS, EL). Two analyzing researchers (EL, MS) coded two interviews independently to further develop the category system. These researchers differed in age and gender to allow for diversity of perspectives in the context of data analysis. This was then discussed by the entire research team and consolidated. The consolidated category system was then used by two researchers (EL, MS) as the basis for coding all interviews. During analysis, the coders independently specified, modified, or removed categories based on the text material. Missing but relevant categories were added inductively based on the transcripts. This process was continued until saturation of the category system was reached (ie, no new categories emerged) [57].

The inductive development of categories was carried out as follows. Based on the textual material in the transcripts, units of meaning formed the units of analysis. Relevant content of the units of meaning was paraphrased to generate a category label. In accordance with recommendations from the methodological literature, a low level of abstraction was initially selected for the generation of category labels [56]. It was scaled down in the course of analysis and further review of the text material. Subsequently, the abstraction level of the different categories was harmonized to reach a final uniform abstraction level of the category system. Finally, the assignment of individual text sections to the respective categories was reviewed again by the entire research team. Differences in coding were discussed and resolved by consent. If necessary, text segments were recoded accordingly.

Our approach complied with the principles of openness and investigator triangulation within qualitative research [40,54]. For data analysis, the software MAXQDA (MAXQDA Plus 12 portable) was used.

The chosen method allowed us to individually adapt the interview guideline to the actual interview and to the aspects presented as relevant by the participants. In turn, this resulted in interviews where we were not able to ask all possible questions, patients did not answer questions even after the question was repeated, or where the participants themselves added new aspects.

Ethics Approval

The ethics committee at Technische Universität Dresden (approval number EK 1012016) approved the study.

Results

Patient Characteristics and Interview Duration

Of the 19 participants that met the inclusion criteria of our study, 12 agreed to be interviewed. To achieve the greatest heterogeneity possible within our study sample, we interviewed all 12 patients. The interviews lasted between 17 and 75 minutes (mean 41.8 minutes, SD 19.4). Table 2 shows the patient characteristics of the selected cohort.

Table 2.

Characteristics of the interviewed patients and the average result of the Mini-Mental State Examination (MMSE) (N=12).

Patient characteristics Sample value
Gender, n (%)

Male 4 (33)

Female 8 (67)
Age category (years), n (%)

65-74 2 (17)

75-85 9 (75)

≥86 1 (8)
Age (years), mean (SD) 78.7 (5.6)
Marital status, n (%)

Single/widowed 6 (50)

Married/cohabitation 6 (50)
Number of comorbidities, n (%)

2-8 7 (58)

≥9 5 (42)
Comorbidity, n (%)

Essential (primary) hypertension 10 (83)

Type 2 diabetes mellitus 5 (42)

Chronic ischemic heart disease 4 (33)
MMSE score, mean (SD) 24.5 (1.6)

Ten study patients used an Asus ZenPad 7.0 tablet and two study patients used a Samsung Tab 4.

Assessment of Usability by Patients With MCI

Usability of the Telemonitoring App

With respect to experience during the initial phase of use, 7 of 10 patients reported that the telemonitoring app was difficult to understand at the beginning. Six of 11 patients reported a feeling of insecurity.

Well, in the beginning I was also doubtful: Can you do it or not or are you doing something wrong? And I was just told, if you entered something wrong, you can always do it again.

Patient 47

Well, I first had to fumble a bit with the thing. I have just a normal phone here. [...] Now it’s fine.

Patient 214

After talking about the initial phase, we asked patients to describe the current usage situation. We observed a clearly positive development. Nine of the 12 patients reported that the telemonitoring app was easy to use at this time: “I find it easy to use. At the beginning [...] I was also anxious.” [Patient 47].

After being asked about difficulties in using the telemonitoring app, one patient answered: “Well, actually nothing more. But the first time, I hadn’t really gotten into it. But that was a long time ago.” [Patient 214].

With respect to individual usability aspects of the telemonitoring app, 7 of 10 patients understood the presentation of the contents of the telemonitoring app well (ie, the used figures and language). Seven of nine patients rated the used symbols as easy to understand.

The questions which are written in the blue box are clear. And then there’s “Start” or “Back” if I saidsomething wrong. [Patient 37]

Yes, that's all explained in the manual, yes. It’s a nice red triangle, you practically have to press on it and you just need to read it properly.

Patient 47

The size of images and illustrations (8/8), the font size (12/12), as well as the color contrast (10/10) were rated as perfectly appropriate by all patients who answered these questions within the interviews.

As another aspect of usability, the effort to make inputs was perceived to be less burdensome by almost all patients (10/11). Seven of 11 patients pointed out that this was made possible due to the automated transmission of vital data from the measuring device to the tablet. Six of seven patients rated the menu navigation as simply structured and easily comprehensible.

Tablet Usability

When examining the usability of a telemonitoring app, it is also worth considering the ease of use of the corresponding hardware in terms of the tablets.

Nine of 10 patients expressed that the tablet was easy to use. However, the patients reported functional problems with the hardware. The very slow startup of the tablet, including difficulties in finding an internet connection (7/9), and the arbitrary change of the device into flight mode, including difficulties in transferring the measured vital data to the ATMoSPHAERE platform (4/9), were most frequently mentioned. Three of nine patients reported difficulties in operating the On/Off switch and the same number were bothered by a low battery life or long charging time of the tablet. These functional issues had a negative impact on the overall satisfaction with the telemonitoring app provided, with only six of nine participants having reported being very satisfied or rather satisfied.

Interviewer: So, on the whole, would you say it’s fun to use that or rather not so much fun?

Patient 225: If it worked right, I would enjoy it […].

Interviewer: Yes, but as it is now?

Patient 225: [...] I always approach it with a bit of mixed feelings.

Range of Functions of the Telemonitoring App

Six patients assessed the telemonitoring app’s range of functions and all rated it is as good or adequate. They also named desired functionalities to be included in the app. Three items were most frequently mentioned. The first item involved provision of more innovative and varied educational materials:

Yes, but that's always the same, isn’t it? [...] It is always the same there. The woman, I don’t know her name and blood sugar and stuff. That's something that gets on my nerves

Patient 214

The second item was related to a better fit of the telemonitoring app to the specific needs of patients with MCI:

The only thing I have, that really concerns me is my short-term memory. And that is not being treated here. [...] I wish it were, because many people feel that way. [...] And then also about the operating instructions, you could get something every 2 months or 3 months short, a small article, on one page, that’s enough: “We’ll tell you again about the operating instructions.”

Patient 245

Support for dementia development is not in here, is it? But I still hope that maybe at some point it will be further developed, that maybe some suggestions will be implemented.

Patient 55

The third item was related to having more individually tailored contents of the telemonitoring app in terms of more individualized questionnaires and response categories or by considering additional diseases within the range of functions:

A huge number of food suggestions and so on. But then, maybe other things that would be more interesting. They cannot be queried. I don’t know. You can’t write anything in it by yourself.

Patient 245

Additional Benefits, Negative Effects, and Changes in Everyday Life of Patients With MCI

Additional Benefits of the Telemonitoring App

Ten of the 12 patients stated that the telemonitoring app has an individual additional benefit for them. Eight of the 12 patients stated that they have an increased feeling of security owing to the regular transmission of vital data, and the knowledge that case and care managers are checking their values and will contact them in case of exceeding critical values. Patients reported: “They’ll take care of me” [Patient 225] and “[...] one is monitored and that is not wrong in my opinion” [Patient 179]. The fact that some of the interviewees did not have supporting family members in the direct neighborhood reinforced that feeling.

Five of the 12 patients regularly measured their blood pressure only since having started using the telemonitoring app and appreciated that kind of monitoring: “Well, you either just do it or you forget and here, I do it” [Patient 214].

Four of the 12 patients rated as positive the possibility of being able to monitor blood pressure independently of the general practitioner’s visit according to their individual needs/feelings. According to one patient, this leads to “[…] independence because you know it’s your blood pressure, everything is fine. And you can just go. […] in the beginning someone always had to go shopping with me” [Patient 47].

Furthermore, the following aspects were positively rated by the interviewed patients: the availability of more health-related data as an improved basis for general practitioners’ treatment decisions, an individualized overview of the development of vital parameters, and the perception of the telemonitoring app as a welcome change to everyday life.

Negative Effects of Using the Telemonitoring App

Aside from the additional benefit of telemonitoring app use, which was central for the majority of interviewed patients, 2 of the 12 patients also reported negative effects in using the telemonitoring app. The study-related, more frequent measurement of vital data led to uncertainty, because patients could not properly classify fluctuating values due to their lack of expertise. Patients were aware that case and care managers from the German Red Cross intervened in instances of exceeding values, but even slight fluctuations seemed to lead to uncertainty. In addition, differences in the values between the devices used in the study and patients’ own measurement devices were reported to be disturbing.

Changes in Everyday Life From Using the Telemonitoring App

We also asked the participants to what extent their everyday life has changed due to the use of the telemonitoring app. Six of nine patients reported that study participation and regular measurements did not represent any significant changes: “[…] you accept this early in the morning, this 5-minute thing in no way makes it difficult” [Patient 179]. Three of nine patients stated that the telemonitoring app even simplified their everyday life. They rated the effort to use it as very little and its integration into everyday life as simple.

Ability of Patients With MCI to Use the Telemonitoring App Independently

Almost all patients (10/11) had received further support after their initial introduction to the telemonitoring app at home. Most commonly (8/11), they received telephone support from the case and care managers at the German Red Cross or got help directly from Philips, or a German Red Cross technician visited patients at their home in the case of serious problems. Four of 11 patients stated that they had used the user manual, which had been given to them at the beginning of use. Besides the support by project staff, family members assisted patients in using the telemonitoring app. For 3 of 11 patients, the partner/spouse and for 4 of 11 patients, other family members such as children and grandchildren played an important role in handling the app. In some cases, patients were not using the telemonitoring app themselves: Patient 55 (supported by daughter), Patient 61 (supported by wife), as well as Patient 68 and Patient 99 (supported by husbands). Patient 68 and Patient 99 showed the lowest MMSE scores (22) within the study population; Patient 55 showed an MMSE score of 26 and Patient 61 had a score of 25. Patients 61 and 68 each had a supporting spouse; these spouses had been included in the overall study (but not in this substudy) and had each achieved a higher MMSE value themselves. This might be the main reason that these supporting spouses took care of the transmission of vital data and other aspects of study participation.

The other eight patients were able to operate the telemonitoring app independently, in spite of their MCI.

Influence of Previous Experience With Smartphones, Tablets, or PCs on Perceived Ease of Use of the Telemonitoring App

Three of the 12 patients reported previous experience with a computer but not with a smartphone or a tablet. One patient stated previous experience with a smartphone/tablet but not with a computer. Two patients had already used both a computer and a smartphone/tablet. Two patients had never used a computer, smartphone, or tablet before. Four patients did not comment on this question.

In the context of evaluation, we considered separately to what extent people without prior experience might have had greater difficulties in using the telemonitoring app. The participants found the app easy to use regardless of whether or not they had prior experience, and there were no clear differences in the assessment of the individual usability aspects examined. Only one of the 12 patients, who already had previous experience with a smartphone, found the telemonitoring app difficult to use.

Discussion

Main Findings

To our knowledge, our study is the first to investigate whether patients with MCI are able to operate an app for monitoring their multiple chronic diseases, and how they evaluate its usability and additional benefits for their everyday life.

As one main result, we were able to show that the majority of examined patients with MCI were capable of operating a telemonitoring app independently. However, we also found the following framework conditions and features of the telemonitoring app to be crucial preconditions for independent telemonitoring by patients with MCI, resulting in high perceived ease-of-use: personal support and design features.

All patients, with one exception, received further support after their initial introduction to the telemonitoring app at their home. Most commonly, they received telephone support from the case and care managers at the German Red Cross or directly from Philips, or a German Red Cross technician visited the patients at home in the case of major problems. Thus, a personal introduction and the availability of constant and familiar contact persons are important in decreasing the perceived effort of use and increasing acceptance among this target group. Our previous studies with older patients suffering from chronic diseases also found this to be a key acceptance factor [38,49]. These factors have already been assessed as crucial in the “Senior Technology Acceptance & Adoption Model (STAM)” [58] and by Schmid et al [59]. Furthermore, the availability of constant and familiar contact people also reduces the fear that using technology may result in loss of human contact [12].

Perceived ease of use and perceived additional benefit are the main impact factors on user acceptance within various well-known technology acceptance models [58,60,61]. The following design features of the telemonitoring app examined resulted in high usability, and therefore in high perceived ease of use, for patients with MCI: (1) use of understandable semantics (eg, no foreign language words or technical terms that are not generally understandable); (2) use of easily understandable outputs and displays; (3) easily understandable and self-explanatory menu structures; (4) easily understandable navigation to the desired content of the telemonitoring app; (5) sufficient sizes of fonts and illustrations; (6) sufficient color contrast; (7) low input effort through automatic transmission of blood pressure values; and (8) clearly understandable feedback from the platform on (incorrect) input.

The telemonitoring app examined largely met the criteria that earlier studies have shown to be crucial for a high level of usability for older users [12,38,48,49,59]. This in turn led to higher user adherence [62]. However, usability was partly restricted by functional problems of the hardware that resulted in patient dissatisfaction. These reliability problems can result in a lack of trust and less extensive use or even end of use [34,63,64]. Hardware robustness and a stable internet connection are two key requirements for enabling the use of a telemonitoring app. Both have been highlighted as crucial issues in many studies [53,65,66]. If both requirements are not met, independent operation and use of support services are significantly more difficult or even not possible. Vulnerable individuals, especially those with cognitive impairment, could become worried by experienced difficulties. This can lead to the fact that otherwise useful telemonitoring apps may not be beneficial for these patients. Additionally, a fundamentally high usability of the telemonitoring app and permanently available contact persons for technical questions are crucial to relieve the burden on informal caregivers. For older patients with MCI, these people are often the first point of contact for questions and usage problems, and difficulties would thus put them under additional strain [67,68].

As another main result, our study revealed that the participants found the telemonitoring app easy to use regardless of whether or not they had previous experience with the use of smartphones, tablets, or computers; this presupposes that the telemonitoring app has the relevant design features mentioned above and that personal support is continuously available on weekdays.

However, our study results also discovered that some of the patients hardly ever worked with the app themselves, and their relatives predominantly operated the app instead. In future studies, patients experiencing difficulty could possibly operate the telemonitoring app together with their spouses or other relatives living close by. This could contribute to a feeling of security and support for both sides. However, the use of the telemonitoring app can be problematic for patients who live alone and do not receive any support from other individuals. Therefore, future research should examine how a telemonitoring app with personal support should be designed and function to enable independent usage by this vulnerable target group. In this context, future telemonitoring apps should be developed in close cooperation with patients with MCI to consider their needs and perspectives comprehensively. This kind of codesigning has also been emphasized as a central requirement for a high degree of usability and user acceptance within several studies [14,69-72]. In addition, greater patient involvement can lead to empowering effects among this patient group [70,71].

The majority of patients with MCI perceived the telemonitoring of their state of health as beneficial. Most frequently, the patients reported an increased feeling of security. Other studies have also shown this aspect as a significant benefit of telemonitoring app usage by older patients [73,74]. In addition, the possibility of being able to measure blood pressure independently of a general practitioner visit led to more autonomy and independence according to the opinion of four study patients. Several studies have shown autonomy of patients to be a positive outcome of telemedicine interventions, as indicated in a recent review by Kruse et al [75]. This effect is especially valuable for multimorbid, older patients with MCI who are facing several challenges in terms of understanding and self-managing their health conditions [8,9]. The management of multimorbidity is often complex, and patients face several challenges in terms of understanding and self-managing the conditions and medication, regular monitoring of several clinically relevant vital parameters, and coordinating multiple medical services [3,4].

Our study also showed that patients with MCI desired greater consideration of individual characteristics within the telemonitoring app. They explicitly asked for more individualized questionnaires and response categories. They also stated that additional diseases should be considered in the development of the telemonitoring app. Other studies also verified an individually adjustable and modular content of the app to be crucial for increasing perceived usefulness among the highly heterogeneous older population with chronic illnesses [38,48,49,59,69,73,76]. The challenge for the app development process is to enable customization and guarantee high usability at the same time. The consideration of artificial intelligence or self-learning approaches could be useful in this matter.

This study was a formative evaluation as part of an iterative development process. The telemonitoring was further developed in accordance with the feedback from the interviews. In the course of the project, patients were also able to use Fresh Minder apps for memory training [77]. Moreover, additional questionnaires and care plans (eg, for pain, dizziness, sleep, and activity) were developed and implemented, and offers for potentially helpful social and nursing services were added.

With regard to coping with the effects of the COVID-19 pandemic, our results have shown that telemonitoring of older patients with multimorbidity and MCI is feasible. Studies have also shown that the pandemic has changed health care toward increased acceptance and utilization of telemedicine by both patients and providers [29,32]. Furthermore, telemonitoring can help to reduce fears, insecurities, and the feeling of social isolation among those affected [29], which also plays an important role in coping with the COVID-19 pandemic.

Implications for Future Research

Telemedicine solutions for patients with MCI had already focused on the following topics, which have been systematically reviewed by Lorenz et al [13]: preservation or improvement of memory performance [78,79], app-based memory training [77,80], preservation of fitness and agility [81], preservation of an independent way of life [82], and provision of information about dementia [79]. All of these topics focused exclusively on patients with cognitive impairment. Future research should focus more on influencing factors enabling patients with multimorbidity and MCI to take an active and participatory role within their treatment process by using telemonitoring apps. Furthermore, research is needed to examine up to which severity stage of dementia patients are able to use a telemonitoring app. Therefore, more qualitative and quantitative studies are required to explore this topic in further detail.

Future studies should be performed in a controlled design. It would be expedient to investigate whether and how telemonitoring itself, and the increased feeling of security and independence, affect the number of general practitioner visits, vital parameters, disease progression, medication adherence, emergency admissions or admissions to nursing homes, quality of life, depression, or empowerment. Furthermore, a health economic evaluation would be useful to examine whether the use of such a telemonitoring app can lead to better care at the same costs or with cost savings.

Implications for Practice

Our study provides initial evidence for the usage of a telemonitoring app by individuals with MCI. We showed that patients with multimorbidity and MCI can be considered as a target group for the use of telemonitoring apps if the above-mentioned conditions are met. For general practitioners and other health professionals, it is important to carefully select which patients are suitable for using such technology and to intensively discuss this option with the patients. Any existing concerns can also be addressed in this context. The patient’s needs and own perceptions, including in the sense of self-selection, are essential requirements for successful use. For individuals with various preexisting chronic conditions, it is essential to carefully determine whether such an app offers effective support. Basically, such apps must fit into the individual treatment pathway and should not represent an additional burden for either the patient or the physician. In this context, it should be taken into account whether relatives are available or whether the patient lives alone and how this might affect use of the telemonitoring app. In addition, the general practitioner or health care professional and the patient should regularly assess and jointly decide whether or not such an app remains suitable.

Overall, the COVID-19 pandemic has caused a rethinking of many issues, which may lead to greater receptiveness among this patient group and treating physicians for such apps.

Strengths and Limitations

This study was carried out as part of the ATMoSPHAERE project, which ended in June 2019 and focused on older patients with MCI. To our knowledge, our study was the first to investigate whether patients with MCI are able to operate a telemonitoring app for managing symptoms of their multiple chronic diseases. We were able to show that the majority of examined patients with MCI were capable of operating a telemonitoring app independently. With regard to ensuring adequate care for multimorbid, chronically ill patients with MCI during the COVID-19 pandemic, this result is highly valuable. Furthermore, our results on relevant acceptance and usability factors of such a telemonitoring app provide important information for the design and implementation of future home-based telemedicine solutions. Our study design and results can be used as a starting point for quantitative studies in this field with a larger sample size and a controlled study design.

In addition to its strengths, our study also has limitations. The recruitment of patients from this vulnerable group was difficult because of concerns regarding their own abilities to operate a telemonitoring app; hence, the occurrence of a selection bias cannot be excluded. Moreover, some patients from this cohort dropped out of the overall study before the qualitative study started due to technical difficulties with the telemonitoring app examined. Finally, we included all 12 patients who met the inclusion criteria and agreed to be interviewed to achieve the greatest heterogeneity possible within our study sample. During the interview series, we noticed that the patients’ responses were repeated toward the end and we reached saturation concerning the topics addressed in the interviews with our available sample. However, it cannot be excluded that the inclusion of further patients with MCI would have opened other relevant topics. When interviewing study participants, there is always the possibility that their answers are influenced by social desirability, which in turn could lead to biased results. To tackle this issue, we opted for an open interview setting, gave the participants the chance to ask questions, and kept the number of people present during the interview to a minimum. In addition, recall bias can exist, particularly in the case of interviewing patients with MCI. Some patients did not adhere to the interview topics and talked about aspects subjectively perceived to be relevant. Hence, some questions remained unanswered or may have been answered inadequately (response bias). However, our study design and results provide a valuable basis for future studies with a larger sample size.

Conclusions

When continuous personal support was available right from the start of use and when the app was tailored in a needs- and disease-specific design, ensuring high perceived ease of use, the majority of examined patients with MCI were capable of operating the telemonitoring app independently. Hence, this study provides initial evidence that older patients with multimorbidity and MCI could increasingly be considered as a relevant user group for telemonitoring apps and should be involved as codesigners in their development. Future studies should investigate this issue further with a larger sample of patients with MCI.

Acknowledgments

The authors would like to thank the German Federal Ministry of Education and Research for funding the ATMoSPHAERE project and making this study possible. Special thanks is extended to the recruiting general practitioners and the interviewed patients who gave us valuable insights into their user needs, perceptions, and experiences. We would also like to thank the partners of the ATMoSPHAERE project for their collaboration and joint activities within the project. The ATMoSPHAERE project (10/2015–06/2019) was funded by The German Federal Ministry of Education and Research within the funding program “Medical Technology Solutions for Multimorbidity” (grant number 13GW0075A). The publication of this article was made possible by Open Access Funding by the Publication Fund of Technische Universität Dresden.

Abbreviations

ATMoSPHAERE

Autonomy despite multimorbidity in Saxony through patient empowerment, holistic care for older people with networking of all regional institutions and service providers

MCI

mild cognitive impairment

MMSE

Mini-Mental State Examination

OECD

Organisation for Economic Co-operation and Development

Appendix

Multimedia Appendix 1

Interview guideline.

Footnotes

Authors' Contributions: The overall study and the presented substudy focusing on patients with MCI were conceived and designed by VH, JS, DD, and MS. VH was in charge of the overall direction and planning of the study. CL supported the recruitment of general practitioners and study patients. The interview guideline was initially developed by MS, and discussed and consented to by the entire research team (all authors). The interviews were conducted by KA, DD, and MS. Data evaluation was carried out by MS, EL, DD, and KA. MS wrote the manuscript with considerable input from CL. All authors reviewed and commented on the final manuscript.

Conflicts of Interest: None declared. Unrelated to this project, JS received institutional funding from Sanofi, Novartis, ALK, and Pfizer for investigator-initiated research, and acted as a consultant for Lilly, Novartis, and Sanofi.

References

  • 1.The Lancet Making more of multimorbidity: an emerging priority. Lancet. 2018 Apr 28;391(10131):1637. doi: 10.1016/S0140-6736(18)30941-3. [DOI] [PubMed] [Google Scholar]
  • 2.OECD . Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. [Google Scholar]
  • 3.Wallace E, Salisbury C, Guthrie B, Lewis C, Fahey T, Smith SM. Managing patients with multimorbidity in primary care. BMJ. 2015 Jan 20;350:h176. doi: 10.1136/bmj.h176. [DOI] [PubMed] [Google Scholar]
  • 4.Zulman DM, Jenchura EC, Cohen DM, Lewis ET, Houston TK, Asch SM. How can eHealth technology address challenges related to multimorbidity? Perspectives from patients with multiple chronic conditions. J Gen Intern Med. 2015 Aug;30(8):1063–1070. doi: 10.1007/s11606-015-3222-9. http://europepmc.org/abstract/MED/25691239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fortin M, Bravo G, Hudon C, Lapointe L, Dubois M, Almirall J. Psychological distress and multimorbidity in primary care. Ann Fam Med. 2006;4(5):417–422. doi: 10.1370/afm.528. http://www.annfammed.org/cgi/pmidlookup?view=long&pmid=17003141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Fortin M, Lapointe L, Hudon C, Vanasse A, Ntetu AL, Maltais D. Multimorbidity and quality of life in primary care: a systematic review. Health Qual Life Outcomes. 2004 Sep 20;2:51. doi: 10.1186/1477-7525-2-51. https://hqlo.biomedcentral.com/articles/10.1186/1477-7525-2-51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Condelius A, Edberg A, Jakobsson U, Hallberg IR. Hospital admissions among people 65+ related to multimorbidity, municipal and outpatient care. Arch Gerontol Geriatr. 2008;46(1):41–55. doi: 10.1016/j.archger.2007.02.005. [DOI] [PubMed] [Google Scholar]
  • 8.Bayliss EA, Bayliss MS, Ware JE, Steiner JF. Predicting declines in physical function in persons with multiple chronic medical conditions: what we can learn from the medical problem list. Health Qual Life Outcomes. 2004 Sep 07;2:47. doi: 10.1186/1477-7525-2-47. https://hqlo.biomedcentral.com/articles/10.1186/1477-7525-2-47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Marengoni A, Angleman S, Melis R, Mangialasche F, Karp A, Garmen A, Meinow B, Fratiglioni L. Aging with multimorbidity: a systematic review of the literature. Ageing Res Rev. 2011 Sep;10(4):430–439. doi: 10.1016/j.arr.2011.03.003. [DOI] [PubMed] [Google Scholar]
  • 10.Tonelli M, Wiebe N, Straus S, Fortin M, Guthrie B, James MT, Klarenbach SW, Tam-Tham H, Lewanczuk R, Manns BJ, Quan H, Ronksley PE, Sargious P, Hemmelgarn B, Alberta Kidney Disease Network Multimorbidity, dementia and health care in older people:a population-based cohort study. CMAJ Open. 2017 Aug 14;5(3):E623–E631. doi: 10.9778/cmajo.20170052. http://cmajopen.ca/cgi/pmidlookup?view=long&pmid=28811281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Anderson ND. State of the science on mild cognitive impairment (MCI) CNS Spectr. 2019 Feb;24(1):78–87. doi: 10.1017/S1092852918001347. [DOI] [PubMed] [Google Scholar]
  • 12.Bossen AL, Kim H, Williams KN, Steinhoff AE, Strieker M. Emerging roles for telemedicine and smart technologies in dementia care. Smart Homecare Technol Telehealth. 2015;3:49–57. doi: 10.2147/SHTT.S59500. http://europepmc.org/abstract/MED/26636049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Lorenz K, Freddolino PP, Comas-Herrera A, Knapp M, Damant J. Technology-based tools and services for people with dementia and carers: Mapping technology onto the dementia care pathway. Dementia (London) 2019 Feb;18(2):725–741. doi: 10.1177/1471301217691617. [DOI] [PubMed] [Google Scholar]
  • 14.Holthe T, Halvorsrud L, Karterud D, Hoel K, Lund A. Usability and acceptability of technology for community-dwelling older adults with mild cognitive impairment and dementia: a systematic literature review. Clin Interv Aging. 2018;13:863–886. doi: 10.2147/CIA.S154717. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Verloo H, Kampel T, Vidal N, Pereira F. Perceptions about technologies that help community-dwelling older adults remain at home: qualitative study. J Med Internet Res. 2020 Jun 04;22(6):e17930. doi: 10.2196/17930. https://www.jmir.org/2020/6/e17930/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Forducey PG, Glueckauf RL, Bergquist TF, Maheu MM, Yutsis M. Telehealth for persons with severe functional disabilities and their caregivers: facilitating self-care management in the home setting. Psychol Serv. 2012 May;9(2):144–162. doi: 10.1037/a0028112. http://europepmc.org/abstract/MED/22662729. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Timpel P, Oswald S, Schwarz PEH, Harst L. Mapping the evidence on the effectiveness of telemedicine interventions in diabetes, dyslipidemia, and hypertension: an umbrella review of systematic reviews and meta-analyses. J Med Internet Res. 2020 Mar 18;22(3):e16791. doi: 10.2196/16791. https://www.jmir.org/2020/3/e16791/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Kruse C, Pesek B, Anderson M, Brennan K, Comfort H. Telemonitoring to manage chronic obstructive pulmonary disease: systematic literature review. JMIR Med Inform. 2019 Mar 20;7(1):e11496. doi: 10.2196/11496. https://medinform.jmir.org/2019/1/e11496/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.van der Watt ASJ, Odendaal W, Louw K, Seedat S. Distant mood monitoring for depressive and bipolar disorders: a systematic review. BMC Psychiatry. 2020 Jul 22;20(1):383. doi: 10.1186/s12888-020-02782-y. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-020-02782-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Hanlon P, Daines L, Campbell C, McKinstry B, Weller D, Pinnock H. Telehealth interventions to support self-management of long-term conditions: a systematic metareview of diabetes, heart failure, asthma, chronic obstructive pulmonary disease, and cancer. J Med Internet Res. 2017 May 17;19(5):e172. doi: 10.2196/jmir.6688. https://www.jmir.org/2017/5/e172/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Wakefield BJ, Koopman RJ, Keplinger LE, Bomar M, Bernt B, Johanning JL, Kruse RL, Davis JW, Wakefield DS, Mehr DR. Effect of home telemonitoring on glycemic and blood pressure control in primary care clinic patients with diabetes. Telemed J E Health. 2014 Mar;20(3):199–205. doi: 10.1089/tmj.2013.0151. http://europepmc.org/abstract/MED/24404819. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Seto E, Ware P, Logan AG, Cafazzo JA, Chapman KR, Segal P, Ross HJ. Self-management and clinical decision support for patients with complex chronic conditions through the use of smartphone-based telemonitoring: randomized controlled trial protocol. JMIR Res Protoc. 2017 Nov 21;6(11):e229. doi: 10.2196/resprot.8367. https://www.researchprotocols.org/2017/11/e229/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Padwal R, McAlister FA, Wood PW, Boulanger P, Fradette M, Klarenbach S, Edwards AL, Holroyd-Leduc JM, Alagiakrishnan K, Rabi D, Majumdar SR. Telemonitoring and protocolized case management for hypertensive community-dwelling seniors with diabetes: Protocol of the TECHNOMED randomized controlled trial. JMIR Res Protoc. 2016 Jun 24;5(2):e107. doi: 10.2196/resprot.5775. https://www.researchprotocols.org/2016/2/e107/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.International Organization for Standardization (ISO) Online Browsing Platform. Geneva: ISO; 2018. [2021-06-25]. ISO 9241-110:2018(en). Ergonomics of Human-system interaction — Part 11: Usability: Definitions and Concepts. https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en. [Google Scholar]
  • 25.Dockweiler C. Akzeptanz der Telemedizin. In: Fisher F, Krämer A, editors. eHealth in Deutschland. Berlin, Heidelberg: Springer Nature; 2016. pp. 257–271. [Google Scholar]
  • 26.Cheung G, Peri K. Challenges to dementia care during COVID-19: Innovations in remote delivery of group Cognitive Stimulation Therapy. Aging Ment Health. 2021 Jun;25(6):977–979. doi: 10.1080/13607863.2020.1789945. [DOI] [PubMed] [Google Scholar]
  • 27.Liu N, Huang R, Baldacchino T, Sud A, Sud K, Khadra M, Kim J. Telehealth for noncritical patients with chronic diseases during the COVID-19 pandemic. J Med Internet Res. 2020 Aug 07;22(8):e19493. doi: 10.2196/19493. https://www.jmir.org/2020/8/e19493/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Cuffaro L, Di Lorenzo F, Bonavita S, Tedeschi G, Leocani L, Lavorgna L. Dementia care and COVID-19 pandemic: a necessary digital revolution. Neurol Sci. 2020 Aug;41(8):1977–1979. doi: 10.1007/s10072-020-04512-4. http://europepmc.org/abstract/MED/32556746. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Tousi B. Dementia care in the time of COVID-19 pandemic. J Alzheimers Dis. 2020;76(2):475–479. doi: 10.3233/JAD-200461. [DOI] [PubMed] [Google Scholar]
  • 30.Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, Xiang J, Wang Y, Song B, Gu X, Guan L, Wei Y, Li H, Wu X, Xu J, Tu S, Zhang Y, Chen H, Cao B. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020 Mar 28;395(10229):1054–1062. doi: 10.1016/S0140-6736(20)30566-3. http://europepmc.org/abstract/MED/32171076. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Caso V, Federico A. No lockdown for neurological diseases during COVID19 pandemic infection. Neurol Sci. 2020 May;41(5):999–1001. doi: 10.1007/s10072-020-04389-3. http://europepmc.org/abstract/MED/32270358. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mann DM, Chen J, Chunara R, Testa PA, Nov O. COVID-19 transforms health care through telemedicine: evidence from the field. J Am Med Inform Assoc. 2020 Jul 01;27(7):1132–1135. doi: 10.1093/jamia/ocaa072. http://europepmc.org/abstract/MED/32324855. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lang C, Voigt K, Neumann R, Bergmann A, Holthoff-Detto V. Adherence and acceptance of a home-based telemonitoring application used by multi-morbid patients aged 65 years and older. J Telemed Telecare. 2020 Feb 02;:1357633X20901400. doi: 10.1177/1357633X20901400. https://journals.sagepub.com/doi/10.1177/1357633X20901400?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Lang C, Scheibe M, Voigt K, Hübsch G, Mocke L, Schmitt J, Bergmann A, Holthoff-Detto V. Reasons for non-acceptance and non-use of a home telemonitoring application by multimorbid patients aged 65 years and over. Z Evid Fortbild Qual Gesundhwes. 2019 May;141-142:76–88. doi: 10.1016/j.zefq.2019.02.009. [DOI] [PubMed] [Google Scholar]
  • 35.Hix D, Hartson HR. Formative evaluation: ensuring usability in user interfaces. Vtechworks. 1993. [2021-06-21]. https://vtechworks.lib.vt.edu/bitstream/handle/10919/19798/TR-92-60.pdf?sequence=3&isAllowed=y.
  • 36.Janny B, Pfeffer S. Formative und summative Usability Evaluationen medizintechnischer Produkte - Menschzentriert entwickeln und dabei die regulatorischen Anforderungen erfüllen. Mensch und Computer 2020 - Usability Professionals; September 6-9, 2020; Magdeburg, Germany. Bonn: Gesellschaft für Informatik e.V. und German UPA e.V; 2020. https://dl.gi.de/bitstream/handle/20.500.12116/34218/muc2020-up-0142.pdf?sequence=1&isAllowed=y. [DOI] [Google Scholar]
  • 37.Lau F, Kuziemsky C. Handbook of eHealth evaluation: an evidence-based approach. Victoria, BC: University of Victoria; 2016. [2021-06-21]. https://dspace.library.uvic.ca/bitstream/handle/1828/7814/Lau_Francis_Handbook%20of%20eHealth%20Evaluation_REV%20Oct2017.pdf?isAllowed=y&sequence=67. [PubMed] [Google Scholar]
  • 38.Scheibe M, Reichelt J, Bellmann M, Kirch W. Acceptance factors of mobile apps for diabetes by patients aged 50 or older: a qualitative study. Med 2 0. 2015 Mar 02;4(1):e1. doi: 10.2196/med20.3912. https://www.medicine20.com/2015/1/e1/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Przyborski A, Wohlrab-Sahr M. Qualitative Sozialforschung. Ein Arbeitsbuch. 3rd edition. München: Oldenbourg Verlag; 2010. [Google Scholar]
  • 40.Flick U. Qualitative Sozialforschung. Eine Einführung. 4th edition. Reinbek bei Hamburg: Rowohlt-Taschenbuch-Verlag; 2011. [Google Scholar]
  • 41.Helfferich C. Die Qualität qualitativer Daten. Manual für die Durchführung qualitativer Interviews. 4th edition. Wiesbaden: Verlag für Sozialwissenschaften; 2011. [Google Scholar]
  • 42.Meuser M, Nagel U, Garz D, Kraimer K. ExpertInneninterviews - vielfach erprobt, wenig bedacht: ein Beitrag zur qualitativen Methodendiskussion. Opladen: Westdeutscher Verlag; 1991. [Google Scholar]
  • 43.Mayer H. Interview und schriftliche Befragung. Entwicklung und Durchführung und Auswertung. 5th edition. München: Oldenbourg Verlag; 2009. [Google Scholar]
  • 44.Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189–198. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
  • 45.Kessler J, Denzler P, Markowitsch H. Mini-Mental-Status-Test. Manual. Weinheim: Beltz Testverlag; 1990. [Google Scholar]
  • 46.Shulman KI, Pushkar Gold D, Cohen CA, Zucchero CA. Clock-drawing and dementia in the community: A longitudinal study. Int J Geriat Psychiatry. 1993 Jun;8(6):487–496. doi: 10.1002/gps.930080606. [DOI] [Google Scholar]
  • 47.Podsiadlo D, Richardson S. J Am Geriatr Soc. 1991 Feb;39(2):142–148. doi: 10.1111/j.1532-5415.1991.tb01616.x. [DOI] [PubMed] [Google Scholar]
  • 48.Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res. 2014 Apr 09;16(4):e104. doi: 10.2196/jmir.2968. https://www.jmir.org/2014/4/e104/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Scheibe M. Einflussfaktoren auf die Akzeptanz und Nutzung von mobilen Diabetes-Applikationen durch Patienten über 50 Jahre PhD thesis. Dresden: Madlen Scheibe; 2015. [Google Scholar]
  • 50.Anderson K, Burford O, Emmerton L. App chronic disease checklist: protocol to evaluate mobile apps for chronic disease self-management. JMIR Res Protoc. 2016 Nov 04;5(4):e204. doi: 10.2196/resprot.6194. https://www.researchprotocols.org/2016/4/e204/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Jeffrey B, Bagala M, Creighton A, Leavey T, Nicholls S, Wood C, Longman J, Barker J, Pit S. Mobile phone applications and their use in the self-management of Type 2 Diabetes Mellitus: a qualitative study among app users and non-app users. Diabetol Metab Syndr. 2019;11:84. doi: 10.1186/s13098-019-0480-4. https://dmsjournal.biomedcentral.com/articles/10.1186/s13098-019-0480-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Anderson K, Burford O, Emmerton L. Mobile health apps to facilitate self-care: a qualitative study of user experiences. PLoS One. 2016;11(5):e0156164. doi: 10.1371/journal.pone.0156164. https://dx.plos.org/10.1371/journal.pone.0156164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Isaković M, Sedlar U, Volk M, Bešter J. Usability pitfalls of diabetes mHealth apps for the elderly. J Diabetes Res. 2016;2016:1604609. doi: 10.1155/2016/1604609. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Flick U. Handbuch qualitative Sozialforschung. Grundlagen, Konzepte, Methoden und Anwendungen. 2nd edition. Weinheim: Beltz, Psychologie-Verlags-Union; 1995. [Google Scholar]
  • 55.Maindok H. Professionelle Interviewführung in der Sozialforschung. Interviewtraining: Bedarf, Stand und Perspektiven. Pfaffenweiler: Centaurus-Verlags-Gesellschaft; 1996. [Google Scholar]
  • 56.Mayring P. Qualitative Inhaltsanalyse. Grundlagen und Techniken. 11th edition. Weinheim: Beltz; 2010. [Google Scholar]
  • 57.Kuckartz U. Einführung in die computergestützte Analyse qualitativer Daten. 3rd edition. Wiesbaden: Verlag für Sozialwissenschaften; 2010. [Google Scholar]
  • 58.Renaud K, van Biljon J. Predicting technology acceptance and adoption by the elderly: a qualitative study. Annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries; October 2008; Wilderness, South Africa. 2008. [DOI] [Google Scholar]
  • 59.Schmid A, Dörfler I, Dany F, Böpple O. Analyse der Akzeptanzkriterien für mobile Anwendungen im Bereich Gesundheit in der Zielgruppe 50+ In: Shire KA, Leimeister JM, editors. Technologiegestützte Dienstleistungsinnovation in der Gesundheitswirtschaft. Wiesbaden: Gabler Verlag; 2012. pp. 57–82. [Google Scholar]
  • 60.Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Management Sci. 1989 Aug;35(8):982–1003. doi: 10.1287/mnsc.35.8.982. [DOI] [Google Scholar]
  • 61.van Biljon J, Kotzé P. Modelling the factors that influence mobile phone adoption. Annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries; October 2007; Port Elizabeth, South Africa. New York: ACM Press; 2007. [DOI] [Google Scholar]
  • 62.Wade R, Cartwright C, Shaw K. Factors relating to home telehealth acceptance and usage compliance. Risk Manag Healthc Policy. 2012;5:25–33. doi: 10.2147/RMHP.S30204. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Lee C. Adoption of smart technology among older adults: challenges and issues. Publ Pol Aging Rep. 2013 Dec 17;24(1):14–17. doi: 10.1093/ppar/prt005. [DOI] [Google Scholar]
  • 64.Lee C, Myrick R, D'Ambrosio L, Coughlin J, de Weck OL. Older adults' experiences with technology: learning from their voices. HCI International 2013; July 21-26, 2013; Las Vegas, NV. 2013. [DOI] [Google Scholar]
  • 65.Fairbrother P, Ure J, Hanley J, McCloughan L, Denvir M, Sheikh A, McKinstry B, Telescot programme team Telemonitoring for chronic heart failure: the views of patients and healthcare professionals - a qualitative study. J Clin Nurs. 2014 Jan;23(1-2):132–144. doi: 10.1111/jocn.12137. [DOI] [PubMed] [Google Scholar]
  • 66.Siebermair J, Clauss S, Martens E, Schuessler F, Oversohl N, Haserueck N, Estner HL, Kääb S, Wakili R. Remote monitoring of implantable cardioverter-defibrillators. Problems and implications using a telemonitoring system. Herz. 2015 Apr;40(Suppl 2):110–118. doi: 10.1007/s00059-014-4080-7. [DOI] [PubMed] [Google Scholar]
  • 67.Brodaty H, Donkin M. Family caregivers of people with dementia. Dialogues Clin Neurosci. 2009;11(2):217–228. doi: 10.31887/DCNS.2009.11.2/hbrodaty. http://europepmc.org/abstract/MED/19585957. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Werner P. Mild cognitive impairment and caregiver burden: a critical review and research agenda. Public Health Rev. 2012 Nov 30;34(2):16. doi: 10.1007/bf03391684. [DOI] [Google Scholar]
  • 69.Wang G, Marradi C, Albayrak A, van der Cammen TJM. Co-designing with people with dementia: A scoping review of involving people with dementia in design research. Maturitas. 2019 Sep;127:55–63. doi: 10.1016/j.maturitas.2019.06.003. https://linkinghub.elsevier.com/retrieve/pii/S0378-5122(19)30125-2. [DOI] [PubMed] [Google Scholar]
  • 70.Span M, Hettinga M, Vernooij-Dassen M, Eefsting J, Smits C. Involving people with dementia in the development of supportive IT applications: a systematic review. Ageing Res Rev. 2013 Mar;12(2):535–551. doi: 10.1016/j.arr.2013.01.002. [DOI] [PubMed] [Google Scholar]
  • 71.Suijkerbuijk S, Nap HH, Cornelisse L, IJsselsteijn WA, de Kort YAW, Minkman MMN. Active involvement of people with dementia: a systematic review of studies developing supportive technologies. J Alzheimers Dis. 2019;69(4):1041–1065. doi: 10.3233/JAD-190050. http://europepmc.org/abstract/MED/31156158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Yousaf K, Mehmood Z, Saba T, Rehman A, Munshi AM, Alharbey R, Rashid M. Mobile-health applications for the efficient delivery of health care facility to people with dementia (PwD) and support to their carers: a survey. Biomed Res Int. 2019;2019:7151475. doi: 10.1155/2019/7151475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Bujnowska-Fedak MM, Grata-Borkowska U. Use of telemedicine-based care for the aging and elderly: promises and pitfalls. Smart Homecare Technol Telehealth. 2015 May;3:91–105. doi: 10.2147/shtt.s59498. [DOI] [Google Scholar]
  • 74.Horton K. Falls in older people: the place of telemonitoring in rehabilitation. J Rehabil Res Dev. 2008;45(8):1183–1194. https://www.rehab.research.va.gov/jour/08/45/8/pdf/Horton.pdf. [PubMed] [Google Scholar]
  • 75.Kruse C, Fohn J, Wilson N, Nunez Patlan E, Zipp S, Mileski M. Utilization barriers and medical outcomes commensurate with the use of telehealth among older adults: systematic review. JMIR Med Inform. 2020 Aug 12;8(8):e20359. doi: 10.2196/20359. https://medinform.jmir.org/2020/8/e20359/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Grindrod KA, Li M, Gates A. Evaluating user perceptions of mobile medication management applications with older adults: a usability study. JMIR Mhealth Uhealth. 2014 Mar 14;2(1):e11. doi: 10.2196/mhealth.3048. https://mhealth.jmir.org/2014/1/e11/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Hoffman R. Fresh Minder. [2021-06-21]. https://freshminder.de/index.htm.
  • 78.Woods B, Aguirre E, Spector AE, Orrell M. Cognitive stimulation to improve cognitive functioning in people with dementia. Cochrane Database Syst Rev. 2012 Feb 15;(2):CD005562. doi: 10.1002/14651858.CD005562.pub2. [DOI] [PubMed] [Google Scholar]
  • 79.Rosenberg L, Nygård L. Persons with dementia become users of assistive technology: a study of the process. Dementia. 2011 Oct 16;11(2):135–154. doi: 10.1177/1471301211421257. [DOI] [Google Scholar]
  • 80.RetroBrain R&D GmbH. [2021-06-21]. https://www.retrobrain.de/
  • 81.Realdon O, Rossetto F, Nalin M, Baroni I, Cabinio M, Fioravanti R, Saibene FL, Alberoni M, Mantovani F, Romano M, Nemni R, Baglio F. Technology-enhanced multi-domain at home continuum of care program with respect to usual care for people with cognitive impairment: the Ability-TelerehABILITation study protocol for a randomized controlled trial. BMC Psychiatry. 2016 Nov 25;16(1):425. doi: 10.1186/s12888-016-1132-y. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-016-1132-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Cheek P, Nikpour L, Nowlin HD. Aging well with smart technology. Nurs Adm Q. 2005;29(4):329–338. doi: 10.1097/00006216-200510000-00007. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Interview guideline.


Articles from JMIR Human Factors are provided here courtesy of JMIR Publications Inc.

RESOURCES