Abstract
Background
As many as 80% of stroke survivors experience upper limb (UL) disability. The strong relationships between disability, lost productivity, and ongoing health care costs mean reducing disability after stroke is critical at both individual and society levels. Unfortunately, the amount of UL-focused rehabilitation received by people with stroke is extremely low. Activity monitoring and promotion using wearable devices offer a potential technology-based solution to address this gap. Commonly, wearable devices are used to deliver a haptic nudge to the wearer with the aim of promoting a particular behavior. However, little is known about the effectiveness of haptic nudging in promoting behaviors in patient populations.
Objective
This study aimed to estimate the effect of haptic nudging delivered via a wrist-worn wearable device on UL movement in people with UL disability following stroke undertaking inpatient rehabilitation.
Methods
A multiple-period randomized crossover design was used to measure the association of UL movement with the occurrence of haptic nudge reminders to move the affected UL in 20 people with stroke undertaking inpatient rehabilitation. UL movement was observed and classified using movement taxonomy across 72 one-minute observation periods from 7:00 AM to 7:00 PM on a single weekday. On 36 occasions, a haptic nudge to move the affected UL was provided just before the observation period. On the other 36 occasions, no haptic nudge was given. The timing of the haptic nudge was randomized across the observation period for each participant. Statistical analysis was performed using mixed logistic regression. The effect of a haptic nudge was evaluated from the intention-to-treat dataset as the ratio of the odds of affected UL movement during the observation period following a “Planned Nudge” to the odds of affected limb movement during the observation period following “No Nudge.”
Results
The primary intention-to-treat analysis showed the odds ratio (OR) of affected UL movement following a haptic nudge was 1.44 (95% CI 1.28-1.63, P<.001). The secondary analysis revealed an increased odds of affected UL movement following a Planned Nudge was predominantly due to increased odds of spontaneous affected UL movement (OR 2.03, 95% CI 1.65-2.51, P<.001) rather than affected UL movement in conjunction with unaffected UL movement (OR 1.13, 95% CI 0.99-1.29, P=.07).
Conclusions
Haptic nudging delivered via a wrist-worn wearable device increases affected UL movement in people with UL disability following stroke undertaking inpatient rehabilitation. The promoted movement appears to be specific to the instructions given.
Trial Registration
Australia New Zealand Clinical Trials Registry 12616000654459; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=370687&isReview=true
Keywords: stroke, rehabilitation, physical activity, movement, disability, technology, upper limb, wearable, haptic, nudge
Introduction
Although the incidence of stroke has reduced, its burden continues to grow as more people are surviving after stroke and living with disability [1]. Direct and indirect health care costs following stroke are strongly correlated with stroke disability, with greater disability associated with greater costs [2,3]. Around 80% of stroke survivors experience upper limb (UL) disability, with only 5%-20% achieving full recovery of UL function [4-6]. UL disability has subsequent impacts on independence in activities of daily living, discharge destination, return to work, quality of life, and mood [7-10].
Effective rehabilitation involves high-dose, intensive, task-specific activity [11]. Meta-analyses of randomized controlled trials suggest there is a dose-response relationship, with higher doses of rehabilitation resulting in better outcomes [12-14]. However, studies describing usual stroke care illustrate that the dose of UL rehabilitation received by people with stroke is extremely low, with as little as 4-6 minutes in physiotherapy sessions and 11-17 minutes in occupational therapy sessions [15]. Movement of the affected UL outside formal therapy sessions during inpatient rehabilitation is also low [16]. Consequently, affected UL movement dose, both within formal therapy sessions and across the rehabilitation day, is currently insufficient to reduce UL disability following stroke.
Rehabilitation technologies have been proposed as potential solutions to the limited dose of rehabilitation this population receives [17]. A number of technological solutions have been developed for use in UL stroke rehabilitation, including virtual reality, gaming, and robotics [17-19]. Despite indications of effectiveness [20,21], the use of rehabilitation technologies is not yet pervasive in stroke care [18]. Therapists have identified several barriers to adopting rehabilitation technologies, including concerns about patient safety, whether the technology effectively addresses a clinical need, and the feasibility of technologies from time, space, and cost perspectives [22,23]. The poor uptake of rehabilitation technologies is inconsistent with research involving people with stroke that indicates rehabilitation technologies can support engagement and interest in performing repetitive rehabilitation activities and offer a means of social support [19,24,25]. Activity monitoring and promotion using wearable devices is a potential low-cost and feasible rehabilitation technology. Research investigating the effect of wearable devices on outcomes following stroke is in its infancy. Preliminary indications suggest that wearable devices may increase the amount and intensity of physical activity undertaken during rehabilitation [26-28] and potentially contribute to improved functional outcomes [29]. However, the effect of wearable devices on UL rehabilitation and outcomes has been less well studied [30,31], with much of the research to date focusing on the accuracy and validity of accelerometry measurement of real-world UL movement [32-34].
Wearable devices that deliver haptic nudges have been used to promote physical activity in both healthy and patient populations [35-39]. Commonly, a haptic nudge reminder is delivered via a small motor embedded inside a wearable device. Wearers are encouraged to respond to a haptic reminder by performing a particular behavior. For example, a haptic nudge might be used to remind the wearer to stand up and move after an extended period of sitting or to undertake rehabilitation exercises. However, despite the pervasiveness of haptic nudging in consumer wearable devices, there remains much to learn about the effectiveness of haptic nudging in promoting behaviors in patient populations. Haptic nudges have been used to effectively promote behaviors in people with autism spectrum disorder [40] and traumatic brain injury engaged in a rehabilitation task [41]. Research also suggests that wearable devices are feasible and well tolerated in people with stroke [30,42,43], with preliminary data indicating haptic nudging via wearable devices may promote affected UL movement [31]. The aim of this study was to estimate the effect of haptic nudging delivered via a wrist-worn wearable device on UL movement in people with UL disability following stroke undertaking inpatient rehabilitation.
Methods
Study Design
A multiple-period randomized crossover design was used to measure the association of UL movement with the occurrence of haptic nudge reminders to move the affected UL in 20 people with stroke undertaking inpatient rehabilitation. UL movement was observed and classified using movement taxonomy across 72 one-minute observation periods from 7:00 am to 7:00 pm on a single weekday. On 36 occasions, a haptic nudge (Nudge) to move the affected UL was provided just before the observation period, and on the other 36 occasions, no haptic nudge was given (No Nudge). The timing of the haptic nudge was randomized. Approval for this study was obtained from the New Zealand Health and Disability Ethics Committee (16/NTA/74).
Participants
All people with stroke admitted to the rehabilitation service from July 2018 through December 2018 were considered for inclusion in this study. Participants were included if they had a confirmed diagnosis of stroke based on the Oxford classification system [44], presented with UL deficit as a result of stroke as determined by their rehabilitation therapist, were deemed medically stable and fit for rehabilitation by their medical consultant, and provided written informed consent. Participants were excluded if they had cognitive, behavioral, or communication impairments that, in the opinion of the research team (RM, DT, NS), would limit their ability to participate in the research (for example, if the person was unable to follow a 2-step verbal command or recall the details of the research study); were within 3 days of planned discharge from inpatient rehabilitation; or reported shoulder pain.
Procedure
Potential participants were identified and referred to the research team by their rehabilitation therapist. They were then informed about the study and screened against the inclusion and exclusion criteria by a trained research assistant. Eligible participants provided written informed consent and identified a mutually agreeable day for data collection. Demographic, clinical, and medical information was gathered from the medical record of consenting participants by the rehabilitation therapist. Collected data included age, sex, ethnicity, date of stroke, type of stroke, side of body most affected, dominant hand prior to stroke, date of admission to the rehabilitation ward, estimated date of discharge, comorbidities, and medications.
On the day of data collection, the participant was fitted with a BuzzNudge wearable device on the wrist of the affected UL. The BuzzNudge is a Bluetooth-enabled wearable device with a 2.3 V coin vibration motor (Precision Microdrives Ltd, Model 310-103), which provided 3 consecutive vibratory stimuli of 0.3 seconds duration at 150 Hz within 1.5 seconds, representing a similar magnitude of stimulus to the vibration of a phone. The researcher explained the value of moving the affected UL after stroke and instructed the participant to “move, try and move, or visualize moving their (affected) arm” following a nudge. The researcher emphasized that the participant should do whatever movement they felt they could manage. If sensation was impaired in the affected UL such that the participant could not feel the haptic nudge, the device was worn on the less affected UL, but the participant was still instructed to use the haptic nudge as a reminder to move the affected UL.
During data collection, participants were followed discreetly out of their field of view around the rehabilitation ward, therapy areas, and hospital facilities by a trained researcher (where feasible). The researcher manually recorded UL movement for 1 minute every 10 minutes [45]. Each minute of observation was broken into 6 epochs of 10 seconds using a silent interval timer. UL movement was classified according to a previously defined taxonomy: (1) unilateral affected UL movement; (2) unilateral unaffected UL movement; (3) bimanual movement, where movement of both ULs was observed to achieve a common task or purpose; (4) bilateral limb movement, where movement of both ULs was observed to achieve independent or unrelated tasks; and (5) no movement [16]. When patients were not able to be directly observed (ie, because curtains were drawn or when in showers or toilets), activity was recorded after conferring with the participant, staff, or family members, as appropriate. In circumstances where the activity could not be estimated (eg, during 4 randomly scheduled observer breaks), activity was coded as unobserved [16,46].
Haptic nudge reminders were triggered by the researcher via Bluetooth immediately before movement observation according to a planned randomization schedule. For half of the observation periods, a haptic nudge was to be provided, and for half, a haptic nudge was not to be provided. Further details regarding the randomization schedule are presented in Multimedia Appendix 1. Haptic nudges were not triggered if the participant was not visible, the participant was asleep, or a nudge was considered inappropriate (eg, if the participant was drinking a hot beverage or undertaking an assessment procedure). Any scheduled nudge that was not given was recorded as a “Missed Nudge.”
Statistical Analysis
Coded data were entered into a Microsoft Excel spreadsheet. Descriptive analysis was used to examine the amount and type of UL movement. If a participant withdrew from the study, their movement observations were coded as missing values, and their scheduled nudges were coded as Missed Nudges. Statistical analysis was performed using mixed logistic regression. Total affected UL movement was collated based on all observations in which the affected UL was moved: total affected UL movement = unilateral affected UL movement + bilateral limb movement + bimanual movement.
In the primary analysis using the intention-to-treat dataset, nudges were represented as a fixed effect factor with two levels: Planned Nudge (ie, Nudge + Missed Nudge) and No Nudge, meaning the analysis considered whether a nudge was planned or not, rather than delivered. The effect of Planned Nudges was evaluated as the ratio of the odds of affected UL movement during the observation period following a Planned Nudge to the odds of affected UL movement during the observation period following No Nudge. More formally, the primary null hypothesis tested with the model was: H0: ORPlanned Nudge/No Nudge = 1.
The sensitivity of the effect of the Planned Nudge to missing values was tested with the pooled effect of 10 worst-case random imputations at the level of the participant with the worst outcomes.
In the secondary analysis using the intention-to-treat dataset, two additional models were used to evaluate the effect of a Planned Nudge on unilateral affected UL movement and the sum of bilateral limb movement + bimanual movement, respectively. A post-hoc exploratory analysis with an instrumental variable approach was used to evaluate the local average treatment effect (also known as complier average causal effect) of the haptic nudge reminder. This analysis considered the effect of the haptic nudge when delivered (Nudged) compared with no haptic nudge (Not Nudged) irrespective of the schedule on total affected UL movement. To explain the variation in UL movement across the day, all models fitted the data with smooth natural splines that had 1 degree of freedom per hour. To account for correlated repeated measures, the models included hierarchical random effects per participant and per hour within participant. Statistical analyses were performed using R version 3.5.1 (R Foundation for Statistical Computing, Vienna, Austria) with lme4 version 1.1-21 [47], splines version 3.5.1 [48], and emmeans version 1.3.4 [39]. The threshold of statistical significance was set at .05. A detailed statistical analysis report containing code snippets and additional graphical representations of data is available in Multimedia Appendix 1.
Results
Participant Characteristics
In total, 20 people consented to participate in this study (Table 1). Participants’ median age was 76 years (IQR 68-83 years), and the median time since stroke was 23.5 days (IQR 8.25-38.25 years); 9 participants had left hemiparesis, 10 had right hemiparesis, and 1 participant had bilateral symptoms with the left UL more affected than the right. Five participants had total anterior circulation syndrome, 10 had partial anterior circulation syndrome, 4 had lacunar circulation syndrome, and 1 had posterior circulation syndrome. Of the participating patients, 4 had hemorrhagic stroke, and 16 had ischemic stroke. Participant 2 was withdrawn from the study when 6 nudges in a row were unable to be delivered due to a technical error. Participant 6 asked to withdraw 20 minutes into data collection due to experiencing anxiety associated with wearing the device.
Table 1.
Participant | Age range (years) | Gender | Stroke classification | Days since stroke | AULa | AUL = dominant ULb | Device worn on AUL |
1 | 70-79 | Male | LACS-Ic | 9 | Left | No | Yes |
2d | 80-89 | Female | TACS-Ie | 39 | Left | No | Yes |
3 | 70-79 | Female | TACS-I | 59 | Left | No | Yes |
4 | 40-49 | Female | LACS-Hf | 8 | Right | Yes | Yes |
5 | 60-69 | Female | PACS-Ig | 5 | Right | Yes | Yes |
6d | 80-89 | Male | PACS-I | 34 | Left | No | Yes |
7 | 70-79 | Male | TACS-I | 27 | Right | Yes | Yes |
8 | 80-89 | Female | PACS-I | 7 | Left | No | Yes |
9 | 80-89 | Male | TACS-I | 67 | Right | Yes | Yes |
10 | 60-69 | Male | PACS-I | 36 | Right | Yes | Yes |
11 | 50-59 | Female | TACS-I | 25 | Left | Yes | Yes |
12 | 70-79 | Male | LACS-H | 33 | Left | No | No |
13 | 80-89 | Male | PACS-I | 12 | Left | No | Yes |
14 | 60-69 | Male | LACS-I | 3 | Right | Yes | No |
15 | 70-79 | Male | PACS-Hh | 40 | Right | Yes | Yes |
16 | 80-89 | Female | PACS-I | 22 | Right | Yes | Yes |
17 | 60-69 | Female | PACS-I | 6 | Left | No | Yes |
18 | 60-69 | Male | POCS-Ii | 10 | Bilateral | Yes | Yes |
19 | 80-89 | Male | PACS-I | 9 | Right | Yes | Yes |
20 | 80-89 | Male | PACS-H | 160 | Right | Yes | Yes |
aAUL: affected upper limb.
bUL: upper limb.
cLACS-I: lacunar circulation syndrome ischemic.
dParticipant withdrawn.
eTACS-I: total anterior circulation syndrome ischemic.
fLACS-H: lacunar circulation syndrome hemorrhagic.
gPACS-I: partial anterior circulation syndrome ischemic.
hPACS-H: partial anterior circulation syndrome hemorrhagic.
iPOCS-I: posterior circulation syndrome ischemic.
Data Completeness
In total, 7517 of a possible 8640 observations of movement in 10-second time intervals were recorded across the 20 participants (median 414 observations/participant, IQR 402-420 observations/participant, range 12-432 observations/participant), representing data completeness of 87.0%. Data loss was due to the 2 participants who withdrew (769/8640 observations, 8.9%) and the remaining participants being away from the service for appointments or involved in private personal hygiene activities (354/8640 observations, 4.1%).
Of the 720 Planned Nudges, 32.6% (235 Nudges) were not delivered (Missed Nudge), with 8.7% (63/720 Nudges) ascribed to the 2 participants that withdrew. For the remaining Missed Nudges, participants were sleeping for 12.6% (90/720) of the Planned Nudges; Nudges could not be directly observed for 6.7% (48/720) of the Planned Nudges; a nudge was deemed inappropriate for 2.8% (20/720) of the Planned Nudges; a technical error prevented nudging for 1.4% (10/720) of the Planned Nudges; and the reason was not stated for 0.4% (3/720) of the Planned Nudges.
UL Movement
During observations without a nudge scheduled (No Nudge), the affected UL moved 19.2% of the time; 15.6% of movement occurred in conjunction with the unaffected UL, and only 3.6% of the time the movement was of the affected UL by itself. The unaffected UL moved 39.2% of the time, with half of this movement (23.6%) being movement of the unaffected UL by itself. Participants used one or both ULs for 42.8% of the observation time.
Haptic Nudge Effect
The results of the statistical analyses are presented in Table 2. The treatment effect of the intervention is represented by the odds ratio (OR) for Planned Nudge versus No Nudge. This OR indicated that the odds of moving the affected UL either independently (unilateral affected UL movement) or in concert with the unaffected limb (bimanual movement or bilateral limb movement) was 1.44 times greater following a Planned Nudge than following No Nudge. The proportions estimated by the model for the affected UL movement (unilateral affected UL movement + bilateral limb movement + bimanual movement) recorded during the observation periods following a Planned Nudge and No Nudge were 26.7% (95% CI 15.4%-42.2%) and 20.2% (95% CI 11.2%-33.6%), respectively. Therefore, the average absolute increase in the proportion of affected UL movement with the intervention was 6.5% (95% CI 4.2%-8.6%), representing an increase of 32.2% in average activity. The sensitivity analysis showed that the effect of the Planned Nudge on unilateral affected UL movement + bilateral limb movement + bimanual movement was robust to missing values (P<.001). The proportion of observation periods with affected UL movement following Planned Nudges and No Nudges by participants is represented in Table 3.
Table 2.
Estimate | Odds ratio | 95% CI | Standard error | Z value | P value | |
Planned nudge/no nudge |
|
|
|
|
|
|
|
Primary analysis: AUa+BiLb+BiMc | 1.44 | 1.28-1.63 | 0.09 | 5.86 | <.001 |
|
Sensitivity analysis: AU+BiL+BiM | 1.30 | 1.16-1.46 | 0.08 | 4.4 | <.001 |
|
Secondary analysis: AU | 2.03 | 1.65-2.51 | 0.22 | 6.65 | <.001 |
|
Secondary analysis: BiL+BiM | 1.13 | 0.99-1.29 | 0.08 | 1.80 | .07 |
Nudged/not nudged |
|
|
|
|
|
|
|
Exploratory analysis: AU+BiL+BiM | 1.64 | 1.42-1.89 | 0.12 | 6.77 | <.001 |
aAU: unilateral affected upper limb movement.
bBiL: bilateral limb movement.
cBiM: bimanual movement.
Table 3.
Participant | No Nudge (%) | Planned Nudge (%) |
1 | 7.41 | 11.11 |
2a | 1.85 | 0.00 |
3 | 26.39 | 30.09 |
4 | 3.24 | 13.89 |
5 | 46.30 | 52.31 |
6a | 3.70 | 0.00 |
7 | 18.06 | 12.96 |
8 | 35.19 | 38.89 |
9 | 1.39 | 5.56 |
10 | 16.67 | 9.26 |
11 | 5.56 | 7.87 |
12 | 6.48 | 0.93 |
13 | 30.09 | 37.96 |
14 | 15.74 | 42.13 |
15 | 20.83 | 39.35 |
16 | 32.87 | 43.98 |
17 | 23.61 | 37.96 |
18 | 38.89 | 24.54 |
19 | 25.93 | 43.06 |
20 | 23.61 | 16.67 |
aParticipant withdrawn.
The secondary analysis revealed that the odds of moving the affected UL independently (unilateral affected UL movement) was 2.03 times greater following a Planned Nudge than following No Nudge. However, the OR for either bilateral or bimanual movement (bilateral limb movement + bimanual movement) was only 1.13 times greater. The exploratory analysis revealed that the OR for the effect of the haptic nudge when delivered (Nudged) compared with no haptic nudge (Not Nudged) irrespective of the schedule was 1.64.
Discussion
Principal Findings
This multiple-period randomized crossover study explored the effect of haptic nudging on UL movement in people with stroke. Haptic nudging increased the likelihood that a person with stroke moved their affected UL by 1.44 times (P<.001) during the subacute rehabilitation phase. Haptic nudging resulted in a relative increase in the proportion of affected UL movement of 32.2%. The actual amount and type of UL movement observed without nudging in our study was comparable with our previously published research [16] and other observational studies [33,46]. This strengthens the assertion that haptic nudges influence the amount of affected UL movement in people with stroke. This study is the first to specifically investigate whether haptic nudges delivered by a wrist-worn wearable device influence the amount of UL movement undertaken during rehabilitation following stroke. Given the limited amount of spontaneous UL movement following stroke [16,46,49] and the challenges associated with increasing the dose of UL rehabilitation [15,50], these research findings indicate that haptic nudging represents a potentially powerful stroke rehabilitation tool that could be easily implemented in clinical practice.
Our secondary analysis clarified the type of UL movement promoted by haptic nudging. Participants were 2.03 times more likely to move their affected UL in isolation (unilateral affected UL movement) following a haptic nudge compared with moving the affected UL in concert with the unaffected UL (bimanual movement + bilateral limb movement), which was just 1.13 times more likely. Given that participants were instructed to move their affected UL rather than both limbs together, the instructions related to haptic nudging may be important in determining exactly which movements are promoted. This specificity in effect has been noted in other studies in which people with stroke altered their behavior in response to feedback. Dobkin and Plummer-D'Amato [51] gave daily feedback in relation to gait speed to people with stroke undertaking rehabilitation. They reported the feedback group had significantly increased gait speed but did not change walking endurance or independence compared with the control group (usual care). Our study contributes to the growing body of research suggesting that drawing attention to specific aspects of movement and physical activity throughout the rehabilitation day can influence patient behavior during stroke rehabilitation [26-31].
The greater odds of moving the affected UL in the minute following a planned nudge resulted in a 32.2% increase in the average amount of movement. Another small-scale proof-of-concept study involving people with stroke (n=7) [30] indicated an increase of 19.7% in the average amount of affected UL movement in the hour following a haptic nudge reminder to undertake exercises. In that study, participants were instructed to perform up to 80 repetitions of task-specific training in response to a haptic nudge, but only received a median of 4 nudges across the rehabilitation day. In contrast, participants in our study received an average of 27 haptic nudges and were instructed to move, try to move, or think about moving their affected UL following a nudge. It is not yet known how the frequency of nudges, burden of the required behavioral response, and capacity to integrate that response into everyday activities influence the magnitude and duration of the haptic nudge effect in people with stroke.
Results for individual participants illustrated that there was considerable variability in response to haptic nudging. For example, 13 participants increased the amount of movement of their affected UL in response to nudging, with 8 exhibiting large relative increases. In contrast, 5 participants had a reduction in the amount of affected UL movement in response to haptic nudging. There appeared to be no relationship between individual response and participant age, stroke severity, hemiplegic side, or whether the hemiplegic side was the dominant hand. Although the researchers checked that the participant understood the instruction to move the affected UL in response to haptic nudging at the beginning of data collection, it remains unclear whether cognitive, communication, perceptual, or sensory deficits influenced participants’ ability to attend and respond to the nudge. Other nudging modalities (eg, auditory tones, lights, and text messaging) may be effective and more appropriate than haptic vibration for some people with stroke [52]. In addition, we relied on observation of movement, and it was not possible to determine whether participants who were more severely affected were attempting to or thinking about moving their affected UL. This could be addressed in future research by using alternative data collection methods such as ecological momentary assessment [53] or electroencephalography to determine movement intention [54]. One participant who had moved less in response to haptic nudging had a cerebellar stroke that influenced UL movement bilaterally; advocating increased movement of the more affected limb might have been inappropriate in that case. The relationship between haptic nudge efficacy and clinical and demographic factors requires further investigation to ensure that this type of technology is used appropriately.
The magnitude of effect in response to haptic nudging might have been underestimated in our study given that we included observations in which planned nudges were not delivered (Missed Nudges), for example, when a participant was asleep or not visible to the researcher. This assertion was supported by the exploratory analysis that revealed the OR for the effect of the scheduled nudge when actually delivered compared with no haptic nudge was 1.64. It is also noteworthy that our participants were advised of the value of moving the affected UL after stroke on a single occasion. The effect of haptic nudging may be enhanced by providing regular positively framed information on the consequences of nudged behavior (eg, “more movement promotes recovery”), encouraging explicit action planning (eg, “I will move my affected arm by…when I feel the nudge”), repeated practice of the desired behavioral response to the haptic nudge, and tracking and reporting the desired behavior [35,55,56]. In commercial wearable devices, haptic nudging is commonly coupled with other behavior change and persuasive strategies including education, gamification, social support via social network services, and reward systems [56,57]. It is likely that the magnitude of effect of a comprehensive rehabilitation wearable technology that incorporates haptic nudging with other behavioral change and persuasive strategies would have a larger effect than the effect of haptic nudging alone, as estimated in this study [35,58,59].
This study sought to investigate the effect of haptic nudging on UL movement across an inpatient rehabilitation day; we did not explore the effect on UL movement over a longer timeframe or in a community setting. It is possible that people with stroke habituate or become less responsive to haptic nudging with everyday use. Conversely, they may learn to respond to haptic nudging more effectively over time. Understanding the effect over time is important, as increasing the dose of upper limb movement to a therapeutic level through continued engagement over a matter of weeks to months is likely required to promote functional gains. In the subacute phase following stroke, adherence to wearable devices has been reported as high [31,42], although use appears to dwindle over time [42]. This is consistent with studies in healthy community-dwelling people, where half to two-thirds of purchasers continued to use wearable devices 6 months after purchase [35,36]. In healthy populations, uptake and ongoing use of such devices are influenced by personal characteristics, including age, computer self-efficacy, ease of use, usual levels of physical activity, internalization of intention to change, and personality [36,60]. Although wearable devices have been found to be acceptable to people with stroke [61], one of our participants withdrew at the beginning of data collection because wearing the device made him feel anxious. Previous research indicates that the use of wearable technologies may increase anxiety in clinical populations [62,63]. When developing wearable devices to promote physical activity and movement in people with stroke it may be important to consider the personal and clinical characteristics of the intended users, when and where in the continuum of care the device will be used and for how long, and how users’ engagement and adherence can be supported.
Limitations
A key limitation of this study was that the researcher observing and recording movement was also responsible for triggering the nudge and therefore not blinded to the intervention. While the randomization schedule was designed to address lag, where the effect of a nudge influences subsequent movement observation periods (refer to Multimedia Appendix 1), the duration of the nudge effect was unknown and might have influenced subsequent observations. While participants were blinded to the study hypothesis, it is possible that the research protocol, particularly being observed by a researcher, may have influenced the likelihood they moved in response to the haptic nudge. Documentation of the number of potential participants screened and the reasons for exclusion from the study would have helped to interpret the external validity of the study findings. A more detailed evaluation of the included participants’ sensorimotor, perceptual, cognitive, and communication impairments along with measurement of their UL functional abilities may have allowed for a more nuanced interpretation of the effect of haptic nudging in people with different clinical presentations of stroke.
Conclusions
Haptic nudging increased the likelihood that a person with stroke moved their affected UL by 1.44 times. This equated to an increase of 32% in the average amount of affected UL movement. Participants were twice (OR 2.03) as likely to move their affected UL in isolation (unilateral affected UL movement) in response to haptic nudging, compared with movement in conjunction with the unaffected UL (OR 1.13), indicating that the effect of haptic nudging was specific to the behavioral instructions given. Given the limited amount of spontaneous UL movement following stroke and the challenges associated with increasing the dose of UL rehabilitation, haptic nudging as part of a comprehensive wearable device aimed at increasing the dose of UL movement represents a potentially powerful stroke rehabilitation tool.
Acknowledgments
This research was funded by a grant from the New Zealand Medical Technologies Centre of Research Excellence. The authors are grateful to the Waitemata District Health Board and the staff of the rehabilitation service at Waitakere Hospital who supported this research. Simon Tse, Rohil Chauhan, Shikha Chaudhary, Abdallah Abou El Ela, and Nicole Wallen contributed to data collection.
Abbreviations
- AU
unilateral affected upper limb movement.
- AUL
affected upper limb.
- BiL
bilateral limb movement.
- BiM
bimanual movement.
- LACS-H
lacunar circulation syndrome hemorrhagic.
- LACS-I
lacunar circulation syndrome ischemic.
- OR
odds ratio.
- PACS-H
partial anterior circulation syndrome hemorrhagic.
- PACS-I
partial anterior circulation syndrome ischemic.
- POCS-I
posterior circulation syndrome ischemic.
- TACS-I
total anterior circulation syndrome ischemic.
- UL
upper limb.
Appendix
Statistical analysis for the haptic nudge study.
Footnotes
Authors' Contributions: NS, DT, and MK conceptualized the study and acquired funding. DT, AV, RM, and NS designed the methodology, and RM, DT, and NS performed project administration. RM and JH collected the data, and MK and FA were responsible for the technology. Data analysis was performed by UR and AV, and UR created the visualizations. Supervision was performed by NS and DT. The original draft was written by NS, RM, and UR, and all authors reviewed and edited the manuscript.
Conflicts of Interest: None declared.
References
- 1.Yu A, Kapral MK. More people are surviving after acute stroke. BMJ. 2019 May 22;365:l2150. doi: 10.1136/bmj.l2150. http://www.bmj.com/cgi/pmidlookup?view=long&pmid=31122927. [DOI] [Google Scholar]
- 2.Dewilde S, Annemans L, Peeters A, Hemelsoet D, Vandermeeren Y, Desfontaines P, Brouns R, Vanhooren G, Cras P, Michielsens B, Redondo P, Thijs V. Modified Rankin scale as a determinant of direct medical costs after stroke. Int J Stroke. 2017 Jun 06;12(4):392–400. doi: 10.1177/1747493017691984. [DOI] [PubMed] [Google Scholar]
- 3.Mittmann N, Seung SJ, Hill MD, Phillips SJ, Hachinski V, Coté R, Buck BH, Mackey A, Gladstone DJ, Howse DC, Shuaib A, Sharma M. Impact of Disability Status on Ischemic Stroke Costs in Canada in the First Year. Can. J. Neurol. Sci. 2014 Dec 02;39(6):793–800. doi: 10.1017/s0317167100015638. [DOI] [PubMed] [Google Scholar]
- 4.Kwakkel G, van Peppen R, Wagenaar RC, Wood Dauphinee S, Richards C, Ashburn A, Miller K, Lincoln N, Partridge C, Wellwood I, Langhorne P. Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke. 2004 Nov;35(11):2529–39. doi: 10.1161/01.STR.0000143153.76460.7d. [DOI] [PubMed] [Google Scholar]
- 5.Houwink A, Nijland RH, Geurts AC, Kwakkel G. Functional recovery of the paretic upper limb after stroke: who regains hand capacity? Arch Phys Med Rehabil. 2013 May;94(5):839–44. doi: 10.1016/j.apmr.2012.11.031. [DOI] [PubMed] [Google Scholar]
- 6.Hendricks HT, van Limbeek J, Geurts AC, Zwarts MJ. Motor recovery after stroke: A systematic review of the literature. Archives of Physical Medicine and Rehabilitation. 2002 Nov;83(11):1629–1637. doi: 10.1053/apmr.2002.35473. [DOI] [PubMed] [Google Scholar]
- 7.Morris JH, van Wijck F, Joice S, Donaghy M. Predicting health related quality of life 6 months after stroke: the role of anxiety and upper limb dysfunction. Disabil Rehabil. 2013 Feb;35(4):291–9. doi: 10.3109/09638288.2012.691942. [DOI] [PubMed] [Google Scholar]
- 8.Wang YC, Kapellusch J, Garg A. Important factors influencing the return to work after stroke. Work. 2014;47(4):553–9. doi: 10.3233/WOR-131627. [DOI] [PubMed] [Google Scholar]
- 9.Frank M, Conzelmann M, Engelter S. Prediction of Discharge Destination after Neurological Rehabilitation in Stroke Patients. Eur Neurol. 2010;63(4):227–233. doi: 10.1159/000279491. [DOI] [PubMed] [Google Scholar]
- 10.Faria-Fortini I, Michaelsen SM, Cassiano JG, Teixeira-Salmela LF. Upper Extremity Function in Stroke Subjects: Relationships between the International Classification of Functioning, Disability, and Health Domains. Journal of Hand Therapy. 2011 Jul;24(3):257–265. doi: 10.1016/j.jht.2011.01.002. [DOI] [PubMed] [Google Scholar]
- 11.Veerbeek JM, van Wegen E, van Peppen R, van der Wees PJ, Hendriks E, Rietberg M, Kwakkel G. What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PLoS One. 2014 Feb;9(2):e87987. doi: 10.1371/journal.pone.0087987. http://dx.plos.org/10.1371/journal.pone.0087987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Schneider EJ, Lannin NA, Ada L, Schmidt J. Increasing the amount of usual rehabilitation improves activity after stroke: a systematic review. J Physiother. 2016 Oct;62(4):182–7. doi: 10.1016/j.jphys.2016.08.006. https://linkinghub.elsevier.com/retrieve/pii/S1836-9553(16)30056-X. [DOI] [PubMed] [Google Scholar]
- 13.Lohse KR, Lang CE, Boyd LA. Is More Better? Using Metadata to Explore Dose–Response Relationships in Stroke Rehabilitation. Stroke. 2014 Jul;45(7):2053–2058. doi: 10.1161/strokeaha.114.004695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Wattchow KA, McDonnell MN, Hillier SL. Rehabilitation Interventions for Upper Limb Function in the First Four Weeks Following Stroke: A Systematic Review and Meta-Analysis of the Evidence. Archives of Physical Medicine and Rehabilitation. 2018 Feb;99(2):367–382. doi: 10.1016/j.apmr.2017.06.014. [DOI] [PubMed] [Google Scholar]
- 15.Hayward KS, Brauer SG. Dose of arm activity training during acute and subacute rehabilitation post stroke: a systematic review of the literature. Clin Rehabil. 2015 Dec;29(12):1234–43. doi: 10.1177/0269215514565395. [DOI] [PubMed] [Google Scholar]
- 16.McLaren R, Signal N, Lord S, Taylor S, Henderson J, Taylor D. The volume and timing of upper limb movement in acute stroke rehabilitation: still room for improvement. Disability and Rehabilitation. 2019 Apr 05;:1–6. doi: 10.1080/09638288.2019.1590471. [DOI] [PubMed] [Google Scholar]
- 17.Crosbie JH, McNeill MDJ, Burke J, McDonough S. Utilising technology for rehabilitation of the upper limb following stroke: the Ulster experience. Physical Therapy Reviews. 2013 Jul 19;14(5):336–347. doi: 10.1179/108331909x12540993897892. [DOI] [Google Scholar]
- 18.Langan J, Subryan H, Nwogu I, Cavuoto L. Reported use of technology in stroke rehabilitation by physical and occupational therapists. Disability and Rehabilitation: Assistive Technology. 2017 Aug 16;13(7):641–647. doi: 10.1080/17483107.2017.1362043. [DOI] [PubMed] [Google Scholar]
- 19.Lam MY, Tatla SK, Lohse KR, Shirzad N, Hoens AM, Miller KJ, Holsti L, Virji-Babul N, Van der Loos HFM. Perceptions of Technology and Its Use for Therapeutic Application for Individuals With Hemiparesis: Findings From Adult and Pediatric Focus Groups. JMIR Rehabil Assist Technol. 2015 Feb 10;2(1):e1. doi: 10.2196/rehab.3484. https://rehab.jmir.org/2015/1/e1/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Aminov A, Rogers JM, Middleton S, Caeyenberghs K, Wilson PH. What do randomized controlled trials say about virtual rehabilitation in stroke? A systematic literature review and meta-analysis of upper-limb and cognitive outcomes. J NeuroEngineering Rehabil. 2018 Mar 27;15(1) doi: 10.1186/s12984-018-0370-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Veerbeek JM, Langbroek-Amersfoort AC, van Wegen EEH, Meskers CGM, Kwakkel G. Effects of Robot-Assisted Therapy for the Upper Limb After Stroke. Neurorehabil Neural Repair. 2016 Sep 24;31(2):107–121. doi: 10.1177/1545968316666957. [DOI] [PubMed] [Google Scholar]
- 22.Chen CC, Bode RK. Factors Influencing Therapists' Decision-Making in the Acceptance of New Technology Devices in Stroke Rehabilitation. American Journal of Physical Medicine & Rehabilitation. 2011;90(5):415–425. doi: 10.1097/phm.0b013e318214f5d8. [DOI] [PubMed] [Google Scholar]
- 23.Scott K, Signal N, Taylor D, Kayes N. Clinician's perspectives on what influences uptake of new technologies into rehabilitation practice. Design4Health; 5th International Conference on Design4Health; 4th-6th September 2018; Sheffield, England. 2018. https://research.shu.ac.uk/design4health/wp-content/uploads/2018/09/664.pdf. [Google Scholar]
- 24.Lemke M, Rodríguez Ramírez E, Robinson B, Signal N. Motivators and barriers to using information and communication technology in everyday life following stroke: a qualitative and video observation study. Disabil Rehabil. 2019 Jan 27;:1–9. doi: 10.1080/09638288.2018.1543460. [DOI] [PubMed] [Google Scholar]
- 25.Seo NJ, Arun KJ, Hur P, Crocher V, Motawar B, Lakshminarayanan K. Usability evaluation of low-cost virtual reality hand and arm rehabilitation games. J Rehabil Res Dev. 2016;53(3):321–34. doi: 10.1682/JRRD.2015.03.0045. http://www.rehab.research.va.gov/jour/2016/533/pdf/JRRD-2015-03-0045.pdf. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kanai M, Izawa KP, Kobayashi M, Onishi A, Kubo H, Nozoe M, Mase K, Shimada S. Effect of accelerometer-based feedback on physical activity in hospitalized patients with ischemic stroke: a randomized controlled trial. Clin Rehabil. 2018 Feb 05;32(8):1047–1056. doi: 10.1177/0269215518755841. [DOI] [PubMed] [Google Scholar]
- 27.Grau-Pellicer M, Lalanza J, Jovell-Fernández E, Capdevila L. Impact of mHealth technology on adherence to healthy PA after stroke: a randomized study. Topics in Stroke Rehabilitation. 2019 Dec 02;27(5):354–368. doi: 10.1080/10749357.2019.1691816. [DOI] [PubMed] [Google Scholar]
- 28.Atkins A, Cannell J, Barr C. Pedometers alone do not increase mobility in inpatient rehabilitation: a randomized controlled trial. Clin Rehabil. 2019 Apr 08;33(8):1382–1390. doi: 10.1177/0269215519838312. [DOI] [PubMed] [Google Scholar]
- 29.Hassett L, van den Berg M, Lindley RI, Crotty M, McCluskey A, van der Ploeg HP, Smith ST, Schurr K, Howard K, Hackett ML, Killington M, Bongers B, Togher L, Treacy D, Dorsch S, Wong S, Scrivener K, Chagpar S, Weber H, Pinheiro M, Heritier S, Sherrington C. Digitally enabled aged care and neurological rehabilitation to enhance outcomes with Activity and MObility UsiNg Technology (AMOUNT) in Australia: A randomised controlled trial. PLoS Med. 2020 Feb 18;17(2):e1003029. doi: 10.1371/journal.pmed.1003029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Da-Silva RH, van Wijck F, Shaw L, Rodgers H, Balaam M, Brkic L, Ploetz T, Jackson D, Ladha K, Price CI. Prompting arm activity after stroke: A clinical proof of concept study of wrist-worn accelerometers with a vibrating alert function. J Rehabil Assist Technol Eng. 2018;5:2055668318761524. doi: 10.1177/2055668318761524. http://europepmc.org/abstract/MED/31191927. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Da-Silva RH, Moore SA, Rodgers H, Shaw L, Sutcliffe L, van Wijck F, Price CI. Wristband Accelerometers to motiVate arm Exercises after Stroke (WAVES): a pilot randomized controlled trial. Clin Rehabil. 2019 Mar 07;33(8):1391–1403. doi: 10.1177/0269215519834720. [DOI] [PubMed] [Google Scholar]
- 32.Wei WXJ, Fong KNK, Chung RCK, Myint JMWW, Cheung HKY, Chow ESL. Utility of a unilateral accelerometer for monitoring upper extremity use in subacute stroke patients after discharge from hospital. Assistive Technology. 2018 Jan 25;31(4):193–198. doi: 10.1080/10400435.2017.1414085. [DOI] [PubMed] [Google Scholar]
- 33.Chin LF, Hayward KS, Soh AJA, Tan CM, Wong CJR, Loh JW, Loke GJH, Brauer S. An accelerometry and observational study to quantify upper limb use after stroke during inpatient rehabilitation. Physiother Res Int. 2019 May 16;24(4) doi: 10.1002/pri.1784. [DOI] [PubMed] [Google Scholar]
- 34.Parker J, Powell L, Heller B, Schweiss E, Mawson S. Upper limb activity in chronic post-stroke survivors: A comparison of accelerometry data with the Action Research Arm Test (ARAT) Annals of Physical and Rehabilitation Medicine. 2018 Jul;61:e187. doi: 10.1016/j.rehab.2018.05.430. [DOI] [Google Scholar]
- 35.Sullivan AN, Lachman ME. Behavior Change with Fitness Technology in Sedentary Adults: A Review of the Evidence for Increasing Physical Activity. Front Public Health. 2016;4:289. doi: 10.3389/fpubh.2016.00289. doi: 10.3389/fpubh.2016.00289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Rupp MA, Michaelis JR, McConnell DS, Smither JA. The role of individual differences on perceptions of wearable fitness device trust, usability, and motivational impact. Applied Ergonomics. 2018 Jul;70:77–87. doi: 10.1016/j.apergo.2018.02.005. [DOI] [PubMed] [Google Scholar]
- 37.Lyons EJ, Swartz MC, Lewis ZH, Martinez E, Jennings K. Feasibility and Acceptability of a Wearable Technology Physical Activity Intervention With Telephone Counseling for Mid-Aged and Older Adults: A Randomized Controlled Pilot Trial. JMIR Mhealth Uhealth. 2017 Mar 06;5(3):e28. doi: 10.2196/mhealth.6967. http://mhealth.jmir.org/2017/3/e28/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Orme MW, Weedon AE, Saukko PM, Esliger DW, Morgan MD, Steiner MC, Downey JW, Sherar LB, Singh SJ. Findings of the Chronic Obstructive Pulmonary Disease-Sitting and Exacerbations Trial (COPD-SEAT) in Reducing Sedentary Time Using Wearable and Mobile Technologies With Educational Support: Randomized Controlled Feasibility Trial. JMIR Mhealth Uhealth. 2018 Apr 11;6(4):e84. doi: 10.2196/mhealth.9398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Sloan RA, Kim Y, Sahasranaman A, Müller-Riemenschneider F, Biddle SJH, Finkelstein EA. The influence of a consumer-wearable activity tracker on sedentary time and prolonged sedentary bouts: secondary analysis of a randomized controlled trial. BMC Res Notes. 2018 Mar 22;11(1) doi: 10.1186/s13104-018-3306-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Finn L, Ramasamy R, Dukes C, Scott J. Using WatchMinder to Increase the On-Task Behavior of Students with Autism Spectrum Disorder. J Autism Dev Disord. 2015 May;45(5):1408–18. doi: 10.1007/s10803-014-2300-x. [DOI] [PubMed] [Google Scholar]
- 41.Dvorkin AY, Ramaiya M, Larson EB, Zollman FS, Hsu N, Pacini S, Shah A, Patton JL. A “virtually minimal” visuo-haptic training of attention in severe traumatic brain injury. J NeuroEngineering Rehabil. 2013;10(1):92. doi: 10.1186/1743-0003-10-92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Ezeugwu VE, Manns PJ. The Feasibility and Longitudinal Effects of a Home-Based Sedentary Behavior Change Intervention After Stroke. Archives of Physical Medicine and Rehabilitation. 2018 Dec;99(12):2540–2547. doi: 10.1016/j.apmr.2018.06.014. [DOI] [PubMed] [Google Scholar]
- 43.Fong KNK, Yang NYH, Chan MKL, Chan DYL, Lau AFC, Chan DYW, Cheung JTY, Cheung HKY, Chung RCK, Chan CCH. Combined effects of sensory cueing and limb activation on unilateral neglect in subacute left hemiplegic stroke patients: a randomized controlled pilot study. Clin Rehabil. 2013 Jul;27(7):628–37. doi: 10.1177/0269215512471959. [DOI] [PubMed] [Google Scholar]
- 44.Bamford J, Sandercock P, Dennis M, Warlow C, Burn J. Classification and natural history of clinically identifiable subtypes of cerebral infarction. The Lancet. 1991 Jun;337(8756):1521–1526. doi: 10.1016/0140-6736(91)93206-o. [DOI] [PubMed] [Google Scholar]
- 45.Bernhardt J, Chan J, Nicola I, Collier JM. Little therapy, little physical activity: rehabilitation within the first 14 days of organized stroke unit care. J Rehabil Med. 2007 Jan;39(1):43–8. doi: 10.2340/16501977-0013. https://www.medicaljournals.se/jrm/content/abstract/10.2340/16501977-0013. [DOI] [PubMed] [Google Scholar]
- 46.Bernhardt J, Chitravas N, Meslo IL, Thrift AG, Indredavik B. Not all stroke units are the same: a comparison of physical activity patterns in Melbourne, Australia, and Trondheim, Norway. Stroke. 2008 Jul;39(7):2059–65. doi: 10.1161/STROKEAHA.107.507160. [DOI] [PubMed] [Google Scholar]
- 47.Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using. J. Stat. Soft. 2015;67(1) doi: 10.18637/jss.v067.i01. [DOI] [Google Scholar]
- 48.R Core Team . R Foundation for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2013. R: A language and environment for statistical computing. [Google Scholar]
- 49.Hayward KS, Eng JJ, Boyd LA, Lakhani B, Bernhardt J, Lang CE. Exploring the Role of Accelerometers in the Measurement of Real World Upper-Limb Use After Stroke. Brain Impairment. 2015 Nov 10;17(1):16–33. doi: 10.1017/brimp.2015.21. [DOI] [Google Scholar]
- 50.Bayley MT, Hurdowar A, Richards CL, Korner-Bitensky N, Wood-Dauphinee S, Eng JJ, McKay-Lyons M, Harrison E, Teasell R, Harrison M, Graham ID. Barriers to implementation of stroke rehabilitation evidence: findings from a multi-site pilot project. Disability and Rehabilitation. 2012 May 28;34(19):1633–1638. doi: 10.3109/09638288.2012.656790. [DOI] [PubMed] [Google Scholar]
- 51.Dobkin BH, Plummer-D'Amato P, Elashoff R, Lee J, SIRROWS Group International randomized clinical trial, stroke inpatient rehabilitation with reinforcement of walking speed (SIRROWS), improves outcomes. Neurorehabil Neural Repair. 2010;24(3):235–42. doi: 10.1177/1545968309357558. http://europepmc.org/abstract/MED/20164411. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Wang Q, Markopoulos P, Yu B, Chen W, Timmermans A. Interactive wearable systems for upper body rehabilitation: a systematic review. J Neuroeng Rehabil. 2017 Dec 11;14(1):20. doi: 10.1186/s12984-017-0229-y. https://jneuroengrehab.biomedcentral.com/articles/10.1186/s12984-017-0229-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Dunton GF. Ecological Momentary Assessment in Physical Activity Research. Exerc Sport Sci Rev. 2017 Dec;45(1):48–54. doi: 10.1249/JES.0000000000000092. http://europepmc.org/abstract/MED/27741022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Jochumsen M, Rovsing C, Rovsing H, Cremoux S, Signal N, Allen K, Taylor D, Niazi IK. Quantification of Movement-Related EEG Correlates Associated with Motor Training: A Study on Movement-Related Cortical Potentials and Sensorimotor Rhythms. Front Hum Neurosci. 2017;11:604. doi: 10.3389/fnhum.2017.00604. doi: 10.3389/fnhum.2017.00604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011 Nov;26(11):1479–98. doi: 10.1080/08870446.2010.540664. [DOI] [PubMed] [Google Scholar]
- 56.Matthews J, Win KT, Oinas-Kukkonen H, Freeman M. Persuasive Technology in Mobile Applications Promoting Physical Activity: a Systematic Review. J Med Syst. 2016 Mar;40(3):72. doi: 10.1007/s10916-015-0425-x. [DOI] [PubMed] [Google Scholar]
- 57.Mercer K, Li M, Giangregorio L, Burns C, Grindrod K. Behavior Change Techniques Present in Wearable Activity Trackers: A Critical Analysis. JMIR Mhealth Uhealth. 2016;4(2):e40. doi: 10.2196/mhealth.4461. http://mhealth.jmir.org/2016/2/e40/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Abedtash H, Holden R. Systematic review of the effectiveness of health-related behavioral interventions using portable activity sensing devices (PASDs) J Am Med Inform Assoc. 2017 Sep 01;24(5):1002–1013. doi: 10.1093/jamia/ocx006. http://europepmc.org/abstract/MED/28339620. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Zhao J, Freeman B, Li M. Can Mobile Phone Apps Influence People's Health Behavior Change? An Evidence Review. J Med Internet Res. 2016 Oct 31;18(11):e287. doi: 10.2196/jmir.5692. http://www.jmir.org/2016/11/e287/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Micallef N, Baillie L, Uzor S. Time to Exercise! An aide memoire stroke app for post stroke arm rehabilitation. Proceedings of 18th International Conference on Human-Computer Interaction with Mobile Devices and Services; 8th International Conference on Human-Computer Interaction with Mobile Devices and Services; 2016; Florence, Italy. 2016. pp. 6–9. [Google Scholar]
- 61.Held JPO, Luft AR, Veerbeek JM. Encouragement-Induced Real-World Upper Limb Use after Stroke by a Tracking and Feedback Device: A Study Protocol for a Multi-Center, Assessor-Blinded, Randomized Controlled Trial. Front. Neurol. 2018 Jan 25;9 doi: 10.3389/fneur.2018.00013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Hartman SJ, Nelson SH, Weiner LS. Patterns of Fitbit Use and Activity Levels Throughout a Physical Activity Intervention: Exploratory Analysis from a Randomized Controlled Trial. JMIR Mhealth Uhealth. 2018 Feb 05;6(2):e29. doi: 10.2196/mhealth.8503. http://mhealth.jmir.org/2018/2/e29/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Kirk MA, Amiri M, Pirbaglou M, Ritvo P. Wearable Technology and Physical Activity Behavior Change in Adults With Chronic Cardiometabolic Disease: A Systematic Review and Meta-Analysis. Am J Health Promot. 2019 Jun;33(5):778–791. doi: 10.1177/0890117118816278. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Statistical analysis for the haptic nudge study.