Abstract
Background
This study investigates the use of an information and communication technology (Elder Tree) designed for older adults and their informal caregivers to improve older adult quality of life and address challenges older adults face in maintaining their independence (for example, loneliness and isolation, falling, managing medications, driving and transportation).
Methods/Design
This study, an unblinded randomized controlled trial, will evaluate the effectiveness and cost of Elder Tree. Older adults who are at risk for losing their independence - along with their informal caregivers, if they name them - are randomized to two groups. The intervention group has access to their usual sources of information and communication as well as to Elder Tree for 18 months while the control group uses only their usual sources of information and communication. The primary outcome of the study is older adult quality of life. Secondary outcomes are cost per Quality-Adjusted Life Year and the impact of the technology on independence, loneliness, falls, medication management, driving and transportation, and caregiver appraisal and mastery. We will also examine the mediating effect of self-determination theory. We will evaluate the effectiveness of Elder Tree by comparing intervention- and control-group participants at baseline and months 6, 12, and 18. We will use mixed-effect models to evaluate the primary and secondary outcomes, where pretest score functions as a covariate, treatment condition is a between-subjects factor, and the multivariate outcome reflects scores for a given assessment at the three time points. Separate analyses will be conducted for each outcome. Cost per Quality-Adjusted Life Year will be compared between the intervention and control groups. Additional analyses will examine the mediating effect of self-determination theory on each outcome.
Discussion
Elder Tree is a multifaceted intervention, making it a challenge to assess which services or combinations of services account for outcomes in which subsets of older adults. If Elder Tree can improve quality of life and reduce healthcare costs among older adults, it could suggest a promising way to ease the burden that advancing age can place on older adults, their families, and the healthcare system.
Trial registration
ClinicalTrials.govNCT02128789. Registered on 26 March 2014.
Electronic supplementary material
The online version of this article (doi:10.1186/s13063-015-0713-2) contains supplementary material, which is available to authorized users.
Keywords: Older adults, Technology, eHealth, Gerontology
Background
Almost 90% of adults over 65 want to live in their homes as long as possible, also referred to as aging in place [1]. Challenges to aging in place include isolation and loneliness [2], falling [3], managing medications [4], and driving and transportation [5]. The cost of falls alone among US adults 65 and older has been estimated at $23.3 billion (in 2008 dollars) annually [6]. Nearly half (46.5%) of adults 65 and older have more than one chronic condition [7], and care for people with multiple chronic conditions accounts for an estimated 95% of Medicare spending [8]. Without innovative interventions, these and other costs are expected to escalate as the proportion of older adults in the population increases. Between 2005 and 2030, the number of US adults aged 65 and older will almost double, from 37 million to more than 70 million [9].
Technology may improve outcomes for older adults [10]. For instance, an eHealth program was effective in promoting health education among frail older people [11], and using the Internet for communication was associated with reduced loneliness [12]. However. few technological systems have been designed specifically for older users [13,14] or rigorously tested for effectiveness [15].
The goal of this study is to test the effects of a technology called Elder Tree designed for and used by older adults and their family caregivers. The primary purpose of Elder Tree, a web-based information and communication technology (ICT), is to improve older adult quality of life.
Methods/Design
Study design and hypotheses
The study is a randomized longitudinal trial conducted by the Active Aging Resource Center (AARC). AARC is a consortium of university, state, and community partners headquartered at the Center for Health Enhancement Systems Studies at the University of Wisconsin- Madison, WI, USA (CHESS). CHESS develops ICTs to help patients and their families improve their health and well-being. Previous CHESS ICTs have been proven effective in numerous randomized trials for a variety of conditions, including alcohol use disorders [16], lung cancer [17,18], pediatric asthma [19], breast cancer [20], and HIV [21]. CHESS also develops process improvement strategies for healthcare systems.
Participants in the study - older adults and their informal caregivers - are randomized to an intervention group that uses their usual sources of information and communication and has access to Elder Tree from laptops and other devices, or to a control group in which participants use only their usual sources of information and communication. Participants in the Elder Tree group receive access to Elder Tree for 18 months and, if needed, a computer and Internet service. The computer is almost always a touchscreen laptop; two participants have been given large monitors because of vision problems. Participants who have their own desktop, laptop, tablet, or smartphone use their own devices. Participants’ use of other services and interventions is not controlled during the trial in either group.
The primary hypothesis is that older adults assigned to Elder Tree will, compared with a control group, have improved quality of life (QOL). Secondary hypotheses are that older adults assigned to Elder Tree will have, compared with those in the control group, improved independence, lower healthcare costs per Quality-Adjusted Life Year (QALY), less loneliness, fewer falls, improved medication management, and greater ease of transportation and driving, and that informal caregivers with access to Elder Tree will have improved caregiver appraisal (reduced burden, increased mastery of caregiving, and increased satisfaction with the older adult receiving care), and improved coping strategies compared with caregivers without Elder Tree. We also hypothesize that self-determination theory (SDT) will mediate Elder Tree effects.
In addition to estimating healthcare costs in both groups, we will estimate the cost of delivering Elder Tree to determine what a governmental entity or other organization would pay to provide Elder Tree on a per-household basis.
Intervention
Elder Tree builds upon ICTs created previously at CHESS for a variety of serious and chronic illnesses (for example, asthma, breast and lung cancer, addiction, and so on) and subjected to many randomized trials [16,18,19,22,23] and field tests [24,25]. Elder Tree has been developed by content experts collaborating with older adults, caregivers, and community and state partners, such as local Aging and Disability Resource Centers and the Wisconsin Bureau of Aging. Information about falls prevention was adapted from the Stepping On falls prevention program, with permission of its authors [26]. See Table 1 for a list of services in Elder Tree.
Table 1.
Purpose of service for user | Challenge being addressed | ||||
---|---|---|---|---|---|
Isolation and loneliness | Driving and transportation | Caregiving | Medication management | Falls prevention | |
Learn | Creating and sharing tips | ||||
Links to resources | |||||
Training to use the site (video tutorials, group training, paper manual) | |||||
Tips from driving coach | Tips from caregiver coach | Tips from diabetes diet coach | Tips from falls coach | ||
Videos for exercise and falls prevention | |||||
Communicate | Discussion groups, photo-sharing | ||||
Family and Friends (a discussion group for only a participant’s invited family and friends. Family and friends do not have access to the rest of Elder Tree) | |||||
Private messages | |||||
Ask a Coach: Elder Tree has four: a driving coach, caregiver support coach, diabetes diet coach, and falls prevention coach | |||||
Bulletin Board (a place where users post recipes, announcements of local events, and other information) | |||||
Self-assess | During setup: personal assets and needs | ||||
For ongoing use: My Health Tracker and My Services. ‘My Health Tracker’ has 18 health measures (weight, blood pressure, quality of sleep, falls, and so on). Users choose which (if any) to track and how frequently they will respond to questions about the measures they select. The user sees results over time reported in graphic displays. In ‘My Services’, participants enter in-home services they receive. Then they get reminders about upcoming services and satisfaction surveys to complete, results of which users can track over time | |||||
Use tools | Links to games | ||||
To-do list with reminders | |||||
Challenges from coaches to try healthy behaviors (for example, strength exercises) | |||||
Route planner |
The design of the Elder Tree interface and the services available in the system have been developed by working closely with hundreds of older adults. We learned from older adults the importance of enabling them to help one another (and not just receive help), keeping the technology safe from scams, having a simple interface that does not require computer savvy, and helping participants find community resources. From the many focus groups, interviews, and other interactions we had and continue to have with older adults, we have also learned how pervasive isolation and loneliness are. (Perhaps not surprisingly, the discussion groups have been the most heavily used service to date in the randomized trial of Elder Tree).
Members of the research team visit participants in their homes to set up and train them in Elder Tree. Researchers help each new participant - older adult and caregiver, if the older adult has named a caregiver - create an Elder Tree profile, which includes such information as interests and activities, ZIP code, and chronic conditions. Some of the information is used to tailor Elder Tree services to each user. For example, a user who is diabetic will receive tips and information from the diabetes diet coach and be invited to take part in a discussion group for participants who have diabetes. Use of Elder Tree is monitored. If an older adult or caregiver changes his or her pattern of using the system or stops using the system entirely after having participated, members of the research team call to find out if any system problems or other solvable issues are preventing their participation. The county coordinator -a grant-funded member of the research team who works in each of the 3 areas where the study is being conducted - calls a participant 1 week after the in-home training to answer questions or solve problems that may have arisen in using the system. Guidelines for the appropriate use of the technology are posted within Elder Tree. Participants whose use is inappropriate (for example, abusive to other participants in online discussion groups) are warned and, if necessary, discontinued. To date (11 February 2015), no participant has been discontinued.
Theoretical foundation
Elder Tree rests on the foundation of SDT, like previous CHESS ICTs [27]. SDT holds that three basic psychological needs must be satisfied to foster well-being: autonomy, competence, and relatedness [28]. Elder Tree services have been designed to: (1) provide older adults with a sense of control over their situation (enhancing autonomy), (2) empower older adults and caregivers through information and skills training (enhancing competence), and (3) increase social support through links to other older adults and to experts (enhancing relatedness). Many services within Elder Tree relate to multiple SDT constructs (that is, acquiring information about preventing falls may improve both a participant’s competence and autonomy). According to SDT, healthcare contexts that support patients’ psychological needs for autonomy, competence, and relatedness will improve older adult QOL (older adults will have better physical and mental health) [29].
In evaluating past ICTs, we have also explored a more specific idea, connected to the relatedness construct in SDT, to explain a system’s effects. Receiving and, most importantly, expressing emotional content in online discussion groups have been shown to be associated with better outcomes [30-33]. We will also examine this outcome among Elder Tree participants.
Ethics
The study received approval from the education and social/behavioral science institutional review board at the University of Wisconsin-Madison (reference number 2013–0171) and is registered at Clinical Trials.gov (NCT02128789). The study complies with the relevant Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) statement and World Health Organization (WHO) checklist (see Additional file 1). The study is funded by the United States Department of Health and Human Services Agency for Healthcare Research and Quality.
Participants
Participants in the randomized trial are adults age 65 and older and their informal caregivers (spouses, children, or others who provide physical, emotional, and/or financial support for the older adult). Participants are being recruited from three regions in Wisconsin: urban Milwaukee County, suburban Waukesha County, and rural Richland, Juneau, and Sauk Counties. See Table 2 for inclusion and exclusion criteria. Inclusion criteria for older adults were selected because they represent risk factors for nursing home admission [34-37].
Table 2.
Older adults | |
---|---|
Inclusion | • Age 65 or older |
criteria | • Live in one of three Wisconsin regions: Milwaukee County; Waukesha County; or Richland, Juneau, or Sauk Counties |
• In the last 12 months, has experienced one or more of the following: | |
○ Fallen once or more | |
○ Felt sad or depressed | |
○ Received home-health services | |
○ Stayed in a skilled nursing facility | |
○ Gone to the emergency room | |
○ Been admitted to the hospital | |
Exclusion criteria | • Is currently homeless or living in a hospice center, assisted living facility without access to a stove, or nursing home |
• Needs help getting into or out of a bed or a chair | |
Informal caregivers | |
Inclusion criteria | • Age 18 or older |
• Provide physical, emotional, and/or financial support to the older adult | |
• Be named by the older adult as a caregiver | |
Exclusion criteria | • Being cognitively impaired, as determined by the recruiter’s observation (for example, inability to answer questions or track the conversation) |
Both older adults and informal caregivers | |
Inclusion criteria | • Understand the consent form, which is in English |
Exclusion criteria | • Being unable to give informed consent |
• Being unable to use Elder Tree (for example, poor vision that prevents reading a computer screen) |
We changed our recruitment criteria from our original plans based on results of a pilot test. Originally, we planned to recruit older adults who had had, in the last 12 months, three of the bulleted inclusion criteria shown in Table 2, but these criteria proved to be too restrictive (that is, to eliminate potential participants who would likely benefit from Elder Tree) and, according to the county coordinators who did the screening, so time-consuming to evaluate and invasive of subjects’ privacy that they drove away potential participants. We have settled on recruiting patients who have one or more of the inclusion criteria.
Recruitment
Each of the three regions in the study is served by an Aging and Disability Resource Center (ADRC). ADRCs are state funded, single- or multi-county agencies in Wisconsin that connect older people and people with disabilities to information, assistance, and counseling. A county coordinator works out of each local ADRC office to recruit potential participants for the study. The county coordinators raise awareness and interest among older adults by giving presentations about the study in neighborhood centers, churches, clubs, congregate eating facilities, and other places. The county coordinators explain the study and the eligibility criteria and ask attendees to provide their contact information. To encourage older adults to provide their names, the coordinators offer a drawing at the end of a presentation in which one of the slips of paper with contact information will be drawn to receive a $10 gift certificate to a local restaurant. Older adults and caregivers who contact an ADRC are also encouraged to participate.
Older adults who provide their contact information are called to confirm eligibility. If the older adult is eligible (and the informal caregiver, if the older adult names an informal caregiver who is also eligible), the county coordinator sends the baseline survey in the mail and sets up a time for a home visit. During the home visit, the county coordinator explains consent and obtains the completed consent form (see the forms in Additional files 2 and 3) and baseline survey from the older adult (and caregiver, if there is one). To date (31 March 2015), we have recruited 392 older adult participants to the study. We plan to recruit 450 participants. Figure 1 shows the flow of participants through the trial.
Randomization
The project statistician used a computer-generated allocation sequence to randomize eligible older adults (or older adult/caregiver dyads) in a 1:1 ratio to intervention (Elder Tree) or control. Randomization is stratified by geographic region, whether a participant has his or her own computer or other device, and living alone, using random blocks of 4 and 6. Randomization is implemented by the project director using sequentially numbered, sealed, opaque envelopes. The sequence is thus unknown to the county coordinators who enroll participants. Because of the nature of the intervention, neither participants nor research staff are blinded to allocation.
Measures and data collection
Our assessment battery consists of instruments with established reliability and validity. Survey measures were chosen based on our theoretical model, SDT. We also sought measures with an easy reading level. Surveys are identified by a code, not a name, and mailed to participants. The form linking codes and names is kept in REDCap (Research Electronic Data Capture) [38]. REDCap is a secure, web-based application designed to support data management for research. Data are stored in REDCap; data management procedures are described the code book. Table 3 summarizes the variables and measures we are using, their evaluation schedule, and item-response burden.
Table 3.
Outcome measures | |||||||||
---|---|---|---|---|---|---|---|---|---|
Construct/Associated Hypothesis a | Instrument | Burden | When | Who | |||||
S | B | 6 | 12 | 18 | |||||
Primary outcome: | |||||||||
Quality of life: Global Mental Health and Global Physical Health/1 | PROMIS Global Health [39] | 10 | X | X | X | X | OA | ||
CG | |||||||||
Secondary outcomes: | |||||||||
Independence: Activities of Daily Living (ADLs) and Instrumental Activities of Daily Living (IADLs)/2 | Getting to places outside the home, moving/walking around the home, taking your medications, planning and preparing meals, bathing and using the toilet, dealing with finances [53-55] | 6 | X | X | X | X | OA | ||
Cost per Quality-Adjusted | QALY: PROMIS Global Health converted to QALYs using EuroQol-5D (EQ-5D) [40] | 0 | X | X | X | X | OA | ||
CG | |||||||||
Life Year (QALY)/3 | |||||||||
Intervention cost: modified DATCAP [41] | 0 | X | X | OA | |||||
CG | |||||||||
Healthcare utilization: patient survey using modified medical services utilization form [43] | 6 | X | X | X | X | OA | |||
CG | |||||||||
Loneliness/4 | UCLA Loneliness Scale (Version 3) [56] | 20 | X | X | X | X | OA | ||
CG | |||||||||
Falls/5 | Recent falls: # of falls; # requiring medical attention | 2 | X | X | X | X | OA | ||
Falls risk: Falls Behavioral Scale for the Older Person (FaB) (modified) [57] | 15 | X | X | X | X | ||||
Medication management/6 | Presence of risky medication: status of taking blood thinners, insulin, or oral medications for high blood sugar or diabetes [58] | 3 | X | X | X | X | OA | ||
Medication adherence: to what extent would you estimate that you take your medication doses? | 1 | X | X | X | X | ||||
Medication side effects: presence or absence of common side effects of antiplatelets/anticoagulants and insulin/oral hypoglycemics [59] | 18 | X | X | X | X | ||||
Ease of driving and transportation/7 | Ease of/comfort with transportation; # of crashes and near-misses | 7 to 12 | X | X | X | X | OA | ||
Caregiver appraisal, burden, satisfaction with relationship, and mastery/8 | Lawton Caregiving Appraisal Scale [60] | 19 | X | X | X | X | CG | ||
Caregiver coping: wishfulness, acceptance, intra-psychic, instrumental/9 | Caregiver Coping Strategies [61] | 16 | X | X | X | X | CG | ||
Mediators: three constructs of self-determination theory | Autonomy: Survey: How well do you carry out social activities and roles; do you currently drive? Elder Tree use data: # and extent of services used. | 2 | X | X | X | X | OA | ||
CG | |||||||||
Competence: Survey: To what extent can you carry out everyday activities; IADLs, comfort with technologies)? Elder Tree use data: # of informational pages and tips viewed. | 3 | X | X | X | X | OA | |||
CG | |||||||||
Relatedness: Survey: selected items from the MOS Social Support Survey (MOS-SS) (modified) [62] related to how often someone is there to provide support to and receive support from you, plus how often you have participated in a health or medical support group or social club or group? Elder Tree use data: # of emotionally supportive messages posted and read | 17 | X | X | X | X | OA | |||
CG | |||||||||
Other measures | |||||||||
Construct | Instrument | Burden | When | Who | |||||
S | B | 6 | 12 | 18 | |||||
Depression | Patient Health Questionnaire (PHQ-8) [63] | 8 | X | X | X | X | OA | ||
CG | |||||||||
Living arrangement | Setting (for example, own home/apartment); live alone or not [34] | 2 | X | X | X | X | X | OA | |
Elder Tree system use | Server log files: pages, minutes, services, engagement, patterns, comments, and so on | 0 | Constantly while participants use Elder Tree. | OA | |||||
CG | |||||||||
Comfort with technology | Smartphone/tablet; desktop/laptop computer; Email; Facebook | 4 | X | X | X | X | OA | ||
CG | |||||||||
Physical limitations to technology use | Auditory, visual, motor, other | 1 | X | X | X | X | OA | ||
Measures related to other challenges | |||||||||
Challenge | Construct | Instrument | Burden | When | Who | ||||
S | B | 6 | 12 | 18 | |||||
Social con-nectedness | Online bonding | CHESS Bonding Scale | 4 | X | X | X | X | OA | |
CG | |||||||||
Size of social network | # of people to listen to you, to whom you listen, from whom you get help, show love, get together to do something enjoyable | 5 | X | X | X | X | OA | ||
Other support | Types of therapy or support groups | 6 | X | X | X | X | OA | ||
CG | |||||||||
Service delivery | Satisfaction with service delivery | Showering/bathing/grooming; in-home meal prep or Meals on Wheels; toileting and incontinence; medical support services | 4 | X | X | X | X | OA | |
CG |
aHypotheses: compared with the control group, at 6, 12, and 18 months, those randomized to Elder Tree will experience:
1. Improved quality of life (older adults).
2. Improved independence (older adults).
3. Lower healthcare cost per QALY (older adults).
4. Less loneliness (older adults).
5. Fewer falls (older adults).
6. Improved medication management (older adults).
7. Greater ease of transportation and driving (older adults).
8. Improved caregiver appraisal (caregivers).
9. Increased coping strategies (caregivers).
Mediation hypothesis: SDT (autonomy, competence, relatedness) will mediate the effects of Elder Tree on older adult outcomes.
S, screening; B, baseline; OA, older adult; CG, caregiver.
CHESS, Center for Health Enhancement Systems Studies at the University of Wisconsin-Madison, WI, USA; DATCAP, Drug Abuse Treatment Cost Analysis Program; MOS; Medical Outcomes Study; PROMIS, Patient-Reported Outcomes Measurement Information System.
We are also collecting data on the server about how participants use Elder Tree. We use this information to monitor the functioning of the website - for example, see if the website has problems. These use data also will be analyzed after the randomized trial to explore such questions as whether participants who used Elder Tree the most had better outcomes.
Measures related to QOL
The primary outcome of older adult quality of life is measured using the Patient-Reported Outcomes Measurement Information System (PROMIS) Global Health scale, a 10-item subjective measure of general health [39]. It includes a 4-item global physical health scale (Cronbach’s α = 0.81), a 4-item global mental health scale (Cronbach’s α = 0.86), and 2 additional items - general health and satisfaction with social roles - that can each be scored as a single item. PROMIS scales were developed using item response theory and capture a greater range of the trait being measured, with greater precision, than other instruments.
Measures related to costs
To quantify the tradeoff between the hypothesized improvements in QOL that Elder Tree may produce versus the cost of providing Elder Tree, we will use incremental cost-effectiveness ratios (ICERs). An ICER is the ratio of the change in costs of an intervention (compared with an alternative) to the change in the effect(s) of the intervention. The primary ICER will be incremental cost per increased QALY. QALYs will be calculated using the approach outlined by Revicki, et al. [40].
We will collect data for two types of costs: intervention cost and healthcare utilization cost. Intervention cost will be estimated using a modified version of The Drug Abuse Treatment Cost Analysis Program (DATCAP) [41]. The DATCAP instrument was originally developed for addiction treatment programs [41]. It has been previously adapted to assess the cost of a quality improvement intervention for addiction treatment [42] and has been adapted for use in this study. We will track: (1) system development costs, including costs associated with programming Elder Tree; (2) research costs, which include salaries and fringe benefits for members of the research team to collect outcome measures; (3) set-up and implementation costs, including salaries (with fringe benefits) for county coordinators; and (4) operating costs, such as hardware (touchscreen laptops), monthly data plans, information technology (IT) costs for maintaining the system, and research staff time for monitoring system use. We will make set-up, implementation, and operating costs available because we anticipate that potential payers (governmental agencies, insurance companies, health systems) will be most interested in these costs.
Healthcare utilization will be collected via bi-annual patient surveys using a modified version of the medical services utilization form [43]. Participants will be asked about their visits to the emergency room and urgent care, hospitalizations, and use of assisted-living facilities and nursing homes. A 6-month recall period is used. Per-patient estimates use average cost per day/episode from the literature multiplied by self-reported healthcare use collected via the medical services utilization form [44-47].
Summing the costs of the intervention and healthcare utilization provides an estimate of total costs for each participant. Costs and effects will be measured at the individual patient/household level, which will allow us to generate cost-effectiveness acceptability curves to represent uncertainty in the ICERs between the intervention and control groups [48].
Measures related to caregivers and mediation
Two instruments will assess the results of using Elder Tree on caregivers. A combination of survey items and Elder Tree use data will assess the mediating effect of the three constructs of SDT. Computer-aided content analyses of discussion group posts will be used to explore the relationship between the reception and expression of emotional content and outcomes.
Sample size
We originally targeted a sample size of N = 300 (150 per group), which would provide 80% power to detect an effect size of Cohen’s d = .4, assuming a response rate near 80% (similar to that of other CHESS studies [16]). Given our diffuse system, we made a decision to extend our focus to individuals and dyads that would benefit from one or two aspects of our system rather than multiple features, with a larger sample therefore needed to detect the greater range of incremental effects on discrete outcomes. More specifically, we set a revised target sample size of N = 450 (225 per group), which would provide 80% power to detect a smaller effect size of Cohen’s d = .3 with an 80% response rate.
Timeline
Recruitment began in November 2013 and will end in May 2015. The intervention period will end in November 2016. Figure 2 shows the timeline and status of the trial.
Data analysis
We will evaluate the effects of Elder Tree by comparing intervention and control participants at 6-, 12-, and 18-month assessments. We will use mixed-effects models to evaluate our primary and secondary hypotheses, where pretest score functions as a covariate, treatment condition is a between-subjects factor, and the multivariate outcome reflects scores for a given assessment across the 3 time points (months 6, 12, and 18). Separate analyses will be conducted for each outcome.
We will use path analysis to test whether the constructs of SDT mediate the relationship between Elder Tree and participants’ QOL at 6, 12, and 18 months. Mediation will be tested based on the significance and size of the specific indirect effects of system use through SDT constructs on relevant outcomes [49-51], as well as the overall fit of the model. Overall model fit will be assessed with statistics traditionally used for this task (for example, CFI, TLI, RMSEA).
Secondary analyses will lend further insight related to primary hypotheses’ findings. The intercorrelations between studied outcomes (for example, Instrumental Activities of Daily Living (IADLs), QOL) and mediator (SDT) will clarify whether these outcomes represent unique versus highly-correlated outcomes. Additional analysis will disaggregate overall Elder Tree effects into component services. Given the non-random selection of services and the potential correlation between the use of certain services, this analysis will address whether a service was used and the intensity of that use. This should reduce multi-collinearity issues in regression analysis and provide insights into each service’s contributions. Outcomes associated with specific Elder Tree services will also be compared between users and non-users of specific services in an exploratory Complier Average Causal Effect (CACE) analysis to examine whether actual use of a service (rather than randomized access to it) is associated with improved outcomes. We will also examine trends within groups over time (for example, whether gains from Elder Tree at 6 and 12 months are maintained to 18 months).
Because we anticipate that Elder Tree will take at least 3 months to have an effect, we plan to conduct exploratory analyses that mirror the aforementioned analyses but exclude participants who die or move to a nursing home or assisted living facility within the first 3 months of the intervention.
Qualitative data collection and analysis
We have used multiple methods of data collection to plan, develop, and implement Elder Tree, including interviews, surveys, and focus groups with older adults and informal caregivers and testing of the technology as it developed. During the planning phase, we collaborated with the ADRC in each of the three regions participating in the study to identify the assets and challenges of older adults by using a community-based strategy called Asset-Based Community Development [52]. We held meetings with ADRC staff and teams of citizens to develop a plan to interview residents and combine the results. In each area, the three most important challenges identified through the process were identical: isolation and loneliness, how to know about and take advantage of community activities and resources, and transportation. During development, we tested paper prototypes and onscreen iterations of the technology with 335 older adults and caregivers one-on-one and in small groups. During implementation, we continue to digitally collect use data to help us understand and improve the system: for example, use data allow us to see which services in Elder Tree are least used. Knowing this, we can find out why participants are not using a service and how we might improve it. Continuous improvement is a hallmark of our approach to technology as we strive to keep our systems abreast of new or improved operating systems, changing conventions, and other developments.
Discussion
The development and testing of Elder Tree mark several important advances. Very few technologies have been designed for or rigorously tested with older adults, who often have physical and cognitive limitations not common among younger people. Elder Tree has been developed with the deep involvement of older adults. The technology also has been developed by working closely with community and state partners, such as local Aging and Disability Resource Centers and the Wisconsin Bureau of Aging, both to create a technology that is adaptable to different communities and to build a base for dissemination. Because we will be able to relate outcomes to use of the system, we also hope to understand why and how the system works or does not work and for whom.
Elder Tree is a multifaceted intervention with interacting services. For example, better medication management as a result of using Elder Tree may reduce the risk of falling. These interactions may make it challenging to assess which services or combination of services in Elder Tree account for changes in outcomes. Settling on our recruitment criteria has been an unexpected challenge because our original inclusion criteria proved to be too restrictive.
We have undertaken an active dissemination campaign in Wisconsin from which we hope to learn about effective ways to promote the use of technology among older adults, including those who have not used computers before. By piloting dissemination during the randomized trial phase, we are learning what communities will need to be able to adapt and maintain Elder Tree for their residents and what types of community organizations may want to provide it and why. This early dissemination work will accelerate the transition from research to practice should the randomized trial show positive results.
If Elder Tree can improve the quality of life of older adults and reduce healthcare costs, it could suggest one path to significantly reducing the physical, emotional, and financial burdens that advancing age can place on older adults, their families and communities, and the healthcare system.
Trial status
The trial has received ethical approval and recruited 392 participants to date (31 March 2015). We anticipate ending recruitment in May 2015.
Acknowledgements
The Agency for Healthcare Research and Quality is the primary funder of the study (5P50HS019917-04). Epic Systems Corporation is a secondary funder. The funders have no role in study design, the interpretation of data, or the publication of results. The authors also wish to thank the dedicated people who have made the research possible: county coordinators Pat Batemon, Christa Glowacki, and Brett Iverson; tech team members at CHESS: Susan Dinauer, Julie Judkins, Gina Landucci, Adam Maus, Patrick Rogne, and Matt Wright; Betsy Abramson and Kris Krasnowski, Wisconsin Institute for Healthy Aging; Valeree Lecey, Greater Wisconsin Agency on Aging Resources; Karen Kedrowski, University of Wisconsin School of Medicine and Public Health; undergraduate and graduate students at CHESS and in the College of Engineering at the University of Wisconsin-Madison; and older adults and their informal caregivers who have not just tested but helped create Elder Tree.
Abbreviations
- AARC
Active Aging Resource Center
- ADLs
Activities of Daily Living
- ADRC
Aging and Disability Resource Center
- CACE
Complier Average Causal Effect
- CHESS
Center for Health Enhancement Systems Studies at the University of Wisconsin-Madison, WI, USA
- DATCAP
Drug Abuse Treatment Cost Analysis Program
- IADLs
Instrumental Activities of Daily Living
- ICERs
Incremental cost-effectiveness ratios
- ICT
Information and communication technology
- IT
Information technology
- PROMIS
Patient-Reported Outcomes Measurement Information System
- QALY
Quality-Adjusted Life Year
- QOL
Quality of life
- REDCap
Research Electronic Data Capture
- SDT
Self-determination theory
- SPIRIT
Standard Protocol Items: Recommendations for Interventional Trials
- WHO
World Health Organization
Additional files
Footnotes
Competing interests
Authors Gustafson Sr., McTavish, Johnson, Quanbeck, and Isham have a shareholder interest in CHESS Mobile Health, a small business that develops web-based healthcare technology for patients and family members. This relationship is extensively managed by the authors and the University of Wisconsin. All other authors declare that they have no competing interests.
Authors’ contributions
DHG Sr. drafted the original manuscript. DHG Sr., JEM, JDL, and DS designed the study. FM, DHG Jr., RAJ, AQ, AKA, AI, RV, and LC contributed to the design and conduct of the study. RAJ performed critical revisions to the manuscript. All authors read, contributed to, and approved the final manuscript.
Contributor Information
David H Gustafson, Sr., Email: dhgustaf@wisc.edu
Fiona McTavish, Email: fmmctavi@wisc.edu.
David H Gustafson, Jr., Email: dgustafson@wisc.edu
Jane E Mahoney, Email: jm2@medicine.wisc.edu.
Roberta A Johnson, Email: rjohnson24@wisc.edu.
John D Lee, Email: jdlee@engr.wisc.edu.
Andrew Quanbeck, Email: arquanbe@wisc.edu.
Amy K Atwood, Email: aatwood@wisc.edu.
Andrew Isham, Email: ajisham@wisc.edu.
Raj Veeramani, Email: raj.veeramani@uwebc.wisc.edu.
Lindy Clemson, Email: lindy.clemson@sydney.ed.au.
Dhavan Shah, Email: dshah@wisc.edu.
References
- 1.Farber N, Shinkle D, Lynott J, Fox-Grage W, Harrell R. Aging in place: a state survey of livability policies and practices. Washington, DC: AARP Public Policy Institute; 2011. [Google Scholar]
- 2.Perissinotto CM, Stijacic Cenzer I, Covinsky KE. Loneliness in older persons: a predictor of functional decline and death. Arch Intern Med. 2012;172:1078–83. doi: 10.1001/archinternmed.2012.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Lord SR, Sherrington C, Menz HB, Close JCT. Falls in older people: risk factors and strategies for prevention. 2. New York: Cambridge University Press; 2007. [Google Scholar]
- 4.Marek KD, Antle L. Medication management of the community-dwelling older adult. In: Hughes RG, editor. Patient safety and quality: an evidence-based handbook for nurses. Rockville, MD: Agency for Healthcare Research and Quality; 2008. [PubMed] [Google Scholar]
- 5.Baldwin G. Director, Division of Unintentional Injury Prevention, National Center for Injury Prevention and Control, Centers for Disease Control and Prevention. Aging, transportation and health. Testimony before the Special Committee on Aging, U.S. Senate. U.S. Department of Health and Human Services: Washington, DC; 2013. [Google Scholar]
- 6.Davis JC, Robertson MC, Ashe MC, Liu-Ambrose T, Khan KM, Marra CA. International comparison of cost of falls in older adults living in the community: a systematic review. Osteoporos Int. 2010;21:1295–306. doi: 10.1007/s00198-009-1162-0. [DOI] [PubMed] [Google Scholar]
- 7.Ward BW, Schiller JS. Prevalence of multiple chronic conditions among US adults: estimates from the National Health Interview Survey, 2010. Prev Chronic Dis. 2013;10 doi: 10.5888/pcd10.120203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Vogeli C, Shields AE, Lee TA, Gibson TB, Marder WD, Weiss KB, et al. Multiple chronic conditions: prevalence, health consequences, and implications for quality, care management, and costs. J Gen Intern Med. 2007;22(Suppl 3):391–5. doi: 10.1007/s11606-007-0322-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Institute of Medicine of the National Academies . Retooling for an aging America: building the health care workforce. Washington, D.C.: The National Academies Press; 2008. [PubMed] [Google Scholar]
- 10.Vedel I, Akhlaghpour S, Vaghefi I, Bergman H, Lapointe L. Health information technologies in geriatrics and gerontology: a mixed systematic review. J Am Med Inform Assoc. 2013;20:1109–19. doi: 10.1136/amiajnl-2013-001705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tse MM, Choi KC, Leung RS. E-health for older people: the use of technology in health promotion. Cyberpsychol Behav. 2008;11:475–9. doi: 10.1089/cpb.2007.0151. [DOI] [PubMed] [Google Scholar]
- 12.Sum S, Mathews RM, Hughes I, Campbell A. Internet use and loneliness in older adults. Cyberpsychol Behav. 2008;11:208–11. doi: 10.1089/cpb.2007.0010. [DOI] [PubMed] [Google Scholar]
- 13.Wahl HW, Iwarsson S, Oswald F. Aging well and the environment: toward an integrative model and research agenda for the future. Gerontologist. 2012;52:306–16. doi: 10.1093/geront/gnr154. [DOI] [PubMed] [Google Scholar]
- 14.Czaja SJ, Lee CC. The impact of aging on access to technology. Univ Access Inf Soc. 2007;5:341–9. doi: 10.1007/s10209-006-0060-x. [DOI] [Google Scholar]
- 15.Hou SI, Charlery SAR, Roberson K. Systematic literature review of Internet interventions across health behaviors. Health Psychol Behav Med. 2014;2:455–81. doi: 10.1080/21642850.2014.895368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiatry. 2014;71:566–72. doi: 10.1001/jamapsychiatry.2013.4642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Gustafson DH, DuBenske LL, Namkoong K, Hawkins R, Chih MY, Atwood AK, et al. An eHealth system supporting palliative care for patients with non-small cell lung cancer: a randomized trial. Cancer. 2013;119:1744–51. doi: 10.1002/cncr.27939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Dubenske LL, Gustafson DH, Namkoong K, Hawkins RP, Atwood AK, Brown RL, et al. CHESS improves cancer caregivers’ burden and mood: results from an eHealth RCT. Health Psychol. 2013;33:1261–72. doi: 10.1037/a0034216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Gustafson D, Wise M, Bhattacharya A, Pulvermacher A, Shanovich K, Phillips B, et al. The effects of combining Web-based eHealth with telephone nurse case management for pediatric asthma control: a randomized controlled trial. J Med Internet Res. 2012;14 doi: 10.2196/jmir.1964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gustafson DH, Hawkins R, Pingree S, McTavish F, Arora NK, Mendenhall J. Effect of computer support on younger women with breast cancer. J Gen Intern Med. 2001;16:435–45. doi: 10.1046/j.1525-1497.2001.016007435.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Gustafson DH, Hawkins R, Boberg E, Pingree S, Serlin RE, Graziano F, et al. Impact of a patient-centered, computer-based health information/support system. Am J Prev Med. 1999;16:1–9. doi: 10.1016/S0749-3797(98)00108-1. [DOI] [PubMed] [Google Scholar]
- 22.Gustafson DH, Greist JH, Stauss FF, Erdman H, Laughren T. A probabilistic system for identifying suicide attemptors. Comput Biomed Res. 1977;10:83–9. doi: 10.1016/0010-4809(77)90026-X. [DOI] [PubMed] [Google Scholar]
- 23.Shaw BR, McTavish F, Hawkins R, Gustafson DH, Pingree S. Experiences of women with breast cancer: exchanging social support over the CHESS computer network. J Health Commun. 2000;5:135–59. doi: 10.1080/108107300406866. [DOI] [PubMed] [Google Scholar]
- 24.McTavish FM, Pingree S, Hawkins R, Gustafson D. Cultural differences in use of an electronic discussion group. J Health Psychol. 2003;8:105–17. doi: 10.1177/1359105303008001447. [DOI] [PubMed] [Google Scholar]
- 25.Meis T, Gaie M, Pingree S, Boberg EW, Patten CA, Offord KP, et al. Development of a tailored, Internet‐based smoking cessation intervention for adolescents. J Comput Mediat Commun. 2002;7:1–7. [Google Scholar]
- 26.Clemson L, Cumming RG, Kendig H, Swann M, Heard R, Taylor K. The effectiveness of a community-based program for reducing the incidence of falls in the elderly: a randomized trial. J Am Geriatr Soc. 2004;52:1487–94. doi: 10.1111/j.1532-5415.2004.52411.x. [DOI] [PubMed] [Google Scholar]
- 27.Pingree S, Hawkins R, Baker T, DuBenske L, Roberts LJ, Gustafson DH. The value of theory for enhancing and understanding e-health interventions. Am J Prev Med. 2010;38:103–9. doi: 10.1016/j.amepre.2009.09.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78. doi: 10.1037/0003-066X.55.1.68. [DOI] [PubMed] [Google Scholar]
- 29.Ryan RM, Patrick H, Deci EL, Williams GC. Facilitating health behaviour change and its maintenance: interventions based on self-determination theory. Eur Health Psychol. 2008;10:2–5. [Google Scholar]
- 30.Shaw BR, Hawkins R, McTavish F, Pingree S, Gustafson DH. Effects of insightful disclosure within computer mediated support groups on women with breast cancer. Health Commun. 2006;19:133–42. doi: 10.1207/s15327027hc1902_5. [DOI] [PubMed] [Google Scholar]
- 31.Kim E, Han JY, Shah D, Shaw B, McTavish F, Gustafson DH. Predictors of supportive message expression and reception in an interactive cancer communication system. J Health Commun. 2011;16:1106–21. doi: 10.1080/10810730.2011.571337. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Yoo W, Chih MY, Kwon MW, Yang J, Cho E, McLaughlin B, et al. Predictors of the change in the expression of emotional support within an online breast cancer support group: a longitudinal study. Patient Educ Couns. 2013;90:88–95. doi: 10.1016/j.pec.2012.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Frattaroli J. Experimental disclosure and its moderators: a meta-analysis. Psychol Bull. 2006;132:823–65. doi: 10.1037/0033-2909.132.6.823. [DOI] [PubMed] [Google Scholar]
- 34.Gaugler JE, Duval S, Anderson KA, Kane RL. Predicting nursing home admission in the US: a meta-analysis. BMC Geriatr. 2007;7:13. doi: 10.1186/1471-2318-7-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Onder G, Liperoti R, Soldato M, Carpenter I, Steel K, Bernabei R, et al. Case management and risk of nursing home admission for older adults in home care: results of the AgeD in HOme Care Study. J Am Geriatr Soc. 2007;55:439–44. doi: 10.1111/j.1532-5415.2007.01079.x. [DOI] [PubMed] [Google Scholar]
- 36.Luppa M, Luck T, Weyerer S, Konig HH, Brahler E, Riedel-Heller SG. Prediction of institutionalization in the elderly. A systematic review. Age Ageing. 2010;39:31–8. doi: 10.1093/ageing/afp202. [DOI] [PubMed] [Google Scholar]
- 37.Meldon SW, Mion LC, Palmer RM, Drew BL, Connor JT, Lewicki LJ, et al. A brief risk-stratification tool to predict repeat emergency department visits and hospitalizations in older patients discharged from the emergency department. Acad Emerg Med. 2003;10:224–32. doi: 10.1111/j.1553-2712.2003.tb01996.x. [DOI] [PubMed] [Google Scholar]
- 38.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Hays RD, Bjorner JB, Revicki DA, Spritzer KL, Cella D. Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res. 2009;18:873–80. doi: 10.1007/s11136-009-9496-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Revicki DA, Kawata AK, Harnam N, Chen WH, Hays RD, Cella D. Predicting EuroQol (EQ-5D) scores from the patient-reported outcomes measurement information system (PROMIS) global items and domain item banks in a United States sample. Qual Life Res. 2009;18:783–91. doi: 10.1007/s11136-009-9489-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.French MT, Dunlap LJ, Zarkin GA, McGeary KA, McLellan AT. A structured instrument for estimating the economic cost of drug abuse treatment. The Drug Abuse Treatment Cost Analysis Program (DATCAP) J Subst Abuse Treat. 1997;14:445–55. doi: 10.1016/S0740-5472(97)00132-3. [DOI] [PubMed] [Google Scholar]
- 42.Gustafson DH, Quanbeck AR, Robinson JM, Ford JH, 2nd, Pulvermacher A, French MT, et al. Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction. 2013;108:1145–57. doi: 10.1111/add.12117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Polsky D, Glick HA, Yang J, Subramaniam GA, Poole SA, Woody GE. Cost-effectiveness of extended buprenorphine-naloxone treatment for opioid-dependent youth: data from a randomized trial. Addiction. 2010;105:1616–24. doi: 10.1111/j.1360-0443.2010.03001.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.The Henry J Kaiser Family Foundation. Hospital adjusted expenses per inpatient day. http://kff.org/other/state-indicator/expenses-per-inpatient-day/. Accessed 27 May 2014.
- 45.MetLife: Market survey of long-term care costs: The 2012 MetLife market survey of nursing home, assisted living, adult day services, and home care costs https://www.metlife.com/mmi/research/2012-market-survey-long-term-care-costs.html#keyfindings. Accessed 27 May 2014.
- 46.Agency for Healthcare Research and Quality: Medical expenditure panel survey (MEPS) http://meps.ahrq.gov/mepsweb/. Accessed 27 May 2014.
- 47.Weinick RM, Bristol SJ, DesRoches CM. Urgent care centers in the US: findings from a national survey. BMC Health Serv Res. 2009;9:79. doi: 10.1186/1472-6963-9-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Löthgren M, Zethraeus N. Definition, interpretation and calculation of cost‐effectiveness acceptability curves. Health Econ. 2000;9:623–30. doi: 10.1002/1099-1050(200010)9:7<623::AID-HEC539>3.0.CO;2-V. [DOI] [PubMed] [Google Scholar]
- 49.Dillard JP, Shen L. On the nature of reactance and its role in persuasive health communication. Commun Monogr. 2005;72:144–68. doi: 10.1080/03637750500111815. [DOI] [Google Scholar]
- 50.Kaplan D. Structural equation modeling: foundations and extensions. Thousand Oaks, CA: Sage Publications; 2009. [Google Scholar]
- 51.Kaplan D. The Sage handbook of quantitative methodology for the social sciences. Thousand Oaks, CA: Sage Publications; 2004. [Google Scholar]
- 52.Kretzmann JP, McKnight JL. Building communities from the inside out: a path toward finding and mobilizing a community’s assets. Chicago, IL: ACTA Publications; 1993. [Google Scholar]
- 53.Cromwell DA, Eagar K, Poulos RG. The performance of instrumental activities of daily living scale in screening for cognitive impairment in elderly community residents. J Clin Epidemiol. 2003;56:131–7. doi: 10.1016/S0895-4356(02)00599-1. [DOI] [PubMed] [Google Scholar]
- 54.Lawton MP. The functional assessment of elderly people. J Am Geriatr Soc. 1971;19:465–81. doi: 10.1111/j.1532-5415.1971.tb01206.x. [DOI] [PubMed] [Google Scholar]
- 55.Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9:179–86. doi: 10.1093/geront/9.3_Part_1.179. [DOI] [PubMed] [Google Scholar]
- 56.Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess. 1996;66:20–40. doi: 10.1207/s15327752jpa6601_2. [DOI] [PubMed] [Google Scholar]
- 57.Clemson L, Cumming RG, Heard R. The development of an assessment to evaluate behavioral factors associated with falling. Am J Occup Ther. 2003;57:380–8. doi: 10.5014/ajot.57.4.380. [DOI] [PubMed] [Google Scholar]
- 58.Budnitz DS, Lovegrove MC, Shehab N, Richards CL. Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med. 2011;365:2002–12. doi: 10.1056/NEJMsa1103053. [DOI] [PubMed] [Google Scholar]
- 59.Piette JD. Patient education via automated calls: a study of English and Spanish speakers with diabetes. Am J Prev Med. 1999;17:138–41. doi: 10.1016/S0749-3797(99)00061-6. [DOI] [PubMed] [Google Scholar]
- 60.Lawton MP, Moss M, Hoffman C, Perkinson M. Two transitions in daughters’ caregiving careers. Gerontologist. 2000;40:437–48. doi: 10.1093/geront/40.4.437. [DOI] [PubMed] [Google Scholar]
- 61.Pruchno RA, Resch NL. Mental health of caregiving spouses: coping as mediator, moderator, or main effect? Psychol Aging. 1989;4:454–63. doi: 10.1037/0882-7974.4.4.454. [DOI] [PubMed] [Google Scholar]
- 62.Sherbourne CD, Stewart AL. The MOS social support survey. Soc Sci Med. 1991;32:705–14. doi: 10.1016/0277-9536(91)90150-B. [DOI] [PubMed] [Google Scholar]
- 63.Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114:163–73. doi: 10.1016/j.jad.2008.06.026. [DOI] [PubMed] [Google Scholar]