Abstract
Objectives:
The United States Department of Veterans Affairs offers numerous technology-delivered interventions to self-manage mental health problems. It is unknown, however, what barriers older military veterans face to using these technologies and how willing they would be to use technologies for mental health concerns.
Methods:
Seventy-seven veterans (Mage = 69.16 years; SD = 7.10) completed interviews in a concurrent mixed methods study. Interviewers asked about technology ownership and described four modalities of delivering self-management interventions: printed materials, DVDs, Internet, and mobile apps. Interviewers obtained feedback about each modality’s benefits, barriers, and facilitators. Participants ranked their self-management modalities preferences alone and compared with counseling. Multi-variable adjusted logistic regression and qualitative analyses were conducted to investigate the reasons contributing to preferences.
Results:
Most reported owning a computer (84.4%), having home Internet (80.5%), and a smartphone (70.1%). Participants preferred printed materials (35.1%) over mobile apps (28.6%), Internet (24.7%), and DVDs (13.0%). Lower computer proficiency was associated with preferring DVDs; higher proficiency was associated with Internet and mobile interventions. Residing in an urban area was associated with mobile apps. When counseling was an option, 66% identified this as their first preference. Qualitative findings showed veterans’ desire for information, training, and provider support with technology.
Conclusions:
Older veterans reported high technology ownership rates, but varied preferences for self-management interventions. Notably, two-thirds preferred some form of technology, which points to the importance of ensuring that providers offer existing technology-delivered interventions to older veterans. Veterans’ strong preference for counseling emphasizes the need for human support alongside self-management.
Keywords: Computers, Internet, Mental Health, Mobile Applications, Self-management, Smartphone, Technology, veteran
More than half of United States (U.S.) military veterans are 60 years or older1 and many suffer from mental health disorders.2 Approximately 9.7 million veterans or 48% of all veterans received care from the U.S. Veterans Health Administration (VHA) annually. 1 The VHA encompasses 1,255 health care facilities and is the largest health care system in the U.S. with mental health care providers integrated in providers including primary care. Studies examining the VHA mental health service usage have shown that older veterans are less likely to use services than are younger veterans.3,4 Lower mental health care utilization among older adults is related to barriers to care, including difficulty navigating the referral process, lower identification of late-life mental health disorders, transportation difficulties, concerns regarding cost of care, and stigma about mental health.5–7 To address these barriers, VHA has integrated behavioral health providers into primary care and implemented clinical video telehealth options to overcome geographical and mobility barriers for patients in remote areas. Still, the scarcity of geriatric mental health providers limits the scalability of telehealth as providers are needed to deliver telehealth services.8 Taken together, these factors underscore a need to offer alternative methods of delivering mental health care for older adult populations, such as self-management.9
A vast body of research supports self-management as efficacious for chronic health and mental health.10–13 In particular, interest in mental health self-management interventions has grown with the wide-scale adoption and use of technologies capable of delivering these interventions. While technology-delivered interventions may increase access to mental health care,14,15 older adults are often omitted from this research due to barriers to accessing technology and sampling bias that may reflect ageist stereotypes of older adults’ interest in technology.16,17
Digital mental health interventions, such as Internet and mobile app-based interventions can address geographical, mobility, and provider-shortage barriers, as they may be used as self-management or with varying levels of provider or peer support.18 These interventions may be used anonymously, discreetly, and usually at no to minimal cost, benefiting individuals who may be reluctant to seek treatment. In addition, incorporating these interventions into existing mental health care could expand access to services by enabling providers to allocate resources to more patients requiring intensive mental health interventions (e.g., weekly psychotherapy).
The VHA surpasses the private sector in the availability of self-management technology-based interventions for mental health spanning from Internet to mobile applications.19–21 Research on veterans’ attitudes toward mobile apps demonstrates that most have positive attitudes towards this intervention modality.22–24 Yet, little attention has been given to older veterans’ attitudes towards technology. In one of the few studies that considered older veteran technology use, researchers conducted a series of semi-structured interviews and found no qualitative differences for older veterans (50 to 70 years old) compared with younger veterans (18 to 49 years old).24 However, older veterans had lower rates of smartphone ownership (32% vs. 56%) and more difficulties using technology compared with younger veterans. Another study25 found that 17.6% and 56% of older veterans had access to smartphones and home Internet respectively. The older veterans also endorsed willingness to reach out to their social networks for technology assistance. The VHA is a leader in home telehealth monitoring, in which technologies, such as biometric devices for blood pressure and weight, assist with the monitoring of chronic health conditions.26 While this approach has been successful for chronic health conditions, it has been less used in monitoring mental health conditions such as depression or posttraumatic stress disorder (PTSD).26 These findings suggest that, similar to the general Veteran population, older veterans are open to using technology to monitor their mental and physical health, but may have limited access to smartphones in particular.
Not only are there few investigations of technology use for mental health in older adults, to date there have been no studies investigating older veterans’ barriers to using technology for mental health. Examining access to and preferences for different modalities of delivering mental health interventions is critical in facilitating usage of existing VHA technology-delivered interventions. Thus, the present study examined older veterans’ experience with, willingness to use, and preferences for four different intervention modalities that represent varied methods of conveying psychoeducation and coping skills to manage mental health problems. The modalities examined were: (1) printed materials, (2) DVDs, (3) Internet-based, and (4) mobile apps. The core content of the self-management interventions would be similar across modalities, but the delivery methods vary, including text, videos, or a combination of information-delivery methods. We hypothesized that greater computer proficiency, residing in an urban area, and elevated mental health symptoms would be related to preference for Internet and mobile apps. These hypotheses were grounded in findings that older veterans seek information about mental health conditions online27 and findings that veterans with mental health symptoms are interested in technology-based mental health interventions.22
Methods
Study Design
The study used a concurrent mixed methods design. Study procedures were approved by Stanford University Institutional Review Board, the IRB of record for the VA Palo Alto Health Care System (32454).
Participants
Purposive sampling was used to recruit veterans aged 60 years or older from a single VA Health Care System catchment area. Participants were recruited using flyers posted at VA clinics and senior centers, contacting previous research participants, holding community presentations, and advertising online (Craigslist) and in print media.
Telephone screening assessed two inclusion criteria: age < 60 years old or absence of possible cognitive impairment suggested by Short Blessed Test28,29 score of ≥ 6. Figure 1 displays the participant flow, yielding 77 completing the semi-structured telephone interview and 74 completing mailed questionnaires.
Figure 1.

Flow of participants through the study
Procedures
Participants were mailed a packet of information that included a copy of the consent form to be reviewed by phone, questionnaires to complete and return, and a guide with brief explanations of the modalities including pictures and screenshots. Informed consent included permission to review their VHA medical record. A brief demographic questionnaire was administered followed by the Technology Semi-Structured Interview. Interviews were completed by phone (n = 75) or in person (n = 2) between September 2016 and April 2018.
Measures
Technology Ownership, Preferences, and Proficiency.
The Technology Semi-Structured Interview (see Supplemental Material) contained questions about participants’ technology use and if they have ever used each modality to cope with emotional difficulties. Then participants were invited to ask questions about the modality. Next, they rated their willingness to use the modality (willingness ratings) on a 1 (No, definitely not willing) to 10 (Yes, definitely willing) scale and were asked about barriers and facilitators of use. Nine technology use and ownership questions, drawn from the Pew Internet Life Survey,30 were included. At the end of the interview, participants rank ordered their choice of the four modalities to use if theoretically faced with a mental health problem (ranked preferences) and then re-ranked their preferences with counseling/psychotherapy included as an option.
The Computer Proficiency Questionnaire (CPQ)31 assesses proficiency using computers in six domains represented by subscales (basics, printer, communication, Internet, calendar, and entertainment). The 33 items ask about how easily one can complete each task on a computer with items rated on a five-point scale ranging from 1 (never tried) to 5 (very easily). Total scores are generated from average scores from each subscale, with higher scores indicating greater computer proficiency.
Health and Medical Burden.
Perceived health was measured using the question: “In general, would you say your health is: excellent, very good, good, fair, poor.” Medical burden was rated using the Cumulative Illness Rating Scale for Geriatrics (CIRS-G)32 with total scores ranging from 0 to 56. Trained raters completed the CIRS-G retrospective medical record review.33 Raters co-reviewed five charts for training and achieved an Intra-class Correlation Coefficient (ICC) of .94 for the CIRS-G total score. Sixty-eight medical records were reviewed. Reasons for the missing CIRS-G ratings were: (1) not receiving care at VHA (n = 6); and (2) insufficient notes to complete the CIRS-G rating (n = 3).
Psychiatric Symptom Measures.
Three measures of psychiatric symptoms with established validity among older adults were used to create a composite variable of elevated psychiatric symptoms with two groups: elevated symptoms (i.e., meeting the cut-point on one or more measures) or no elevated symptoms. The first measure, the Patient Health Questionnaire depression scale (PHQ-8)34 is an eight-item measure of depressive symptoms that has comparable validity to the PHQ-9.35 The PHQ-8 omits the suicide ideation item for use with asynchronous data collection. Scores ≥10 or greater are suggestive of elevated depressive symptoms. The Geriatric Anxiety Scale (GAS)35 is a 30-item measure that assesses a broad range of anxiety symptoms. The first 25 items are summed; the remaining five items can be used to better understand content of worries and fears (e.g., finances, health). A score ≥16 maximizes sensitivity and specificity for the detection of anxiety disorders in older adults.37 The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5)38 is a 20-item measure of PTSD symptoms. Scores ≥ 33 are suggestive of PTSD.39
Rural status.
Rural status was characterized using zip codes aggregated using the Rural Urban Commuting Area (RUCA) codes40 as employed in a previous study of veterans’ technology attitudes.24 Veterans’ place of residence were grouped as urban (i.e., metropolitan areas) or rural (small, isolated towns ranging to large rural towns) using categorization method C.41
Statistical Analyses
We aimed to recruit a sample of 75 individuals based on a power analysis to detect a medium size effect (.3) for to the quantitative research aim regarding preferences. With regard to the qualitative aims, it was estimated that approximately 25 interviews would provide sufficient data to address the research questions42 and would yield code saturation with a complex understanding of the data.43 Thus, we expected to reach data saturation before achieving our targeted sample size for the quantitative aim.
Quantitative.
Frequencies and percentages were calculated to summarize participant characteristics, and technology use, ownership, and preferences. Mean willingness and percentages of ranked preferences for each modality were calculated. Differences in willingness and rankings were examined with a non-parametric test (Friedman’s ANOVA).
Logistic regressions were conducted to examine whether rural status; CPQ total score; and presence of elevated psychiatric symptoms were related to preferences. Years of education were included as a covariate. Follow-up models included the CIRS-G as a predictor. Analyses were conducted with SPSS version 24.44
Qualitative.
Transcribed interviews were analyzed using Dedoose version 8.0.45 The coding scheme was developed based on CREATE model of older adult technology use46,47 with deductive codes related to the user (individual characteristics), technological system (software, hardware/interface), and the task (task engagement, intervention content). Inductive codes were added based on transcript review. Two authors (CEG, AMZ) trained in qualitative analyses coded the data. The codebook was adjudicated 7 times across 20 interviews resulting in a final pooled kappa of .90. We achieved data saturation soon after adjudicating the codebook. The remaining interviews completed after reaching data saturation focused on exploring variations on the themes and subthemes. Team-based thematic analysis converged on factors underlying participant’s preferences for technology delivery platforms and identified barriers and facilitators to use.
Results
Participants were older veterans (Mage = 69.16, SD = 7.10 years, range 60-90+), with the majority being white, non-Hispanic individuals (63.6%), male (81.8%), and retired (72.7%) (Table 1). With regard to mental health conditions, 45.9% of participants endorsed psychiatric symptoms above clinical cut-points on at least one of three self-report measures. Based on the CIRS-G ratings, 72.1% (n = 49 of 68 completed reviews) experienced some level of psychiatric illness (mild to severe). Nearly all participants owned a cellphone (92.2%), and most (70.1%) owned a smartphone (Table 2). Most also owned either a desktop or laptop computer (84.4%) and a slightly lower percentage had Internet service at home (80.5%). Technology use or ownership did not differ by demographic characteristics. Of smartphone owners, 96.3% (n = 52) had sent a text message, 90.7% (n = 49) had downloaded an app, 88.9% (n = 48) had sent an email, and 87.0% (n = 47) had used the Internet on their phone. Of tablet users, 76.3% (n = 29) had downloaded an app. However, of the mobile device owners (smartphone and/or tablet), only 11.9% (n = 7) had downloaded an app to learn about or manage physical health, emotional health, or stress.
Table 1.
Participant Characteristics (N=77)
| Characteristic | n (%) | M (SD) |
|---|---|---|
| Age | 69.16 (7.10) | |
| Years of Education | ||
| ≤ 15 years | 29 (37.7%) | |
| ≥ 16 years | 48 (62.3%) | |
| Sex | ||
| Male | 63 (81.8%) | |
| Female | 14 (18.18%) | |
| Race/Ethnicity | ||
| Black/African American | 9 (11.69%) | |
| White, Non-Hispanic | 49 (63.64%) | |
| White, Hispanic | 5 (6.49%) | |
| Other | 14 (18.19%) | |
| Marital Status | ||
| Single | 18 (23.4%) | |
| Married | 28 (36.4%) | |
| Divorced/Separated | 24 (31.2%) | |
| Widowed | 7 (9.1%) | |
| Employment | ||
| Full/Part-time | 11 (14.3%) | |
| Unemployed | 6 (7.8%) | |
| Retired | 56 (72.7%) | |
| Disabled | 4 (5.2%) | |
| Rural Status | ||
| Urban | 62 (80.5%) | |
| Rural | 15 (19.5%) | |
| General Health | ||
| Excellent | 5 (6.5%) | |
| Very Good | 22 (28.6%) | |
| Good | 32 (41.6%) | |
| Fair | 11 (14.3%) | |
| Poor | 4 (5.2%) | |
| Elevated Psychiatric Symptoms | ||
| Present | 34 (45.9%) | |
| Absent | 40 (54.1%) | |
| Measures | ||
| CIRS-G Total Score | 12.07 (4.93) | |
| GAS | 16.20 (12.20) | |
| PHQ-8 | 6.31 (6.15) | |
| PCL-5 | 20.36 (18.69) | |
| CPQ Total Score | 23.80 (6.53) |
Note. CIRS-G = Cumulative Illness Rating Scale for Geriatrics (N = 68). GAS = Geriatric Anxiety Scale, PHQ-9 = Patient Health Questionnaire-8 item; CPQ = Computer Proficiency Score (N = 74). Race/ethnicity approximates that of the local VA Health Care System.
Table 2.
Technology Use, Modality Ratings, Mental Health, and Medical Burden Measures
| n (%) | M (SD) | Min-Max | |
|---|---|---|---|
| Technology Ownership and Services | |||
| DVD Player | 57 (74.0%) | ||
| Computer | 65 (84.4%) | ||
| Cellphone | 71 (92.2%) | ||
| Smartphone | 54 (70.1%) | ||
| Tablet | 38 (49.4%) | ||
| Smartphone or Tablet | 59 (76.6%) | ||
| Internet Service in Home | 62 (80.5%) | ||
| Any Technology | 77 (100%) | ||
| Willingness Rating | |||
| Printed Materials | 8.79 (1.89) | 3-10 | |
| DVD | 8.04 (2.57) | 1-10 | |
| Internet | 8.24 (2.40) | 1-10 | |
| Mobile app | 7.75 (2.97) | 1-10 | |
| First Preference for Delivery Modality | |||
| Printed Materials | 27 (35.1%) | ||
| Mobile app | 22 (28.6%) | ||
| Internet | 19 (24.7%) | ||
| DVD | 10 (13.0%) | ||
| First Preference for Delivery Modality when Included Counseling | |||
| Counseling | 51 (66.2%) | ||
| Internet | 10 (13.0%) | ||
| Mobile apps | 8 (10.4%) | ||
| Printed Materials | 6 (7.8%) | ||
| DVD | 3 (3.9%) | ||
Intervention Delivery Modality Experience and Preferences
Participants’ experience using the modalities to cope with emotional difficulties varied considerably. Seventy percent (n = 54) had used printed materials for mental health self-management, 25.6% had used the Internet (n = 20), 16.9% had used DVDs (n = 13), and 9.1% had used mobile apps (n = 7). Overall, 72% (n = 56) reported using any type of self-management. Of those 53.5% (n = 30) used only one modality, while 46.4% (n = 26) used more than one modality. Notably, users of any type of self-management were not more likely to have elevated psychiatric symptoms, χ(74) = 1.32, p = .25. Willingness to try each modality to manage emotional difficulties was high (Table 2) and did not differ significantly among participants, χ F 2 (3) = 6.37, p = .10.
Friedman’s ANOVA found rank differences among the four self-management modalities, χ F 2 (3) = 9.25, p =.03. Printed materials were preferred the most, followed by mobile apps, Internet, and DVDs (Table 2). Pairwise comparisons demonstrated that the only difference in rankings emerged for the DVDs. When counseling was added as an option, most (n = 51, 66%) preferred this option while the remaining third (n = 26) preferred a self-management option as their first choice.
Logistic regression analyses identified characteristics associated with preferences for each self-management modality (See Table 3). Models, adjusted by years of education, examined computer proficiency, rural status, and presence of elevated psychiatric symptoms. Lower computer proficiency was associated with preference for using DVDs, whereas greater computer proficiency was associated with preference for Internet interventions. Residing in an urban area was associated with preference for using mobile interventions. No variables were associated with preference for printed materials. Sensitivity analyses examined models with CIRS-G total scores; however, scores were not associated with preferences (results not shown).
Table 3.
Factors Associated with Self-Management Preferences
| Printed Materials | DVDs | Internet Interventions | Mobile App Interventions | |
|---|---|---|---|---|
|
| ||||
| OR (95% CI) | OR (95% CI) | OR (95% CI) | OR (95% CI) | |
| Education | ||||
| ≤ 15 years (Ref) | ||||
| ≥ 16 years | 2.42 (0.72, 8.21) | 1.81 (0.21, 5.70) | 0.45 (0.13, 1.54) | 0.67 (0.19, 2.34) |
| Rural Status | ||||
| Rural (Ref) | ||||
| Urban | 0.82 (0.23, 2.97) | 0.00 (0.00, 0.00)a | 0.40 (0.08, 2.14) | 5.14 (1.37, 19.28) |
| Elevated Psychiatric Symptoms | ||||
| Absent (Ref) | ||||
| Present | 0.61 (0.22, 1.70) | 3.49 (0.69, 17.81) | 0.99 (0.33, 3.00) | 1.14 (.38, 3.43) |
| CPQ Total Score | 0.92 (0.85, 1.01) | 0.84 (0.73, 0.95) | 1.15 (1.02, 1.30) | 1.12 (1.00, 1.24) |
Note. CPQ = Computer Proficiency Questionnaire. Not shown are models adjusted by CIRS-G total scores because CIRS-G was not a significant predictor. Bolded ORs indicate that that predictor was significant at p < .05.
No rural-dwelling individuals ranked DVDs first, but model remained unchanged when excluding this variable, so variable retained in model.
Qualitative Analysis
Preferences.
Qualitative analysis of participants’ justification for their ranked preferences revealed similar themes across modalities and some differences based on specific features of each modality (See Table 4). One similar theme was that participants prefer what they know (i.e., comfort, familiarity) and what they have used in the past. Second, convenience, accessibility, and portability influenced preferences. Differences among modalities were related to multiple factors including: (1) preferences for special features or specific equipment (i.e., having a larger computer monitor vs. small phone screen); (2) lack of security/privacy concerns; (3) interactivity; and (4) amount of available information. Concerns about security and privacy issues were noted among participants who ranked either printed materials or DVDs highly, as these modalities generally do not involve sharing of one’s information. Participants mentioned preferences for listening to information, benefits of pictures and visuals, and demonstrations of skills as reasons for ranking DVDs first. Participants who ranked Internet and mobile applications highly described the importance of interactive, multimedia information delivery, and access to current information. Internet interventions were valued due to the unlimited information available; however, combing through the Internet’s breadth of information was noted as a drawback. Individuals who ranked mobile apps highly mentioned the value of having skills at one’s fingertips, their phone being readily available (“always on me”), and the ability to use their phone to call for help if needed.
Table 4.
Qualitative Themes Underlying Preferences
| Themes | Description | First Choice and Example Quote |
|---|---|---|
| People prefer what they know | Experience using, comfort/familiarity with, and enjoyment of modality |
Printed Materials: “I am most comfortable with books and printed materials. And the Internet, I’m okay with that, I mean I Google and do that, but I find that frustrating too because there are so many options.” DVDs: “The DVD, you know it’s like going to school. It’s like learning something. It has that feature to it that it’s outside of yourself and somebody’s explaining it and you can interact with the DVD as well.” |
| Ease of access wherever and whenever | Portability, convenience of the modality, and device ownership |
Mobile apps: “I have my phone 100% of the time and my computer 80-90% of the time. So the mobile apps I would place as number one because I always have my phone with me. It is more convenient than having to go to a computer to run a DVD, or to go home to pick up a brochure that I got mailed last time.” Printed Materials: “A book is a highly efficient tool because you can put a book marker in it and you can just go straight to that paragraph and whereas with a mobile app your battery might be low, the noise level in the car or the train or the bus is too high or you don’t understand the symbols. A book is easy to access.” |
| Specific Modality Features | Interactivity, multimedia delivery |
DVDs: “I would pay attention more to DVDs. The pictures and writing and that would probably be more helpful to me.” Internet: “The Internet is a lot better [than mobile apps] and a lot easier to be able to communicate, manipulate, move your way around, so that would be my choice. It gives you more freedom of movement, more access to what you want to know, and being able to ask questions.” |
| Ease navigation and user experience |
Internet: “On my desktop computer, I have a large monitor, a 27 inch. So, I can turn up the fonts and it makes it easy to read.” Mobile Apps: “Ease of entry for me would be having it as an app where I can click on it and get into all the information that would be available on that program.” |
|
| Data security and information privacy issues | Printed Materials & DVDs: “I’m comfortable with the security of those [printed materials and DVDs] because I have them with me and I know that I have control over what comes on and what goes off. Internet-based and mobile apps, there is always that possibility of the material being hacked. And don’t tell me it doesn’t because it happens all the time nowadays.” |
Barriers to Using Self-Management Technology Modalities.
The primary and most concrete barrier was lack of access, which was attributed to cost, owning older devices that are less compatible with software or apps, or frustration with ongoing maintenance, such as required computer updates. Insufficient knowledge of technical lexicon, menu symbols, and general comfort using the technologies, particularly related to mobile apps, limited use of these technologies. Additional barriers were related to individual user’s sensory abilities, such as changes in vision functioning that affected their ability to view information on a small screen. Others noted the importance of having subtitles or adjustable volume to accommodate hearing impairment. Finally, some described challenges navigating a touch screen using their fingers due to small screen size and “fat fingers”.
Facilitators.
The primary facilitator identified was the role of a person to support the participant during an intervention. Some suggested that a provider could serve as a navigator, directing them to evidence-based resources specific to their problem. One participant described that their “first choice would probably be to talk to another person on the phone or hotline and then they could help direct [me] to other sorts of resources.” Other person-based supports included teaching about using technology, answering technology questions, discussing intervention content, and encouraging adherence. One participant highlighted the importance of knowing both technology and mental health interventions: “[the] person has to be kind of like multi-tool– part-time therapist and very skilled in technology.”
Conclusion
Our findings highlight that older veterans have high rates of technology ownership. Notably, these rates of ownership did not differ significantly among those in urban versus rural regions. Despite 100% of participants owning technology, preferences for self-management treatment delivery varied. More veterans preferred printed materials (35%) than any specific form of technology. However, 65% preferred some form of technology (i.e., DVDs, Internet, or mobile app-delivered interventions). These data confirm that older veterans are interested and willing to use mental health self-management interventions, particularly if human support accompanies the intervention. While the findings do support willingness to try self-management, when provided with the option of counseling, the majority of participants expressed interest in trying this option first.
Key factors related to preferences for treatment delivery modalities included access, experience, and comfort with modalities. Consistent with our predictions, findings demonstrated the importance of computer proficiency, which aligns with qualitative themes regarding people preferring what they know. Regarding mobile apps, the preference for apps was stronger for veterans living in an urban compared with rural regions and are in line with our predictions and previous research.24 Contrary to our predictions, presence of elevated mental health symptoms, present in 46% of participants, were not related to preference for any modalities. With a larger sample or more detailed mental health information, such as treatment histories, an association with preferences may have emerged.
Qualitative findings further uncovered factors underlying these preferences. Mobile apps were valued for their convenience, portability, and multimedia intervention delivery. Internet interventions were valued for multimedia delivery and for the ability to view these interventions on a larger computer screen compared with a smartphone screen. Although our findings demonstrate that past experience, knowledge, access, and portability underlie older veterans’ preferences for self-management intervention delivery modalities, high willingness to try all the modalities suggests their openness to different self-management options. A question that remains is whether matching with older veterans’ intervention delivery preferences would lead to better outcomes. It is possible that considering patient preferences and characteristics (e.g., technology proficiency) when recommending mental health self-management interventions may lead to greater acceptance of these interventions and improved outcomes through providing person-centered care.
Our findings highlight the varied roles that a provider may play in supporting mental health in older veterans. Many participants showed a preference for traditional counseling, if available. Yet, the qualitative findings suggested that they wanted providers to provide personalized recommendations about the different self-management tools, such as brief readings or books, videos, websites, and mobile apps. Furthermore, one third were interested in exploring and using a self-management tool as a first step to treatment, which aligns with others’ findings that a common reason for not seeking mental health treatment is the desire to work out problems on one’s own.48
Older adults are often novice technology users and may need personalized support and teaching to improve their technology proficiency. The participants’ desire for human support when using self-management technology interventions affords an opportunity to implement new models of mental health care that integrate basic teaching about technology and ongoing human support around the implementation of these interventions. Extant models of support, such as the efficiency model of support,18 address the importance of adherence, but do not consider the need to teach technology-use basics or to provide ongoing support for novice users. New models should consider direct instruction about technology, use of assistive devices (e.g., stylus pens, screen magnifier, accessibility features), and sharing tailored informational handouts targeted at improving knowledge of technology basics.
Several limitations to this study should be acknowledged. First, the study did not collect information on participants’ mental health treatment history, socioeconomic status, or income, which all could influence preferences for delivery modalities. Second, the study may not have been sufficiently powered to examine all the quantitative factors underlying preferences. Third, the study did not directly examine the impact of these interventions on mental health symptoms or address whether older veterans derive similar benefits from technology-delivered interventions compared with younger veterans. Fourth, many of the individuals in the study resided in proximity to a technology hub and had higher years of education, but similar levels of multimorbidity to older veterans in other studies.5
Study strengths included the use of telephone interviews to reach veterans in remote areas, employment of qualitative analysis to understand factors underlying preferences, and the measurement of mental health symptoms and medical comorbidity. This study provides key information about veterans’ preferences through the use of qualitative interviewing methods to ensure that the veterans understood the different modalities prior to inviting them to select their preference among multiple options. This person-centered approach provides nuanced information about preferences that would not otherwise have been obtained in a survey alone.
Our findings suggest that providers play a critical role in recommending credible self-management options for older veterans in addition to providing traditional psychotherapy interventions. Recommendations should include multiple self-management delivery options to meet older veterans’ preferences. With over fifty percent interested in Internet or mobile apps, it is important that providers offer existing digital mental health interventions to older veterans; however, special consideration is needed for rural individuals who may not be as interested in mobile apps. Recommending these interventions may necessitate technology training for providers or health coaches, new models of behavioral health delivery, and making instructional support for technology available within health care systems.
Supplementary Material
Key-points.
This study investigated older military veterans’ ownership of devices and modality preferences for technology-delivered mental health self-management interventions.
Older veterans reported high rates of technology ownership. Thirty-five percent preferred printed materials for self-management, whereas the remaining majority preferred some form of technology for accessing a mental health self-management intervention.
Qualitative findings suggest that technology training, and particularly provider support may facilitate the use of self-management interventions.
Acknowledgements:
The authors wish to thank Sujatha Kalle, MBBS, for assistance with comorbidity ratings. This work was supported by a Career Development Award (IK2 RX001478; PI: Gould) from the United States (U.S.) Department of Veterans Affairs Rehabilitation Research and Development Service. Views expressed in this article are those of the authors and not necessarily those of the Department of Veterans Affairs or the Federal Government.
Aimee Marie Zapata is now at Kaiser Permanente, Department of Psychiatry, San Jose, CA. Julia Loup is now at University of Alabama, Tuscaloosa, Department of Psychology.
Conflicts of Interest Summary:
Dr. Gould reports grants from Department of Veterans Affairs, Rehabilitation Research and Development Service, during the conduct of the study. Ms. Loup, Ms. Ma, and Drs. Kuhn, Beaudreau, Goldstein, Wetherell, Zapata, Choe, and O’Hara have nothing to disclose.
Footnotes
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
- 1.National Center for Veterans Statistics. Veteran Population 2016 [Internet]. 2018. [cited 2019 Mar 20];Available from: https://www.va.gov/vetdata/veteran_population.asp
- 2.Williamson V, Stevelink SA, Greenberg K, Greenberg N. Prevalence of mental health disorders in elderly US military veterans: a Meta-analysis and systematic review. Am J Geriatr Psychiatry 2018;26(5):534–45. [DOI] [PubMed] [Google Scholar]
- 3.DiNapoli EA, Cully JA, Wayde E, Sansgiry S, Yu HJ, Kunik ME. Age as a predictive factor of mental health service use among adults with depression and/or anxiety disorder receiving care through the Veterans Health Administration. Int J Geriatr Psychiatry 2016;31(6):575–82. [DOI] [PubMed] [Google Scholar]
- 4.Lindley S, Cacciapaglia H, Noronha D, Carlson E, Schatzberg A. Monitoring mental health treatment acceptance and initial treatment adherence in veterans. Ann N Y Acad Sci 2010;1208(1):104–13. [DOI] [PubMed] [Google Scholar]
- 5.DiNapoli EA, Cinna C, Whiteman KL, Fox L, Appelt CJ, Kasckow J. Mental health treatment preferences and challenges of living with multimorbidity from the veteran perspective. Int J Geriatr Psychiatry 2016;31(10):1097–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Robb C, Haley WE, Becker MA, Polivka LA, Chwa H-J. Attitudes towards mental health care in younger and older adults: Similarities and differences. Aging Ment Health 2003;7(2):142–52. [DOI] [PubMed] [Google Scholar]
- 7.Calleo J, Stanley MA, Greisinger A, et al. Generalized anxiety disorder in older medical patients: diagnostic recognition, mental health management and service utilization. J Clin Psychol Med Settings 2009;16(2):178–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Institute of Medicine. The mental health and substance use workforce for older adults: In whose hands? Washington, DC: National Academies Press; 2012. [PubMed] [Google Scholar]
- 9.Lenze EJ. Solving the Geriatric Mental Health Crisis in the 21st Century. JAMA Psychiatry 2015;72(10):967–8. [DOI] [PubMed] [Google Scholar]
- 10.Lorig KR, Holman HR. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med 2003;26(1):1–7. [DOI] [PubMed] [Google Scholar]
- 11.Scogin F, Jamison C, Gochneaur K. Comparative efficacy of cognitive and behavioral bibliotherapy for mildly and moderately depressed older adults. J Consult Clin Psychol 1989;57(3):403. [DOI] [PubMed] [Google Scholar]
- 12.McKendree-Smith NL, Floyd M, Scogin FR. Self-administered treatments for depression: A review. J Clin Psychol 2003;59(3):275–88. [DOI] [PubMed] [Google Scholar]
- 13.Gould CE, Kok BC, Ma VK, Wetherell JL, Sudheimer K, Beaudreau SA. Video-Delivered Relaxation Intervention Reduces Late-Life Anxiety: A Pilot Randomized Controlled Trial. Am J Geriatr Psychiatry 2019;27(5):514–25. [DOI] [PubMed] [Google Scholar]
- 14.Munoz RF. Using evidence-based internet interventions to reduce health disparities worldwide. J Med Internet Res 2010;12(5):e60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ebert DD, Cuijpers P, Muñoz RF, Baumeister H. Prevention of mental health disorders using internet-and mobile-based interventions: a narrative review and recommendations for future research. Front Psychiatry 2017;8:116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Crabb RM, Cavanagh K, Proudfoot J, Learmonth D, Rafie S, Weingardt KR. Is computerized cognitive-behavioural therapy a treatment option for depression in late-life? A systematic review. Br J Clin Psychol 2012;51(4):459–64. [DOI] [PubMed] [Google Scholar]
- 17.Kuerbis A, Mulliken A, Muench F, Moore AA, Gardner D. Older adults and mobile technology: Factors that enhance and inhibit utilization in the context of behavioral health. 2017; [Google Scholar]
- 18.Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clin Psychol Sci Pract 2017;24(1):27–45. [Google Scholar]
- 19.Chumbler NR, Haggstrom D, Saleem JJ. Implementation of health information technology in Veterans Health Administration to support transformational change: telehealth and personal health records. Med Care 2011;49:S36–42. [DOI] [PubMed] [Google Scholar]
- 20.Owen JE, Kuhn E, Jaworski BK, et al. VA mobile apps for PTSD and related problems: public health resources for veterans and those who care for them. Mhealth 2018;4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Gould CE, Kok BC, Ma VK, Zapata AML, Owen JE, Kuhn E. Veterans Affairs and the Department of Defense mental health apps: A systematic literature review. Psychol Serv 2018; [DOI] [PubMed] [Google Scholar]
- 22.Erbes CR, Stinson R, Kuhn E, et al. Access, utilization, and interest in mHealth applications among veterans receiving outpatient care for PTSD. Mil Med 2014;179(11):1218–22. [DOI] [PubMed] [Google Scholar]
- 23.Miller CJ, McInnes DK, Stolzmann K, Bauer MS. Interest in use of technology for healthcare among veterans receiving treatment for mental health. Telemed E-Health 2016;22(10):847–54. [DOI] [PubMed] [Google Scholar]
- 24.Connolly SL, Miller CJ, Koenig CJ, et al. Veterans’ Attitudes Toward Smartphone App Use for Mental Health Care: Qualitative Study of Rurality and Age Differences. JMIR MHealth UHealth 2018;6(8). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Luger TM, Hogan TP, Richardson LM, Cioffari-Bailiff L, Harvey K, Houston TK. Older veteran digital disparities: examining the potential for solutions within social networks. J Med Internet Res 2016;18(11). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Darkins A, Ryan P, Kobb R, et al. Home telehealth, and disease management to support the care of veteran patients with chronic conditions. Telemed eHealth 2008;14(10):1118–26. [DOI] [PubMed] [Google Scholar]
- 27.Zapata AML, Beaudreau SA, O’Hara R, et al. Information-Seeking about Anxiety and Perceptions about Technology to Teach Coping Skills in Older Veterans. Clin Gerontol 2018;41(4):346–56. [DOI] [PubMed] [Google Scholar]
- 28.Katzman R, Brown T, Fuld P, Peck A, Schechter R, Schimmel H. Validation of a short Orientation-Memory-Concentration Test of cognitive impairment. Am J Psychiatry 1983;140(6):734–9. [DOI] [PubMed] [Google Scholar]
- 29.Meiran N, Stuss DT, Guzman DA, Lafleche G, Willmer J. Diagnosis of dementia: Methods for interpretation of scores of 5 neuropsychological tests. Arch Neurol 1996;53(10):1043–54. [DOI] [PubMed] [Google Scholar]
- 30.Pew Research Center. Tech Adoption Climbs Among Older Adults [Internet]. 2017. [cited 2019 Jan 6];Available from: http://www.pewinternet.org/2017/05/17/tech-adoption-climbs-among-older-adults/
- 31.Boot WR, Charness N, Czaja SJ, et al. Computer proficiency questionnaire: assessing low and high computer proficient seniors. The Gerontologist 2013;55(3):404–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Miller MD, Paradis CF, Houck PR, et al. Rating chronic medical illness burden in geropsychiatric practice and research: application of the Cumulative Illness Rating Scale. Psychiatry Res 1992;41(3):237–48. [DOI] [PubMed] [Google Scholar]
- 33.Hudon C, Fortin M, Vanasse A. Cumulative Illness Rating Scale was a reliable and valid index in a family practice context. J Clin Epidemiol 2005;58(6):603–8. [DOI] [PubMed] [Google Scholar]
- 34.Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009;114(1–3):163–73. [DOI] [PubMed] [Google Scholar]
- 35.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16(9):606–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Segal DL, June A, Payne M, Coolidge FL, Yochim B. Development and initial validation of a self-report assessment tool for anxiety among older adults: the Geriatric Anxiety Scale. J Anxiety Disord 2010;24(7):709–14. [DOI] [PubMed] [Google Scholar]
- 37.Gould CE, Segal DL, Yochim BP, Pachana NA, Byrne GJ, Beaudreau SA. Measuring anxiety in late life: a psychometric examination of the geriatric anxiety inventory and geriatric anxiety scale. J Anxiety Disord 2014;28(8):804–11. [DOI] [PubMed] [Google Scholar]
- 38.Weathers FW, Bovin MJ, Lee DJ, et al. The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5): Development and initial psychometric evaluation in military veterans. Psychol Assess 2018;30(3):383–95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Bovin MJ, Marx BP, Weathers FW, et al. Psychometric properties of the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition (PCL-5) in veterans. Psychol Assess 2016;28(11):1379–91. [DOI] [PubMed] [Google Scholar]
- 40.Rural Health Research Center. RUCA Data [Internet]. [cited 2019 Mar 15];Available from: http://depts.washington.edu/uwruca/ruca-data.php
- 41.Rural Health Research Center. Using RUCA Data [Internet]. [cited 2019 Mar 15];Available from: http://depts.washington.edu/uwruca/ruca-uses.php
- 42.Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods 2006;18(1):59–82. [Google Scholar]
- 43.Hennink MM, Kaiser BN, Marconi VC. Code saturation versus meaning saturation: how many interviews are enough? Qual Health Res 2017;27(4):591–608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.IBM Corp. IBM SPSS Statistics for Windows. Armok, NY: IBM Corp; 2016. [Google Scholar]
- 45.Dedoose [Internet]. Los Angeles, CA: SocioCultural Research Consultants; 2018. Available from: https://www.dedoose.com/ [Google Scholar]
- 46.Fisk AD, Rogers WA, Charness N, Czaja SJ, Sharit J. Designing for Older Adults: Principles and Creative Human Factors Approaches, 2009. Washington, DC: CRC Press; 2009. [Google Scholar]
- 47.Rogers WA, Fisk AD. Toward a psychological science of advanced technology design for older adults. J Gerontol B Psychol Sci Soc Sci 2010;65(6):645–53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Mojtabai R, Olfson M, Sampson NA, et al. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med 2011;41(8):1751–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
